Nov 08 12:04:40 user nova-compute[74840]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74840) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74840) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74840) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 08 12:04:40 user nova-compute[74840]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:04:40 user nova-compute[74840]: INFO nova.virt.driver [None req-7c03c03b-9376-40ec-a613-03019933148c None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 08 12:04:40 user nova-compute[74840]: INFO nova.compute.provider_config [None req-7c03c03b-9376-40ec-a613-03019933148c None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-7c03c03b-9376-40ec-a613-03019933148c None None] Acquiring lock "singleton_lock" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-7c03c03b-9376-40ec-a613-03019933148c None None] Acquired lock "singleton_lock" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-7c03c03b-9376-40ec-a613-03019933148c None None] Releasing lock "singleton_lock" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] Full set of CONF: {{(pid=74840) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] ******************************************************************************** {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] Configuration options gathered from: {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] ================================================================================ {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] allow_resize_to_same_host      = True {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] arq_binding_timeout            = 300 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] backdoor_port                  = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] backdoor_socket                = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] block_device_allocate_retries  = 300 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] block_device_allocate_retries_interval = 5 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cert                           = self.pem {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] compute_monitors               = [] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] config_dir                     = [] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] config_drive_format            = iso9660 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] config_source                  = [] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] console_host                   = user {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] control_exchange               = nova {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cpu_allocation_ratio           = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] daemon                         = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] debug                          = True {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] default_access_ip_network_name = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] default_availability_zone      = nova {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] default_ephemeral_format       = ext4 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] default_green_pool_size        = 1000 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] default_schedule_zone          = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] disk_allocation_ratio          = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] enable_new_services            = True {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] enabled_apis                   = ['osapi_compute'] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] enabled_ssl_apis               = [] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] flat_injected                  = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] force_config_drive             = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] force_raw_images               = True {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] graceful_shutdown_timeout      = 5 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] heal_instance_info_cache_interval = 60 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] host                           = user {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] instance_build_timeout         = 0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] instance_delete_interval       = 300 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] instance_format                = [instance: %(uuid)s]  {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] instance_name_template         = instance-%08x {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] instance_usage_audit           = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] instance_usage_audit_period    = month {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] internal_service_availability_zone = internal {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] key                            = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] live_migration_retry_count     = 30 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] log_config_append              = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] log_dir                        = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] log_file                       = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] log_options                    = True {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:40 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] log_rotate_interval            = 1 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] log_rotate_interval_type       = days {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] log_rotation_type              = none {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] long_rpc_timeout               = 1800 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] max_concurrent_builds          = 10 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] max_concurrent_live_migrations = 1 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] max_concurrent_snapshots       = 5 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] max_local_block_devices        = 3 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] max_logfile_count              = 30 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] max_logfile_size_mb            = 200 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] maximum_instance_delete_attempts = 5 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] metadata_listen                = 0.0.0.0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] metadata_listen_port           = 8775 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] metadata_workers               = 3 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] migrate_max_retries            = -1 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] mkisofs_cmd                    = genisoimage {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] my_ip                          = 10.0.0.210 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] network_allocate_retries       = 0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] osapi_compute_listen_port      = 8774 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] osapi_compute_unique_server_name_scope =  {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] osapi_compute_workers          = 3 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] password_length                = 12 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] periodic_enable                = True {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] periodic_fuzzy_delay           = 60 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] pointer_model                  = ps2mouse {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] preallocate_images             = none {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] publish_errors                 = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] pybasedir                      = /opt/stack/nova {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] ram_allocation_ratio           = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] rate_limit_burst               = 0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] rate_limit_except_level        = CRITICAL {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] rate_limit_interval            = 0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] reboot_timeout                 = 0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] reclaim_instance_interval      = 0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] record                         = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] reimage_timeout_per_gb         = 60 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] report_interval                = 120 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] rescue_timeout                 = 0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] reserved_host_cpus             = 0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] reserved_host_disk_mb          = 0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] reserved_host_memory_mb        = 512 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] reserved_huge_pages            = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] resize_confirm_window          = 0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] resize_fs_using_block_device   = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] resume_guests_state_on_host_boot = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] rpc_response_timeout           = 60 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] run_external_periodic_tasks    = True {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] running_deleted_instance_action = reap {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] running_deleted_instance_poll_interval = 1800 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] running_deleted_instance_timeout = 0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] scheduler_instance_sync_interval = 120 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] service_down_time              = 720 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] servicegroup_driver            = db {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] shelved_offload_time           = 0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] shelved_poll_interval          = 3600 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] shutdown_timeout               = 0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] source_is_ipv6                 = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] ssl_only                       = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] state_path                     = /opt/stack/data/nova {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] sync_power_state_interval      = 600 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] sync_power_state_pool_size     = 1000 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] syslog_log_facility            = LOG_USER {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] tempdir                        = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] timeout_nbd                    = 10 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] transport_url                  = **** {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] update_resources_interval      = 0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] use_cow_images                 = True {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] use_eventlog                   = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] use_journal                    = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] use_json                       = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] use_rootwrap_daemon            = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] use_stderr                     = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] use_syslog                     = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vcpu_pin_set                   = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vif_plugging_is_fatal          = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vif_plugging_timeout           = 0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] virt_mkfs                      = [] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] volume_usage_poll_interval     = 0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] watch_log_file                 = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] web                            = /usr/share/spice-html5 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_concurrency.disable_process_locking = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] api.auth_strategy              = keystone {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] api.compute_link_prefix        = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] api.dhcp_domain                = novalocal {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] api.enable_instance_password   = True {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] api.glance_link_prefix         = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] api.instance_list_per_project_cells = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] api.list_records_by_skipping_down_cells = True {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] api.local_metadata_per_cell    = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] api.max_limit                  = 1000 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] api.metadata_cache_expiration  = 15 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] api.neutron_default_tenant_id  = default {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] api.use_forwarded_for          = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] api.use_neutron_default_nets   = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] api.vendordata_dynamic_targets = [] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] api.vendordata_jsonfile_path   = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cache.backend                  = dogpile.cache.memcached {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cache.backend_argument         = **** {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cache.config_prefix            = cache.oslo {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cache.dead_timeout             = 60.0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cache.debug_cache_backend      = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cache.enable_retry_client      = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cache.enable_socket_keepalive  = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cache.enabled                  = True {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cache.expiration_time          = 600 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cache.hashclient_retry_attempts = 2 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cache.memcache_dead_retry      = 300 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cache.memcache_password        =  {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cache.memcache_pool_maxsize    = 10 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cache.memcache_sasl_enabled    = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cache.memcache_username        =  {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cache.proxies                  = [] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cache.retry_attempts           = 2 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cache.retry_delay              = 0.0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cache.socket_keepalive_count   = 1 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cache.socket_keepalive_idle    = 1 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cache.socket_keepalive_interval = 1 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cache.tls_allowed_ciphers      = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cache.tls_cafile               = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cache.tls_certfile             = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cache.tls_enabled              = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cache.tls_keyfile              = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cinder.auth_section            = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cinder.auth_type               = password {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cinder.cafile                  = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cinder.certfile                = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cinder.collect_timing          = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cinder.cross_az_attach         = True {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cinder.debug                   = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cinder.endpoint_template       = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cinder.http_retries            = 3 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cinder.insecure                = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cinder.keyfile                 = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cinder.os_region_name          = RegionOne {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cinder.split_loggers           = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cinder.timeout                 = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] compute.cpu_dedicated_set      = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] compute.cpu_shared_set         = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] compute.image_type_exclude_list = [] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] compute.max_concurrent_disk_ops = 0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] compute.max_disk_devices_to_attach = -1 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] compute.resource_provider_association_refresh = 300 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] compute.shutdown_retry_interval = 10 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] conductor.workers              = 3 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] console.allowed_origins        = [] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] console.ssl_ciphers            = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] console.ssl_minimum_version    = default {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] consoleauth.token_ttl          = 600 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cyborg.cafile                  = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cyborg.certfile                = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cyborg.collect_timing          = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cyborg.connect_retries         = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cyborg.connect_retry_delay     = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cyborg.endpoint_override       = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cyborg.insecure                = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cyborg.keyfile                 = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cyborg.max_version             = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cyborg.min_version             = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cyborg.region_name             = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cyborg.service_name            = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cyborg.service_type            = accelerator {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cyborg.split_loggers           = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cyborg.status_code_retries     = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cyborg.status_code_retry_delay = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cyborg.timeout                 = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] cyborg.version                 = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] database.backend               = sqlalchemy {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] database.connection            = **** {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] database.connection_debug      = 0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] database.connection_parameters =  {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] database.connection_recycle_time = 3600 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] database.connection_trace      = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] database.db_inc_retry_interval = True {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] database.db_max_retries        = 20 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] database.db_max_retry_interval = 10 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] database.db_retry_interval     = 1 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] database.max_overflow          = 50 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] database.max_pool_size         = 5 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] database.max_retries           = 10 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] database.mysql_wsrep_sync_wait = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] database.pool_timeout          = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] database.retry_interval        = 10 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] database.slave_connection      = **** {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] database.sqlite_synchronous    = True {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] api_database.backend           = sqlalchemy {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] api_database.connection        = **** {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] api_database.connection_debug  = 0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] api_database.connection_parameters =  {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] api_database.connection_recycle_time = 3600 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] api_database.connection_trace  = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] api_database.db_inc_retry_interval = True {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] api_database.db_max_retries    = 20 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] api_database.db_max_retry_interval = 10 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] api_database.db_retry_interval = 1 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] api_database.max_overflow      = 50 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] api_database.max_pool_size     = 5 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] api_database.max_retries       = 10 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] api_database.pool_timeout      = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] api_database.retry_interval    = 10 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] api_database.slave_connection  = **** {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] api_database.sqlite_synchronous = True {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] devices.enabled_mdev_types     = [] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] ephemeral_storage_encryption.enabled = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] glance.api_servers             = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] glance.cafile                  = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] glance.certfile                = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] glance.collect_timing          = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] glance.connect_retries         = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] glance.connect_retry_delay     = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] glance.debug                   = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] glance.default_trusted_certificate_ids = [] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] glance.enable_certificate_validation = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] glance.enable_rbd_download     = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] glance.endpoint_override       = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] glance.insecure                = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] glance.keyfile                 = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] glance.max_version             = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] glance.min_version             = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] glance.num_retries             = 3 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] glance.rbd_ceph_conf           =  {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] glance.rbd_connect_timeout     = 5 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] glance.rbd_pool                =  {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] glance.rbd_user                =  {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] glance.region_name             = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] glance.service_name            = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] glance.service_type            = image {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] glance.split_loggers           = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] glance.status_code_retries     = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] glance.status_code_retry_delay = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] glance.timeout                 = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] glance.verify_glance_signatures = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] glance.version                 = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] guestfs.debug                  = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] hyperv.config_drive_cdrom      = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] hyperv.config_drive_inject_password = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] hyperv.enable_instance_metrics_collection = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] hyperv.enable_remotefx         = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] hyperv.instances_path_share    =  {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] hyperv.iscsi_initiator_list    = [] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] hyperv.limit_cpu_features      = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] hyperv.power_state_check_timeframe = 60 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] hyperv.use_multipath_io        = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] hyperv.volume_attach_retry_count = 10 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] hyperv.vswitch_name            = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] mks.enabled                    = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] image_cache.manager_interval   = 2400 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] image_cache.precache_concurrency = 1 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] image_cache.remove_unused_base_images = True {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] image_cache.subdirectory_name  = _base {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] ironic.api_max_retries         = 60 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] ironic.api_retry_interval      = 2 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] ironic.auth_section            = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] ironic.auth_type               = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] ironic.cafile                  = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] ironic.certfile                = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] ironic.collect_timing          = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] ironic.conductor_group         = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] ironic.connect_retries         = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] ironic.connect_retry_delay     = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] ironic.endpoint_override       = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] ironic.insecure                = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] ironic.keyfile                 = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] ironic.max_version             = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] ironic.min_version             = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] ironic.peer_list               = [] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] ironic.region_name             = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] ironic.serial_console_state_timeout = 10 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] ironic.service_name            = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] ironic.service_type            = baremetal {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] ironic.split_loggers           = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] ironic.status_code_retries     = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] ironic.status_code_retry_delay = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] ironic.timeout                 = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] ironic.version                 = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] key_manager.fixed_key          = **** {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] barbican.barbican_api_version  = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] barbican.barbican_endpoint     = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] barbican.barbican_endpoint_type = public {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] barbican.barbican_region_name  = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] barbican.cafile                = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] barbican.certfile              = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] barbican.collect_timing        = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] barbican.insecure              = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] barbican.keyfile               = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] barbican.number_of_retries     = 60 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] barbican.retry_delay           = 1 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] barbican.send_service_user_token = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] barbican.split_loggers         = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] barbican.timeout               = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] barbican.verify_ssl            = True {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] barbican.verify_ssl_path       = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] barbican_service_user.auth_section = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] barbican_service_user.auth_type = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] barbican_service_user.cafile   = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] barbican_service_user.certfile = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] barbican_service_user.collect_timing = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] barbican_service_user.insecure = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] barbican_service_user.keyfile  = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] barbican_service_user.split_loggers = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] barbican_service_user.timeout  = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vault.approle_role_id          = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vault.approle_secret_id        = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vault.cafile                   = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vault.certfile                 = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vault.collect_timing           = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vault.insecure                 = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vault.keyfile                  = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vault.kv_mountpoint            = secret {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vault.kv_path                  = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vault.kv_version               = 2 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vault.namespace                = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vault.root_token_id            = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vault.split_loggers            = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vault.ssl_ca_crt_file          = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vault.timeout                  = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vault.use_ssl                  = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] keystone.auth_section          = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] keystone.auth_type             = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] keystone.cafile                = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] keystone.certfile              = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] keystone.collect_timing        = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] keystone.connect_retries       = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] keystone.connect_retry_delay   = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] keystone.endpoint_override     = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] keystone.insecure              = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] keystone.keyfile               = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] keystone.max_version           = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] keystone.min_version           = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] keystone.region_name           = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] keystone.service_name          = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] keystone.service_type          = identity {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] keystone.split_loggers         = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] keystone.status_code_retries   = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] keystone.status_code_retry_delay = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] keystone.timeout               = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] keystone.version               = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.connection_uri         =  {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.cpu_mode               = custom {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: WARNING oslo_config.cfg [None req-7c03c03b-9376-40ec-a613-03019933148c None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.cpu_power_governor_high = performance {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.cpu_power_governor_low = powersave {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.cpu_power_management   = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.device_detach_attempts = 8 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.device_detach_timeout  = 20 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.disk_cachemodes        = [] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.disk_prefix            = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.enabled_perf_events    = [] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.file_backed_memory     = 0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.gid_maps               = [] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.hw_disk_discard        = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.hw_machine_type        = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.images_rbd_glance_store_name =  {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.images_rbd_pool        = rbd {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.images_type            = default {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.images_volume_group    = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.inject_key             = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.inject_partition       = -2 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.inject_password        = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.iscsi_iface            = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.iser_use_multipath     = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.live_migration_bandwidth = 0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.live_migration_downtime = 500 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.live_migration_inbound_addr = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.live_migration_permit_post_copy = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.live_migration_scheme  = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.live_migration_timeout_action = abort {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.live_migration_tunnelled = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: WARNING oslo_config.cfg [None req-7c03c03b-9376-40ec-a613-03019933148c None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 08 12:04:41 user nova-compute[74840]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 08 12:04:41 user nova-compute[74840]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 08 12:04:41 user nova-compute[74840]: and ``live_migration_inbound_addr`` respectively.
Nov 08 12:04:41 user nova-compute[74840]: ).  Its value may be silently ignored in the future.
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.live_migration_with_native_tls = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.max_queues             = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.nfs_mount_options      = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.num_memory_encrypted_guests = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.num_pcie_ports         = 0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.pmem_namespaces        = [] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.quobyte_client_cfg     = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.rbd_secret_uuid        = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.rbd_user               = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.remote_filesystem_transport = ssh {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.rescue_image_id        = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.rescue_kernel_id       = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.rescue_ramdisk_id      = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.rx_queue_size          = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.smbfs_mount_options    =  {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.snapshot_compression   = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.snapshot_image_format  = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.sparse_logical_volumes = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.swtpm_enabled          = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.swtpm_group            = tss {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.swtpm_user             = tss {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.sysinfo_serial         = unique {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.tb_cache_size          = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.tx_queue_size          = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.uid_maps               = [] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.use_virtio_for_bridges = True {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.virt_type              = kvm {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.volume_clear           = zero {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.volume_clear_size      = 0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.volume_use_multipath   = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.vzstorage_cache_path   = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.vzstorage_mount_user   = stack {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] neutron.auth_section           = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] neutron.auth_type              = password {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] neutron.cafile                 = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] neutron.certfile               = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] neutron.collect_timing         = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] neutron.connect_retries        = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] neutron.connect_retry_delay    = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] neutron.default_floating_pool  = public {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] neutron.endpoint_override      = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] neutron.extension_sync_interval = 600 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] neutron.http_retries           = 3 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] neutron.insecure               = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] neutron.keyfile                = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] neutron.max_version            = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] neutron.min_version            = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] neutron.ovs_bridge             = br-int {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] neutron.physnets               = [] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] neutron.region_name            = RegionOne {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] neutron.service_metadata_proxy = True {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] neutron.service_name           = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] neutron.service_type           = network {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] neutron.split_loggers          = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] neutron.status_code_retries    = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] neutron.status_code_retry_delay = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] neutron.timeout                = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] neutron.version                = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] notifications.bdms_in_notifications = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] notifications.default_level    = INFO {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] notifications.notification_format = unversioned {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] notifications.notify_on_state_change = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] pci.alias                      = [] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] pci.device_spec                = [] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] pci.report_in_placement        = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] placement.auth_section         = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] placement.auth_type            = password {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] placement.cafile               = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] placement.certfile             = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] placement.collect_timing       = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] placement.connect_retries      = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] placement.connect_retry_delay  = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] placement.default_domain_id    = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] placement.default_domain_name  = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] placement.domain_id            = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] placement.domain_name          = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] placement.endpoint_override    = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] placement.insecure             = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] placement.keyfile              = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] placement.max_version          = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] placement.min_version          = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] placement.password             = **** {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] placement.project_domain_id    = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] placement.project_domain_name  = Default {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] placement.project_id           = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] placement.project_name         = service {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] placement.region_name          = RegionOne {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] placement.service_name         = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] placement.service_type         = placement {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] placement.split_loggers        = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] placement.status_code_retries  = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] placement.status_code_retry_delay = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] placement.system_scope         = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] placement.timeout              = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] placement.trust_id             = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] placement.user_domain_id       = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] placement.user_domain_name     = Default {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] placement.user_id              = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] placement.username             = placement {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] placement.version              = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] quota.cores                    = 20 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] quota.count_usage_from_placement = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] quota.injected_file_content_bytes = 10240 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] quota.injected_file_path_length = 255 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] quota.injected_files           = 5 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] quota.instances                = 10 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] quota.key_pairs                = 100 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] quota.metadata_items           = 128 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] quota.ram                      = 51200 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] quota.recheck_quota            = True {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] quota.server_group_members     = 10 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] quota.server_groups            = 10 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] rdp.enabled                    = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] scheduler.image_metadata_prefilter = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] scheduler.max_attempts         = 3 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] scheduler.max_placement_results = 1000 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] scheduler.query_placement_for_image_type_support = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] scheduler.workers              = 3 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] filter_scheduler.host_subset_size = 1 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] filter_scheduler.isolated_hosts = [] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] filter_scheduler.isolated_images = [] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] filter_scheduler.pci_in_placement = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] filter_scheduler.track_instance_changes = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] metrics.required               = True {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] metrics.weight_multiplier      = 1.0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] metrics.weight_setting         = [] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] serial_console.enabled         = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] serial_console.port_range      = 10000:20000 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] serial_console.serialproxy_port = 6083 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] service_user.auth_section      = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] service_user.auth_type         = password {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] service_user.cafile            = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] service_user.certfile          = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] service_user.collect_timing    = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] service_user.insecure          = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] service_user.keyfile           = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] service_user.send_service_user_token = True {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] service_user.split_loggers     = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] service_user.timeout           = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] spice.agent_enabled            = True {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] spice.enabled                  = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] spice.html5proxy_port          = 6082 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] spice.image_compression        = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] spice.jpeg_compression         = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] spice.playback_compression     = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] spice.server_listen            = 127.0.0.1 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] spice.streaming_mode           = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] spice.zlib_compression         = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] upgrade_levels.baseapi         = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] upgrade_levels.cert            = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] upgrade_levels.compute         = auto {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] upgrade_levels.conductor       = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] upgrade_levels.scheduler       = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vendordata_dynamic_auth.auth_section = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vendordata_dynamic_auth.auth_type = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vendordata_dynamic_auth.cafile = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vendordata_dynamic_auth.certfile = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vendordata_dynamic_auth.insecure = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vendordata_dynamic_auth.keyfile = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vendordata_dynamic_auth.timeout = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vmware.api_retry_count         = 10 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vmware.ca_file                 = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vmware.cache_prefix            = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vmware.cluster_name            = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vmware.connection_pool_size    = 10 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vmware.console_delay_seconds   = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vmware.datastore_regex         = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vmware.host_ip                 = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vmware.host_password           = **** {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vmware.host_port               = 443 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vmware.host_username           = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vmware.insecure                = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vmware.integration_bridge      = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vmware.maximum_objects         = 100 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vmware.pbm_default_policy      = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vmware.pbm_enabled             = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vmware.pbm_wsdl_location       = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vmware.serial_port_proxy_uri   = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vmware.serial_port_service_uri = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vmware.task_poll_interval      = 0.5 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vmware.use_linked_clone        = True {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vmware.vnc_keymap              = en-us {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vmware.vnc_port                = 5900 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vmware.vnc_port_total          = 10000 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vnc.auth_schemes               = ['none'] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vnc.enabled                    = True {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vnc.novncproxy_port            = 6080 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vnc.server_listen              = 0.0.0.0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vnc.vencrypt_ca_certs          = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vnc.vencrypt_client_cert       = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vnc.vencrypt_client_key        = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] workarounds.disable_rootwrap   = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] workarounds.enable_numa_live_migration = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] workarounds.libvirt_disable_apic = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] wsgi.client_socket_timeout     = 900 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] wsgi.default_pool_size         = 1000 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] wsgi.keep_alive                = True {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] wsgi.max_header_line           = 16384 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] wsgi.ssl_ca_file               = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] wsgi.ssl_cert_file             = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] wsgi.ssl_key_file              = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] wsgi.tcp_keepidle              = 600 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] zvm.ca_file                    = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] zvm.cloud_connector_url        = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] zvm.reachable_timeout          = 300 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_policy.enforce_new_defaults = True {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_policy.enforce_scope      = True {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_policy.policy_default_rule = default {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_policy.policy_file        = policy.yaml {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] profiler.connection_string     = messaging:// {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] profiler.enabled               = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] profiler.es_doc_type           = notification {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] profiler.es_scroll_size        = 10000 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] profiler.es_scroll_time        = 2m {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] profiler.filter_error_trace    = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] profiler.hmac_keys             = **** {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] profiler.sentinel_service_name = mymaster {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] profiler.socket_timeout        = 0.1 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] profiler.trace_requests        = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] profiler.trace_sqlalchemy      = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] profiler_jaeger.process_tags   = {} {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] profiler_jaeger.service_name_prefix = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] profiler_otlp.service_name_prefix = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] remote_debug.host              = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] remote_debug.port              = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_messaging_rabbit.ssl      = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_messaging_notifications.retry = -1 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_messaging_notifications.transport_url = **** {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_limit.auth_section        = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_limit.auth_type           = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_limit.cafile              = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_limit.certfile            = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_limit.collect_timing      = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_limit.connect_retries     = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_limit.connect_retry_delay = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_limit.endpoint_id         = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_limit.endpoint_override   = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_limit.insecure            = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_limit.keyfile             = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_limit.max_version         = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_limit.min_version         = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_limit.region_name         = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_limit.service_name        = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_limit.service_type        = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_limit.split_loggers       = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_limit.status_code_retries = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_limit.status_code_retry_delay = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_limit.timeout             = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_limit.valid_interfaces    = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_limit.version             = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_reports.file_event_handler = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] oslo_reports.log_dir           = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vif_plug_ovs_privileged.group  = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] vif_plug_ovs_privileged.user   = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] os_vif_linux_bridge.flat_interface = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] os_vif_ovs.isolate_vif         = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] os_vif_ovs.per_port_bridge     = False {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] os_brick.lock_path             = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] privsep_osbrick.capabilities   = [21] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] privsep_osbrick.group          = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] privsep_osbrick.helper_command = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] privsep_osbrick.user           = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] nova_sys_admin.group           = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] nova_sys_admin.helper_command  = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] nova_sys_admin.user            = None {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG oslo_service.service [None req-7c03c03b-9376-40ec-a613-03019933148c None None] ******************************************************************************** {{(pid=74840) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 08 12:04:41 user nova-compute[74840]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 08 12:04:41 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Connecting to libvirt: qemu:///system {{(pid=74840) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fa7f5143040> {{(pid=74840) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 08 12:04:41 user nova-compute[74840]: libvirt:  error : internal error: could not initialize domain event timer
Nov 08 12:04:41 user nova-compute[74840]: WARNING nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 08 12:04:41 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fa7f5143040> {{(pid=74840) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Starting native event thread {{(pid=74840) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Starting green dispatch thread {{(pid=74840) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 08 12:04:41 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Starting connection event dispatch thread {{(pid=74840) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 08 12:04:41 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Connection event '1' reason 'None'
Nov 08 12:04:41 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 08 12:04:41 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.mount [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Initialising _HostMountState generation 0 {{(pid=74840) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 08 12:04:48 user nova-compute[74840]: INFO nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Libvirt host capabilities <capabilities>
Nov 08 12:04:48 user nova-compute[74840]:   <host>
Nov 08 12:04:48 user nova-compute[74840]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 08 12:04:48 user nova-compute[74840]:     <cpu>
Nov 08 12:04:48 user nova-compute[74840]:       <arch>x86_64</arch>
Nov 08 12:04:48 user nova-compute[74840]:       <model>IvyBridge-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <vendor>Intel</vendor>
Nov 08 12:04:48 user nova-compute[74840]:       <microcode version='1070'/>
Nov 08 12:04:48 user nova-compute[74840]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 08 12:04:48 user nova-compute[74840]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature name='ss'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature name='vmx'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature name='pcid'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature name='osxsave'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature name='hypervisor'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature name='arat'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature name='tsc_adjust'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature name='md-clear'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature name='stibp'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature name='arch-capabilities'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature name='ssbd'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature name='invtsc'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature name='rsba'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature name='skip-l1dfl-vmentry'/>
Nov 08 12:04:48 user nova-compute[74840]:       <pages unit='KiB' size='4'/>
Nov 08 12:04:48 user nova-compute[74840]:       <pages unit='KiB' size='2048'/>
Nov 08 12:04:48 user nova-compute[74840]:     </cpu>
Nov 08 12:04:48 user nova-compute[74840]:     <power_management>
Nov 08 12:04:48 user nova-compute[74840]:       <suspend_mem/>
Nov 08 12:04:48 user nova-compute[74840]:       <suspend_disk/>
Nov 08 12:04:48 user nova-compute[74840]:       <suspend_hybrid/>
Nov 08 12:04:48 user nova-compute[74840]:     </power_management>
Nov 08 12:04:48 user nova-compute[74840]:     <iommu support='no'/>
Nov 08 12:04:48 user nova-compute[74840]:     <migration_features>
Nov 08 12:04:48 user nova-compute[74840]:       <live/>
Nov 08 12:04:48 user nova-compute[74840]:       <uri_transports>
Nov 08 12:04:48 user nova-compute[74840]:         <uri_transport>tcp</uri_transport>
Nov 08 12:04:48 user nova-compute[74840]:         <uri_transport>rdma</uri_transport>
Nov 08 12:04:48 user nova-compute[74840]:       </uri_transports>
Nov 08 12:04:48 user nova-compute[74840]:     </migration_features>
Nov 08 12:04:48 user nova-compute[74840]:     <topology>
Nov 08 12:04:48 user nova-compute[74840]:       <cells num='2'>
Nov 08 12:04:48 user nova-compute[74840]:         <cell id='0'>
Nov 08 12:04:48 user nova-compute[74840]:           <memory unit='KiB'>8189224</memory>
Nov 08 12:04:48 user nova-compute[74840]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 08 12:04:48 user nova-compute[74840]:           <pages unit='KiB' size='2048'>0</pages>
Nov 08 12:04:48 user nova-compute[74840]:           <distances>
Nov 08 12:04:48 user nova-compute[74840]:             <sibling id='0' value='10'/>
Nov 08 12:04:48 user nova-compute[74840]:             <sibling id='1' value='20'/>
Nov 08 12:04:48 user nova-compute[74840]:           </distances>
Nov 08 12:04:48 user nova-compute[74840]:           <cpus num='6'>
Nov 08 12:04:48 user nova-compute[74840]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 08 12:04:48 user nova-compute[74840]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 08 12:04:48 user nova-compute[74840]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 08 12:04:48 user nova-compute[74840]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 08 12:04:48 user nova-compute[74840]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 08 12:04:48 user nova-compute[74840]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 08 12:04:48 user nova-compute[74840]:           </cpus>
Nov 08 12:04:48 user nova-compute[74840]:         </cell>
Nov 08 12:04:48 user nova-compute[74840]:         <cell id='1'>
Nov 08 12:04:48 user nova-compute[74840]:           <memory unit='KiB'>8206460</memory>
Nov 08 12:04:48 user nova-compute[74840]:           <pages unit='KiB' size='4'>2051615</pages>
Nov 08 12:04:48 user nova-compute[74840]:           <pages unit='KiB' size='2048'>0</pages>
Nov 08 12:04:48 user nova-compute[74840]:           <distances>
Nov 08 12:04:48 user nova-compute[74840]:             <sibling id='0' value='20'/>
Nov 08 12:04:48 user nova-compute[74840]:             <sibling id='1' value='10'/>
Nov 08 12:04:48 user nova-compute[74840]:           </distances>
Nov 08 12:04:48 user nova-compute[74840]:           <cpus num='6'>
Nov 08 12:04:48 user nova-compute[74840]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 08 12:04:48 user nova-compute[74840]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 08 12:04:48 user nova-compute[74840]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 08 12:04:48 user nova-compute[74840]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 08 12:04:48 user nova-compute[74840]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 08 12:04:48 user nova-compute[74840]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 08 12:04:48 user nova-compute[74840]:           </cpus>
Nov 08 12:04:48 user nova-compute[74840]:         </cell>
Nov 08 12:04:48 user nova-compute[74840]:       </cells>
Nov 08 12:04:48 user nova-compute[74840]:     </topology>
Nov 08 12:04:48 user nova-compute[74840]:     <cache>
Nov 08 12:04:48 user nova-compute[74840]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 08 12:04:48 user nova-compute[74840]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 08 12:04:48 user nova-compute[74840]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 08 12:04:48 user nova-compute[74840]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 08 12:04:48 user nova-compute[74840]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 08 12:04:48 user nova-compute[74840]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 08 12:04:48 user nova-compute[74840]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 08 12:04:48 user nova-compute[74840]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 08 12:04:48 user nova-compute[74840]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 08 12:04:48 user nova-compute[74840]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 08 12:04:48 user nova-compute[74840]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 08 12:04:48 user nova-compute[74840]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 08 12:04:48 user nova-compute[74840]:     </cache>
Nov 08 12:04:48 user nova-compute[74840]:     <secmodel>
Nov 08 12:04:48 user nova-compute[74840]:       <model>apparmor</model>
Nov 08 12:04:48 user nova-compute[74840]:       <doi>0</doi>
Nov 08 12:04:48 user nova-compute[74840]:     </secmodel>
Nov 08 12:04:48 user nova-compute[74840]:     <secmodel>
Nov 08 12:04:48 user nova-compute[74840]:       <model>dac</model>
Nov 08 12:04:48 user nova-compute[74840]:       <doi>0</doi>
Nov 08 12:04:48 user nova-compute[74840]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 08 12:04:48 user nova-compute[74840]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 08 12:04:48 user nova-compute[74840]:     </secmodel>
Nov 08 12:04:48 user nova-compute[74840]:   </host>
Nov 08 12:04:48 user nova-compute[74840]:   <guest>
Nov 08 12:04:48 user nova-compute[74840]:     <os_type>hvm</os_type>
Nov 08 12:04:48 user nova-compute[74840]:     <arch name='alpha'>
Nov 08 12:04:48 user nova-compute[74840]:       <wordsize>64</wordsize>
Nov 08 12:04:48 user nova-compute[74840]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='4'>clipper</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <domain type='qemu'/>
Nov 08 12:04:48 user nova-compute[74840]:     </arch>
Nov 08 12:04:48 user nova-compute[74840]:     <features>
Nov 08 12:04:48 user nova-compute[74840]:       <cpuselection/>
Nov 08 12:04:48 user nova-compute[74840]:       <deviceboot/>
Nov 08 12:04:48 user nova-compute[74840]:       <disksnapshot default='on' toggle='no'/>
Nov 08 12:04:48 user nova-compute[74840]:     </features>
Nov 08 12:04:48 user nova-compute[74840]:   </guest>
Nov 08 12:04:48 user nova-compute[74840]:   <guest>
Nov 08 12:04:48 user nova-compute[74840]:     <os_type>hvm</os_type>
Nov 08 12:04:48 user nova-compute[74840]:     <arch name='armv6l'>
Nov 08 12:04:48 user nova-compute[74840]:       <wordsize>32</wordsize>
Nov 08 12:04:48 user nova-compute[74840]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>integratorcp</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>borzoi</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>spitz</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2'>nuri</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2'>musca-b1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>versatileab</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>kzm</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2'>musca-a</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2'>smdkc210</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>sx1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>z2</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>tosa</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='4'>sabrelite</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>realview-eb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>n810</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>n800</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>versatilepb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>terrier</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>mainstone</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='4'>midway</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>musicpal</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>microbit</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>cubieboard</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>verdex</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>netduino2</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='4'>raspi2b</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>cheetah</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='4'>highbank</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>akita</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>connex</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>collie</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>raspi0</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <domain type='qemu'/>
Nov 08 12:04:48 user nova-compute[74840]:     </arch>
Nov 08 12:04:48 user nova-compute[74840]:     <features>
Nov 08 12:04:48 user nova-compute[74840]:       <cpuselection/>
Nov 08 12:04:48 user nova-compute[74840]:       <deviceboot/>
Nov 08 12:04:48 user nova-compute[74840]:       <disksnapshot default='on' toggle='no'/>
Nov 08 12:04:48 user nova-compute[74840]:     </features>
Nov 08 12:04:48 user nova-compute[74840]:   </guest>
Nov 08 12:04:48 user nova-compute[74840]:   <guest>
Nov 08 12:04:48 user nova-compute[74840]:     <os_type>hvm</os_type>
Nov 08 12:04:48 user nova-compute[74840]:     <arch name='armv7l'>
Nov 08 12:04:48 user nova-compute[74840]:       <wordsize>32</wordsize>
Nov 08 12:04:48 user nova-compute[74840]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>integratorcp</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>borzoi</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>spitz</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2'>nuri</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2'>musca-b1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>versatileab</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>kzm</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2'>musca-a</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2'>smdkc210</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>sx1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>z2</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>tosa</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='4'>sabrelite</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>realview-eb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>n810</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>n800</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>versatilepb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>terrier</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>mainstone</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='4'>midway</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>musicpal</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>microbit</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>cubieboard</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>verdex</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>netduino2</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='4'>raspi2b</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>cheetah</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='4'>highbank</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>akita</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>connex</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>collie</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>raspi0</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <domain type='qemu'/>
Nov 08 12:04:48 user nova-compute[74840]:     </arch>
Nov 08 12:04:48 user nova-compute[74840]:     <features>
Nov 08 12:04:48 user nova-compute[74840]:       <cpuselection/>
Nov 08 12:04:48 user nova-compute[74840]:       <deviceboot/>
Nov 08 12:04:48 user nova-compute[74840]:       <disksnapshot default='on' toggle='no'/>
Nov 08 12:04:48 user nova-compute[74840]:     </features>
Nov 08 12:04:48 user nova-compute[74840]:   </guest>
Nov 08 12:04:48 user nova-compute[74840]:   <guest>
Nov 08 12:04:48 user nova-compute[74840]:     <os_type>hvm</os_type>
Nov 08 12:04:48 user nova-compute[74840]:     <arch name='aarch64'>
Nov 08 12:04:48 user nova-compute[74840]:       <wordsize>64</wordsize>
Nov 08 12:04:48 user nova-compute[74840]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>integratorcp</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>borzoi</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>spitz</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2'>nuri</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2'>musca-b1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>versatileab</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>kzm</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2'>musca-a</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2'>smdkc210</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>sx1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>z2</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>tosa</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='4'>sabrelite</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>realview-eb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>n810</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>n800</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>versatilepb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>terrier</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>mainstone</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='4'>midway</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>musicpal</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>microbit</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>cubieboard</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>verdex</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>netduino2</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='4'>raspi3b</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='4'>raspi2b</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>cheetah</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='4'>highbank</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>akita</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>connex</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>collie</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>raspi0</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <domain type='qemu'/>
Nov 08 12:04:48 user nova-compute[74840]:     </arch>
Nov 08 12:04:48 user nova-compute[74840]:     <features>
Nov 08 12:04:48 user nova-compute[74840]:       <acpi default='on' toggle='yes'/>
Nov 08 12:04:48 user nova-compute[74840]:       <cpuselection/>
Nov 08 12:04:48 user nova-compute[74840]:       <deviceboot/>
Nov 08 12:04:48 user nova-compute[74840]:       <disksnapshot default='on' toggle='no'/>
Nov 08 12:04:48 user nova-compute[74840]:     </features>
Nov 08 12:04:48 user nova-compute[74840]:   </guest>
Nov 08 12:04:48 user nova-compute[74840]:   <guest>
Nov 08 12:04:48 user nova-compute[74840]:     <os_type>hvm</os_type>
Nov 08 12:04:48 user nova-compute[74840]:     <arch name='cris'>
Nov 08 12:04:48 user nova-compute[74840]:       <wordsize>32</wordsize>
Nov 08 12:04:48 user nova-compute[74840]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <domain type='qemu'/>
Nov 08 12:04:48 user nova-compute[74840]:     </arch>
Nov 08 12:04:48 user nova-compute[74840]:     <features>
Nov 08 12:04:48 user nova-compute[74840]:       <cpuselection/>
Nov 08 12:04:48 user nova-compute[74840]:       <deviceboot/>
Nov 08 12:04:48 user nova-compute[74840]:       <disksnapshot default='on' toggle='no'/>
Nov 08 12:04:48 user nova-compute[74840]:     </features>
Nov 08 12:04:48 user nova-compute[74840]:   </guest>
Nov 08 12:04:48 user nova-compute[74840]:   <guest>
Nov 08 12:04:48 user nova-compute[74840]:     <os_type>hvm</os_type>
Nov 08 12:04:48 user nova-compute[74840]:     <arch name='i686'>
Nov 08 12:04:48 user nova-compute[74840]:       <wordsize>32</wordsize>
Nov 08 12:04:48 user nova-compute[74840]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>x-remote</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>isapc</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>microvm</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <domain type='qemu'/>
Nov 08 12:04:48 user nova-compute[74840]:       <domain type='kvm'/>
Nov 08 12:04:48 user nova-compute[74840]:     </arch>
Nov 08 12:04:48 user nova-compute[74840]:     <features>
Nov 08 12:04:48 user nova-compute[74840]:       <pae/>
Nov 08 12:04:48 user nova-compute[74840]:       <nonpae/>
Nov 08 12:04:48 user nova-compute[74840]:       <acpi default='on' toggle='yes'/>
Nov 08 12:04:48 user nova-compute[74840]:       <apic default='on' toggle='no'/>
Nov 08 12:04:48 user nova-compute[74840]:       <cpuselection/>
Nov 08 12:04:48 user nova-compute[74840]:       <deviceboot/>
Nov 08 12:04:48 user nova-compute[74840]:       <disksnapshot default='on' toggle='no'/>
Nov 08 12:04:48 user nova-compute[74840]:     </features>
Nov 08 12:04:48 user nova-compute[74840]:   </guest>
Nov 08 12:04:48 user nova-compute[74840]:   <guest>
Nov 08 12:04:48 user nova-compute[74840]:     <os_type>hvm</os_type>
Nov 08 12:04:48 user nova-compute[74840]:     <arch name='m68k'>
Nov 08 12:04:48 user nova-compute[74840]:       <wordsize>32</wordsize>
Nov 08 12:04:48 user nova-compute[74840]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>an5206</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>q800</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>next-cube</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <domain type='qemu'/>
Nov 08 12:04:48 user nova-compute[74840]:     </arch>
Nov 08 12:04:48 user nova-compute[74840]:     <features>
Nov 08 12:04:48 user nova-compute[74840]:       <cpuselection/>
Nov 08 12:04:48 user nova-compute[74840]:       <deviceboot/>
Nov 08 12:04:48 user nova-compute[74840]:       <disksnapshot default='on' toggle='no'/>
Nov 08 12:04:48 user nova-compute[74840]:     </features>
Nov 08 12:04:48 user nova-compute[74840]:   </guest>
Nov 08 12:04:48 user nova-compute[74840]:   <guest>
Nov 08 12:04:48 user nova-compute[74840]:     <os_type>hvm</os_type>
Nov 08 12:04:48 user nova-compute[74840]:     <arch name='microblaze'>
Nov 08 12:04:48 user nova-compute[74840]:       <wordsize>32</wordsize>
Nov 08 12:04:48 user nova-compute[74840]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <domain type='qemu'/>
Nov 08 12:04:48 user nova-compute[74840]:     </arch>
Nov 08 12:04:48 user nova-compute[74840]:     <features>
Nov 08 12:04:48 user nova-compute[74840]:       <cpuselection/>
Nov 08 12:04:48 user nova-compute[74840]:       <deviceboot/>
Nov 08 12:04:48 user nova-compute[74840]:       <disksnapshot default='on' toggle='no'/>
Nov 08 12:04:48 user nova-compute[74840]:     </features>
Nov 08 12:04:48 user nova-compute[74840]:   </guest>
Nov 08 12:04:48 user nova-compute[74840]:   <guest>
Nov 08 12:04:48 user nova-compute[74840]:     <os_type>hvm</os_type>
Nov 08 12:04:48 user nova-compute[74840]:     <arch name='microblazeel'>
Nov 08 12:04:48 user nova-compute[74840]:       <wordsize>32</wordsize>
Nov 08 12:04:48 user nova-compute[74840]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <domain type='qemu'/>
Nov 08 12:04:48 user nova-compute[74840]:     </arch>
Nov 08 12:04:48 user nova-compute[74840]:     <features>
Nov 08 12:04:48 user nova-compute[74840]:       <cpuselection/>
Nov 08 12:04:48 user nova-compute[74840]:       <deviceboot/>
Nov 08 12:04:48 user nova-compute[74840]:       <disksnapshot default='on' toggle='no'/>
Nov 08 12:04:48 user nova-compute[74840]:     </features>
Nov 08 12:04:48 user nova-compute[74840]:   </guest>
Nov 08 12:04:48 user nova-compute[74840]:   <guest>
Nov 08 12:04:48 user nova-compute[74840]:     <os_type>hvm</os_type>
Nov 08 12:04:48 user nova-compute[74840]:     <arch name='mips'>
Nov 08 12:04:48 user nova-compute[74840]:       <wordsize>32</wordsize>
Nov 08 12:04:48 user nova-compute[74840]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='16'>malta</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>mipssim</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <domain type='qemu'/>
Nov 08 12:04:48 user nova-compute[74840]:     </arch>
Nov 08 12:04:48 user nova-compute[74840]:     <features>
Nov 08 12:04:48 user nova-compute[74840]:       <cpuselection/>
Nov 08 12:04:48 user nova-compute[74840]:       <deviceboot/>
Nov 08 12:04:48 user nova-compute[74840]:       <disksnapshot default='on' toggle='no'/>
Nov 08 12:04:48 user nova-compute[74840]:     </features>
Nov 08 12:04:48 user nova-compute[74840]:   </guest>
Nov 08 12:04:48 user nova-compute[74840]:   <guest>
Nov 08 12:04:48 user nova-compute[74840]:     <os_type>hvm</os_type>
Nov 08 12:04:48 user nova-compute[74840]:     <arch name='mipsel'>
Nov 08 12:04:48 user nova-compute[74840]:       <wordsize>32</wordsize>
Nov 08 12:04:48 user nova-compute[74840]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='16'>malta</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>mipssim</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <domain type='qemu'/>
Nov 08 12:04:48 user nova-compute[74840]:     </arch>
Nov 08 12:04:48 user nova-compute[74840]:     <features>
Nov 08 12:04:48 user nova-compute[74840]:       <cpuselection/>
Nov 08 12:04:48 user nova-compute[74840]:       <deviceboot/>
Nov 08 12:04:48 user nova-compute[74840]:       <disksnapshot default='on' toggle='no'/>
Nov 08 12:04:48 user nova-compute[74840]:     </features>
Nov 08 12:04:48 user nova-compute[74840]:   </guest>
Nov 08 12:04:48 user nova-compute[74840]:   <guest>
Nov 08 12:04:48 user nova-compute[74840]:     <os_type>hvm</os_type>
Nov 08 12:04:48 user nova-compute[74840]:     <arch name='mips64'>
Nov 08 12:04:48 user nova-compute[74840]:       <wordsize>64</wordsize>
Nov 08 12:04:48 user nova-compute[74840]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='16'>malta</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>mipssim</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>pica61</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>magnum</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <domain type='qemu'/>
Nov 08 12:04:48 user nova-compute[74840]:     </arch>
Nov 08 12:04:48 user nova-compute[74840]:     <features>
Nov 08 12:04:48 user nova-compute[74840]:       <cpuselection/>
Nov 08 12:04:48 user nova-compute[74840]:       <deviceboot/>
Nov 08 12:04:48 user nova-compute[74840]:       <disksnapshot default='on' toggle='no'/>
Nov 08 12:04:48 user nova-compute[74840]:     </features>
Nov 08 12:04:48 user nova-compute[74840]:   </guest>
Nov 08 12:04:48 user nova-compute[74840]:   <guest>
Nov 08 12:04:48 user nova-compute[74840]:     <os_type>hvm</os_type>
Nov 08 12:04:48 user nova-compute[74840]:     <arch name='mips64el'>
Nov 08 12:04:48 user nova-compute[74840]:       <wordsize>64</wordsize>
Nov 08 12:04:48 user nova-compute[74840]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='16'>malta</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>mipssim</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>pica61</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>magnum</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='16'>boston</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <domain type='qemu'/>
Nov 08 12:04:48 user nova-compute[74840]:     </arch>
Nov 08 12:04:48 user nova-compute[74840]:     <features>
Nov 08 12:04:48 user nova-compute[74840]:       <cpuselection/>
Nov 08 12:04:48 user nova-compute[74840]:       <deviceboot/>
Nov 08 12:04:48 user nova-compute[74840]:       <disksnapshot default='on' toggle='no'/>
Nov 08 12:04:48 user nova-compute[74840]:     </features>
Nov 08 12:04:48 user nova-compute[74840]:   </guest>
Nov 08 12:04:48 user nova-compute[74840]:   <guest>
Nov 08 12:04:48 user nova-compute[74840]:     <os_type>hvm</os_type>
Nov 08 12:04:48 user nova-compute[74840]:     <arch name='ppc'>
Nov 08 12:04:48 user nova-compute[74840]:       <wordsize>32</wordsize>
Nov 08 12:04:48 user nova-compute[74840]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>g3beige</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>mac99</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='32'>ppce500</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>pegasos2</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>sam460ex</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>bamboo</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>40p</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>ref405ep</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>taihu</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <domain type='qemu'/>
Nov 08 12:04:48 user nova-compute[74840]:     </arch>
Nov 08 12:04:48 user nova-compute[74840]:     <features>
Nov 08 12:04:48 user nova-compute[74840]:       <cpuselection/>
Nov 08 12:04:48 user nova-compute[74840]:       <deviceboot/>
Nov 08 12:04:48 user nova-compute[74840]:       <disksnapshot default='on' toggle='no'/>
Nov 08 12:04:48 user nova-compute[74840]:     </features>
Nov 08 12:04:48 user nova-compute[74840]:   </guest>
Nov 08 12:04:48 user nova-compute[74840]:   <guest>
Nov 08 12:04:48 user nova-compute[74840]:     <os_type>hvm</os_type>
Nov 08 12:04:48 user nova-compute[74840]:     <arch name='ppc64'>
Nov 08 12:04:48 user nova-compute[74840]:       <wordsize>64</wordsize>
Nov 08 12:04:48 user nova-compute[74840]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2048'>powernv9</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>taihu</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2048'>powernv10</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='32'>ppce500</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>40p</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>pegasos2</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>bamboo</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>g3beige</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>mac99</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>sam460ex</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>ref405ep</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2048'>powernv8</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <domain type='qemu'/>
Nov 08 12:04:48 user nova-compute[74840]:     </arch>
Nov 08 12:04:48 user nova-compute[74840]:     <features>
Nov 08 12:04:48 user nova-compute[74840]:       <cpuselection/>
Nov 08 12:04:48 user nova-compute[74840]:       <deviceboot/>
Nov 08 12:04:48 user nova-compute[74840]:       <disksnapshot default='on' toggle='no'/>
Nov 08 12:04:48 user nova-compute[74840]:     </features>
Nov 08 12:04:48 user nova-compute[74840]:   </guest>
Nov 08 12:04:48 user nova-compute[74840]:   <guest>
Nov 08 12:04:48 user nova-compute[74840]:     <os_type>hvm</os_type>
Nov 08 12:04:48 user nova-compute[74840]:     <arch name='ppc64le'>
Nov 08 12:04:48 user nova-compute[74840]:       <wordsize>64</wordsize>
Nov 08 12:04:48 user nova-compute[74840]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2048'>powernv9</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>taihu</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2048'>powernv10</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='32'>ppce500</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>40p</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>pegasos2</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>bamboo</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>g3beige</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>mac99</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>sam460ex</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>ref405ep</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2048'>powernv8</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <domain type='qemu'/>
Nov 08 12:04:48 user nova-compute[74840]:     </arch>
Nov 08 12:04:48 user nova-compute[74840]:     <features>
Nov 08 12:04:48 user nova-compute[74840]:       <cpuselection/>
Nov 08 12:04:48 user nova-compute[74840]:       <deviceboot/>
Nov 08 12:04:48 user nova-compute[74840]:       <disksnapshot default='on' toggle='no'/>
Nov 08 12:04:48 user nova-compute[74840]:     </features>
Nov 08 12:04:48 user nova-compute[74840]:   </guest>
Nov 08 12:04:48 user nova-compute[74840]:   <guest>
Nov 08 12:04:48 user nova-compute[74840]:     <os_type>hvm</os_type>
Nov 08 12:04:48 user nova-compute[74840]:     <arch name='riscv32'>
Nov 08 12:04:48 user nova-compute[74840]:       <wordsize>32</wordsize>
Nov 08 12:04:48 user nova-compute[74840]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='8'>spike</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>opentitan</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='5'>sifive_u</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>sifive_e</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='8'>virt</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <domain type='qemu'/>
Nov 08 12:04:48 user nova-compute[74840]:     </arch>
Nov 08 12:04:48 user nova-compute[74840]:     <features>
Nov 08 12:04:48 user nova-compute[74840]:       <cpuselection/>
Nov 08 12:04:48 user nova-compute[74840]:       <deviceboot/>
Nov 08 12:04:48 user nova-compute[74840]:       <disksnapshot default='on' toggle='no'/>
Nov 08 12:04:48 user nova-compute[74840]:     </features>
Nov 08 12:04:48 user nova-compute[74840]:   </guest>
Nov 08 12:04:48 user nova-compute[74840]:   <guest>
Nov 08 12:04:48 user nova-compute[74840]:     <os_type>hvm</os_type>
Nov 08 12:04:48 user nova-compute[74840]:     <arch name='riscv64'>
Nov 08 12:04:48 user nova-compute[74840]:       <wordsize>64</wordsize>
Nov 08 12:04:48 user nova-compute[74840]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='8'>spike</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='5'>sifive_u</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>shakti_c</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>sifive_e</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='8'>virt</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <domain type='qemu'/>
Nov 08 12:04:48 user nova-compute[74840]:     </arch>
Nov 08 12:04:48 user nova-compute[74840]:     <features>
Nov 08 12:04:48 user nova-compute[74840]:       <cpuselection/>
Nov 08 12:04:48 user nova-compute[74840]:       <deviceboot/>
Nov 08 12:04:48 user nova-compute[74840]:       <disksnapshot default='on' toggle='no'/>
Nov 08 12:04:48 user nova-compute[74840]:     </features>
Nov 08 12:04:48 user nova-compute[74840]:   </guest>
Nov 08 12:04:48 user nova-compute[74840]:   <guest>
Nov 08 12:04:48 user nova-compute[74840]:     <os_type>hvm</os_type>
Nov 08 12:04:48 user nova-compute[74840]:     <arch name='s390x'>
Nov 08 12:04:48 user nova-compute[74840]:       <wordsize>64</wordsize>
Nov 08 12:04:48 user nova-compute[74840]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <domain type='qemu'/>
Nov 08 12:04:48 user nova-compute[74840]:     </arch>
Nov 08 12:04:48 user nova-compute[74840]:     <features>
Nov 08 12:04:48 user nova-compute[74840]:       <cpuselection/>
Nov 08 12:04:48 user nova-compute[74840]:       <deviceboot/>
Nov 08 12:04:48 user nova-compute[74840]:       <disksnapshot default='on' toggle='no'/>
Nov 08 12:04:48 user nova-compute[74840]:     </features>
Nov 08 12:04:48 user nova-compute[74840]:   </guest>
Nov 08 12:04:48 user nova-compute[74840]:   <guest>
Nov 08 12:04:48 user nova-compute[74840]:     <os_type>hvm</os_type>
Nov 08 12:04:48 user nova-compute[74840]:     <arch name='sh4'>
Nov 08 12:04:48 user nova-compute[74840]:       <wordsize>32</wordsize>
Nov 08 12:04:48 user nova-compute[74840]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>shix</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>r2d</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <domain type='qemu'/>
Nov 08 12:04:48 user nova-compute[74840]:     </arch>
Nov 08 12:04:48 user nova-compute[74840]:     <features>
Nov 08 12:04:48 user nova-compute[74840]:       <cpuselection/>
Nov 08 12:04:48 user nova-compute[74840]:       <deviceboot/>
Nov 08 12:04:48 user nova-compute[74840]:       <disksnapshot default='on' toggle='no'/>
Nov 08 12:04:48 user nova-compute[74840]:     </features>
Nov 08 12:04:48 user nova-compute[74840]:   </guest>
Nov 08 12:04:48 user nova-compute[74840]:   <guest>
Nov 08 12:04:48 user nova-compute[74840]:     <os_type>hvm</os_type>
Nov 08 12:04:48 user nova-compute[74840]:     <arch name='sh4eb'>
Nov 08 12:04:48 user nova-compute[74840]:       <wordsize>64</wordsize>
Nov 08 12:04:48 user nova-compute[74840]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>shix</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>r2d</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <domain type='qemu'/>
Nov 08 12:04:48 user nova-compute[74840]:     </arch>
Nov 08 12:04:48 user nova-compute[74840]:     <features>
Nov 08 12:04:48 user nova-compute[74840]:       <cpuselection/>
Nov 08 12:04:48 user nova-compute[74840]:       <deviceboot/>
Nov 08 12:04:48 user nova-compute[74840]:       <disksnapshot default='on' toggle='no'/>
Nov 08 12:04:48 user nova-compute[74840]:     </features>
Nov 08 12:04:48 user nova-compute[74840]:   </guest>
Nov 08 12:04:48 user nova-compute[74840]:   <guest>
Nov 08 12:04:48 user nova-compute[74840]:     <os_type>hvm</os_type>
Nov 08 12:04:48 user nova-compute[74840]:     <arch name='sparc'>
Nov 08 12:04:48 user nova-compute[74840]:       <wordsize>32</wordsize>
Nov 08 12:04:48 user nova-compute[74840]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>SS-5</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='4'>SS-20</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>LX</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>SS-4</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='4'>SS-10</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>Voyager</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <domain type='qemu'/>
Nov 08 12:04:48 user nova-compute[74840]:     </arch>
Nov 08 12:04:48 user nova-compute[74840]:     <features>
Nov 08 12:04:48 user nova-compute[74840]:       <cpuselection/>
Nov 08 12:04:48 user nova-compute[74840]:       <deviceboot/>
Nov 08 12:04:48 user nova-compute[74840]:       <disksnapshot default='on' toggle='no'/>
Nov 08 12:04:48 user nova-compute[74840]:     </features>
Nov 08 12:04:48 user nova-compute[74840]:   </guest>
Nov 08 12:04:48 user nova-compute[74840]:   <guest>
Nov 08 12:04:48 user nova-compute[74840]:     <os_type>hvm</os_type>
Nov 08 12:04:48 user nova-compute[74840]:     <arch name='sparc64'>
Nov 08 12:04:48 user nova-compute[74840]:       <wordsize>64</wordsize>
Nov 08 12:04:48 user nova-compute[74840]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>sun4u</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>niagara</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>sun4v</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <domain type='qemu'/>
Nov 08 12:04:48 user nova-compute[74840]:     </arch>
Nov 08 12:04:48 user nova-compute[74840]:     <features>
Nov 08 12:04:48 user nova-compute[74840]:       <cpuselection/>
Nov 08 12:04:48 user nova-compute[74840]:       <deviceboot/>
Nov 08 12:04:48 user nova-compute[74840]:       <disksnapshot default='on' toggle='no'/>
Nov 08 12:04:48 user nova-compute[74840]:     </features>
Nov 08 12:04:48 user nova-compute[74840]:   </guest>
Nov 08 12:04:48 user nova-compute[74840]:   <guest>
Nov 08 12:04:48 user nova-compute[74840]:     <os_type>hvm</os_type>
Nov 08 12:04:48 user nova-compute[74840]:     <arch name='x86_64'>
Nov 08 12:04:48 user nova-compute[74840]:       <wordsize>64</wordsize>
Nov 08 12:04:48 user nova-compute[74840]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>x-remote</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='1'>isapc</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>microvm</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <domain type='qemu'/>
Nov 08 12:04:48 user nova-compute[74840]:       <domain type='kvm'/>
Nov 08 12:04:48 user nova-compute[74840]:     </arch>
Nov 08 12:04:48 user nova-compute[74840]:     <features>
Nov 08 12:04:48 user nova-compute[74840]:       <acpi default='on' toggle='yes'/>
Nov 08 12:04:48 user nova-compute[74840]:       <apic default='on' toggle='no'/>
Nov 08 12:04:48 user nova-compute[74840]:       <cpuselection/>
Nov 08 12:04:48 user nova-compute[74840]:       <deviceboot/>
Nov 08 12:04:48 user nova-compute[74840]:       <disksnapshot default='on' toggle='no'/>
Nov 08 12:04:48 user nova-compute[74840]:     </features>
Nov 08 12:04:48 user nova-compute[74840]:   </guest>
Nov 08 12:04:48 user nova-compute[74840]:   <guest>
Nov 08 12:04:48 user nova-compute[74840]:     <os_type>hvm</os_type>
Nov 08 12:04:48 user nova-compute[74840]:     <arch name='xtensa'>
Nov 08 12:04:48 user nova-compute[74840]:       <wordsize>32</wordsize>
Nov 08 12:04:48 user nova-compute[74840]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='4'>sim</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='32'>kc705</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='32'>ml605</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='32'>virt</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='32'>lx200</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='32'>lx60</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <domain type='qemu'/>
Nov 08 12:04:48 user nova-compute[74840]:     </arch>
Nov 08 12:04:48 user nova-compute[74840]:     <features>
Nov 08 12:04:48 user nova-compute[74840]:       <cpuselection/>
Nov 08 12:04:48 user nova-compute[74840]:       <deviceboot/>
Nov 08 12:04:48 user nova-compute[74840]:       <disksnapshot default='on' toggle='no'/>
Nov 08 12:04:48 user nova-compute[74840]:     </features>
Nov 08 12:04:48 user nova-compute[74840]:   </guest>
Nov 08 12:04:48 user nova-compute[74840]:   <guest>
Nov 08 12:04:48 user nova-compute[74840]:     <os_type>hvm</os_type>
Nov 08 12:04:48 user nova-compute[74840]:     <arch name='xtensaeb'>
Nov 08 12:04:48 user nova-compute[74840]:       <wordsize>32</wordsize>
Nov 08 12:04:48 user nova-compute[74840]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='4'>sim</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='32'>kc705</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='32'>ml605</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='32'>virt</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='32'>lx200</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='32'>lx60</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 08 12:04:48 user nova-compute[74840]:       <domain type='qemu'/>
Nov 08 12:04:48 user nova-compute[74840]:     </arch>
Nov 08 12:04:48 user nova-compute[74840]:     <features>
Nov 08 12:04:48 user nova-compute[74840]:       <cpuselection/>
Nov 08 12:04:48 user nova-compute[74840]:       <deviceboot/>
Nov 08 12:04:48 user nova-compute[74840]:       <disksnapshot default='on' toggle='no'/>
Nov 08 12:04:48 user nova-compute[74840]:     </features>
Nov 08 12:04:48 user nova-compute[74840]:   </guest>
Nov 08 12:04:48 user nova-compute[74840]: </capabilities>
Nov 08 12:04:48 user nova-compute[74840]: 
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74840) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74840) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=74840) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74840) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74840) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74840) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74840) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74840) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74840) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74840) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74840) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'ubuntu', 'pc', 'q35'} {{(pid=74840) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 08 12:04:48 user nova-compute[74840]: <domainCapabilities>
Nov 08 12:04:48 user nova-compute[74840]:   <path>/usr/bin/qemu-system-i386</path>
Nov 08 12:04:48 user nova-compute[74840]:   <domain>kvm</domain>
Nov 08 12:04:48 user nova-compute[74840]:   <machine>pc-q35-jammy</machine>
Nov 08 12:04:48 user nova-compute[74840]:   <arch>i686</arch>
Nov 08 12:04:48 user nova-compute[74840]:   <vcpu max='288'/>
Nov 08 12:04:48 user nova-compute[74840]:   <iothreads supported='yes'/>
Nov 08 12:04:48 user nova-compute[74840]:   <os supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:     <enum name='firmware'/>
Nov 08 12:04:48 user nova-compute[74840]:     <loader supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 08 12:04:48 user nova-compute[74840]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 08 12:04:48 user nova-compute[74840]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 08 12:04:48 user nova-compute[74840]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 08 12:04:48 user nova-compute[74840]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='type'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>rom</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>pflash</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='readonly'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>yes</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>no</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='secure'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>no</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </loader>
Nov 08 12:04:48 user nova-compute[74840]:   </os>
Nov 08 12:04:48 user nova-compute[74840]:   <cpu>
Nov 08 12:04:48 user nova-compute[74840]:     <mode name='host-passthrough' supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='hostPassthroughMigratable'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>off</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </mode>
Nov 08 12:04:48 user nova-compute[74840]:     <mode name='maximum' supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='maximumMigratable'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>on</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>off</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </mode>
Nov 08 12:04:48 user nova-compute[74840]:     <mode name='host-model' supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <vendor>Intel</vendor>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='ss'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='vmx'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='pcid'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='hypervisor'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='arat'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='umip'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='md-clear'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='stibp'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='ssbd'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='ibpb'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='ibrs'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='amd-stibp'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='disable' name='erms'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='disable' name='lm'/>
Nov 08 12:04:48 user nova-compute[74840]:     </mode>
Nov 08 12:04:48 user nova-compute[74840]:     <mode name='custom' supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>qemu64</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>qemu32</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>phenom</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>pentium3</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>pentium2</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>pentium</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>n270</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>kvm64</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>kvm32</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>coreduo</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>core2duo</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>athlon</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Westmere-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Westmere</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Snowridge</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Skylake-Server</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Skylake-Client</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>SandyBridge</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Penryn</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Opteron_G5</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Opteron_G4</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Opteron_G3</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Opteron_G2</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Opteron_G1</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Nehalem-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Nehalem</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>IvyBridge</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Icelake-Server</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Haswell</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>EPYC-Rome</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>EPYC-Milan</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>EPYC</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Dhyana</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Cooperlake</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Conroe</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Broadwell</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>486</model>
Nov 08 12:04:48 user nova-compute[74840]:     </mode>
Nov 08 12:04:48 user nova-compute[74840]:   </cpu>
Nov 08 12:04:48 user nova-compute[74840]:   <memoryBacking supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:     <enum name='sourceType'>
Nov 08 12:04:48 user nova-compute[74840]:       <value>file</value>
Nov 08 12:04:48 user nova-compute[74840]:       <value>anonymous</value>
Nov 08 12:04:48 user nova-compute[74840]:       <value>memfd</value>
Nov 08 12:04:48 user nova-compute[74840]:     </enum>
Nov 08 12:04:48 user nova-compute[74840]:   </memoryBacking>
Nov 08 12:04:48 user nova-compute[74840]:   <devices>
Nov 08 12:04:48 user nova-compute[74840]:     <disk supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='diskDevice'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>disk</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>cdrom</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>floppy</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>lun</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='bus'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>fdc</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>scsi</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>usb</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>sata</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='model'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio-transitional</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio-non-transitional</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </disk>
Nov 08 12:04:48 user nova-compute[74840]:     <graphics supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='type'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>sdl</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>vnc</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>spice</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>egl-headless</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </graphics>
Nov 08 12:04:48 user nova-compute[74840]:     <video supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='modelType'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>vga</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>cirrus</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>vmvga</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>qxl</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>none</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>bochs</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>ramfb</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </video>
Nov 08 12:04:48 user nova-compute[74840]:     <hostdev supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='mode'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>subsystem</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='startupPolicy'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>default</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>mandatory</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>requisite</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>optional</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='subsysType'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>usb</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>pci</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>scsi</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='capsType'/>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='pciBackend'/>
Nov 08 12:04:48 user nova-compute[74840]:     </hostdev>
Nov 08 12:04:48 user nova-compute[74840]:     <rng supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='model'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio-transitional</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio-non-transitional</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='backendModel'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>random</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>egd</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>builtin</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </rng>
Nov 08 12:04:48 user nova-compute[74840]:     <filesystem supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='driverType'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>path</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>handle</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtiofs</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </filesystem>
Nov 08 12:04:48 user nova-compute[74840]:     <tpm supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='model'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>tpm-tis</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>tpm-crb</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='backendModel'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>passthrough</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>emulator</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </tpm>
Nov 08 12:04:48 user nova-compute[74840]:   </devices>
Nov 08 12:04:48 user nova-compute[74840]:   <features>
Nov 08 12:04:48 user nova-compute[74840]:     <gic supported='no'/>
Nov 08 12:04:48 user nova-compute[74840]:     <vmcoreinfo supported='yes'/>
Nov 08 12:04:48 user nova-compute[74840]:     <genid supported='yes'/>
Nov 08 12:04:48 user nova-compute[74840]:     <backingStoreInput supported='yes'/>
Nov 08 12:04:48 user nova-compute[74840]:     <backup supported='yes'/>
Nov 08 12:04:48 user nova-compute[74840]:     <sev supported='no'/>
Nov 08 12:04:48 user nova-compute[74840]:   </features>
Nov 08 12:04:48 user nova-compute[74840]: </domainCapabilities>
Nov 08 12:04:48 user nova-compute[74840]:  {{(pid=74840) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 08 12:04:48 user nova-compute[74840]: <domainCapabilities>
Nov 08 12:04:48 user nova-compute[74840]:   <path>/usr/bin/qemu-system-i386</path>
Nov 08 12:04:48 user nova-compute[74840]:   <domain>kvm</domain>
Nov 08 12:04:48 user nova-compute[74840]:   <machine>pc-i440fx-jammy</machine>
Nov 08 12:04:48 user nova-compute[74840]:   <arch>i686</arch>
Nov 08 12:04:48 user nova-compute[74840]:   <vcpu max='255'/>
Nov 08 12:04:48 user nova-compute[74840]:   <iothreads supported='yes'/>
Nov 08 12:04:48 user nova-compute[74840]:   <os supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:     <enum name='firmware'/>
Nov 08 12:04:48 user nova-compute[74840]:     <loader supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 08 12:04:48 user nova-compute[74840]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 08 12:04:48 user nova-compute[74840]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 08 12:04:48 user nova-compute[74840]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 08 12:04:48 user nova-compute[74840]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='type'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>rom</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>pflash</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='readonly'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>yes</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>no</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='secure'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>no</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </loader>
Nov 08 12:04:48 user nova-compute[74840]:   </os>
Nov 08 12:04:48 user nova-compute[74840]:   <cpu>
Nov 08 12:04:48 user nova-compute[74840]:     <mode name='host-passthrough' supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='hostPassthroughMigratable'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>off</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </mode>
Nov 08 12:04:48 user nova-compute[74840]:     <mode name='maximum' supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='maximumMigratable'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>on</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>off</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </mode>
Nov 08 12:04:48 user nova-compute[74840]:     <mode name='host-model' supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <vendor>Intel</vendor>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='ss'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='vmx'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='pcid'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='hypervisor'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='arat'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='umip'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='md-clear'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='stibp'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='ssbd'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='ibpb'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='ibrs'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='amd-stibp'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='disable' name='erms'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='disable' name='lm'/>
Nov 08 12:04:48 user nova-compute[74840]:     </mode>
Nov 08 12:04:48 user nova-compute[74840]:     <mode name='custom' supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>qemu64</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>qemu32</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>phenom</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>pentium3</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>pentium2</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>pentium</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>n270</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>kvm64</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>kvm32</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>coreduo</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>core2duo</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>athlon</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Westmere-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Westmere</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Snowridge</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Skylake-Server</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Skylake-Client</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>SandyBridge</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Penryn</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Opteron_G5</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Opteron_G4</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Opteron_G3</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Opteron_G2</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Opteron_G1</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Nehalem-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Nehalem</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>IvyBridge</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Icelake-Server</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Haswell</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>EPYC-Rome</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>EPYC-Milan</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>EPYC</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Dhyana</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Cooperlake</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Conroe</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Broadwell</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>486</model>
Nov 08 12:04:48 user nova-compute[74840]:     </mode>
Nov 08 12:04:48 user nova-compute[74840]:   </cpu>
Nov 08 12:04:48 user nova-compute[74840]:   <memoryBacking supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:     <enum name='sourceType'>
Nov 08 12:04:48 user nova-compute[74840]:       <value>file</value>
Nov 08 12:04:48 user nova-compute[74840]:       <value>anonymous</value>
Nov 08 12:04:48 user nova-compute[74840]:       <value>memfd</value>
Nov 08 12:04:48 user nova-compute[74840]:     </enum>
Nov 08 12:04:48 user nova-compute[74840]:   </memoryBacking>
Nov 08 12:04:48 user nova-compute[74840]:   <devices>
Nov 08 12:04:48 user nova-compute[74840]:     <disk supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='diskDevice'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>disk</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>cdrom</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>floppy</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>lun</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='bus'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>ide</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>fdc</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>scsi</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>usb</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>sata</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='model'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio-transitional</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio-non-transitional</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </disk>
Nov 08 12:04:48 user nova-compute[74840]:     <graphics supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='type'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>sdl</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>vnc</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>spice</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>egl-headless</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </graphics>
Nov 08 12:04:48 user nova-compute[74840]:     <video supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='modelType'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>vga</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>cirrus</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>vmvga</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>qxl</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>none</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>bochs</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>ramfb</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </video>
Nov 08 12:04:48 user nova-compute[74840]:     <hostdev supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='mode'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>subsystem</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='startupPolicy'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>default</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>mandatory</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>requisite</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>optional</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='subsysType'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>usb</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>pci</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>scsi</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='capsType'/>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='pciBackend'/>
Nov 08 12:04:48 user nova-compute[74840]:     </hostdev>
Nov 08 12:04:48 user nova-compute[74840]:     <rng supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='model'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio-transitional</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio-non-transitional</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='backendModel'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>random</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>egd</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>builtin</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </rng>
Nov 08 12:04:48 user nova-compute[74840]:     <filesystem supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='driverType'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>path</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>handle</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtiofs</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </filesystem>
Nov 08 12:04:48 user nova-compute[74840]:     <tpm supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='model'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>tpm-tis</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>tpm-crb</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='backendModel'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>passthrough</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>emulator</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </tpm>
Nov 08 12:04:48 user nova-compute[74840]:   </devices>
Nov 08 12:04:48 user nova-compute[74840]:   <features>
Nov 08 12:04:48 user nova-compute[74840]:     <gic supported='no'/>
Nov 08 12:04:48 user nova-compute[74840]:     <vmcoreinfo supported='yes'/>
Nov 08 12:04:48 user nova-compute[74840]:     <genid supported='yes'/>
Nov 08 12:04:48 user nova-compute[74840]:     <backingStoreInput supported='yes'/>
Nov 08 12:04:48 user nova-compute[74840]:     <backup supported='yes'/>
Nov 08 12:04:48 user nova-compute[74840]:     <sev supported='no'/>
Nov 08 12:04:48 user nova-compute[74840]:   </features>
Nov 08 12:04:48 user nova-compute[74840]: </domainCapabilities>
Nov 08 12:04:48 user nova-compute[74840]:  {{(pid=74840) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 08 12:04:48 user nova-compute[74840]: <domainCapabilities>
Nov 08 12:04:48 user nova-compute[74840]:   <path>/usr/bin/qemu-system-i386</path>
Nov 08 12:04:48 user nova-compute[74840]:   <domain>kvm</domain>
Nov 08 12:04:48 user nova-compute[74840]:   <machine>pc-i440fx-6.2</machine>
Nov 08 12:04:48 user nova-compute[74840]:   <arch>i686</arch>
Nov 08 12:04:48 user nova-compute[74840]:   <vcpu max='255'/>
Nov 08 12:04:48 user nova-compute[74840]:   <iothreads supported='yes'/>
Nov 08 12:04:48 user nova-compute[74840]:   <os supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:     <enum name='firmware'/>
Nov 08 12:04:48 user nova-compute[74840]:     <loader supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 08 12:04:48 user nova-compute[74840]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 08 12:04:48 user nova-compute[74840]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 08 12:04:48 user nova-compute[74840]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 08 12:04:48 user nova-compute[74840]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='type'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>rom</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>pflash</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='readonly'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>yes</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>no</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='secure'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>no</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </loader>
Nov 08 12:04:48 user nova-compute[74840]:   </os>
Nov 08 12:04:48 user nova-compute[74840]:   <cpu>
Nov 08 12:04:48 user nova-compute[74840]:     <mode name='host-passthrough' supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='hostPassthroughMigratable'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>off</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </mode>
Nov 08 12:04:48 user nova-compute[74840]:     <mode name='maximum' supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='maximumMigratable'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>on</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>off</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </mode>
Nov 08 12:04:48 user nova-compute[74840]:     <mode name='host-model' supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <vendor>Intel</vendor>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='ss'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='vmx'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='pcid'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='hypervisor'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='arat'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='umip'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='md-clear'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='stibp'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='ssbd'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='ibpb'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='ibrs'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='amd-stibp'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='disable' name='erms'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='disable' name='lm'/>
Nov 08 12:04:48 user nova-compute[74840]:     </mode>
Nov 08 12:04:48 user nova-compute[74840]:     <mode name='custom' supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>qemu64</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>qemu32</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>phenom</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>pentium3</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>pentium2</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>pentium</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>n270</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>kvm64</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>kvm32</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>coreduo</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>core2duo</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>athlon</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Westmere-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Westmere</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Snowridge</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Skylake-Server</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Skylake-Client</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>SandyBridge</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Penryn</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Opteron_G5</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Opteron_G4</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Opteron_G3</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Opteron_G2</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Opteron_G1</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Nehalem-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Nehalem</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>IvyBridge</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Icelake-Server</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Haswell</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>EPYC-Rome</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>EPYC-Milan</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>EPYC</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Dhyana</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Cooperlake</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Conroe</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Broadwell</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>486</model>
Nov 08 12:04:48 user nova-compute[74840]:     </mode>
Nov 08 12:04:48 user nova-compute[74840]:   </cpu>
Nov 08 12:04:48 user nova-compute[74840]:   <memoryBacking supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:     <enum name='sourceType'>
Nov 08 12:04:48 user nova-compute[74840]:       <value>file</value>
Nov 08 12:04:48 user nova-compute[74840]:       <value>anonymous</value>
Nov 08 12:04:48 user nova-compute[74840]:       <value>memfd</value>
Nov 08 12:04:48 user nova-compute[74840]:     </enum>
Nov 08 12:04:48 user nova-compute[74840]:   </memoryBacking>
Nov 08 12:04:48 user nova-compute[74840]:   <devices>
Nov 08 12:04:48 user nova-compute[74840]:     <disk supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='diskDevice'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>disk</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>cdrom</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>floppy</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>lun</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='bus'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>ide</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>fdc</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>scsi</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>usb</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>sata</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='model'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio-transitional</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio-non-transitional</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </disk>
Nov 08 12:04:48 user nova-compute[74840]:     <graphics supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='type'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>sdl</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>vnc</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>spice</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>egl-headless</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </graphics>
Nov 08 12:04:48 user nova-compute[74840]:     <video supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='modelType'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>vga</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>cirrus</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>vmvga</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>qxl</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>none</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>bochs</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>ramfb</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </video>
Nov 08 12:04:48 user nova-compute[74840]:     <hostdev supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='mode'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>subsystem</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='startupPolicy'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>default</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>mandatory</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>requisite</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>optional</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='subsysType'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>usb</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>pci</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>scsi</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='capsType'/>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='pciBackend'/>
Nov 08 12:04:48 user nova-compute[74840]:     </hostdev>
Nov 08 12:04:48 user nova-compute[74840]:     <rng supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='model'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio-transitional</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio-non-transitional</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='backendModel'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>random</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>egd</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>builtin</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </rng>
Nov 08 12:04:48 user nova-compute[74840]:     <filesystem supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='driverType'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>path</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>handle</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtiofs</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </filesystem>
Nov 08 12:04:48 user nova-compute[74840]:     <tpm supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='model'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>tpm-tis</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>tpm-crb</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='backendModel'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>passthrough</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>emulator</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </tpm>
Nov 08 12:04:48 user nova-compute[74840]:   </devices>
Nov 08 12:04:48 user nova-compute[74840]:   <features>
Nov 08 12:04:48 user nova-compute[74840]:     <gic supported='no'/>
Nov 08 12:04:48 user nova-compute[74840]:     <vmcoreinfo supported='yes'/>
Nov 08 12:04:48 user nova-compute[74840]:     <genid supported='yes'/>
Nov 08 12:04:48 user nova-compute[74840]:     <backingStoreInput supported='yes'/>
Nov 08 12:04:48 user nova-compute[74840]:     <backup supported='yes'/>
Nov 08 12:04:48 user nova-compute[74840]:     <sev supported='no'/>
Nov 08 12:04:48 user nova-compute[74840]:   </features>
Nov 08 12:04:48 user nova-compute[74840]: </domainCapabilities>
Nov 08 12:04:48 user nova-compute[74840]:  {{(pid=74840) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 08 12:04:48 user nova-compute[74840]: <domainCapabilities>
Nov 08 12:04:48 user nova-compute[74840]:   <path>/usr/bin/qemu-system-i386</path>
Nov 08 12:04:48 user nova-compute[74840]:   <domain>kvm</domain>
Nov 08 12:04:48 user nova-compute[74840]:   <machine>pc-q35-6.2</machine>
Nov 08 12:04:48 user nova-compute[74840]:   <arch>i686</arch>
Nov 08 12:04:48 user nova-compute[74840]:   <vcpu max='288'/>
Nov 08 12:04:48 user nova-compute[74840]:   <iothreads supported='yes'/>
Nov 08 12:04:48 user nova-compute[74840]:   <os supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:     <enum name='firmware'/>
Nov 08 12:04:48 user nova-compute[74840]:     <loader supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 08 12:04:48 user nova-compute[74840]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 08 12:04:48 user nova-compute[74840]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 08 12:04:48 user nova-compute[74840]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 08 12:04:48 user nova-compute[74840]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='type'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>rom</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>pflash</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='readonly'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>yes</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>no</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='secure'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>no</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </loader>
Nov 08 12:04:48 user nova-compute[74840]:   </os>
Nov 08 12:04:48 user nova-compute[74840]:   <cpu>
Nov 08 12:04:48 user nova-compute[74840]:     <mode name='host-passthrough' supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='hostPassthroughMigratable'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>off</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </mode>
Nov 08 12:04:48 user nova-compute[74840]:     <mode name='maximum' supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='maximumMigratable'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>on</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>off</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </mode>
Nov 08 12:04:48 user nova-compute[74840]:     <mode name='host-model' supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <vendor>Intel</vendor>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='ss'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='vmx'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='pcid'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='hypervisor'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='arat'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='umip'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='md-clear'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='stibp'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='ssbd'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='ibpb'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='ibrs'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='amd-stibp'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='disable' name='erms'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='disable' name='lm'/>
Nov 08 12:04:48 user nova-compute[74840]:     </mode>
Nov 08 12:04:48 user nova-compute[74840]:     <mode name='custom' supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>qemu64</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>qemu32</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>phenom</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>pentium3</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>pentium2</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>pentium</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>n270</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>kvm64</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>kvm32</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>coreduo</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>core2duo</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>athlon</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Westmere-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Westmere</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Snowridge</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Skylake-Server</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Skylake-Client</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>SandyBridge</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Penryn</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Opteron_G5</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Opteron_G4</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Opteron_G3</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Opteron_G2</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Opteron_G1</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Nehalem-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Nehalem</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>IvyBridge</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Icelake-Server</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Haswell</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>EPYC-Rome</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>EPYC-Milan</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>EPYC</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Dhyana</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Cooperlake</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Conroe</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Broadwell</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>486</model>
Nov 08 12:04:48 user nova-compute[74840]:     </mode>
Nov 08 12:04:48 user nova-compute[74840]:   </cpu>
Nov 08 12:04:48 user nova-compute[74840]:   <memoryBacking supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:     <enum name='sourceType'>
Nov 08 12:04:48 user nova-compute[74840]:       <value>file</value>
Nov 08 12:04:48 user nova-compute[74840]:       <value>anonymous</value>
Nov 08 12:04:48 user nova-compute[74840]:       <value>memfd</value>
Nov 08 12:04:48 user nova-compute[74840]:     </enum>
Nov 08 12:04:48 user nova-compute[74840]:   </memoryBacking>
Nov 08 12:04:48 user nova-compute[74840]:   <devices>
Nov 08 12:04:48 user nova-compute[74840]:     <disk supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='diskDevice'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>disk</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>cdrom</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>floppy</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>lun</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='bus'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>fdc</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>scsi</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>usb</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>sata</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='model'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio-transitional</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio-non-transitional</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </disk>
Nov 08 12:04:48 user nova-compute[74840]:     <graphics supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='type'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>sdl</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>vnc</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>spice</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>egl-headless</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </graphics>
Nov 08 12:04:48 user nova-compute[74840]:     <video supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='modelType'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>vga</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>cirrus</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>vmvga</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>qxl</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>none</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>bochs</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>ramfb</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </video>
Nov 08 12:04:48 user nova-compute[74840]:     <hostdev supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='mode'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>subsystem</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='startupPolicy'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>default</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>mandatory</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>requisite</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>optional</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='subsysType'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>usb</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>pci</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>scsi</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='capsType'/>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='pciBackend'/>
Nov 08 12:04:48 user nova-compute[74840]:     </hostdev>
Nov 08 12:04:48 user nova-compute[74840]:     <rng supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='model'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio-transitional</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio-non-transitional</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='backendModel'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>random</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>egd</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>builtin</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </rng>
Nov 08 12:04:48 user nova-compute[74840]:     <filesystem supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='driverType'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>path</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>handle</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtiofs</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </filesystem>
Nov 08 12:04:48 user nova-compute[74840]:     <tpm supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='model'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>tpm-tis</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>tpm-crb</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='backendModel'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>passthrough</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>emulator</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </tpm>
Nov 08 12:04:48 user nova-compute[74840]:   </devices>
Nov 08 12:04:48 user nova-compute[74840]:   <features>
Nov 08 12:04:48 user nova-compute[74840]:     <gic supported='no'/>
Nov 08 12:04:48 user nova-compute[74840]:     <vmcoreinfo supported='yes'/>
Nov 08 12:04:48 user nova-compute[74840]:     <genid supported='yes'/>
Nov 08 12:04:48 user nova-compute[74840]:     <backingStoreInput supported='yes'/>
Nov 08 12:04:48 user nova-compute[74840]:     <backup supported='yes'/>
Nov 08 12:04:48 user nova-compute[74840]:     <sev supported='no'/>
Nov 08 12:04:48 user nova-compute[74840]:   </features>
Nov 08 12:04:48 user nova-compute[74840]: </domainCapabilities>
Nov 08 12:04:48 user nova-compute[74840]:  {{(pid=74840) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=74840) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74840) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74840) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74840) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74840) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74840) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74840) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74840) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74840) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74840) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74840) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74840) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74840) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74840) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74840) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74840) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74840) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=74840) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74840) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74840) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74840) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=74840) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74840) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74840) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74840) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74840) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74840) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74840) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74840) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74840) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74840) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74840) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74840) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74840) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74840) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74840) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74840) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74840) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'ubuntu', 'pc', 'q35'} {{(pid=74840) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 08 12:04:48 user nova-compute[74840]: <domainCapabilities>
Nov 08 12:04:48 user nova-compute[74840]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 08 12:04:48 user nova-compute[74840]:   <domain>kvm</domain>
Nov 08 12:04:48 user nova-compute[74840]:   <machine>pc-q35-jammy</machine>
Nov 08 12:04:48 user nova-compute[74840]:   <arch>x86_64</arch>
Nov 08 12:04:48 user nova-compute[74840]:   <vcpu max='288'/>
Nov 08 12:04:48 user nova-compute[74840]:   <iothreads supported='yes'/>
Nov 08 12:04:48 user nova-compute[74840]:   <os supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:     <enum name='firmware'>
Nov 08 12:04:48 user nova-compute[74840]:       <value>efi</value>
Nov 08 12:04:48 user nova-compute[74840]:     </enum>
Nov 08 12:04:48 user nova-compute[74840]:     <loader supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 08 12:04:48 user nova-compute[74840]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 08 12:04:48 user nova-compute[74840]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='type'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>rom</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>pflash</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='readonly'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>yes</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>no</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='secure'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>yes</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>no</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </loader>
Nov 08 12:04:48 user nova-compute[74840]:   </os>
Nov 08 12:04:48 user nova-compute[74840]:   <cpu>
Nov 08 12:04:48 user nova-compute[74840]:     <mode name='host-passthrough' supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='hostPassthroughMigratable'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>on</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>off</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </mode>
Nov 08 12:04:48 user nova-compute[74840]:     <mode name='maximum' supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='maximumMigratable'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>on</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>off</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </mode>
Nov 08 12:04:48 user nova-compute[74840]:     <mode name='host-model' supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <vendor>Intel</vendor>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='ss'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='vmx'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='pcid'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='hypervisor'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='arat'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='umip'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='md-clear'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='stibp'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='ssbd'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='invtsc'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='ibpb'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='ibrs'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='amd-stibp'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='rsba'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='pschange-mc-no'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='disable' name='erms'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 12:04:48 user nova-compute[74840]:     </mode>
Nov 08 12:04:48 user nova-compute[74840]:     <mode name='custom' supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>qemu64</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>qemu32</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>phenom</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>pentium3</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>pentium2</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>pentium</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>n270</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>kvm64</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>kvm32</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>coreduo</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>core2duo</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>athlon</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>Westmere-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>Westmere</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Snowridge</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Skylake-Server</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Skylake-Client</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>SandyBridge</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>Penryn</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Opteron_G5</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Opteron_G4</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Opteron_G3</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Opteron_G2</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>Opteron_G1</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>Nehalem</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>IvyBridge</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Icelake-Server</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Haswell</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>EPYC-Rome</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>EPYC-Milan</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>EPYC</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Dhyana</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Cooperlake</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>Conroe</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Broadwell</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>486</model>
Nov 08 12:04:48 user nova-compute[74840]:     </mode>
Nov 08 12:04:48 user nova-compute[74840]:   </cpu>
Nov 08 12:04:48 user nova-compute[74840]:   <memoryBacking supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:     <enum name='sourceType'>
Nov 08 12:04:48 user nova-compute[74840]:       <value>file</value>
Nov 08 12:04:48 user nova-compute[74840]:       <value>anonymous</value>
Nov 08 12:04:48 user nova-compute[74840]:       <value>memfd</value>
Nov 08 12:04:48 user nova-compute[74840]:     </enum>
Nov 08 12:04:48 user nova-compute[74840]:   </memoryBacking>
Nov 08 12:04:48 user nova-compute[74840]:   <devices>
Nov 08 12:04:48 user nova-compute[74840]:     <disk supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='diskDevice'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>disk</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>cdrom</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>floppy</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>lun</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='bus'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>fdc</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>scsi</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>usb</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>sata</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='model'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio-transitional</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio-non-transitional</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </disk>
Nov 08 12:04:48 user nova-compute[74840]:     <graphics supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='type'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>sdl</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>vnc</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>spice</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>egl-headless</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </graphics>
Nov 08 12:04:48 user nova-compute[74840]:     <video supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='modelType'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>vga</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>cirrus</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>vmvga</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>qxl</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>none</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>bochs</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>ramfb</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </video>
Nov 08 12:04:48 user nova-compute[74840]:     <hostdev supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='mode'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>subsystem</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='startupPolicy'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>default</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>mandatory</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>requisite</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>optional</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='subsysType'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>usb</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>pci</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>scsi</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='capsType'/>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='pciBackend'/>
Nov 08 12:04:48 user nova-compute[74840]:     </hostdev>
Nov 08 12:04:48 user nova-compute[74840]:     <rng supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='model'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio-transitional</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio-non-transitional</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='backendModel'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>random</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>egd</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>builtin</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </rng>
Nov 08 12:04:48 user nova-compute[74840]:     <filesystem supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='driverType'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>path</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>handle</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtiofs</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </filesystem>
Nov 08 12:04:48 user nova-compute[74840]:     <tpm supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='model'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>tpm-tis</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>tpm-crb</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='backendModel'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>passthrough</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>emulator</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </tpm>
Nov 08 12:04:48 user nova-compute[74840]:   </devices>
Nov 08 12:04:48 user nova-compute[74840]:   <features>
Nov 08 12:04:48 user nova-compute[74840]:     <gic supported='no'/>
Nov 08 12:04:48 user nova-compute[74840]:     <vmcoreinfo supported='yes'/>
Nov 08 12:04:48 user nova-compute[74840]:     <genid supported='yes'/>
Nov 08 12:04:48 user nova-compute[74840]:     <backingStoreInput supported='yes'/>
Nov 08 12:04:48 user nova-compute[74840]:     <backup supported='yes'/>
Nov 08 12:04:48 user nova-compute[74840]:     <sev supported='no'/>
Nov 08 12:04:48 user nova-compute[74840]:   </features>
Nov 08 12:04:48 user nova-compute[74840]: </domainCapabilities>
Nov 08 12:04:48 user nova-compute[74840]:  {{(pid=74840) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 08 12:04:48 user nova-compute[74840]: <domainCapabilities>
Nov 08 12:04:48 user nova-compute[74840]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 08 12:04:48 user nova-compute[74840]:   <domain>kvm</domain>
Nov 08 12:04:48 user nova-compute[74840]:   <machine>pc-i440fx-jammy</machine>
Nov 08 12:04:48 user nova-compute[74840]:   <arch>x86_64</arch>
Nov 08 12:04:48 user nova-compute[74840]:   <vcpu max='255'/>
Nov 08 12:04:48 user nova-compute[74840]:   <iothreads supported='yes'/>
Nov 08 12:04:48 user nova-compute[74840]:   <os supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:     <enum name='firmware'>
Nov 08 12:04:48 user nova-compute[74840]:       <value>efi</value>
Nov 08 12:04:48 user nova-compute[74840]:     </enum>
Nov 08 12:04:48 user nova-compute[74840]:     <loader supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='type'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>rom</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>pflash</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='readonly'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>yes</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>no</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='secure'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>no</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </loader>
Nov 08 12:04:48 user nova-compute[74840]:   </os>
Nov 08 12:04:48 user nova-compute[74840]:   <cpu>
Nov 08 12:04:48 user nova-compute[74840]:     <mode name='host-passthrough' supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='hostPassthroughMigratable'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>on</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>off</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </mode>
Nov 08 12:04:48 user nova-compute[74840]:     <mode name='maximum' supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='maximumMigratable'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>on</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>off</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </mode>
Nov 08 12:04:48 user nova-compute[74840]:     <mode name='host-model' supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <vendor>Intel</vendor>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='ss'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='vmx'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='pcid'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='hypervisor'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='arat'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='umip'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='md-clear'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='stibp'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='ssbd'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='invtsc'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='ibpb'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='ibrs'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='amd-stibp'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='rsba'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='pschange-mc-no'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='disable' name='erms'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 12:04:48 user nova-compute[74840]:     </mode>
Nov 08 12:04:48 user nova-compute[74840]:     <mode name='custom' supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>qemu64</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>qemu32</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>phenom</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>pentium3</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>pentium2</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>pentium</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>n270</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>kvm64</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>kvm32</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>coreduo</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>core2duo</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>athlon</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>Westmere-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>Westmere</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Snowridge</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Skylake-Server</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Skylake-Client</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>SandyBridge</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>Penryn</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Opteron_G5</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Opteron_G4</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Opteron_G3</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Opteron_G2</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>Opteron_G1</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>Nehalem</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>IvyBridge</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Icelake-Server</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Haswell</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>EPYC-Rome</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>EPYC-Milan</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>EPYC</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Dhyana</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Cooperlake</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>Conroe</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Broadwell</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>486</model>
Nov 08 12:04:48 user nova-compute[74840]:     </mode>
Nov 08 12:04:48 user nova-compute[74840]:   </cpu>
Nov 08 12:04:48 user nova-compute[74840]:   <memoryBacking supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:     <enum name='sourceType'>
Nov 08 12:04:48 user nova-compute[74840]:       <value>file</value>
Nov 08 12:04:48 user nova-compute[74840]:       <value>anonymous</value>
Nov 08 12:04:48 user nova-compute[74840]:       <value>memfd</value>
Nov 08 12:04:48 user nova-compute[74840]:     </enum>
Nov 08 12:04:48 user nova-compute[74840]:   </memoryBacking>
Nov 08 12:04:48 user nova-compute[74840]:   <devices>
Nov 08 12:04:48 user nova-compute[74840]:     <disk supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='diskDevice'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>disk</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>cdrom</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>floppy</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>lun</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='bus'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>ide</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>fdc</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>scsi</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>usb</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>sata</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='model'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio-transitional</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio-non-transitional</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </disk>
Nov 08 12:04:48 user nova-compute[74840]:     <graphics supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='type'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>sdl</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>vnc</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>spice</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>egl-headless</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </graphics>
Nov 08 12:04:48 user nova-compute[74840]:     <video supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='modelType'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>vga</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>cirrus</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>vmvga</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>qxl</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>none</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>bochs</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>ramfb</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </video>
Nov 08 12:04:48 user nova-compute[74840]:     <hostdev supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='mode'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>subsystem</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='startupPolicy'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>default</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>mandatory</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>requisite</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>optional</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='subsysType'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>usb</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>pci</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>scsi</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='capsType'/>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='pciBackend'/>
Nov 08 12:04:48 user nova-compute[74840]:     </hostdev>
Nov 08 12:04:48 user nova-compute[74840]:     <rng supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='model'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio-transitional</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio-non-transitional</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='backendModel'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>random</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>egd</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>builtin</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </rng>
Nov 08 12:04:48 user nova-compute[74840]:     <filesystem supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='driverType'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>path</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>handle</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtiofs</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </filesystem>
Nov 08 12:04:48 user nova-compute[74840]:     <tpm supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='model'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>tpm-tis</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>tpm-crb</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='backendModel'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>passthrough</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>emulator</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </tpm>
Nov 08 12:04:48 user nova-compute[74840]:   </devices>
Nov 08 12:04:48 user nova-compute[74840]:   <features>
Nov 08 12:04:48 user nova-compute[74840]:     <gic supported='no'/>
Nov 08 12:04:48 user nova-compute[74840]:     <vmcoreinfo supported='yes'/>
Nov 08 12:04:48 user nova-compute[74840]:     <genid supported='yes'/>
Nov 08 12:04:48 user nova-compute[74840]:     <backingStoreInput supported='yes'/>
Nov 08 12:04:48 user nova-compute[74840]:     <backup supported='yes'/>
Nov 08 12:04:48 user nova-compute[74840]:     <sev supported='no'/>
Nov 08 12:04:48 user nova-compute[74840]:   </features>
Nov 08 12:04:48 user nova-compute[74840]: </domainCapabilities>
Nov 08 12:04:48 user nova-compute[74840]:  {{(pid=74840) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 08 12:04:48 user nova-compute[74840]: <domainCapabilities>
Nov 08 12:04:48 user nova-compute[74840]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 08 12:04:48 user nova-compute[74840]:   <domain>kvm</domain>
Nov 08 12:04:48 user nova-compute[74840]:   <machine>pc-i440fx-6.2</machine>
Nov 08 12:04:48 user nova-compute[74840]:   <arch>x86_64</arch>
Nov 08 12:04:48 user nova-compute[74840]:   <vcpu max='255'/>
Nov 08 12:04:48 user nova-compute[74840]:   <iothreads supported='yes'/>
Nov 08 12:04:48 user nova-compute[74840]:   <os supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:     <enum name='firmware'>
Nov 08 12:04:48 user nova-compute[74840]:       <value>efi</value>
Nov 08 12:04:48 user nova-compute[74840]:     </enum>
Nov 08 12:04:48 user nova-compute[74840]:     <loader supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='type'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>rom</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>pflash</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='readonly'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>yes</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>no</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='secure'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>no</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </loader>
Nov 08 12:04:48 user nova-compute[74840]:   </os>
Nov 08 12:04:48 user nova-compute[74840]:   <cpu>
Nov 08 12:04:48 user nova-compute[74840]:     <mode name='host-passthrough' supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='hostPassthroughMigratable'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>on</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>off</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </mode>
Nov 08 12:04:48 user nova-compute[74840]:     <mode name='maximum' supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='maximumMigratable'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>on</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>off</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </mode>
Nov 08 12:04:48 user nova-compute[74840]:     <mode name='host-model' supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <vendor>Intel</vendor>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='ss'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='vmx'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='pcid'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='hypervisor'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='arat'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='umip'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='md-clear'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='stibp'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='ssbd'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='invtsc'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='ibpb'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='ibrs'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='amd-stibp'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='rsba'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='pschange-mc-no'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='disable' name='erms'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 12:04:48 user nova-compute[74840]:     </mode>
Nov 08 12:04:48 user nova-compute[74840]:     <mode name='custom' supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>qemu64</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>qemu32</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>phenom</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>pentium3</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>pentium2</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>pentium</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>n270</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>kvm64</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>kvm32</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>coreduo</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>core2duo</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>athlon</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>Westmere-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>Westmere</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Snowridge</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Skylake-Server</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Skylake-Client</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>SandyBridge</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>Penryn</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Opteron_G5</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Opteron_G4</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Opteron_G3</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Opteron_G2</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>Opteron_G1</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>Nehalem</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>IvyBridge</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Icelake-Server</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Haswell</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>EPYC-Rome</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>EPYC-Milan</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>EPYC</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Dhyana</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Cooperlake</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>Conroe</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Broadwell</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>486</model>
Nov 08 12:04:48 user nova-compute[74840]:     </mode>
Nov 08 12:04:48 user nova-compute[74840]:   </cpu>
Nov 08 12:04:48 user nova-compute[74840]:   <memoryBacking supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:     <enum name='sourceType'>
Nov 08 12:04:48 user nova-compute[74840]:       <value>file</value>
Nov 08 12:04:48 user nova-compute[74840]:       <value>anonymous</value>
Nov 08 12:04:48 user nova-compute[74840]:       <value>memfd</value>
Nov 08 12:04:48 user nova-compute[74840]:     </enum>
Nov 08 12:04:48 user nova-compute[74840]:   </memoryBacking>
Nov 08 12:04:48 user nova-compute[74840]:   <devices>
Nov 08 12:04:48 user nova-compute[74840]:     <disk supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='diskDevice'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>disk</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>cdrom</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>floppy</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>lun</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='bus'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>ide</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>fdc</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>scsi</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>usb</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>sata</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='model'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio-transitional</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio-non-transitional</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </disk>
Nov 08 12:04:48 user nova-compute[74840]:     <graphics supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='type'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>sdl</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>vnc</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>spice</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>egl-headless</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </graphics>
Nov 08 12:04:48 user nova-compute[74840]:     <video supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='modelType'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>vga</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>cirrus</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>vmvga</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>qxl</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>none</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>bochs</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>ramfb</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </video>
Nov 08 12:04:48 user nova-compute[74840]:     <hostdev supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='mode'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>subsystem</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='startupPolicy'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>default</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>mandatory</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>requisite</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>optional</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='subsysType'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>usb</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>pci</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>scsi</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='capsType'/>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='pciBackend'/>
Nov 08 12:04:48 user nova-compute[74840]:     </hostdev>
Nov 08 12:04:48 user nova-compute[74840]:     <rng supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='model'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio-transitional</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio-non-transitional</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='backendModel'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>random</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>egd</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>builtin</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </rng>
Nov 08 12:04:48 user nova-compute[74840]:     <filesystem supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='driverType'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>path</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>handle</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtiofs</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </filesystem>
Nov 08 12:04:48 user nova-compute[74840]:     <tpm supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='model'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>tpm-tis</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>tpm-crb</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='backendModel'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>passthrough</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>emulator</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </tpm>
Nov 08 12:04:48 user nova-compute[74840]:   </devices>
Nov 08 12:04:48 user nova-compute[74840]:   <features>
Nov 08 12:04:48 user nova-compute[74840]:     <gic supported='no'/>
Nov 08 12:04:48 user nova-compute[74840]:     <vmcoreinfo supported='yes'/>
Nov 08 12:04:48 user nova-compute[74840]:     <genid supported='yes'/>
Nov 08 12:04:48 user nova-compute[74840]:     <backingStoreInput supported='yes'/>
Nov 08 12:04:48 user nova-compute[74840]:     <backup supported='yes'/>
Nov 08 12:04:48 user nova-compute[74840]:     <sev supported='no'/>
Nov 08 12:04:48 user nova-compute[74840]:   </features>
Nov 08 12:04:48 user nova-compute[74840]: </domainCapabilities>
Nov 08 12:04:48 user nova-compute[74840]:  {{(pid=74840) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 08 12:04:48 user nova-compute[74840]: <domainCapabilities>
Nov 08 12:04:48 user nova-compute[74840]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 08 12:04:48 user nova-compute[74840]:   <domain>kvm</domain>
Nov 08 12:04:48 user nova-compute[74840]:   <machine>pc-q35-6.2</machine>
Nov 08 12:04:48 user nova-compute[74840]:   <arch>x86_64</arch>
Nov 08 12:04:48 user nova-compute[74840]:   <vcpu max='288'/>
Nov 08 12:04:48 user nova-compute[74840]:   <iothreads supported='yes'/>
Nov 08 12:04:48 user nova-compute[74840]:   <os supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:     <enum name='firmware'>
Nov 08 12:04:48 user nova-compute[74840]:       <value>efi</value>
Nov 08 12:04:48 user nova-compute[74840]:     </enum>
Nov 08 12:04:48 user nova-compute[74840]:     <loader supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 08 12:04:48 user nova-compute[74840]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 08 12:04:48 user nova-compute[74840]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='type'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>rom</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>pflash</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='readonly'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>yes</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>no</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='secure'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>yes</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>no</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </loader>
Nov 08 12:04:48 user nova-compute[74840]:   </os>
Nov 08 12:04:48 user nova-compute[74840]:   <cpu>
Nov 08 12:04:48 user nova-compute[74840]:     <mode name='host-passthrough' supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='hostPassthroughMigratable'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>on</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>off</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </mode>
Nov 08 12:04:48 user nova-compute[74840]:     <mode name='maximum' supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='maximumMigratable'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>on</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>off</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </mode>
Nov 08 12:04:48 user nova-compute[74840]:     <mode name='host-model' supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <vendor>Intel</vendor>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='ss'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='vmx'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='pcid'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='hypervisor'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='arat'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='umip'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='md-clear'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='stibp'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='ssbd'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='invtsc'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='ibpb'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='ibrs'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='amd-stibp'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='rsba'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='require' name='pschange-mc-no'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='disable' name='erms'/>
Nov 08 12:04:48 user nova-compute[74840]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 12:04:48 user nova-compute[74840]:     </mode>
Nov 08 12:04:48 user nova-compute[74840]:     <mode name='custom' supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>qemu64</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>qemu32</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>phenom</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>pentium3</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>pentium2</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>pentium</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>n270</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>kvm64</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>kvm32</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>coreduo</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>core2duo</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>athlon</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>Westmere-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>Westmere</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Snowridge</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Skylake-Server</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Skylake-Client</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>SandyBridge</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>Penryn</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Opteron_G5</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Opteron_G4</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Opteron_G3</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Opteron_G2</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>Opteron_G1</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>Nehalem</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>IvyBridge</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Icelake-Server</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Haswell</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>EPYC-Rome</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>EPYC-Milan</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>EPYC</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Dhyana</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Cooperlake</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>Conroe</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='no'>Broadwell</model>
Nov 08 12:04:48 user nova-compute[74840]:       <model usable='yes'>486</model>
Nov 08 12:04:48 user nova-compute[74840]:     </mode>
Nov 08 12:04:48 user nova-compute[74840]:   </cpu>
Nov 08 12:04:48 user nova-compute[74840]:   <memoryBacking supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:     <enum name='sourceType'>
Nov 08 12:04:48 user nova-compute[74840]:       <value>file</value>
Nov 08 12:04:48 user nova-compute[74840]:       <value>anonymous</value>
Nov 08 12:04:48 user nova-compute[74840]:       <value>memfd</value>
Nov 08 12:04:48 user nova-compute[74840]:     </enum>
Nov 08 12:04:48 user nova-compute[74840]:   </memoryBacking>
Nov 08 12:04:48 user nova-compute[74840]:   <devices>
Nov 08 12:04:48 user nova-compute[74840]:     <disk supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='diskDevice'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>disk</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>cdrom</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>floppy</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>lun</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='bus'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>fdc</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>scsi</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>usb</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>sata</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='model'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio-transitional</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio-non-transitional</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </disk>
Nov 08 12:04:48 user nova-compute[74840]:     <graphics supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='type'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>sdl</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>vnc</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>spice</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>egl-headless</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </graphics>
Nov 08 12:04:48 user nova-compute[74840]:     <video supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='modelType'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>vga</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>cirrus</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>vmvga</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>qxl</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>none</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>bochs</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>ramfb</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </video>
Nov 08 12:04:48 user nova-compute[74840]:     <hostdev supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='mode'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>subsystem</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='startupPolicy'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>default</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>mandatory</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>requisite</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>optional</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='subsysType'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>usb</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>pci</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>scsi</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='capsType'/>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='pciBackend'/>
Nov 08 12:04:48 user nova-compute[74840]:     </hostdev>
Nov 08 12:04:48 user nova-compute[74840]:     <rng supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='model'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio-transitional</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtio-non-transitional</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='backendModel'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>random</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>egd</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>builtin</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </rng>
Nov 08 12:04:48 user nova-compute[74840]:     <filesystem supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='driverType'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>path</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>handle</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>virtiofs</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </filesystem>
Nov 08 12:04:48 user nova-compute[74840]:     <tpm supported='yes'>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='model'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>tpm-tis</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>tpm-crb</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:       <enum name='backendModel'>
Nov 08 12:04:48 user nova-compute[74840]:         <value>passthrough</value>
Nov 08 12:04:48 user nova-compute[74840]:         <value>emulator</value>
Nov 08 12:04:48 user nova-compute[74840]:       </enum>
Nov 08 12:04:48 user nova-compute[74840]:     </tpm>
Nov 08 12:04:48 user nova-compute[74840]:   </devices>
Nov 08 12:04:48 user nova-compute[74840]:   <features>
Nov 08 12:04:48 user nova-compute[74840]:     <gic supported='no'/>
Nov 08 12:04:48 user nova-compute[74840]:     <vmcoreinfo supported='yes'/>
Nov 08 12:04:48 user nova-compute[74840]:     <genid supported='yes'/>
Nov 08 12:04:48 user nova-compute[74840]:     <backingStoreInput supported='yes'/>
Nov 08 12:04:48 user nova-compute[74840]:     <backup supported='yes'/>
Nov 08 12:04:48 user nova-compute[74840]:     <sev supported='no'/>
Nov 08 12:04:48 user nova-compute[74840]:   </features>
Nov 08 12:04:48 user nova-compute[74840]: </domainCapabilities>
Nov 08 12:04:48 user nova-compute[74840]:  {{(pid=74840) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74840) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74840) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74840) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74840) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Checking secure boot support for host arch (x86_64) {{(pid=74840) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 08 12:04:48 user nova-compute[74840]: INFO nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Secure Boot support detected
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] cpu compare xml: <cpu match="exact">
Nov 08 12:04:48 user nova-compute[74840]:   <model>Nehalem</model>
Nov 08 12:04:48 user nova-compute[74840]: </cpu>
Nov 08 12:04:48 user nova-compute[74840]:  {{(pid=74840) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 08 12:04:48 user nova-compute[74840]: INFO nova.virt.node [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Generated node identity 74d527b3-4704-47dd-ab76-ffd69ef9a25e
Nov 08 12:04:48 user nova-compute[74840]: INFO nova.virt.node [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Wrote node identity 74d527b3-4704-47dd-ab76-ffd69ef9a25e to /opt/stack/data/nova/compute_id
Nov 08 12:04:48 user nova-compute[74840]: WARNING nova.compute.manager [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Compute nodes ['74d527b3-4704-47dd-ab76-ffd69ef9a25e'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 08 12:04:48 user nova-compute[74840]: INFO nova.compute.manager [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 08 12:04:48 user nova-compute[74840]: WARNING nova.compute.manager [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 08 12:04:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:04:48 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:04:49 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:04:49 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:04:49 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Hypervisor/Node resource view: name=user free_ram=10932MB free_disk=26.013202667236328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:04:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:04:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:04:49 user nova-compute[74840]: WARNING nova.compute.resource_tracker [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] No compute node record for user:74d527b3-4704-47dd-ab76-ffd69ef9a25e: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 74d527b3-4704-47dd-ab76-ffd69ef9a25e could not be found.
Nov 08 12:04:49 user nova-compute[74840]: INFO nova.compute.resource_tracker [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Compute node record created for user:user with uuid: 74d527b3-4704-47dd-ab76-ffd69ef9a25e
Nov 08 12:04:49 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:04:49 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:04:49 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] [req-9cd86acb-859e-48d8-9201-345418db64bd] Created resource provider record via placement API for resource provider with UUID 74d527b3-4704-47dd-ab76-ffd69ef9a25e and name user.
Nov 08 12:04:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74840) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 08 12:04:49 user nova-compute[74840]: INFO nova.virt.libvirt.host [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] kernel doesn't support AMD SEV
Nov 08 12:04:49 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Updating inventory in ProviderTree for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 12:04:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:04:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Libvirt baseline CPU <cpu>
Nov 08 12:04:49 user nova-compute[74840]:   <arch>x86_64</arch>
Nov 08 12:04:49 user nova-compute[74840]:   <model>Nehalem</model>
Nov 08 12:04:49 user nova-compute[74840]:   <vendor>Intel</vendor>
Nov 08 12:04:49 user nova-compute[74840]:   <topology sockets="6" cores="1" threads="1"/>
Nov 08 12:04:49 user nova-compute[74840]: </cpu>
Nov 08 12:04:49 user nova-compute[74840]:  {{(pid=74840) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 08 12:04:49 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Updated inventory for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 08 12:04:49 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Updating resource provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e generation from 0 to 1 during operation: update_inventory {{(pid=74840) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 08 12:04:49 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Updating inventory in ProviderTree for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 12:04:49 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Updating resource provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e generation from 1 to 2 during operation: update_traits {{(pid=74840) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 08 12:04:49 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:04:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.594s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:04:49 user nova-compute[74840]: DEBUG nova.service [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Creating RPC server for service compute {{(pid=74840) start /opt/stack/nova/nova/service.py:182}}
Nov 08 12:04:49 user nova-compute[74840]: DEBUG nova.service [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] Join ServiceGroup membership for this service compute {{(pid=74840) start /opt/stack/nova/nova/service.py:199}}
Nov 08 12:04:49 user nova-compute[74840]: DEBUG nova.servicegroup.drivers.db [None req-83caf3ce-e442-483f-8391-9cfc2346287a None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74840) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 08 12:05:04 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:05:04 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:05:40 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:05:40 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:05:40 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:05:40 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Rebuilding the list of instances to heal {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 12:05:40 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Didn't find any instances for network info cache update. {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 12:05:40 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:05:40 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:05:40 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:05:40 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:05:40 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:05:40 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:05:40 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:05:40 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:05:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:05:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:05:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:05:40 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:05:41 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:05:41 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:05:41 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=10379MB free_disk=25.91708755493164GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:05:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:05:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:05:41 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:05:41 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:05:41 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:05:41 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:05:41 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:05:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.142s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:06:41 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:06:41 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:06:41 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:06:41 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:06:41 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:06:41 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:06:41 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:06:41 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Rebuilding the list of instances to heal {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 12:06:41 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Didn't find any instances for network info cache update. {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 12:06:41 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:06:41 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:06:41 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:06:42 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:06:42 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:06:42 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:06:42 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:06:42 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:06:42 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:06:42 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:06:42 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:06:42 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=10319MB free_disk=25.970260620117188GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:06:42 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:06:42 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:06:43 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:06:43 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:06:43 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:06:43 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:06:43 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:06:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.145s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:07:41 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:07:41 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:07:41 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:07:41 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Rebuilding the list of instances to heal {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 12:07:41 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Didn't find any instances for network info cache update. {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 12:07:41 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:07:41 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:07:42 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:07:42 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:07:42 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:07:42 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:07:42 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:07:42 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:07:42 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:07:42 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:07:42 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:07:42 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:07:42 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=10349MB free_disk=25.733856201171875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:07:42 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:07:42 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:07:43 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:07:43 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:07:43 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:07:43 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:07:43 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:07:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.103s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:07:44 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:07:44 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:08:40 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:08:42 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:08:42 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:08:42 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Rebuilding the list of instances to heal {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 12:08:42 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Didn't find any instances for network info cache update. {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 12:08:42 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:08:42 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:08:42 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:08:43 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:08:43 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:08:44 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:08:44 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:08:44 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:08:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:08:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:08:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:08:44 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:08:45 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:08:45 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:08:45 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=9545MB free_disk=25.75274658203125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:08:45 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:08:45 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:08:45 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 43eae335-a4a0-40b2-8cd4-c7881cd397b1 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 08 12:08:45 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:08:45 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:08:45 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "43eae335-a4a0-40b2-8cd4-c7881cd397b1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:08:45 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "43eae335-a4a0-40b2-8cd4-c7881cd397b1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:08:45 user nova-compute[74840]: DEBUG nova.compute.manager [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Starting instance... {{(pid=74840) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 12:08:45 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:08:45 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:08:45 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:08:45 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.263s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:08:45 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:08:45 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:08:45 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:08:45 user nova-compute[74840]: INFO nova.compute.claims [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Claim successful on node user
Nov 08 12:08:46 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:08:46 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:08:46 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.620s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:08:46 user nova-compute[74840]: DEBUG nova.compute.manager [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Start building networks asynchronously for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 12:08:46 user nova-compute[74840]: DEBUG nova.compute.manager [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Allocating IP information in the background. {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 12:08:46 user nova-compute[74840]: DEBUG nova.network.neutron [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 12:08:46 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 12:08:46 user nova-compute[74840]: DEBUG nova.compute.manager [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Start building block device mappings for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 12:08:46 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:08:46 user nova-compute[74840]: DEBUG nova.compute.manager [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Start spawning the instance on the hypervisor. {{(pid=74840) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 12:08:46 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:08:46 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Creating image(s)
Nov 08 12:08:46 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "/opt/stack/data/nova/instances/43eae335-a4a0-40b2-8cd4-c7881cd397b1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:08:46 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "/opt/stack/data/nova/instances/43eae335-a4a0-40b2-8cd4-c7881cd397b1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:08:46 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "/opt/stack/data/nova/instances/43eae335-a4a0-40b2-8cd4-c7881cd397b1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:08:46 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "5d26578eba85497f494c575690c4248f381a0fe6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:08:46 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:08:46 user nova-compute[74840]: DEBUG nova.policy [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e172625e7f334a2b896b2738bbf49aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec082e08ddf4477a721e410fe944d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 12:08:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6.part --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:08:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6.part --force-share --output=json" returned: 0 in 0.161s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:08:47 user nova-compute[74840]: DEBUG nova.virt.images [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] 4fa17706-d304-4117-a420-dab994c703dc was qcow2, converting to raw {{(pid=74840) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 12:08:47 user nova-compute[74840]: DEBUG nova.privsep.utils [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74840) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 12:08:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6.part /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6.converted {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:08:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6.part /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6.converted" returned: 0 in 0.229s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:08:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6.converted --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:08:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6.converted --force-share --output=json" returned: 0 in 0.171s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:08:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.583s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:08:48 user nova-compute[74840]: INFO oslo.privsep.daemon [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpqgqja2r3/privsep.sock']
Nov 08 12:08:48 user sudo[84073]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpqgqja2r3/privsep.sock
Nov 08 12:08:48 user sudo[84073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 08 12:08:48 user nova-compute[74840]: DEBUG nova.network.neutron [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Successfully created port: fb33b08e-aef7-4999-9121-3caf5d027586 {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:08:49 user sudo[84073]: pam_unix(sudo:session): session closed for user root
Nov 08 12:08:49 user nova-compute[74840]: INFO oslo.privsep.daemon [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Spawned new privsep daemon via rootwrap
Nov 08 12:08:49 user nova-compute[74840]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 08 12:08:49 user nova-compute[74840]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 08 12:08:49 user nova-compute[74840]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 08 12:08:49 user nova-compute[74840]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84078
Nov 08 12:08:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:08:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.219s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:08:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "5d26578eba85497f494c575690c4248f381a0fe6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:08:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:08:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:08:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.200s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:08:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/43eae335-a4a0-40b2-8cd4-c7881cd397b1/disk 1073741824 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:08:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/43eae335-a4a0-40b2-8cd4-c7881cd397b1/disk 1073741824" returned: 0 in 0.052s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:08:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:08:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:08:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.192s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:08:50 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Checking if we can resize image /opt/stack/data/nova/instances/43eae335-a4a0-40b2-8cd4-c7881cd397b1/disk. size=1073741824 {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 12:08:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43eae335-a4a0-40b2-8cd4-c7881cd397b1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:08:50 user nova-compute[74840]: DEBUG nova.network.neutron [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Successfully updated port: fb33b08e-aef7-4999-9121-3caf5d027586 {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:08:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "refresh_cache-43eae335-a4a0-40b2-8cd4-c7881cd397b1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:08:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquired lock "refresh_cache-43eae335-a4a0-40b2-8cd4-c7881cd397b1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:08:50 user nova-compute[74840]: DEBUG nova.network.neutron [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:08:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43eae335-a4a0-40b2-8cd4-c7881cd397b1/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:08:50 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Cannot resize image /opt/stack/data/nova/instances/43eae335-a4a0-40b2-8cd4-c7881cd397b1/disk to a smaller size. {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 12:08:50 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Created local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 12:08:50 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Ensure instance console log exists: /opt/stack/data/nova/instances/43eae335-a4a0-40b2-8cd4-c7881cd397b1/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:08:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:08:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:08:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:08:50 user nova-compute[74840]: DEBUG nova.network.neutron [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:08:51 user nova-compute[74840]: DEBUG nova.compute.manager [req-a37f85a7-c70c-41da-81b9-155b5ee46cf9 req-4c67ad49-fd8a-4535-a9b1-e54470bf82e7 service nova] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Received event network-changed-fb33b08e-aef7-4999-9121-3caf5d027586 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:08:51 user nova-compute[74840]: DEBUG nova.compute.manager [req-a37f85a7-c70c-41da-81b9-155b5ee46cf9 req-4c67ad49-fd8a-4535-a9b1-e54470bf82e7 service nova] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Refreshing instance network info cache due to event network-changed-fb33b08e-aef7-4999-9121-3caf5d027586. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:08:51 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a37f85a7-c70c-41da-81b9-155b5ee46cf9 req-4c67ad49-fd8a-4535-a9b1-e54470bf82e7 service nova] Acquiring lock "refresh_cache-43eae335-a4a0-40b2-8cd4-c7881cd397b1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:08:52 user nova-compute[74840]: DEBUG nova.network.neutron [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Updating instance_info_cache with network_info: [{"id": "fb33b08e-aef7-4999-9121-3caf5d027586", "address": "fa:16:3e:8f:c3:d6", "network": {"id": "381cad9f-376a-4335-95a4-4824aa0d7fad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1035058856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ec082e08ddf4477a721e410fe944d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb33b08e-ae", "ovs_interfaceid": "fb33b08e-aef7-4999-9121-3caf5d027586", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:08:52 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Releasing lock "refresh_cache-43eae335-a4a0-40b2-8cd4-c7881cd397b1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:08:52 user nova-compute[74840]: DEBUG nova.compute.manager [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Instance network_info: |[{"id": "fb33b08e-aef7-4999-9121-3caf5d027586", "address": "fa:16:3e:8f:c3:d6", "network": {"id": "381cad9f-376a-4335-95a4-4824aa0d7fad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1035058856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ec082e08ddf4477a721e410fe944d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb33b08e-ae", "ovs_interfaceid": "fb33b08e-aef7-4999-9121-3caf5d027586", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 12:08:52 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a37f85a7-c70c-41da-81b9-155b5ee46cf9 req-4c67ad49-fd8a-4535-a9b1-e54470bf82e7 service nova] Acquired lock "refresh_cache-43eae335-a4a0-40b2-8cd4-c7881cd397b1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:08:52 user nova-compute[74840]: DEBUG nova.network.neutron [req-a37f85a7-c70c-41da-81b9-155b5ee46cf9 req-4c67ad49-fd8a-4535-a9b1-e54470bf82e7 service nova] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Refreshing network info cache for port fb33b08e-aef7-4999-9121-3caf5d027586 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:08:52 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Start _get_guest_xml network_info=[{"id": "fb33b08e-aef7-4999-9121-3caf5d027586", "address": "fa:16:3e:8f:c3:d6", "network": {"id": "381cad9f-376a-4335-95a4-4824aa0d7fad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1035058856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ec082e08ddf4477a721e410fe944d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb33b08e-ae", "ovs_interfaceid": "fb33b08e-aef7-4999-9121-3caf5d027586", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'image_id': '4fa17706-d304-4117-a420-dab994c703dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:08:52 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:08:52 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:08:52 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:08:52 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:08:52 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:08:52 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:08:52 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:08:52 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:08:52 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:08:52 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:08:52 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:08:52 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:08:52 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:08:52 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:08:52 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:08:52 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:08:52 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:08:52 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:08:52 user nova-compute[74840]: DEBUG nova.privsep.utils [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74840) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 12:08:52 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:08:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1315362065',display_name='tempest-AttachVolumeNegativeTest-server-1315362065',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1315362065',id=1,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFreICnbAFizKKslyGfEnjFmW5UGlVQkC9XWYCjb5jOtF+PG6Az7MQ838BlFrTrlGesqyu/zhTSCVQmT+nxhs8fxB71Cnu/BA2xHDhU07/9nMYSkFkHKFetOeH7B2IbW7A==',key_name='tempest-keypair-1354977390',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ec082e08ddf4477a721e410fe944d10',ramdisk_id='',reservation_id='r-px3ivrur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1526881991',owner_user_name='tempest-AttachVolumeNegativeTest-1526881991-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:08:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e172625e7f334a2b896b2738bbf49aa8',uuid=43eae335-a4a0-40b2-8cd4-c7881cd397b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb33b08e-aef7-4999-9121-3caf5d027586", "address": "fa:16:3e:8f:c3:d6", "network": {"id": "381cad9f-376a-4335-95a4-4824aa0d7fad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1035058856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ec082e08ddf4477a721e410fe944d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb33b08e-ae", "ovs_interfaceid": "fb33b08e-aef7-4999-9121-3caf5d027586", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:08:52 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Converting VIF {"id": "fb33b08e-aef7-4999-9121-3caf5d027586", "address": "fa:16:3e:8f:c3:d6", "network": {"id": "381cad9f-376a-4335-95a4-4824aa0d7fad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1035058856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ec082e08ddf4477a721e410fe944d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb33b08e-ae", "ovs_interfaceid": "fb33b08e-aef7-4999-9121-3caf5d027586", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:08:52 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:c3:d6,bridge_name='br-int',has_traffic_filtering=True,id=fb33b08e-aef7-4999-9121-3caf5d027586,network=Network(381cad9f-376a-4335-95a4-4824aa0d7fad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb33b08e-ae') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:08:52 user nova-compute[74840]: DEBUG nova.objects.instance [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lazy-loading 'pci_devices' on Instance uuid 43eae335-a4a0-40b2-8cd4-c7881cd397b1 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:08:52 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:08:52 user nova-compute[74840]:   <uuid>43eae335-a4a0-40b2-8cd4-c7881cd397b1</uuid>
Nov 08 12:08:52 user nova-compute[74840]:   <name>instance-00000001</name>
Nov 08 12:08:52 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:08:52 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:08:52 user nova-compute[74840]:   <metadata>
Nov 08 12:08:52 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:08:52 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:08:52 user nova-compute[74840]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1315362065</nova:name>
Nov 08 12:08:52 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:08:52</nova:creationTime>
Nov 08 12:08:52 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:08:52 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:08:52 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:08:52 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:08:52 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:08:52 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:08:52 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:08:52 user nova-compute[74840]:       <nova:owner>
Nov 08 12:08:52 user nova-compute[74840]:         <nova:user uuid="e172625e7f334a2b896b2738bbf49aa8">tempest-AttachVolumeNegativeTest-1526881991-project-member</nova:user>
Nov 08 12:08:52 user nova-compute[74840]:         <nova:project uuid="3ec082e08ddf4477a721e410fe944d10">tempest-AttachVolumeNegativeTest-1526881991</nova:project>
Nov 08 12:08:52 user nova-compute[74840]:       </nova:owner>
Nov 08 12:08:52 user nova-compute[74840]:       <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:08:52 user nova-compute[74840]:       <nova:ports>
Nov 08 12:08:52 user nova-compute[74840]:         <nova:port uuid="fb33b08e-aef7-4999-9121-3caf5d027586">
Nov 08 12:08:52 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 12:08:52 user nova-compute[74840]:         </nova:port>
Nov 08 12:08:52 user nova-compute[74840]:       </nova:ports>
Nov 08 12:08:52 user nova-compute[74840]:     </nova:instance>
Nov 08 12:08:52 user nova-compute[74840]:   </metadata>
Nov 08 12:08:52 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:08:52 user nova-compute[74840]:     <system>
Nov 08 12:08:52 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:08:52 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:08:52 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:08:52 user nova-compute[74840]:       <entry name="serial">43eae335-a4a0-40b2-8cd4-c7881cd397b1</entry>
Nov 08 12:08:52 user nova-compute[74840]:       <entry name="uuid">43eae335-a4a0-40b2-8cd4-c7881cd397b1</entry>
Nov 08 12:08:52 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:08:52 user nova-compute[74840]:     </system>
Nov 08 12:08:52 user nova-compute[74840]:   </sysinfo>
Nov 08 12:08:52 user nova-compute[74840]:   <os>
Nov 08 12:08:52 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:08:52 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:08:52 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:08:52 user nova-compute[74840]:   </os>
Nov 08 12:08:52 user nova-compute[74840]:   <features>
Nov 08 12:08:52 user nova-compute[74840]:     <acpi/>
Nov 08 12:08:52 user nova-compute[74840]:     <apic/>
Nov 08 12:08:52 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:08:52 user nova-compute[74840]:   </features>
Nov 08 12:08:52 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:08:52 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:08:52 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:08:52 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:08:52 user nova-compute[74840]:   </clock>
Nov 08 12:08:52 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:08:52 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:08:52 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:08:52 user nova-compute[74840]:   </cpu>
Nov 08 12:08:52 user nova-compute[74840]:   <devices>
Nov 08 12:08:52 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:08:52 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:08:52 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/43eae335-a4a0-40b2-8cd4-c7881cd397b1/disk"/>
Nov 08 12:08:52 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:08:52 user nova-compute[74840]:     </disk>
Nov 08 12:08:52 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:08:52 user nova-compute[74840]:       <mac address="fa:16:3e:8f:c3:d6"/>
Nov 08 12:08:52 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:08:52 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:08:52 user nova-compute[74840]:       <target dev="tapfb33b08e-ae"/>
Nov 08 12:08:52 user nova-compute[74840]:     </interface>
Nov 08 12:08:52 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:08:52 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/43eae335-a4a0-40b2-8cd4-c7881cd397b1/console.log" append="off"/>
Nov 08 12:08:52 user nova-compute[74840]:     </serial>
Nov 08 12:08:52 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:08:52 user nova-compute[74840]:     <video>
Nov 08 12:08:52 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:08:52 user nova-compute[74840]:     </video>
Nov 08 12:08:52 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:08:52 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:08:52 user nova-compute[74840]:     </rng>
Nov 08 12:08:52 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:08:52 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:08:52 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:08:52 user nova-compute[74840]:     </memballoon>
Nov 08 12:08:52 user nova-compute[74840]:   </devices>
Nov 08 12:08:52 user nova-compute[74840]: </domain>
Nov 08 12:08:52 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:08:52 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:08:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1315362065',display_name='tempest-AttachVolumeNegativeTest-server-1315362065',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1315362065',id=1,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFreICnbAFizKKslyGfEnjFmW5UGlVQkC9XWYCjb5jOtF+PG6Az7MQ838BlFrTrlGesqyu/zhTSCVQmT+nxhs8fxB71Cnu/BA2xHDhU07/9nMYSkFkHKFetOeH7B2IbW7A==',key_name='tempest-keypair-1354977390',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ec082e08ddf4477a721e410fe944d10',ramdisk_id='',reservation_id='r-px3ivrur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1526881991',owner_user_name='tempest-AttachVolumeNegativeTest-1526881991-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:08:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e172625e7f334a2b896b2738bbf49aa8',uuid=43eae335-a4a0-40b2-8cd4-c7881cd397b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb33b08e-aef7-4999-9121-3caf5d027586", "address": "fa:16:3e:8f:c3:d6", "network": {"id": "381cad9f-376a-4335-95a4-4824aa0d7fad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1035058856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ec082e08ddf4477a721e410fe944d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb33b08e-ae", "ovs_interfaceid": "fb33b08e-aef7-4999-9121-3caf5d027586", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:08:52 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Converting VIF {"id": "fb33b08e-aef7-4999-9121-3caf5d027586", "address": "fa:16:3e:8f:c3:d6", "network": {"id": "381cad9f-376a-4335-95a4-4824aa0d7fad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1035058856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ec082e08ddf4477a721e410fe944d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb33b08e-ae", "ovs_interfaceid": "fb33b08e-aef7-4999-9121-3caf5d027586", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:08:52 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:c3:d6,bridge_name='br-int',has_traffic_filtering=True,id=fb33b08e-aef7-4999-9121-3caf5d027586,network=Network(381cad9f-376a-4335-95a4-4824aa0d7fad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb33b08e-ae') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:08:52 user nova-compute[74840]: DEBUG os_vif [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:c3:d6,bridge_name='br-int',has_traffic_filtering=True,id=fb33b08e-aef7-4999-9121-3caf5d027586,network=Network(381cad9f-376a-4335-95a4-4824aa0d7fad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb33b08e-ae') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:08:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Created schema index Interface.name {{(pid=74840) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 08 12:08:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Created schema index Port.name {{(pid=74840) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 08 12:08:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Created schema index Bridge.name {{(pid=74840) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 08 12:08:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:08:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [POLLOUT] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:08:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:08:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:08:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:08:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:08:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:08:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:08:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:08:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:08:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7c3cf73f-7754-506b-be6a-d9fd4a3be7a4', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:08:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:08:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:08:52 user nova-compute[74840]: INFO oslo.privsep.daemon [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmplwi9xvc7/privsep.sock']
Nov 08 12:08:52 user sudo[84096]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmplwi9xvc7/privsep.sock
Nov 08 12:08:52 user sudo[84096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 08 12:08:53 user nova-compute[74840]: DEBUG nova.network.neutron [req-a37f85a7-c70c-41da-81b9-155b5ee46cf9 req-4c67ad49-fd8a-4535-a9b1-e54470bf82e7 service nova] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Updated VIF entry in instance network info cache for port fb33b08e-aef7-4999-9121-3caf5d027586. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:08:53 user nova-compute[74840]: DEBUG nova.network.neutron [req-a37f85a7-c70c-41da-81b9-155b5ee46cf9 req-4c67ad49-fd8a-4535-a9b1-e54470bf82e7 service nova] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Updating instance_info_cache with network_info: [{"id": "fb33b08e-aef7-4999-9121-3caf5d027586", "address": "fa:16:3e:8f:c3:d6", "network": {"id": "381cad9f-376a-4335-95a4-4824aa0d7fad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1035058856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ec082e08ddf4477a721e410fe944d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb33b08e-ae", "ovs_interfaceid": "fb33b08e-aef7-4999-9121-3caf5d027586", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:08:53 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a37f85a7-c70c-41da-81b9-155b5ee46cf9 req-4c67ad49-fd8a-4535-a9b1-e54470bf82e7 service nova] Releasing lock "refresh_cache-43eae335-a4a0-40b2-8cd4-c7881cd397b1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:08:54 user sudo[84096]: pam_unix(sudo:session): session closed for user root
Nov 08 12:08:54 user nova-compute[74840]: INFO oslo.privsep.daemon [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Spawned new privsep daemon via rootwrap
Nov 08 12:08:54 user nova-compute[74840]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 08 12:08:54 user nova-compute[74840]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 08 12:08:54 user nova-compute[74840]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 08 12:08:54 user nova-compute[74840]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84102
Nov 08 12:08:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:08:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb33b08e-ae, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:08:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfb33b08e-ae, col_values=(('qos', UUID('604f0d10-9ce0-4242-9fa7-3f89ade2dbc8')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:08:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfb33b08e-ae, col_values=(('external_ids', {'iface-id': 'fb33b08e-aef7-4999-9121-3caf5d027586', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:c3:d6', 'vm-uuid': '43eae335-a4a0-40b2-8cd4-c7881cd397b1'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:08:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:08:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:08:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:08:55 user nova-compute[74840]: INFO os_vif [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:c3:d6,bridge_name='br-int',has_traffic_filtering=True,id=fb33b08e-aef7-4999-9121-3caf5d027586,network=Network(381cad9f-376a-4335-95a4-4824aa0d7fad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb33b08e-ae')
Nov 08 12:08:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Acquiring lock "9c06ed5e-4b10-44d1-b4b5-faea4dcd6849" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:08:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Lock "9c06ed5e-4b10-44d1-b4b5-faea4dcd6849" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:08:55 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:08:55 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] No VIF found with MAC fa:16:3e:8f:c3:d6, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:08:55 user nova-compute[74840]: DEBUG nova.compute.manager [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Starting instance... {{(pid=74840) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 12:08:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:08:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:08:55 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:08:55 user nova-compute[74840]: INFO nova.compute.claims [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Claim successful on node user
Nov 08 12:08:55 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:08:55 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:08:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:08:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.385s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:08:55 user nova-compute[74840]: DEBUG nova.compute.manager [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Start building networks asynchronously for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 12:08:55 user nova-compute[74840]: DEBUG nova.compute.manager [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Allocating IP information in the background. {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 12:08:55 user nova-compute[74840]: DEBUG nova.network.neutron [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 12:08:56 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 12:08:56 user nova-compute[74840]: DEBUG nova.compute.manager [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Start building block device mappings for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 12:08:56 user nova-compute[74840]: DEBUG nova.compute.manager [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Start spawning the instance on the hypervisor. {{(pid=74840) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 12:08:56 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:08:56 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Creating image(s)
Nov 08 12:08:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Acquiring lock "/opt/stack/data/nova/instances/9c06ed5e-4b10-44d1-b4b5-faea4dcd6849/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:08:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Lock "/opt/stack/data/nova/instances/9c06ed5e-4b10-44d1-b4b5-faea4dcd6849/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:08:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Lock "/opt/stack/data/nova/instances/9c06ed5e-4b10-44d1-b4b5-faea4dcd6849/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:08:56 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:08:56 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.183s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:08:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Acquiring lock "5d26578eba85497f494c575690c4248f381a0fe6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:08:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:08:56 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:08:56 user nova-compute[74840]: DEBUG nova.policy [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '50959a9651d643cfb93a860ef57cbc34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863c5c6a90544832a7a4cad6917978c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 12:08:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:08:56 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.241s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:08:56 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/9c06ed5e-4b10-44d1-b4b5-faea4dcd6849/disk 1073741824 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:08:56 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/9c06ed5e-4b10-44d1-b4b5-faea4dcd6849/disk 1073741824" returned: 0 in 0.060s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:08:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.311s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:08:56 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:08:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:08:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:08:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:08:56 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.237s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:08:56 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9c06ed5e-4b10-44d1-b4b5-faea4dcd6849/disk. size=1073741824 {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 12:08:56 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c06ed5e-4b10-44d1-b4b5-faea4dcd6849/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:08:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:08:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:08:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c06ed5e-4b10-44d1-b4b5-faea4dcd6849/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:08:57 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Cannot resize image /opt/stack/data/nova/instances/9c06ed5e-4b10-44d1-b4b5-faea4dcd6849/disk to a smaller size. {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 12:08:57 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Created local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 12:08:57 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Ensure instance console log exists: /opt/stack/data/nova/instances/9c06ed5e-4b10-44d1-b4b5-faea4dcd6849/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:08:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:08:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:08:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:08:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:08:58 user nova-compute[74840]: DEBUG nova.compute.manager [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:08:58 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:08:59 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Instance spawned successfully.
Nov 08 12:08:59 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:08:59 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:08:59 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Found default for hw_cdrom_bus of ide {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:08:59 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Found default for hw_disk_bus of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:08:59 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:08:59 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:08:59 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Found default for hw_video_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:08:59 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Found default for hw_vif_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:08:59 user nova-compute[74840]: INFO nova.compute.manager [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Took 12.77 seconds to spawn the instance on the hypervisor.
Nov 08 12:08:59 user nova-compute[74840]: DEBUG nova.compute.manager [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:08:59 user nova-compute[74840]: INFO nova.compute.manager [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Took 13.96 seconds to build instance.
Nov 08 12:08:59 user nova-compute[74840]: DEBUG nova.network.neutron [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Successfully created port: 2cc86a4c-4952-4765-831c-a1919e56193f {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:08:59 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1ec404cb-28e9-4872-8cf7-8e757cb9a592 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "43eae335-a4a0-40b2-8cd4-c7881cd397b1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.205s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:09:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:00 user nova-compute[74840]: DEBUG nova.network.neutron [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Successfully updated port: 2cc86a4c-4952-4765-831c-a1919e56193f {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:09:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Acquiring lock "refresh_cache-9c06ed5e-4b10-44d1-b4b5-faea4dcd6849" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:09:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Acquired lock "refresh_cache-9c06ed5e-4b10-44d1-b4b5-faea4dcd6849" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:09:00 user nova-compute[74840]: DEBUG nova.network.neutron [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:09:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:00 user nova-compute[74840]: DEBUG nova.compute.manager [req-26a856d1-06d8-43ec-9f44-c270e64846bd req-a80c60b1-9ea9-4bdc-844a-c4cc9e41b939 service nova] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Received event network-changed-2cc86a4c-4952-4765-831c-a1919e56193f {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:09:00 user nova-compute[74840]: DEBUG nova.compute.manager [req-26a856d1-06d8-43ec-9f44-c270e64846bd req-a80c60b1-9ea9-4bdc-844a-c4cc9e41b939 service nova] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Refreshing instance network info cache due to event network-changed-2cc86a4c-4952-4765-831c-a1919e56193f. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:09:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-26a856d1-06d8-43ec-9f44-c270e64846bd req-a80c60b1-9ea9-4bdc-844a-c4cc9e41b939 service nova] Acquiring lock "refresh_cache-9c06ed5e-4b10-44d1-b4b5-faea4dcd6849" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:09:00 user nova-compute[74840]: DEBUG nova.network.neutron [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Acquiring lock "3b10fda0-9488-4089-8033-dd1c8e42af89" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lock "3b10fda0-9488-4089-8033-dd1c8e42af89" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG nova.compute.manager [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Starting instance... {{(pid=74840) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG nova.network.neutron [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Updating instance_info_cache with network_info: [{"id": "2cc86a4c-4952-4765-831c-a1919e56193f", "address": "fa:16:3e:e8:ed:67", "network": {"id": "e629cfa0-f295-42b5-9e17-b273bfa2a1c9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-185728581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863c5c6a90544832a7a4cad6917978c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc86a4c-49", "ovs_interfaceid": "2cc86a4c-4952-4765-831c-a1919e56193f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Releasing lock "refresh_cache-9c06ed5e-4b10-44d1-b4b5-faea4dcd6849" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG nova.compute.manager [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Instance network_info: |[{"id": "2cc86a4c-4952-4765-831c-a1919e56193f", "address": "fa:16:3e:e8:ed:67", "network": {"id": "e629cfa0-f295-42b5-9e17-b273bfa2a1c9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-185728581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863c5c6a90544832a7a4cad6917978c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc86a4c-49", "ovs_interfaceid": "2cc86a4c-4952-4765-831c-a1919e56193f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-26a856d1-06d8-43ec-9f44-c270e64846bd req-a80c60b1-9ea9-4bdc-844a-c4cc9e41b939 service nova] Acquired lock "refresh_cache-9c06ed5e-4b10-44d1-b4b5-faea4dcd6849" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG nova.network.neutron [req-26a856d1-06d8-43ec-9f44-c270e64846bd req-a80c60b1-9ea9-4bdc-844a-c4cc9e41b939 service nova] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Refreshing network info cache for port 2cc86a4c-4952-4765-831c-a1919e56193f {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Start _get_guest_xml network_info=[{"id": "2cc86a4c-4952-4765-831c-a1919e56193f", "address": "fa:16:3e:e8:ed:67", "network": {"id": "e629cfa0-f295-42b5-9e17-b273bfa2a1c9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-185728581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863c5c6a90544832a7a4cad6917978c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc86a4c-49", "ovs_interfaceid": "2cc86a4c-4952-4765-831c-a1919e56193f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'image_id': '4fa17706-d304-4117-a420-dab994c703dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:09:01 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:09:01 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:09:01 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:08:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-72142012',display_name='tempest-DeleteServersTestJSON-server-72142012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-72142012',id=2,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='863c5c6a90544832a7a4cad6917978c0',ramdisk_id='',reservation_id='r-zsfo70h0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-956668807',owner_user_name='tempest-DeleteServersTestJSON-956668807-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:08:56Z,user_data=None,user_id='50959a9651d643cfb93a860ef57cbc34',uuid=9c06ed5e-4b10-44d1-b4b5-faea4dcd6849,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2cc86a4c-4952-4765-831c-a1919e56193f", "address": "fa:16:3e:e8:ed:67", "network": {"id": "e629cfa0-f295-42b5-9e17-b273bfa2a1c9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-185728581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863c5c6a90544832a7a4cad6917978c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc86a4c-49", "ovs_interfaceid": "2cc86a4c-4952-4765-831c-a1919e56193f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Converting VIF {"id": "2cc86a4c-4952-4765-831c-a1919e56193f", "address": "fa:16:3e:e8:ed:67", "network": {"id": "e629cfa0-f295-42b5-9e17-b273bfa2a1c9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-185728581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863c5c6a90544832a7a4cad6917978c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc86a4c-49", "ovs_interfaceid": "2cc86a4c-4952-4765-831c-a1919e56193f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:ed:67,bridge_name='br-int',has_traffic_filtering=True,id=2cc86a4c-4952-4765-831c-a1919e56193f,network=Network(e629cfa0-f295-42b5-9e17-b273bfa2a1c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cc86a4c-49') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG nova.objects.instance [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Lazy-loading 'pci_devices' on Instance uuid 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:09:01 user nova-compute[74840]: INFO nova.compute.claims [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Claim successful on node user
Nov 08 12:09:01 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:09:01 user nova-compute[74840]:   <uuid>9c06ed5e-4b10-44d1-b4b5-faea4dcd6849</uuid>
Nov 08 12:09:01 user nova-compute[74840]:   <name>instance-00000002</name>
Nov 08 12:09:01 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:09:01 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:09:01 user nova-compute[74840]:   <metadata>
Nov 08 12:09:01 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:09:01 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:09:01 user nova-compute[74840]:       <nova:name>tempest-DeleteServersTestJSON-server-72142012</nova:name>
Nov 08 12:09:01 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:09:01</nova:creationTime>
Nov 08 12:09:01 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:09:01 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:09:01 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:09:01 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:09:01 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:09:01 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:09:01 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:09:01 user nova-compute[74840]:       <nova:owner>
Nov 08 12:09:01 user nova-compute[74840]:         <nova:user uuid="50959a9651d643cfb93a860ef57cbc34">tempest-DeleteServersTestJSON-956668807-project-member</nova:user>
Nov 08 12:09:01 user nova-compute[74840]:         <nova:project uuid="863c5c6a90544832a7a4cad6917978c0">tempest-DeleteServersTestJSON-956668807</nova:project>
Nov 08 12:09:01 user nova-compute[74840]:       </nova:owner>
Nov 08 12:09:01 user nova-compute[74840]:       <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:09:01 user nova-compute[74840]:       <nova:ports>
Nov 08 12:09:01 user nova-compute[74840]:         <nova:port uuid="2cc86a4c-4952-4765-831c-a1919e56193f">
Nov 08 12:09:01 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 08 12:09:01 user nova-compute[74840]:         </nova:port>
Nov 08 12:09:01 user nova-compute[74840]:       </nova:ports>
Nov 08 12:09:01 user nova-compute[74840]:     </nova:instance>
Nov 08 12:09:01 user nova-compute[74840]:   </metadata>
Nov 08 12:09:01 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:09:01 user nova-compute[74840]:     <system>
Nov 08 12:09:01 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:09:01 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:09:01 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:09:01 user nova-compute[74840]:       <entry name="serial">9c06ed5e-4b10-44d1-b4b5-faea4dcd6849</entry>
Nov 08 12:09:01 user nova-compute[74840]:       <entry name="uuid">9c06ed5e-4b10-44d1-b4b5-faea4dcd6849</entry>
Nov 08 12:09:01 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:09:01 user nova-compute[74840]:     </system>
Nov 08 12:09:01 user nova-compute[74840]:   </sysinfo>
Nov 08 12:09:01 user nova-compute[74840]:   <os>
Nov 08 12:09:01 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:09:01 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:09:01 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:09:01 user nova-compute[74840]:   </os>
Nov 08 12:09:01 user nova-compute[74840]:   <features>
Nov 08 12:09:01 user nova-compute[74840]:     <acpi/>
Nov 08 12:09:01 user nova-compute[74840]:     <apic/>
Nov 08 12:09:01 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:09:01 user nova-compute[74840]:   </features>
Nov 08 12:09:01 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:09:01 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:09:01 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:09:01 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:09:01 user nova-compute[74840]:   </clock>
Nov 08 12:09:01 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:09:01 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:09:01 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:09:01 user nova-compute[74840]:   </cpu>
Nov 08 12:09:01 user nova-compute[74840]:   <devices>
Nov 08 12:09:01 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:09:01 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:09:01 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/9c06ed5e-4b10-44d1-b4b5-faea4dcd6849/disk"/>
Nov 08 12:09:01 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:09:01 user nova-compute[74840]:     </disk>
Nov 08 12:09:01 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:09:01 user nova-compute[74840]:       <mac address="fa:16:3e:e8:ed:67"/>
Nov 08 12:09:01 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:09:01 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:09:01 user nova-compute[74840]:       <target dev="tap2cc86a4c-49"/>
Nov 08 12:09:01 user nova-compute[74840]:     </interface>
Nov 08 12:09:01 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:09:01 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/9c06ed5e-4b10-44d1-b4b5-faea4dcd6849/console.log" append="off"/>
Nov 08 12:09:01 user nova-compute[74840]:     </serial>
Nov 08 12:09:01 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:09:01 user nova-compute[74840]:     <video>
Nov 08 12:09:01 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:09:01 user nova-compute[74840]:     </video>
Nov 08 12:09:01 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:09:01 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:09:01 user nova-compute[74840]:     </rng>
Nov 08 12:09:01 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:09:01 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:09:01 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:09:01 user nova-compute[74840]:     </memballoon>
Nov 08 12:09:01 user nova-compute[74840]:   </devices>
Nov 08 12:09:01 user nova-compute[74840]: </domain>
Nov 08 12:09:01 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:08:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-72142012',display_name='tempest-DeleteServersTestJSON-server-72142012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-72142012',id=2,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='863c5c6a90544832a7a4cad6917978c0',ramdisk_id='',reservation_id='r-zsfo70h0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-956668807',owner_user_name='tempest-DeleteServersTestJSON-956668807-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:08:56Z,user_data=None,user_id='50959a9651d643cfb93a860ef57cbc34',uuid=9c06ed5e-4b10-44d1-b4b5-faea4dcd6849,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2cc86a4c-4952-4765-831c-a1919e56193f", "address": "fa:16:3e:e8:ed:67", "network": {"id": "e629cfa0-f295-42b5-9e17-b273bfa2a1c9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-185728581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863c5c6a90544832a7a4cad6917978c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc86a4c-49", "ovs_interfaceid": "2cc86a4c-4952-4765-831c-a1919e56193f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Converting VIF {"id": "2cc86a4c-4952-4765-831c-a1919e56193f", "address": "fa:16:3e:e8:ed:67", "network": {"id": "e629cfa0-f295-42b5-9e17-b273bfa2a1c9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-185728581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863c5c6a90544832a7a4cad6917978c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc86a4c-49", "ovs_interfaceid": "2cc86a4c-4952-4765-831c-a1919e56193f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:ed:67,bridge_name='br-int',has_traffic_filtering=True,id=2cc86a4c-4952-4765-831c-a1919e56193f,network=Network(e629cfa0-f295-42b5-9e17-b273bfa2a1c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cc86a4c-49') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG os_vif [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:ed:67,bridge_name='br-int',has_traffic_filtering=True,id=2cc86a4c-4952-4765-831c-a1919e56193f,network=Network(e629cfa0-f295-42b5-9e17-b273bfa2a1c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cc86a4c-49') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c3a0acfe-bf31-59fc-a2d4-faea38207c7a', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2cc86a4c-49, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2cc86a4c-49, col_values=(('qos', UUID('4b82d6c9-3371-4aa2-812b-0538a8d0e19f')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2cc86a4c-49, col_values=(('external_ids', {'iface-id': '2cc86a4c-4952-4765-831c-a1919e56193f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:ed:67', 'vm-uuid': '9c06ed5e-4b10-44d1-b4b5-faea4dcd6849'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:01 user nova-compute[74840]: INFO os_vif [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:ed:67,bridge_name='br-int',has_traffic_filtering=True,id=2cc86a4c-4952-4765-831c-a1919e56193f,network=Network(e629cfa0-f295-42b5-9e17-b273bfa2a1c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cc86a4c-49')
Nov 08 12:09:01 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] No VIF found with MAC fa:16:3e:e8:ed:67, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.382s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG nova.compute.manager [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Start building networks asynchronously for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG nova.network.neutron [req-26a856d1-06d8-43ec-9f44-c270e64846bd req-a80c60b1-9ea9-4bdc-844a-c4cc9e41b939 service nova] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Updated VIF entry in instance network info cache for port 2cc86a4c-4952-4765-831c-a1919e56193f. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG nova.network.neutron [req-26a856d1-06d8-43ec-9f44-c270e64846bd req-a80c60b1-9ea9-4bdc-844a-c4cc9e41b939 service nova] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Updating instance_info_cache with network_info: [{"id": "2cc86a4c-4952-4765-831c-a1919e56193f", "address": "fa:16:3e:e8:ed:67", "network": {"id": "e629cfa0-f295-42b5-9e17-b273bfa2a1c9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-185728581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863c5c6a90544832a7a4cad6917978c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc86a4c-49", "ovs_interfaceid": "2cc86a4c-4952-4765-831c-a1919e56193f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG nova.compute.manager [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Allocating IP information in the background. {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG nova.network.neutron [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 12:09:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-26a856d1-06d8-43ec-9f44-c270e64846bd req-a80c60b1-9ea9-4bdc-844a-c4cc9e41b939 service nova] Releasing lock "refresh_cache-9c06ed5e-4b10-44d1-b4b5-faea4dcd6849" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:09:01 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 12:09:01 user nova-compute[74840]: DEBUG nova.compute.manager [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Start building block device mappings for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 12:09:02 user nova-compute[74840]: DEBUG nova.policy [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '47ef9bdd58a147518d0a09267731b67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a544910dc2c4b169c986fa74b5979d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 12:09:02 user nova-compute[74840]: DEBUG nova.compute.manager [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Start spawning the instance on the hypervisor. {{(pid=74840) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 12:09:02 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:09:02 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Creating image(s)
Nov 08 12:09:02 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Acquiring lock "/opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:09:02 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lock "/opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:09:02 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lock "/opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:09:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:09:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.272s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:09:02 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Acquiring lock "5d26578eba85497f494c575690c4248f381a0fe6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:09:02 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:09:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:09:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.251s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:09:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk 1073741824 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:09:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk 1073741824" returned: 0 in 0.109s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:09:02 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.370s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:09:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:09:03 user nova-compute[74840]: DEBUG nova.network.neutron [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Successfully created port: b48b5298-045f-463d-9585-fbb5feb869bf {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:09:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.293s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:09:03 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk. size=1073741824 {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 12:09:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:09:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:09:03 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Cannot resize image /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk to a smaller size. {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 12:09:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Created local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 12:09:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Ensure instance console log exists: /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:09:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:09:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:09:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:09:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG nova.network.neutron [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Successfully updated port: b48b5298-045f-463d-9585-fbb5feb869bf {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Acquiring lock "refresh_cache-3b10fda0-9488-4089-8033-dd1c8e42af89" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Acquired lock "refresh_cache-3b10fda0-9488-4089-8033-dd1c8e42af89" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG nova.network.neutron [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG nova.network.neutron [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG nova.compute.manager [req-3c434af9-f116-4bc4-99b1-3d14dfea2cea req-f5b60edf-5052-487b-bdc2-8c28cb092a52 service nova] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Received event network-changed-b48b5298-045f-463d-9585-fbb5feb869bf {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG nova.compute.manager [req-3c434af9-f116-4bc4-99b1-3d14dfea2cea req-f5b60edf-5052-487b-bdc2-8c28cb092a52 service nova] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Refreshing instance network info cache due to event network-changed-b48b5298-045f-463d-9585-fbb5feb869bf. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3c434af9-f116-4bc4-99b1-3d14dfea2cea req-f5b60edf-5052-487b-bdc2-8c28cb092a52 service nova] Acquiring lock "refresh_cache-3b10fda0-9488-4089-8033-dd1c8e42af89" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG nova.network.neutron [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Updating instance_info_cache with network_info: [{"id": "b48b5298-045f-463d-9585-fbb5feb869bf", "address": "fa:16:3e:19:58:1f", "network": {"id": "9dec89b0-562f-482c-aec1-d024351d0bd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-237264167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a544910dc2c4b169c986fa74b5979d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48b5298-04", "ovs_interfaceid": "b48b5298-045f-463d-9585-fbb5feb869bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Releasing lock "refresh_cache-3b10fda0-9488-4089-8033-dd1c8e42af89" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG nova.compute.manager [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Instance network_info: |[{"id": "b48b5298-045f-463d-9585-fbb5feb869bf", "address": "fa:16:3e:19:58:1f", "network": {"id": "9dec89b0-562f-482c-aec1-d024351d0bd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-237264167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a544910dc2c4b169c986fa74b5979d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48b5298-04", "ovs_interfaceid": "b48b5298-045f-463d-9585-fbb5feb869bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3c434af9-f116-4bc4-99b1-3d14dfea2cea req-f5b60edf-5052-487b-bdc2-8c28cb092a52 service nova] Acquired lock "refresh_cache-3b10fda0-9488-4089-8033-dd1c8e42af89" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG nova.network.neutron [req-3c434af9-f116-4bc4-99b1-3d14dfea2cea req-f5b60edf-5052-487b-bdc2-8c28cb092a52 service nova] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Refreshing network info cache for port b48b5298-045f-463d-9585-fbb5feb869bf {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Start _get_guest_xml network_info=[{"id": "b48b5298-045f-463d-9585-fbb5feb869bf", "address": "fa:16:3e:19:58:1f", "network": {"id": "9dec89b0-562f-482c-aec1-d024351d0bd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-237264167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a544910dc2c4b169c986fa74b5979d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48b5298-04", "ovs_interfaceid": "b48b5298-045f-463d-9585-fbb5feb869bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'image_id': '4fa17706-d304-4117-a420-dab994c703dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:09:04 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:09:04 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:09:04 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:08:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-172158050',display_name='tempest-ServerActionsTestOtherB-server-172158050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-172158050',id=3,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJKFMe0GKEBW9KmyXjqsjBsUl5GOfddH2uub399MmagL+sAbL8XpD7Zv97iB27MfsDGdoFheqqd0EDelgcb+/IZFf73OQgm/+DITCITQulDQXkqFfn6taEL9Zjc2Dr8/0g==',key_name='tempest-keypair-2038726199',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a544910dc2c4b169c986fa74b5979d9',ramdisk_id='',reservation_id='r-o6735td4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1148036573',owner_user_name='tempest-ServerActionsTestOtherB-1148036573-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:09:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47ef9bdd58a147518d0a09267731b67c',uuid=3b10fda0-9488-4089-8033-dd1c8e42af89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b48b5298-045f-463d-9585-fbb5feb869bf", "address": "fa:16:3e:19:58:1f", "network": {"id": "9dec89b0-562f-482c-aec1-d024351d0bd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-237264167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a544910dc2c4b169c986fa74b5979d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48b5298-04", "ovs_interfaceid": "b48b5298-045f-463d-9585-fbb5feb869bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Converting VIF {"id": "b48b5298-045f-463d-9585-fbb5feb869bf", "address": "fa:16:3e:19:58:1f", "network": {"id": "9dec89b0-562f-482c-aec1-d024351d0bd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-237264167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a544910dc2c4b169c986fa74b5979d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48b5298-04", "ovs_interfaceid": "b48b5298-045f-463d-9585-fbb5feb869bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:58:1f,bridge_name='br-int',has_traffic_filtering=True,id=b48b5298-045f-463d-9585-fbb5feb869bf,network=Network(9dec89b0-562f-482c-aec1-d024351d0bd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb48b5298-04') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG nova.objects.instance [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b10fda0-9488-4089-8033-dd1c8e42af89 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:09:04 user nova-compute[74840]:   <uuid>3b10fda0-9488-4089-8033-dd1c8e42af89</uuid>
Nov 08 12:09:04 user nova-compute[74840]:   <name>instance-00000003</name>
Nov 08 12:09:04 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:09:04 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:09:04 user nova-compute[74840]:   <metadata>
Nov 08 12:09:04 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:09:04 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:09:04 user nova-compute[74840]:       <nova:name>tempest-ServerActionsTestOtherB-server-172158050</nova:name>
Nov 08 12:09:04 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:09:04</nova:creationTime>
Nov 08 12:09:04 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:09:04 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:09:04 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:09:04 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:09:04 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:09:04 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:09:04 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:09:04 user nova-compute[74840]:       <nova:owner>
Nov 08 12:09:04 user nova-compute[74840]:         <nova:user uuid="47ef9bdd58a147518d0a09267731b67c">tempest-ServerActionsTestOtherB-1148036573-project-member</nova:user>
Nov 08 12:09:04 user nova-compute[74840]:         <nova:project uuid="7a544910dc2c4b169c986fa74b5979d9">tempest-ServerActionsTestOtherB-1148036573</nova:project>
Nov 08 12:09:04 user nova-compute[74840]:       </nova:owner>
Nov 08 12:09:04 user nova-compute[74840]:       <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:09:04 user nova-compute[74840]:       <nova:ports>
Nov 08 12:09:04 user nova-compute[74840]:         <nova:port uuid="b48b5298-045f-463d-9585-fbb5feb869bf">
Nov 08 12:09:04 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 12:09:04 user nova-compute[74840]:         </nova:port>
Nov 08 12:09:04 user nova-compute[74840]:       </nova:ports>
Nov 08 12:09:04 user nova-compute[74840]:     </nova:instance>
Nov 08 12:09:04 user nova-compute[74840]:   </metadata>
Nov 08 12:09:04 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:09:04 user nova-compute[74840]:     <system>
Nov 08 12:09:04 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:09:04 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:09:04 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:09:04 user nova-compute[74840]:       <entry name="serial">3b10fda0-9488-4089-8033-dd1c8e42af89</entry>
Nov 08 12:09:04 user nova-compute[74840]:       <entry name="uuid">3b10fda0-9488-4089-8033-dd1c8e42af89</entry>
Nov 08 12:09:04 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:09:04 user nova-compute[74840]:     </system>
Nov 08 12:09:04 user nova-compute[74840]:   </sysinfo>
Nov 08 12:09:04 user nova-compute[74840]:   <os>
Nov 08 12:09:04 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:09:04 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:09:04 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:09:04 user nova-compute[74840]:   </os>
Nov 08 12:09:04 user nova-compute[74840]:   <features>
Nov 08 12:09:04 user nova-compute[74840]:     <acpi/>
Nov 08 12:09:04 user nova-compute[74840]:     <apic/>
Nov 08 12:09:04 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:09:04 user nova-compute[74840]:   </features>
Nov 08 12:09:04 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:09:04 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:09:04 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:09:04 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:09:04 user nova-compute[74840]:   </clock>
Nov 08 12:09:04 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:09:04 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:09:04 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:09:04 user nova-compute[74840]:   </cpu>
Nov 08 12:09:04 user nova-compute[74840]:   <devices>
Nov 08 12:09:04 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:09:04 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:09:04 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk"/>
Nov 08 12:09:04 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:09:04 user nova-compute[74840]:     </disk>
Nov 08 12:09:04 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:09:04 user nova-compute[74840]:       <mac address="fa:16:3e:19:58:1f"/>
Nov 08 12:09:04 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:09:04 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:09:04 user nova-compute[74840]:       <target dev="tapb48b5298-04"/>
Nov 08 12:09:04 user nova-compute[74840]:     </interface>
Nov 08 12:09:04 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:09:04 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/console.log" append="off"/>
Nov 08 12:09:04 user nova-compute[74840]:     </serial>
Nov 08 12:09:04 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:09:04 user nova-compute[74840]:     <video>
Nov 08 12:09:04 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:09:04 user nova-compute[74840]:     </video>
Nov 08 12:09:04 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:09:04 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:09:04 user nova-compute[74840]:     </rng>
Nov 08 12:09:04 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:09:04 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:09:04 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:09:04 user nova-compute[74840]:     </memballoon>
Nov 08 12:09:04 user nova-compute[74840]:   </devices>
Nov 08 12:09:04 user nova-compute[74840]: </domain>
Nov 08 12:09:04 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:08:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-172158050',display_name='tempest-ServerActionsTestOtherB-server-172158050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-172158050',id=3,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJKFMe0GKEBW9KmyXjqsjBsUl5GOfddH2uub399MmagL+sAbL8XpD7Zv97iB27MfsDGdoFheqqd0EDelgcb+/IZFf73OQgm/+DITCITQulDQXkqFfn6taEL9Zjc2Dr8/0g==',key_name='tempest-keypair-2038726199',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a544910dc2c4b169c986fa74b5979d9',ramdisk_id='',reservation_id='r-o6735td4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1148036573',owner_user_name='tempest-ServerActionsTestOtherB-1148036573-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:09:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47ef9bdd58a147518d0a09267731b67c',uuid=3b10fda0-9488-4089-8033-dd1c8e42af89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b48b5298-045f-463d-9585-fbb5feb869bf", "address": "fa:16:3e:19:58:1f", "network": {"id": "9dec89b0-562f-482c-aec1-d024351d0bd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-237264167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a544910dc2c4b169c986fa74b5979d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48b5298-04", "ovs_interfaceid": "b48b5298-045f-463d-9585-fbb5feb869bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Converting VIF {"id": "b48b5298-045f-463d-9585-fbb5feb869bf", "address": "fa:16:3e:19:58:1f", "network": {"id": "9dec89b0-562f-482c-aec1-d024351d0bd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-237264167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a544910dc2c4b169c986fa74b5979d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48b5298-04", "ovs_interfaceid": "b48b5298-045f-463d-9585-fbb5feb869bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:58:1f,bridge_name='br-int',has_traffic_filtering=True,id=b48b5298-045f-463d-9585-fbb5feb869bf,network=Network(9dec89b0-562f-482c-aec1-d024351d0bd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb48b5298-04') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG os_vif [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:58:1f,bridge_name='br-int',has_traffic_filtering=True,id=b48b5298-045f-463d-9585-fbb5feb869bf,network=Network(9dec89b0-562f-482c-aec1-d024351d0bd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb48b5298-04') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '67178738-2a99-5b94-933c-dd46fce8bd89', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb48b5298-04, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb48b5298-04, col_values=(('qos', UUID('bf8886b0-ec1c-43ce-adaf-da8be49b4e3f')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb48b5298-04, col_values=(('external_ids', {'iface-id': 'b48b5298-045f-463d-9585-fbb5feb869bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:58:1f', 'vm-uuid': '3b10fda0-9488-4089-8033-dd1c8e42af89'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:09:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:04 user nova-compute[74840]: INFO os_vif [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:58:1f,bridge_name='br-int',has_traffic_filtering=True,id=b48b5298-045f-463d-9585-fbb5feb869bf,network=Network(9dec89b0-562f-482c-aec1-d024351d0bd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb48b5298-04')
Nov 08 12:09:05 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:09:05 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] No VIF found with MAC fa:16:3e:19:58:1f, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:09:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:05 user nova-compute[74840]: DEBUG nova.network.neutron [req-3c434af9-f116-4bc4-99b1-3d14dfea2cea req-f5b60edf-5052-487b-bdc2-8c28cb092a52 service nova] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Updated VIF entry in instance network info cache for port b48b5298-045f-463d-9585-fbb5feb869bf. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:09:05 user nova-compute[74840]: DEBUG nova.network.neutron [req-3c434af9-f116-4bc4-99b1-3d14dfea2cea req-f5b60edf-5052-487b-bdc2-8c28cb092a52 service nova] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Updating instance_info_cache with network_info: [{"id": "b48b5298-045f-463d-9585-fbb5feb869bf", "address": "fa:16:3e:19:58:1f", "network": {"id": "9dec89b0-562f-482c-aec1-d024351d0bd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-237264167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a544910dc2c4b169c986fa74b5979d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48b5298-04", "ovs_interfaceid": "b48b5298-045f-463d-9585-fbb5feb869bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:09:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3c434af9-f116-4bc4-99b1-3d14dfea2cea req-f5b60edf-5052-487b-bdc2-8c28cb092a52 service nova] Releasing lock "refresh_cache-3b10fda0-9488-4089-8033-dd1c8e42af89" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:09:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:05 user nova-compute[74840]: DEBUG nova.compute.manager [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:09:05 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:09:05 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Instance spawned successfully.
Nov 08 12:09:05 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:09:05 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Found default for hw_cdrom_bus of ide {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:09:05 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Found default for hw_disk_bus of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:09:05 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:09:05 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:09:05 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Found default for hw_video_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:09:05 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Found default for hw_vif_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:09:06 user nova-compute[74840]: INFO nova.compute.manager [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Took 9.88 seconds to spawn the instance on the hypervisor.
Nov 08 12:09:06 user nova-compute[74840]: DEBUG nova.compute.manager [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:09:06 user nova-compute[74840]: INFO nova.compute.manager [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Took 10.83 seconds to build instance.
Nov 08 12:09:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b068be5d-9de9-49ac-be78-b2638ed444fd tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Lock "9c06ed5e-4b10-44d1-b4b5-faea4dcd6849" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.029s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:09:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:10 user nova-compute[74840]: DEBUG nova.compute.manager [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:09:10 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:09:10 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Instance spawned successfully.
Nov 08 12:09:10 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:09:10 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Found default for hw_cdrom_bus of ide {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:09:10 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Found default for hw_disk_bus of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:09:10 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:09:10 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:09:10 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Found default for hw_video_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:09:10 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Found default for hw_vif_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:09:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:10 user nova-compute[74840]: INFO nova.compute.manager [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Took 8.24 seconds to spawn the instance on the hypervisor.
Nov 08 12:09:10 user nova-compute[74840]: DEBUG nova.compute.manager [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:09:10 user nova-compute[74840]: INFO nova.compute.manager [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Took 9.20 seconds to build instance.
Nov 08 12:09:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cd7e29f3-f477-413e-84e2-44ddcfd591ba tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lock "3b10fda0-9488-4089-8033-dd1c8e42af89" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.389s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:09:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:12 user nova-compute[74840]: DEBUG nova.compute.manager [req-1f88ac81-2b3c-478b-bd2d-6244d9d22c3d req-5890afea-d5f6-4876-9a7a-1b0cad4669cf service nova] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Received event network-vif-plugged-2cc86a4c-4952-4765-831c-a1919e56193f {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:09:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-1f88ac81-2b3c-478b-bd2d-6244d9d22c3d req-5890afea-d5f6-4876-9a7a-1b0cad4669cf service nova] Acquiring lock "9c06ed5e-4b10-44d1-b4b5-faea4dcd6849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:09:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-1f88ac81-2b3c-478b-bd2d-6244d9d22c3d req-5890afea-d5f6-4876-9a7a-1b0cad4669cf service nova] Lock "9c06ed5e-4b10-44d1-b4b5-faea4dcd6849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:09:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-1f88ac81-2b3c-478b-bd2d-6244d9d22c3d req-5890afea-d5f6-4876-9a7a-1b0cad4669cf service nova] Lock "9c06ed5e-4b10-44d1-b4b5-faea4dcd6849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:09:12 user nova-compute[74840]: DEBUG nova.compute.manager [req-1f88ac81-2b3c-478b-bd2d-6244d9d22c3d req-5890afea-d5f6-4876-9a7a-1b0cad4669cf service nova] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] No waiting events found dispatching network-vif-plugged-2cc86a4c-4952-4765-831c-a1919e56193f {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:09:12 user nova-compute[74840]: WARNING nova.compute.manager [req-1f88ac81-2b3c-478b-bd2d-6244d9d22c3d req-5890afea-d5f6-4876-9a7a-1b0cad4669cf service nova] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Received unexpected event network-vif-plugged-2cc86a4c-4952-4765-831c-a1919e56193f for instance with vm_state active and task_state None.
Nov 08 12:09:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Acquiring lock "684b8be2-7f8f-499f-8885-c9d1c86eef2f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:09:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Lock "684b8be2-7f8f-499f-8885-c9d1c86eef2f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:09:13 user nova-compute[74840]: DEBUG nova.compute.manager [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Starting instance... {{(pid=74840) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 12:09:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:09:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:09:13 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:09:13 user nova-compute[74840]: INFO nova.compute.claims [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Claim successful on node user
Nov 08 12:09:13 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:09:13 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:09:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.456s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:09:13 user nova-compute[74840]: DEBUG nova.compute.manager [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Start building networks asynchronously for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 12:09:13 user nova-compute[74840]: DEBUG nova.compute.manager [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Allocating IP information in the background. {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 12:09:13 user nova-compute[74840]: DEBUG nova.network.neutron [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 12:09:13 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 12:09:13 user nova-compute[74840]: DEBUG nova.compute.manager [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Start building block device mappings for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 12:09:13 user nova-compute[74840]: DEBUG nova.policy [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '016aab95b2394f5f89283d1e62c5fd8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd51d983b3aa441dabb1543296f0bb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 12:09:14 user nova-compute[74840]: DEBUG nova.compute.manager [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Start spawning the instance on the hypervisor. {{(pid=74840) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 12:09:14 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:09:14 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Creating image(s)
Nov 08 12:09:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Acquiring lock "/opt/stack/data/nova/instances/684b8be2-7f8f-499f-8885-c9d1c86eef2f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:09:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Lock "/opt/stack/data/nova/instances/684b8be2-7f8f-499f-8885-c9d1c86eef2f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:09:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Lock "/opt/stack/data/nova/instances/684b8be2-7f8f-499f-8885-c9d1c86eef2f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:09:14 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:09:14 user nova-compute[74840]: DEBUG nova.compute.manager [req-25aa5763-b358-4fc9-a3f4-73a1bd96a535 req-365da66e-a786-410f-a37d-631cb7360f47 service nova] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Received event network-vif-plugged-2cc86a4c-4952-4765-831c-a1919e56193f {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:09:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-25aa5763-b358-4fc9-a3f4-73a1bd96a535 req-365da66e-a786-410f-a37d-631cb7360f47 service nova] Acquiring lock "9c06ed5e-4b10-44d1-b4b5-faea4dcd6849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:09:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-25aa5763-b358-4fc9-a3f4-73a1bd96a535 req-365da66e-a786-410f-a37d-631cb7360f47 service nova] Lock "9c06ed5e-4b10-44d1-b4b5-faea4dcd6849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:09:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-25aa5763-b358-4fc9-a3f4-73a1bd96a535 req-365da66e-a786-410f-a37d-631cb7360f47 service nova] Lock "9c06ed5e-4b10-44d1-b4b5-faea4dcd6849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:09:14 user nova-compute[74840]: DEBUG nova.compute.manager [req-25aa5763-b358-4fc9-a3f4-73a1bd96a535 req-365da66e-a786-410f-a37d-631cb7360f47 service nova] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] No waiting events found dispatching network-vif-plugged-2cc86a4c-4952-4765-831c-a1919e56193f {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:09:14 user nova-compute[74840]: WARNING nova.compute.manager [req-25aa5763-b358-4fc9-a3f4-73a1bd96a535 req-365da66e-a786-410f-a37d-631cb7360f47 service nova] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Received unexpected event network-vif-plugged-2cc86a4c-4952-4765-831c-a1919e56193f for instance with vm_state active and task_state None.
Nov 08 12:09:14 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.240s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:09:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Acquiring lock "5d26578eba85497f494c575690c4248f381a0fe6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:09:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:09:14 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:09:14 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.238s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:09:14 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/684b8be2-7f8f-499f-8885-c9d1c86eef2f/disk 1073741824 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:09:14 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/684b8be2-7f8f-499f-8885-c9d1c86eef2f/disk 1073741824" returned: 0 in 0.059s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:09:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.303s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:09:14 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:09:14 user nova-compute[74840]: DEBUG nova.network.neutron [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Successfully created port: b910fb2a-440c-426f-a000-064149073835 {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:09:14 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.325s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:09:14 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Checking if we can resize image /opt/stack/data/nova/instances/684b8be2-7f8f-499f-8885-c9d1c86eef2f/disk. size=1073741824 {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 12:09:14 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/684b8be2-7f8f-499f-8885-c9d1c86eef2f/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:09:14 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Acquiring lock "4647e942-c600-4a9c-95ba-a59064d04619" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:09:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Lock "4647e942-c600-4a9c-95ba-a59064d04619" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:09:15 user nova-compute[74840]: DEBUG nova.compute.manager [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Starting instance... {{(pid=74840) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 12:09:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/684b8be2-7f8f-499f-8885-c9d1c86eef2f/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:09:15 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Cannot resize image /opt/stack/data/nova/instances/684b8be2-7f8f-499f-8885-c9d1c86eef2f/disk to a smaller size. {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 12:09:15 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Created local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 12:09:15 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Ensure instance console log exists: /opt/stack/data/nova/instances/684b8be2-7f8f-499f-8885-c9d1c86eef2f/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:09:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:09:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:09:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:09:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:09:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:09:15 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:09:15 user nova-compute[74840]: INFO nova.compute.claims [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Claim successful on node user
Nov 08 12:09:15 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:09:15 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:09:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.508s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:09:15 user nova-compute[74840]: DEBUG nova.compute.manager [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Start building networks asynchronously for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 12:09:15 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:15 user nova-compute[74840]: DEBUG nova.network.neutron [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Successfully updated port: b910fb2a-440c-426f-a000-064149073835 {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:09:15 user nova-compute[74840]: DEBUG nova.compute.manager [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Allocating IP information in the background. {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 12:09:15 user nova-compute[74840]: DEBUG nova.network.neutron [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 12:09:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Acquiring lock "refresh_cache-684b8be2-7f8f-499f-8885-c9d1c86eef2f" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:09:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Acquired lock "refresh_cache-684b8be2-7f8f-499f-8885-c9d1c86eef2f" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:09:15 user nova-compute[74840]: DEBUG nova.network.neutron [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:09:15 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 08 12:09:15 user nova-compute[74840]: DEBUG nova.compute.manager [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Start building block device mappings for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 12:09:16 user nova-compute[74840]: DEBUG nova.compute.manager [req-23e47280-9717-4beb-bff3-abf78f381178 req-59b0f415-a237-4eac-9d2b-a38a5964931d service nova] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Received event network-changed-b910fb2a-440c-426f-a000-064149073835 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:09:16 user nova-compute[74840]: DEBUG nova.compute.manager [req-23e47280-9717-4beb-bff3-abf78f381178 req-59b0f415-a237-4eac-9d2b-a38a5964931d service nova] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Refreshing instance network info cache due to event network-changed-b910fb2a-440c-426f-a000-064149073835. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:09:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-23e47280-9717-4beb-bff3-abf78f381178 req-59b0f415-a237-4eac-9d2b-a38a5964931d service nova] Acquiring lock "refresh_cache-684b8be2-7f8f-499f-8885-c9d1c86eef2f" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:09:16 user nova-compute[74840]: DEBUG nova.network.neutron [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:09:16 user nova-compute[74840]: DEBUG nova.policy [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b1041650fc2f4bc3aa7313d901af94a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8d34c1c5dea4b59b332d650f2639c20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 12:09:16 user nova-compute[74840]: DEBUG nova.compute.manager [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Start spawning the instance on the hypervisor. {{(pid=74840) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 12:09:16 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:09:16 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Creating image(s)
Nov 08 12:09:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Acquiring lock "/opt/stack/data/nova/instances/4647e942-c600-4a9c-95ba-a59064d04619/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:09:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Lock "/opt/stack/data/nova/instances/4647e942-c600-4a9c-95ba-a59064d04619/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:09:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Lock "/opt/stack/data/nova/instances/4647e942-c600-4a9c-95ba-a59064d04619/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:09:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Acquiring lock "47404ecbbc241394773fc3ad597637e2b47fec91" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:09:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Lock "47404ecbbc241394773fc3ad597637e2b47fec91" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:09:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47404ecbbc241394773fc3ad597637e2b47fec91.part --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:09:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47404ecbbc241394773fc3ad597637e2b47fec91.part --force-share --output=json" returned: 0 in 0.275s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:09:16 user nova-compute[74840]: DEBUG nova.virt.images [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] 3406d889-0335-4bdc-84d9-0f98ada5c11a was qcow2, converting to raw {{(pid=74840) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 12:09:16 user nova-compute[74840]: DEBUG nova.privsep.utils [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74840) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 12:09:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/47404ecbbc241394773fc3ad597637e2b47fec91.part /opt/stack/data/nova/instances/_base/47404ecbbc241394773fc3ad597637e2b47fec91.converted {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG nova.network.neutron [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Updating instance_info_cache with network_info: [{"id": "b910fb2a-440c-426f-a000-064149073835", "address": "fa:16:3e:fd:8e:63", "network": {"id": "bfa1d7ef-3436-4676-a399-ead8194a958a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-3950314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd51d983b3aa441dabb1543296f0bb70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb910fb2a-44", "ovs_interfaceid": "b910fb2a-440c-426f-a000-064149073835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Releasing lock "refresh_cache-684b8be2-7f8f-499f-8885-c9d1c86eef2f" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG nova.compute.manager [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Instance network_info: |[{"id": "b910fb2a-440c-426f-a000-064149073835", "address": "fa:16:3e:fd:8e:63", "network": {"id": "bfa1d7ef-3436-4676-a399-ead8194a958a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-3950314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd51d983b3aa441dabb1543296f0bb70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb910fb2a-44", "ovs_interfaceid": "b910fb2a-440c-426f-a000-064149073835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-23e47280-9717-4beb-bff3-abf78f381178 req-59b0f415-a237-4eac-9d2b-a38a5964931d service nova] Acquired lock "refresh_cache-684b8be2-7f8f-499f-8885-c9d1c86eef2f" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG nova.network.neutron [req-23e47280-9717-4beb-bff3-abf78f381178 req-59b0f415-a237-4eac-9d2b-a38a5964931d service nova] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Refreshing network info cache for port b910fb2a-440c-426f-a000-064149073835 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Start _get_guest_xml network_info=[{"id": "b910fb2a-440c-426f-a000-064149073835", "address": "fa:16:3e:fd:8e:63", "network": {"id": "bfa1d7ef-3436-4676-a399-ead8194a958a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-3950314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd51d983b3aa441dabb1543296f0bb70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb910fb2a-44", "ovs_interfaceid": "b910fb2a-440c-426f-a000-064149073835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'image_id': '4fa17706-d304-4117-a420-dab994c703dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:09:17 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:09:17 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:09:17 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:09:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-163515573',display_name='tempest-VolumesAdminNegativeTest-server-163515573',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-163515573',id=4,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIJZL0dMho7k4byp5eyjMmCBjS1q40Bmx1HHYC8I1rNDXrB0dJ6f16FDcTMWHIFSXefA1qgMxJqLXZpTH7tQfZ1Xwe4wPuWbLs5+64ZIoEqahsozVUkGt6SApZ3oM31Eg==',key_name='tempest-keypair-1000135048',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd51d983b3aa441dabb1543296f0bb70',ramdisk_id='',reservation_id='r-70xdhzpj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1071383436',owner_user_name='tempest-VolumesAdminNegativeTest-1071383436-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:09:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='016aab95b2394f5f89283d1e62c5fd8d',uuid=684b8be2-7f8f-499f-8885-c9d1c86eef2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b910fb2a-440c-426f-a000-064149073835", "address": "fa:16:3e:fd:8e:63", "network": {"id": "bfa1d7ef-3436-4676-a399-ead8194a958a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-3950314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd51d983b3aa441dabb1543296f0bb70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb910fb2a-44", "ovs_interfaceid": "b910fb2a-440c-426f-a000-064149073835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Converting VIF {"id": "b910fb2a-440c-426f-a000-064149073835", "address": "fa:16:3e:fd:8e:63", "network": {"id": "bfa1d7ef-3436-4676-a399-ead8194a958a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-3950314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd51d983b3aa441dabb1543296f0bb70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb910fb2a-44", "ovs_interfaceid": "b910fb2a-440c-426f-a000-064149073835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:8e:63,bridge_name='br-int',has_traffic_filtering=True,id=b910fb2a-440c-426f-a000-064149073835,network=Network(bfa1d7ef-3436-4676-a399-ead8194a958a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb910fb2a-44') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG nova.objects.instance [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Lazy-loading 'pci_devices' on Instance uuid 684b8be2-7f8f-499f-8885-c9d1c86eef2f {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:09:17 user nova-compute[74840]:   <uuid>684b8be2-7f8f-499f-8885-c9d1c86eef2f</uuid>
Nov 08 12:09:17 user nova-compute[74840]:   <name>instance-00000004</name>
Nov 08 12:09:17 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:09:17 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:09:17 user nova-compute[74840]:   <metadata>
Nov 08 12:09:17 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:09:17 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:09:17 user nova-compute[74840]:       <nova:name>tempest-VolumesAdminNegativeTest-server-163515573</nova:name>
Nov 08 12:09:17 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:09:17</nova:creationTime>
Nov 08 12:09:17 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:09:17 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:09:17 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:09:17 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:09:17 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:09:17 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:09:17 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:09:17 user nova-compute[74840]:       <nova:owner>
Nov 08 12:09:17 user nova-compute[74840]:         <nova:user uuid="016aab95b2394f5f89283d1e62c5fd8d">tempest-VolumesAdminNegativeTest-1071383436-project-member</nova:user>
Nov 08 12:09:17 user nova-compute[74840]:         <nova:project uuid="bd51d983b3aa441dabb1543296f0bb70">tempest-VolumesAdminNegativeTest-1071383436</nova:project>
Nov 08 12:09:17 user nova-compute[74840]:       </nova:owner>
Nov 08 12:09:17 user nova-compute[74840]:       <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:09:17 user nova-compute[74840]:       <nova:ports>
Nov 08 12:09:17 user nova-compute[74840]:         <nova:port uuid="b910fb2a-440c-426f-a000-064149073835">
Nov 08 12:09:17 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 12:09:17 user nova-compute[74840]:         </nova:port>
Nov 08 12:09:17 user nova-compute[74840]:       </nova:ports>
Nov 08 12:09:17 user nova-compute[74840]:     </nova:instance>
Nov 08 12:09:17 user nova-compute[74840]:   </metadata>
Nov 08 12:09:17 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:09:17 user nova-compute[74840]:     <system>
Nov 08 12:09:17 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:09:17 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:09:17 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:09:17 user nova-compute[74840]:       <entry name="serial">684b8be2-7f8f-499f-8885-c9d1c86eef2f</entry>
Nov 08 12:09:17 user nova-compute[74840]:       <entry name="uuid">684b8be2-7f8f-499f-8885-c9d1c86eef2f</entry>
Nov 08 12:09:17 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:09:17 user nova-compute[74840]:     </system>
Nov 08 12:09:17 user nova-compute[74840]:   </sysinfo>
Nov 08 12:09:17 user nova-compute[74840]:   <os>
Nov 08 12:09:17 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:09:17 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:09:17 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:09:17 user nova-compute[74840]:   </os>
Nov 08 12:09:17 user nova-compute[74840]:   <features>
Nov 08 12:09:17 user nova-compute[74840]:     <acpi/>
Nov 08 12:09:17 user nova-compute[74840]:     <apic/>
Nov 08 12:09:17 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:09:17 user nova-compute[74840]:   </features>
Nov 08 12:09:17 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:09:17 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:09:17 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:09:17 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:09:17 user nova-compute[74840]:   </clock>
Nov 08 12:09:17 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:09:17 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:09:17 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:09:17 user nova-compute[74840]:   </cpu>
Nov 08 12:09:17 user nova-compute[74840]:   <devices>
Nov 08 12:09:17 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:09:17 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:09:17 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/684b8be2-7f8f-499f-8885-c9d1c86eef2f/disk"/>
Nov 08 12:09:17 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:09:17 user nova-compute[74840]:     </disk>
Nov 08 12:09:17 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:09:17 user nova-compute[74840]:       <mac address="fa:16:3e:fd:8e:63"/>
Nov 08 12:09:17 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:09:17 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:09:17 user nova-compute[74840]:       <target dev="tapb910fb2a-44"/>
Nov 08 12:09:17 user nova-compute[74840]:     </interface>
Nov 08 12:09:17 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:09:17 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/684b8be2-7f8f-499f-8885-c9d1c86eef2f/console.log" append="off"/>
Nov 08 12:09:17 user nova-compute[74840]:     </serial>
Nov 08 12:09:17 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:09:17 user nova-compute[74840]:     <video>
Nov 08 12:09:17 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:09:17 user nova-compute[74840]:     </video>
Nov 08 12:09:17 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:09:17 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:09:17 user nova-compute[74840]:     </rng>
Nov 08 12:09:17 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:09:17 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:09:17 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:09:17 user nova-compute[74840]:     </memballoon>
Nov 08 12:09:17 user nova-compute[74840]:   </devices>
Nov 08 12:09:17 user nova-compute[74840]: </domain>
Nov 08 12:09:17 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:09:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-163515573',display_name='tempest-VolumesAdminNegativeTest-server-163515573',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-163515573',id=4,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIJZL0dMho7k4byp5eyjMmCBjS1q40Bmx1HHYC8I1rNDXrB0dJ6f16FDcTMWHIFSXefA1qgMxJqLXZpTH7tQfZ1Xwe4wPuWbLs5+64ZIoEqahsozVUkGt6SApZ3oM31Eg==',key_name='tempest-keypair-1000135048',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd51d983b3aa441dabb1543296f0bb70',ramdisk_id='',reservation_id='r-70xdhzpj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1071383436',owner_user_name='tempest-VolumesAdminNegativeTest-1071383436-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:09:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='016aab95b2394f5f89283d1e62c5fd8d',uuid=684b8be2-7f8f-499f-8885-c9d1c86eef2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b910fb2a-440c-426f-a000-064149073835", "address": "fa:16:3e:fd:8e:63", "network": {"id": "bfa1d7ef-3436-4676-a399-ead8194a958a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-3950314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd51d983b3aa441dabb1543296f0bb70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb910fb2a-44", "ovs_interfaceid": "b910fb2a-440c-426f-a000-064149073835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Converting VIF {"id": "b910fb2a-440c-426f-a000-064149073835", "address": "fa:16:3e:fd:8e:63", "network": {"id": "bfa1d7ef-3436-4676-a399-ead8194a958a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-3950314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd51d983b3aa441dabb1543296f0bb70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb910fb2a-44", "ovs_interfaceid": "b910fb2a-440c-426f-a000-064149073835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:8e:63,bridge_name='br-int',has_traffic_filtering=True,id=b910fb2a-440c-426f-a000-064149073835,network=Network(bfa1d7ef-3436-4676-a399-ead8194a958a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb910fb2a-44') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG os_vif [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:8e:63,bridge_name='br-int',has_traffic_filtering=True,id=b910fb2a-440c-426f-a000-064149073835,network=Network(bfa1d7ef-3436-4676-a399-ead8194a958a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb910fb2a-44') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/47404ecbbc241394773fc3ad597637e2b47fec91.part /opt/stack/data/nova/instances/_base/47404ecbbc241394773fc3ad597637e2b47fec91.converted" returned: 0 in 0.381s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47404ecbbc241394773fc3ad597637e2b47fec91.converted --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '84af0dbb-d72c-53e2-8f63-4a8646efb2a4', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb910fb2a-44, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb910fb2a-44, col_values=(('qos', UUID('c37d8548-4aca-4d35-98c4-63b55f641c90')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb910fb2a-44, col_values=(('external_ids', {'iface-id': 'b910fb2a-440c-426f-a000-064149073835', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:8e:63', 'vm-uuid': '684b8be2-7f8f-499f-8885-c9d1c86eef2f'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:17 user nova-compute[74840]: INFO os_vif [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:8e:63,bridge_name='br-int',has_traffic_filtering=True,id=b910fb2a-440c-426f-a000-064149073835,network=Network(bfa1d7ef-3436-4676-a399-ead8194a958a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb910fb2a-44')
Nov 08 12:09:17 user nova-compute[74840]: DEBUG nova.network.neutron [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Successfully created port: bf46d9d3-89c8-43be-b311-e9c6b68fcb9e {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] No VIF found with MAC fa:16:3e:fd:8e:63, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47404ecbbc241394773fc3ad597637e2b47fec91.converted --force-share --output=json" returned: 0 in 0.290s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Lock "47404ecbbc241394773fc3ad597637e2b47fec91" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.452s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47404ecbbc241394773fc3ad597637e2b47fec91 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47404ecbbc241394773fc3ad597637e2b47fec91 --force-share --output=json" returned: 0 in 0.213s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Acquiring lock "47404ecbbc241394773fc3ad597637e2b47fec91" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Lock "47404ecbbc241394773fc3ad597637e2b47fec91" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:09:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47404ecbbc241394773fc3ad597637e2b47fec91 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:09:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47404ecbbc241394773fc3ad597637e2b47fec91 --force-share --output=json" returned: 0 in 0.268s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:09:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47404ecbbc241394773fc3ad597637e2b47fec91,backing_fmt=raw /opt/stack/data/nova/instances/4647e942-c600-4a9c-95ba-a59064d04619/disk 1073741824 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:09:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47404ecbbc241394773fc3ad597637e2b47fec91,backing_fmt=raw /opt/stack/data/nova/instances/4647e942-c600-4a9c-95ba-a59064d04619/disk 1073741824" returned: 0 in 0.056s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:09:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Lock "47404ecbbc241394773fc3ad597637e2b47fec91" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.332s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:09:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47404ecbbc241394773fc3ad597637e2b47fec91 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:09:18 user nova-compute[74840]: DEBUG nova.network.neutron [req-23e47280-9717-4beb-bff3-abf78f381178 req-59b0f415-a237-4eac-9d2b-a38a5964931d service nova] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Updated VIF entry in instance network info cache for port b910fb2a-440c-426f-a000-064149073835. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:09:18 user nova-compute[74840]: DEBUG nova.network.neutron [req-23e47280-9717-4beb-bff3-abf78f381178 req-59b0f415-a237-4eac-9d2b-a38a5964931d service nova] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Updating instance_info_cache with network_info: [{"id": "b910fb2a-440c-426f-a000-064149073835", "address": "fa:16:3e:fd:8e:63", "network": {"id": "bfa1d7ef-3436-4676-a399-ead8194a958a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-3950314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd51d983b3aa441dabb1543296f0bb70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb910fb2a-44", "ovs_interfaceid": "b910fb2a-440c-426f-a000-064149073835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:09:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-23e47280-9717-4beb-bff3-abf78f381178 req-59b0f415-a237-4eac-9d2b-a38a5964931d service nova] Releasing lock "refresh_cache-684b8be2-7f8f-499f-8885-c9d1c86eef2f" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:09:18 user nova-compute[74840]: DEBUG nova.network.neutron [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Successfully updated port: bf46d9d3-89c8-43be-b311-e9c6b68fcb9e {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:09:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47404ecbbc241394773fc3ad597637e2b47fec91 --force-share --output=json" returned: 0 in 0.293s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:09:18 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4647e942-c600-4a9c-95ba-a59064d04619/disk. size=1073741824 {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 12:09:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4647e942-c600-4a9c-95ba-a59064d04619/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:09:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Acquiring lock "refresh_cache-4647e942-c600-4a9c-95ba-a59064d04619" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:09:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Acquired lock "refresh_cache-4647e942-c600-4a9c-95ba-a59064d04619" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:09:18 user nova-compute[74840]: DEBUG nova.network.neutron [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:09:18 user nova-compute[74840]: DEBUG nova.compute.manager [req-f24c5d24-6008-4cf1-a4e7-4a918436540e req-0852e5f5-a1c8-4bba-954f-1abb0836ace1 service nova] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Received event network-changed-bf46d9d3-89c8-43be-b311-e9c6b68fcb9e {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:09:18 user nova-compute[74840]: DEBUG nova.compute.manager [req-f24c5d24-6008-4cf1-a4e7-4a918436540e req-0852e5f5-a1c8-4bba-954f-1abb0836ace1 service nova] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Refreshing instance network info cache due to event network-changed-bf46d9d3-89c8-43be-b311-e9c6b68fcb9e. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:09:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-f24c5d24-6008-4cf1-a4e7-4a918436540e req-0852e5f5-a1c8-4bba-954f-1abb0836ace1 service nova] Acquiring lock "refresh_cache-4647e942-c600-4a9c-95ba-a59064d04619" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:09:18 user nova-compute[74840]: DEBUG nova.network.neutron [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:09:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4647e942-c600-4a9c-95ba-a59064d04619/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:09:18 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Cannot resize image /opt/stack/data/nova/instances/4647e942-c600-4a9c-95ba-a59064d04619/disk to a smaller size. {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 12:09:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Created local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 12:09:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Ensure instance console log exists: /opt/stack/data/nova/instances/4647e942-c600-4a9c-95ba-a59064d04619/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:09:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:09:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:09:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:09:19 user nova-compute[74840]: DEBUG nova.network.neutron [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Updating instance_info_cache with network_info: [{"id": "bf46d9d3-89c8-43be-b311-e9c6b68fcb9e", "address": "fa:16:3e:84:44:b2", "network": {"id": "c40fb022-567d-4eee-8ac6-14b45b43c92b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1575943545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8d34c1c5dea4b59b332d650f2639c20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf46d9d3-89", "ovs_interfaceid": "bf46d9d3-89c8-43be-b311-e9c6b68fcb9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:09:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Releasing lock "refresh_cache-4647e942-c600-4a9c-95ba-a59064d04619" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:09:19 user nova-compute[74840]: DEBUG nova.compute.manager [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Instance network_info: |[{"id": "bf46d9d3-89c8-43be-b311-e9c6b68fcb9e", "address": "fa:16:3e:84:44:b2", "network": {"id": "c40fb022-567d-4eee-8ac6-14b45b43c92b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1575943545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8d34c1c5dea4b59b332d650f2639c20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf46d9d3-89", "ovs_interfaceid": "bf46d9d3-89c8-43be-b311-e9c6b68fcb9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 12:09:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-f24c5d24-6008-4cf1-a4e7-4a918436540e req-0852e5f5-a1c8-4bba-954f-1abb0836ace1 service nova] Acquired lock "refresh_cache-4647e942-c600-4a9c-95ba-a59064d04619" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:09:19 user nova-compute[74840]: DEBUG nova.network.neutron [req-f24c5d24-6008-4cf1-a4e7-4a918436540e req-0852e5f5-a1c8-4bba-954f-1abb0836ace1 service nova] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Refreshing network info cache for port bf46d9d3-89c8-43be-b311-e9c6b68fcb9e {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:09:19 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Start _get_guest_xml network_info=[{"id": "bf46d9d3-89c8-43be-b311-e9c6b68fcb9e", "address": "fa:16:3e:84:44:b2", "network": {"id": "c40fb022-567d-4eee-8ac6-14b45b43c92b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1575943545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8d34c1c5dea4b59b332d650f2639c20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf46d9d3-89", "ovs_interfaceid": "bf46d9d3-89c8-43be-b311-e9c6b68fcb9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:09:06Z,direct_url=<?>,disk_format='qcow2',id=3406d889-0335-4bdc-84d9-0f98ada5c11a,min_disk=0,min_ram=0,name='',owner='125250c28cfe42e1bc16454f55a00f43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:09:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/sda', 'disk_bus': 'scsi', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'image_id': '3406d889-0335-4bdc-84d9-0f98ada5c11a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:09:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:19 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:09:19 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:09:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:19 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:09:19 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:09:19 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:09:19 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:09:19 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:09:19 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:09:06Z,direct_url=<?>,disk_format='qcow2',id=3406d889-0335-4bdc-84d9-0f98ada5c11a,min_disk=0,min_ram=0,name='',owner='125250c28cfe42e1bc16454f55a00f43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:09:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:09:19 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:09:19 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:09:19 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:09:19 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:09:19 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:09:19 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:09:19 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:09:19 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:09:19 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:09:19 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:09:19 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:09:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-261667012',display_name='tempest-AttachSCSIVolumeTestJSON-server-261667012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-261667012',id=5,image_ref='3406d889-0335-4bdc-84d9-0f98ada5c11a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOfxgYUfKvo74kGCGXAkc7EgNkeogTmyx9QsDwXy07UN7URUO0RM2LfP+tpg18lKKXctslOHwapdvtF+bpBDofEN2nSncWmfPaEwUv1nSwfR4ko4wf9dT9AoRawwkprGAw==',key_name='tempest-keypair-1416255561',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8d34c1c5dea4b59b332d650f2639c20',ramdisk_id='',reservation_id='r-tes958mw',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3406d889-0335-4bdc-84d9-0f98ada5c11a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-424545312',owner_user_name='tempest-AttachSCSIVolumeTestJSON-424545312-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:09:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1041650fc2f4bc3aa7313d901af94a2',uuid=4647e942-c600-4a9c-95ba-a59064d04619,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf46d9d3-89c8-43be-b311-e9c6b68fcb9e", "address": "fa:16:3e:84:44:b2", "network": {"id": "c40fb022-567d-4eee-8ac6-14b45b43c92b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1575943545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8d34c1c5dea4b59b332d650f2639c20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf46d9d3-89", "ovs_interfaceid": "bf46d9d3-89c8-43be-b311-e9c6b68fcb9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:09:19 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Converting VIF {"id": "bf46d9d3-89c8-43be-b311-e9c6b68fcb9e", "address": "fa:16:3e:84:44:b2", "network": {"id": "c40fb022-567d-4eee-8ac6-14b45b43c92b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1575943545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8d34c1c5dea4b59b332d650f2639c20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf46d9d3-89", "ovs_interfaceid": "bf46d9d3-89c8-43be-b311-e9c6b68fcb9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:09:19 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:44:b2,bridge_name='br-int',has_traffic_filtering=True,id=bf46d9d3-89c8-43be-b311-e9c6b68fcb9e,network=Network(c40fb022-567d-4eee-8ac6-14b45b43c92b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf46d9d3-89') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:09:19 user nova-compute[74840]: DEBUG nova.objects.instance [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Lazy-loading 'pci_devices' on Instance uuid 4647e942-c600-4a9c-95ba-a59064d04619 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:09:19 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:09:19 user nova-compute[74840]:   <uuid>4647e942-c600-4a9c-95ba-a59064d04619</uuid>
Nov 08 12:09:19 user nova-compute[74840]:   <name>instance-00000005</name>
Nov 08 12:09:19 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:09:19 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:09:19 user nova-compute[74840]:   <metadata>
Nov 08 12:09:19 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:09:19 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:09:19 user nova-compute[74840]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-261667012</nova:name>
Nov 08 12:09:19 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:09:19</nova:creationTime>
Nov 08 12:09:19 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:09:19 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:09:19 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:09:19 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:09:19 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:09:19 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:09:19 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:09:19 user nova-compute[74840]:       <nova:owner>
Nov 08 12:09:19 user nova-compute[74840]:         <nova:user uuid="b1041650fc2f4bc3aa7313d901af94a2">tempest-AttachSCSIVolumeTestJSON-424545312-project-member</nova:user>
Nov 08 12:09:19 user nova-compute[74840]:         <nova:project uuid="e8d34c1c5dea4b59b332d650f2639c20">tempest-AttachSCSIVolumeTestJSON-424545312</nova:project>
Nov 08 12:09:19 user nova-compute[74840]:       </nova:owner>
Nov 08 12:09:19 user nova-compute[74840]:       <nova:root type="image" uuid="3406d889-0335-4bdc-84d9-0f98ada5c11a"/>
Nov 08 12:09:19 user nova-compute[74840]:       <nova:ports>
Nov 08 12:09:19 user nova-compute[74840]:         <nova:port uuid="bf46d9d3-89c8-43be-b311-e9c6b68fcb9e">
Nov 08 12:09:19 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 08 12:09:19 user nova-compute[74840]:         </nova:port>
Nov 08 12:09:19 user nova-compute[74840]:       </nova:ports>
Nov 08 12:09:19 user nova-compute[74840]:     </nova:instance>
Nov 08 12:09:19 user nova-compute[74840]:   </metadata>
Nov 08 12:09:19 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:09:19 user nova-compute[74840]:     <system>
Nov 08 12:09:19 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:09:19 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:09:19 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:09:19 user nova-compute[74840]:       <entry name="serial">4647e942-c600-4a9c-95ba-a59064d04619</entry>
Nov 08 12:09:19 user nova-compute[74840]:       <entry name="uuid">4647e942-c600-4a9c-95ba-a59064d04619</entry>
Nov 08 12:09:19 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:09:19 user nova-compute[74840]:     </system>
Nov 08 12:09:19 user nova-compute[74840]:   </sysinfo>
Nov 08 12:09:19 user nova-compute[74840]:   <os>
Nov 08 12:09:19 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:09:19 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:09:19 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:09:19 user nova-compute[74840]:   </os>
Nov 08 12:09:19 user nova-compute[74840]:   <features>
Nov 08 12:09:19 user nova-compute[74840]:     <acpi/>
Nov 08 12:09:19 user nova-compute[74840]:     <apic/>
Nov 08 12:09:19 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:09:19 user nova-compute[74840]:   </features>
Nov 08 12:09:19 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:09:19 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:09:19 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:09:19 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:09:19 user nova-compute[74840]:   </clock>
Nov 08 12:09:19 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:09:19 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:09:19 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:09:19 user nova-compute[74840]:   </cpu>
Nov 08 12:09:19 user nova-compute[74840]:   <devices>
Nov 08 12:09:19 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:09:19 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:09:19 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/4647e942-c600-4a9c-95ba-a59064d04619/disk"/>
Nov 08 12:09:19 user nova-compute[74840]:       <target dev="sda" bus="scsi"/>
Nov 08 12:09:19 user nova-compute[74840]:       <address type="drive" controller="0" unit="0"/>
Nov 08 12:09:19 user nova-compute[74840]:     </disk>
Nov 08 12:09:19 user nova-compute[74840]:     <disk type="file" device="cdrom">
Nov 08 12:09:19 user nova-compute[74840]:       <driver name="qemu" type="raw" cache="none"/>
Nov 08 12:09:19 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/4647e942-c600-4a9c-95ba-a59064d04619/disk.config"/>
Nov 08 12:09:19 user nova-compute[74840]:       <target dev="sdb" bus="scsi"/>
Nov 08 12:09:19 user nova-compute[74840]:       <address type="drive" controller="0" unit="1"/>
Nov 08 12:09:19 user nova-compute[74840]:     </disk>
Nov 08 12:09:19 user nova-compute[74840]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 08 12:09:19 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:09:19 user nova-compute[74840]:       <mac address="fa:16:3e:84:44:b2"/>
Nov 08 12:09:19 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:09:19 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:09:19 user nova-compute[74840]:       <target dev="tapbf46d9d3-89"/>
Nov 08 12:09:19 user nova-compute[74840]:     </interface>
Nov 08 12:09:19 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:09:19 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/4647e942-c600-4a9c-95ba-a59064d04619/console.log" append="off"/>
Nov 08 12:09:19 user nova-compute[74840]:     </serial>
Nov 08 12:09:19 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:09:19 user nova-compute[74840]:     <video>
Nov 08 12:09:19 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:09:19 user nova-compute[74840]:     </video>
Nov 08 12:09:19 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:09:19 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:09:19 user nova-compute[74840]:     </rng>
Nov 08 12:09:19 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:09:19 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:09:19 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:09:19 user nova-compute[74840]:     </memballoon>
Nov 08 12:09:19 user nova-compute[74840]:   </devices>
Nov 08 12:09:19 user nova-compute[74840]: </domain>
Nov 08 12:09:19 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:09:19 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:09:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-261667012',display_name='tempest-AttachSCSIVolumeTestJSON-server-261667012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-261667012',id=5,image_ref='3406d889-0335-4bdc-84d9-0f98ada5c11a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOfxgYUfKvo74kGCGXAkc7EgNkeogTmyx9QsDwXy07UN7URUO0RM2LfP+tpg18lKKXctslOHwapdvtF+bpBDofEN2nSncWmfPaEwUv1nSwfR4ko4wf9dT9AoRawwkprGAw==',key_name='tempest-keypair-1416255561',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8d34c1c5dea4b59b332d650f2639c20',ramdisk_id='',reservation_id='r-tes958mw',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3406d889-0335-4bdc-84d9-0f98ada5c11a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-424545312',owner_user_name='tempest-AttachSCSIVolumeTestJSON-424545312-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:09:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1041650fc2f4bc3aa7313d901af94a2',uuid=4647e942-c600-4a9c-95ba-a59064d04619,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf46d9d3-89c8-43be-b311-e9c6b68fcb9e", "address": "fa:16:3e:84:44:b2", "network": {"id": "c40fb022-567d-4eee-8ac6-14b45b43c92b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1575943545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8d34c1c5dea4b59b332d650f2639c20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf46d9d3-89", "ovs_interfaceid": "bf46d9d3-89c8-43be-b311-e9c6b68fcb9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:09:19 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Converting VIF {"id": "bf46d9d3-89c8-43be-b311-e9c6b68fcb9e", "address": "fa:16:3e:84:44:b2", "network": {"id": "c40fb022-567d-4eee-8ac6-14b45b43c92b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1575943545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8d34c1c5dea4b59b332d650f2639c20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf46d9d3-89", "ovs_interfaceid": "bf46d9d3-89c8-43be-b311-e9c6b68fcb9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:09:19 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:44:b2,bridge_name='br-int',has_traffic_filtering=True,id=bf46d9d3-89c8-43be-b311-e9c6b68fcb9e,network=Network(c40fb022-567d-4eee-8ac6-14b45b43c92b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf46d9d3-89') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:09:19 user nova-compute[74840]: DEBUG os_vif [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:44:b2,bridge_name='br-int',has_traffic_filtering=True,id=bf46d9d3-89c8-43be-b311-e9c6b68fcb9e,network=Network(c40fb022-567d-4eee-8ac6-14b45b43c92b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf46d9d3-89') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:09:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:09:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:09:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9f6bcffd-4627-5798-a3ce-7ef8ca133687', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:09:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf46d9d3-89, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:09:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbf46d9d3-89, col_values=(('qos', UUID('ab729347-dfb9-4955-ad61-b0496f980db9')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:09:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbf46d9d3-89, col_values=(('external_ids', {'iface-id': 'bf46d9d3-89c8-43be-b311-e9c6b68fcb9e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:44:b2', 'vm-uuid': '4647e942-c600-4a9c-95ba-a59064d04619'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:09:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:09:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:19 user nova-compute[74840]: INFO os_vif [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:44:b2,bridge_name='br-int',has_traffic_filtering=True,id=bf46d9d3-89c8-43be-b311-e9c6b68fcb9e,network=Network(c40fb022-567d-4eee-8ac6-14b45b43c92b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf46d9d3-89')
Nov 08 12:09:19 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] No BDM found with device name sda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:09:19 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:09:19 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] No VIF found with MAC fa:16:3e:84:44:b2, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:09:19 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Using config drive
Nov 08 12:09:20 user nova-compute[74840]: DEBUG nova.compute.manager [req-1bb8bf42-0041-44e0-8dc6-fee6c651cd94 req-f4b3a4d3-d192-479c-8cc6-eb5c74aa559d service nova] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Received event network-vif-plugged-b910fb2a-440c-426f-a000-064149073835 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:09:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-1bb8bf42-0041-44e0-8dc6-fee6c651cd94 req-f4b3a4d3-d192-479c-8cc6-eb5c74aa559d service nova] Acquiring lock "684b8be2-7f8f-499f-8885-c9d1c86eef2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:09:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-1bb8bf42-0041-44e0-8dc6-fee6c651cd94 req-f4b3a4d3-d192-479c-8cc6-eb5c74aa559d service nova] Lock "684b8be2-7f8f-499f-8885-c9d1c86eef2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:09:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-1bb8bf42-0041-44e0-8dc6-fee6c651cd94 req-f4b3a4d3-d192-479c-8cc6-eb5c74aa559d service nova] Lock "684b8be2-7f8f-499f-8885-c9d1c86eef2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:09:20 user nova-compute[74840]: DEBUG nova.compute.manager [req-1bb8bf42-0041-44e0-8dc6-fee6c651cd94 req-f4b3a4d3-d192-479c-8cc6-eb5c74aa559d service nova] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] No waiting events found dispatching network-vif-plugged-b910fb2a-440c-426f-a000-064149073835 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:09:20 user nova-compute[74840]: WARNING nova.compute.manager [req-1bb8bf42-0041-44e0-8dc6-fee6c651cd94 req-f4b3a4d3-d192-479c-8cc6-eb5c74aa559d service nova] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Received unexpected event network-vif-plugged-b910fb2a-440c-426f-a000-064149073835 for instance with vm_state building and task_state spawning.
Nov 08 12:09:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:20 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Creating config drive at /opt/stack/data/nova/instances/4647e942-c600-4a9c-95ba-a59064d04619/disk.config
Nov 08 12:09:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4647e942-c600-4a9c-95ba-a59064d04619/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmps2b97444 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:09:20 user nova-compute[74840]: DEBUG nova.network.neutron [req-f24c5d24-6008-4cf1-a4e7-4a918436540e req-0852e5f5-a1c8-4bba-954f-1abb0836ace1 service nova] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Updated VIF entry in instance network info cache for port bf46d9d3-89c8-43be-b311-e9c6b68fcb9e. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:09:20 user nova-compute[74840]: DEBUG nova.network.neutron [req-f24c5d24-6008-4cf1-a4e7-4a918436540e req-0852e5f5-a1c8-4bba-954f-1abb0836ace1 service nova] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Updating instance_info_cache with network_info: [{"id": "bf46d9d3-89c8-43be-b311-e9c6b68fcb9e", "address": "fa:16:3e:84:44:b2", "network": {"id": "c40fb022-567d-4eee-8ac6-14b45b43c92b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1575943545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8d34c1c5dea4b59b332d650f2639c20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf46d9d3-89", "ovs_interfaceid": "bf46d9d3-89c8-43be-b311-e9c6b68fcb9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:09:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4647e942-c600-4a9c-95ba-a59064d04619/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmps2b97444" returned: 0 in 0.064s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:09:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-f24c5d24-6008-4cf1-a4e7-4a918436540e req-0852e5f5-a1c8-4bba-954f-1abb0836ace1 service nova] Releasing lock "refresh_cache-4647e942-c600-4a9c-95ba-a59064d04619" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:09:20 user nova-compute[74840]: DEBUG nova.compute.manager [req-02cc25fe-1ff9-4f83-95b3-ed0eabbfe4fd req-89ee2fae-2af8-45d0-954e-56b61fd5d87b service nova] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Received event network-vif-plugged-fb33b08e-aef7-4999-9121-3caf5d027586 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:09:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-02cc25fe-1ff9-4f83-95b3-ed0eabbfe4fd req-89ee2fae-2af8-45d0-954e-56b61fd5d87b service nova] Acquiring lock "43eae335-a4a0-40b2-8cd4-c7881cd397b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:09:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-02cc25fe-1ff9-4f83-95b3-ed0eabbfe4fd req-89ee2fae-2af8-45d0-954e-56b61fd5d87b service nova] Lock "43eae335-a4a0-40b2-8cd4-c7881cd397b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:09:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-02cc25fe-1ff9-4f83-95b3-ed0eabbfe4fd req-89ee2fae-2af8-45d0-954e-56b61fd5d87b service nova] Lock "43eae335-a4a0-40b2-8cd4-c7881cd397b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:09:20 user nova-compute[74840]: DEBUG nova.compute.manager [req-02cc25fe-1ff9-4f83-95b3-ed0eabbfe4fd req-89ee2fae-2af8-45d0-954e-56b61fd5d87b service nova] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] No waiting events found dispatching network-vif-plugged-fb33b08e-aef7-4999-9121-3caf5d027586 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:09:20 user nova-compute[74840]: WARNING nova.compute.manager [req-02cc25fe-1ff9-4f83-95b3-ed0eabbfe4fd req-89ee2fae-2af8-45d0-954e-56b61fd5d87b service nova] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Received unexpected event network-vif-plugged-fb33b08e-aef7-4999-9121-3caf5d027586 for instance with vm_state active and task_state None.
Nov 08 12:09:20 user nova-compute[74840]: DEBUG nova.compute.manager [req-02cc25fe-1ff9-4f83-95b3-ed0eabbfe4fd req-89ee2fae-2af8-45d0-954e-56b61fd5d87b service nova] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Received event network-vif-plugged-fb33b08e-aef7-4999-9121-3caf5d027586 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:09:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-02cc25fe-1ff9-4f83-95b3-ed0eabbfe4fd req-89ee2fae-2af8-45d0-954e-56b61fd5d87b service nova] Acquiring lock "43eae335-a4a0-40b2-8cd4-c7881cd397b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:09:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-02cc25fe-1ff9-4f83-95b3-ed0eabbfe4fd req-89ee2fae-2af8-45d0-954e-56b61fd5d87b service nova] Lock "43eae335-a4a0-40b2-8cd4-c7881cd397b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:09:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-02cc25fe-1ff9-4f83-95b3-ed0eabbfe4fd req-89ee2fae-2af8-45d0-954e-56b61fd5d87b service nova] Lock "43eae335-a4a0-40b2-8cd4-c7881cd397b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:09:20 user nova-compute[74840]: DEBUG nova.compute.manager [req-02cc25fe-1ff9-4f83-95b3-ed0eabbfe4fd req-89ee2fae-2af8-45d0-954e-56b61fd5d87b service nova] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] No waiting events found dispatching network-vif-plugged-fb33b08e-aef7-4999-9121-3caf5d027586 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:09:20 user nova-compute[74840]: WARNING nova.compute.manager [req-02cc25fe-1ff9-4f83-95b3-ed0eabbfe4fd req-89ee2fae-2af8-45d0-954e-56b61fd5d87b service nova] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Received unexpected event network-vif-plugged-fb33b08e-aef7-4999-9121-3caf5d027586 for instance with vm_state active and task_state None.
Nov 08 12:09:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:22 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:22 user nova-compute[74840]: DEBUG nova.compute.manager [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:09:22 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:09:22 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Instance spawned successfully.
Nov 08 12:09:22 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:09:22 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:22 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:22 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Found default for hw_cdrom_bus of ide {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:09:22 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Found default for hw_disk_bus of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:09:22 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:09:22 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:09:22 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Found default for hw_video_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:09:22 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Found default for hw_vif_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:09:22 user nova-compute[74840]: INFO nova.compute.manager [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Took 8.20 seconds to spawn the instance on the hypervisor.
Nov 08 12:09:22 user nova-compute[74840]: DEBUG nova.compute.manager [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:09:22 user nova-compute[74840]: DEBUG nova.compute.manager [req-4025aa32-5b4f-4af1-b319-566b6d0fd605 req-f513fd73-50ad-43e9-8e27-22ed5327e64c service nova] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Received event network-vif-plugged-b910fb2a-440c-426f-a000-064149073835 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:09:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4025aa32-5b4f-4af1-b319-566b6d0fd605 req-f513fd73-50ad-43e9-8e27-22ed5327e64c service nova] Acquiring lock "684b8be2-7f8f-499f-8885-c9d1c86eef2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:09:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4025aa32-5b4f-4af1-b319-566b6d0fd605 req-f513fd73-50ad-43e9-8e27-22ed5327e64c service nova] Lock "684b8be2-7f8f-499f-8885-c9d1c86eef2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:09:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4025aa32-5b4f-4af1-b319-566b6d0fd605 req-f513fd73-50ad-43e9-8e27-22ed5327e64c service nova] Lock "684b8be2-7f8f-499f-8885-c9d1c86eef2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:09:22 user nova-compute[74840]: DEBUG nova.compute.manager [req-4025aa32-5b4f-4af1-b319-566b6d0fd605 req-f513fd73-50ad-43e9-8e27-22ed5327e64c service nova] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] No waiting events found dispatching network-vif-plugged-b910fb2a-440c-426f-a000-064149073835 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:09:22 user nova-compute[74840]: WARNING nova.compute.manager [req-4025aa32-5b4f-4af1-b319-566b6d0fd605 req-f513fd73-50ad-43e9-8e27-22ed5327e64c service nova] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Received unexpected event network-vif-plugged-b910fb2a-440c-426f-a000-064149073835 for instance with vm_state building and task_state spawning.
Nov 08 12:09:22 user nova-compute[74840]: INFO nova.compute.manager [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Took 9.27 seconds to build instance.
Nov 08 12:09:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cf08d251-c8b1-4fbc-acdd-984c522f111a tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Lock "684b8be2-7f8f-499f-8885-c9d1c86eef2f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.519s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:09:22 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:22 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:22 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:24 user nova-compute[74840]: DEBUG nova.compute.manager [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:09:24 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:09:24 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Instance spawned successfully.
Nov 08 12:09:24 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:09:24 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:09:24 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:09:24 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Found default for hw_video_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:09:24 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Found default for hw_vif_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:09:24 user nova-compute[74840]: INFO nova.compute.manager [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Took 8.54 seconds to spawn the instance on the hypervisor.
Nov 08 12:09:24 user nova-compute[74840]: DEBUG nova.compute.manager [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:09:24 user nova-compute[74840]: INFO nova.compute.manager [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Took 9.68 seconds to build instance.
Nov 08 12:09:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0a8ebeaf-871c-493f-af3d-8117d27852c9 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Lock "4647e942-c600-4a9c-95ba-a59064d04619" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.867s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:09:25 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:26 user nova-compute[74840]: DEBUG nova.compute.manager [req-fb995f27-a17e-45c4-88c4-37fc91a0cb29 req-1aa379e5-da86-4b5d-b9f2-d2605e07a88e service nova] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Received event network-vif-plugged-bf46d9d3-89c8-43be-b311-e9c6b68fcb9e {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:09:26 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-fb995f27-a17e-45c4-88c4-37fc91a0cb29 req-1aa379e5-da86-4b5d-b9f2-d2605e07a88e service nova] Acquiring lock "4647e942-c600-4a9c-95ba-a59064d04619-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:09:26 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-fb995f27-a17e-45c4-88c4-37fc91a0cb29 req-1aa379e5-da86-4b5d-b9f2-d2605e07a88e service nova] Lock "4647e942-c600-4a9c-95ba-a59064d04619-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:09:26 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-fb995f27-a17e-45c4-88c4-37fc91a0cb29 req-1aa379e5-da86-4b5d-b9f2-d2605e07a88e service nova] Lock "4647e942-c600-4a9c-95ba-a59064d04619-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:09:26 user nova-compute[74840]: DEBUG nova.compute.manager [req-fb995f27-a17e-45c4-88c4-37fc91a0cb29 req-1aa379e5-da86-4b5d-b9f2-d2605e07a88e service nova] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] No waiting events found dispatching network-vif-plugged-bf46d9d3-89c8-43be-b311-e9c6b68fcb9e {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:09:26 user nova-compute[74840]: WARNING nova.compute.manager [req-fb995f27-a17e-45c4-88c4-37fc91a0cb29 req-1aa379e5-da86-4b5d-b9f2-d2605e07a88e service nova] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Received unexpected event network-vif-plugged-bf46d9d3-89c8-43be-b311-e9c6b68fcb9e for instance with vm_state active and task_state None.
Nov 08 12:09:26 user nova-compute[74840]: DEBUG nova.compute.manager [req-633f4d96-433a-4f39-84cf-6b32b6293e5f req-219539cd-4b7c-4282-9de4-2564ad850e18 service nova] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Received event network-vif-plugged-b48b5298-045f-463d-9585-fbb5feb869bf {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:09:26 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-633f4d96-433a-4f39-84cf-6b32b6293e5f req-219539cd-4b7c-4282-9de4-2564ad850e18 service nova] Acquiring lock "3b10fda0-9488-4089-8033-dd1c8e42af89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:09:26 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-633f4d96-433a-4f39-84cf-6b32b6293e5f req-219539cd-4b7c-4282-9de4-2564ad850e18 service nova] Lock "3b10fda0-9488-4089-8033-dd1c8e42af89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:09:26 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-633f4d96-433a-4f39-84cf-6b32b6293e5f req-219539cd-4b7c-4282-9de4-2564ad850e18 service nova] Lock "3b10fda0-9488-4089-8033-dd1c8e42af89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:09:26 user nova-compute[74840]: DEBUG nova.compute.manager [req-633f4d96-433a-4f39-84cf-6b32b6293e5f req-219539cd-4b7c-4282-9de4-2564ad850e18 service nova] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] No waiting events found dispatching network-vif-plugged-b48b5298-045f-463d-9585-fbb5feb869bf {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:09:26 user nova-compute[74840]: WARNING nova.compute.manager [req-633f4d96-433a-4f39-84cf-6b32b6293e5f req-219539cd-4b7c-4282-9de4-2564ad850e18 service nova] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Received unexpected event network-vif-plugged-b48b5298-045f-463d-9585-fbb5feb869bf for instance with vm_state active and task_state None.
Nov 08 12:09:28 user nova-compute[74840]: DEBUG nova.compute.manager [req-6a44b3fa-a83b-4a75-81b5-734a7d24807f req-d76eff35-3aa9-414d-809d-396cd1a42e3f service nova] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Received event network-vif-plugged-bf46d9d3-89c8-43be-b311-e9c6b68fcb9e {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:09:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-6a44b3fa-a83b-4a75-81b5-734a7d24807f req-d76eff35-3aa9-414d-809d-396cd1a42e3f service nova] Acquiring lock "4647e942-c600-4a9c-95ba-a59064d04619-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:09:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-6a44b3fa-a83b-4a75-81b5-734a7d24807f req-d76eff35-3aa9-414d-809d-396cd1a42e3f service nova] Lock "4647e942-c600-4a9c-95ba-a59064d04619-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.008s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:09:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-6a44b3fa-a83b-4a75-81b5-734a7d24807f req-d76eff35-3aa9-414d-809d-396cd1a42e3f service nova] Lock "4647e942-c600-4a9c-95ba-a59064d04619-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:09:28 user nova-compute[74840]: DEBUG nova.compute.manager [req-6a44b3fa-a83b-4a75-81b5-734a7d24807f req-d76eff35-3aa9-414d-809d-396cd1a42e3f service nova] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] No waiting events found dispatching network-vif-plugged-bf46d9d3-89c8-43be-b311-e9c6b68fcb9e {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:09:28 user nova-compute[74840]: WARNING nova.compute.manager [req-6a44b3fa-a83b-4a75-81b5-734a7d24807f req-d76eff35-3aa9-414d-809d-396cd1a42e3f service nova] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Received unexpected event network-vif-plugged-bf46d9d3-89c8-43be-b311-e9c6b68fcb9e for instance with vm_state active and task_state None.
Nov 08 12:09:28 user nova-compute[74840]: DEBUG nova.compute.manager [req-2e7a2efd-1b0b-4554-b4e4-b777d03ad5a5 req-631f8ff2-d7d4-422c-b684-5305fa5bff18 service nova] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Received event network-vif-plugged-b48b5298-045f-463d-9585-fbb5feb869bf {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:09:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2e7a2efd-1b0b-4554-b4e4-b777d03ad5a5 req-631f8ff2-d7d4-422c-b684-5305fa5bff18 service nova] Acquiring lock "3b10fda0-9488-4089-8033-dd1c8e42af89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:09:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2e7a2efd-1b0b-4554-b4e4-b777d03ad5a5 req-631f8ff2-d7d4-422c-b684-5305fa5bff18 service nova] Lock "3b10fda0-9488-4089-8033-dd1c8e42af89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:09:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2e7a2efd-1b0b-4554-b4e4-b777d03ad5a5 req-631f8ff2-d7d4-422c-b684-5305fa5bff18 service nova] Lock "3b10fda0-9488-4089-8033-dd1c8e42af89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:09:28 user nova-compute[74840]: DEBUG nova.compute.manager [req-2e7a2efd-1b0b-4554-b4e4-b777d03ad5a5 req-631f8ff2-d7d4-422c-b684-5305fa5bff18 service nova] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] No waiting events found dispatching network-vif-plugged-b48b5298-045f-463d-9585-fbb5feb869bf {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:09:28 user nova-compute[74840]: WARNING nova.compute.manager [req-2e7a2efd-1b0b-4554-b4e4-b777d03ad5a5 req-631f8ff2-d7d4-422c-b684-5305fa5bff18 service nova] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Received unexpected event network-vif-plugged-b48b5298-045f-463d-9585-fbb5feb869bf for instance with vm_state active and task_state None.
Nov 08 12:09:29 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:30 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Acquiring lock "58f2a38d-14cf-4199-bb04-179ab4605a9e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:09:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Lock "58f2a38d-14cf-4199-bb04-179ab4605a9e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:09:31 user nova-compute[74840]: DEBUG nova.compute.manager [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Starting instance... {{(pid=74840) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 12:09:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:09:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:09:31 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:09:31 user nova-compute[74840]: INFO nova.compute.claims [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Claim successful on node user
Nov 08 12:09:31 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:09:31 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:09:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.363s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:09:31 user nova-compute[74840]: DEBUG nova.compute.manager [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Start building networks asynchronously for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 12:09:31 user nova-compute[74840]: DEBUG nova.compute.manager [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Allocating IP information in the background. {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 12:09:31 user nova-compute[74840]: DEBUG nova.network.neutron [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 12:09:31 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 12:09:31 user nova-compute[74840]: DEBUG nova.compute.manager [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Start building block device mappings for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 12:09:31 user nova-compute[74840]: DEBUG nova.policy [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d0c7a84ad7c46969004b4040c5cb3d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0b4cf1a052c48c2a33f1f645c2b52a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 12:09:31 user nova-compute[74840]: DEBUG nova.compute.manager [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Start spawning the instance on the hypervisor. {{(pid=74840) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 12:09:31 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:09:31 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Creating image(s)
Nov 08 12:09:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Acquiring lock "/opt/stack/data/nova/instances/58f2a38d-14cf-4199-bb04-179ab4605a9e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:09:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Lock "/opt/stack/data/nova/instances/58f2a38d-14cf-4199-bb04-179ab4605a9e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:09:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Lock "/opt/stack/data/nova/instances/58f2a38d-14cf-4199-bb04-179ab4605a9e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:09:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:09:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.201s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:09:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Acquiring lock "5d26578eba85497f494c575690c4248f381a0fe6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:09:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:09:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:09:32 user nova-compute[74840]: DEBUG nova.network.neutron [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Successfully created port: 62ca1e88-0819-443c-890f-05f6538b8f3e {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:09:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.212s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:09:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/58f2a38d-14cf-4199-bb04-179ab4605a9e/disk 1073741824 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:09:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/58f2a38d-14cf-4199-bb04-179ab4605a9e/disk 1073741824" returned: 0 in 0.096s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:09:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.314s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:09:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:09:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.265s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:09:32 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Checking if we can resize image /opt/stack/data/nova/instances/58f2a38d-14cf-4199-bb04-179ab4605a9e/disk. size=1073741824 {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 12:09:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2a38d-14cf-4199-bb04-179ab4605a9e/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:09:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2a38d-14cf-4199-bb04-179ab4605a9e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:09:32 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Cannot resize image /opt/stack/data/nova/instances/58f2a38d-14cf-4199-bb04-179ab4605a9e/disk to a smaller size. {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 12:09:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Created local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 12:09:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Ensure instance console log exists: /opt/stack/data/nova/instances/58f2a38d-14cf-4199-bb04-179ab4605a9e/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:09:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:09:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:09:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG nova.network.neutron [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Successfully updated port: 62ca1e88-0819-443c-890f-05f6538b8f3e {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Acquiring lock "refresh_cache-58f2a38d-14cf-4199-bb04-179ab4605a9e" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Acquired lock "refresh_cache-58f2a38d-14cf-4199-bb04-179ab4605a9e" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG nova.network.neutron [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG nova.compute.manager [req-2cafad4b-e51f-4a90-b5e6-ca37cec21782 req-1a9e1d4f-ec2d-4b7e-b1f8-a378c942c397 service nova] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Received event network-changed-62ca1e88-0819-443c-890f-05f6538b8f3e {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG nova.compute.manager [req-2cafad4b-e51f-4a90-b5e6-ca37cec21782 req-1a9e1d4f-ec2d-4b7e-b1f8-a378c942c397 service nova] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Refreshing instance network info cache due to event network-changed-62ca1e88-0819-443c-890f-05f6538b8f3e. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2cafad4b-e51f-4a90-b5e6-ca37cec21782 req-1a9e1d4f-ec2d-4b7e-b1f8-a378c942c397 service nova] Acquiring lock "refresh_cache-58f2a38d-14cf-4199-bb04-179ab4605a9e" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG nova.network.neutron [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG nova.network.neutron [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Updating instance_info_cache with network_info: [{"id": "62ca1e88-0819-443c-890f-05f6538b8f3e", "address": "fa:16:3e:3b:d1:37", "network": {"id": "6462e35c-7722-46f1-afee-a088965b85e8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-713817565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b4cf1a052c48c2a33f1f645c2b52a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62ca1e88-08", "ovs_interfaceid": "62ca1e88-0819-443c-890f-05f6538b8f3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Releasing lock "refresh_cache-58f2a38d-14cf-4199-bb04-179ab4605a9e" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG nova.compute.manager [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Instance network_info: |[{"id": "62ca1e88-0819-443c-890f-05f6538b8f3e", "address": "fa:16:3e:3b:d1:37", "network": {"id": "6462e35c-7722-46f1-afee-a088965b85e8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-713817565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b4cf1a052c48c2a33f1f645c2b52a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62ca1e88-08", "ovs_interfaceid": "62ca1e88-0819-443c-890f-05f6538b8f3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2cafad4b-e51f-4a90-b5e6-ca37cec21782 req-1a9e1d4f-ec2d-4b7e-b1f8-a378c942c397 service nova] Acquired lock "refresh_cache-58f2a38d-14cf-4199-bb04-179ab4605a9e" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG nova.network.neutron [req-2cafad4b-e51f-4a90-b5e6-ca37cec21782 req-1a9e1d4f-ec2d-4b7e-b1f8-a378c942c397 service nova] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Refreshing network info cache for port 62ca1e88-0819-443c-890f-05f6538b8f3e {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Start _get_guest_xml network_info=[{"id": "62ca1e88-0819-443c-890f-05f6538b8f3e", "address": "fa:16:3e:3b:d1:37", "network": {"id": "6462e35c-7722-46f1-afee-a088965b85e8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-713817565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b4cf1a052c48c2a33f1f645c2b52a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62ca1e88-08", "ovs_interfaceid": "62ca1e88-0819-443c-890f-05f6538b8f3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'image_id': '4fa17706-d304-4117-a420-dab994c703dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:09:33 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:09:33 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:09:33 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:09:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1629452286',display_name='tempest-TestVolumeSwap-server-1629452286',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1629452286',id=6,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6exY8SfNI/CUUXXb92KxNWgYjX2NcNT6pHGUBlYjoEhsM9TUD+mJVBMTG/PBbjkv5xvH+P17cCXsP2gTNLFxi0sZC7+DwCBmePqadVL6pp0w09KHcOTjTo/BlUCjybAg==',key_name='tempest-keypair-600142584',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0b4cf1a052c48c2a33f1f645c2b52a8',ramdisk_id='',reservation_id='r-bqu4wzxd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-2072360936',owner_user_name='tempest-TestVolumeSwap-2072360936-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:09:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d0c7a84ad7c46969004b4040c5cb3d7',uuid=58f2a38d-14cf-4199-bb04-179ab4605a9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62ca1e88-0819-443c-890f-05f6538b8f3e", "address": "fa:16:3e:3b:d1:37", "network": {"id": "6462e35c-7722-46f1-afee-a088965b85e8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-713817565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b4cf1a052c48c2a33f1f645c2b52a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62ca1e88-08", "ovs_interfaceid": "62ca1e88-0819-443c-890f-05f6538b8f3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Converting VIF {"id": "62ca1e88-0819-443c-890f-05f6538b8f3e", "address": "fa:16:3e:3b:d1:37", "network": {"id": "6462e35c-7722-46f1-afee-a088965b85e8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-713817565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b4cf1a052c48c2a33f1f645c2b52a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62ca1e88-08", "ovs_interfaceid": "62ca1e88-0819-443c-890f-05f6538b8f3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:d1:37,bridge_name='br-int',has_traffic_filtering=True,id=62ca1e88-0819-443c-890f-05f6538b8f3e,network=Network(6462e35c-7722-46f1-afee-a088965b85e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62ca1e88-08') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG nova.objects.instance [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Lazy-loading 'pci_devices' on Instance uuid 58f2a38d-14cf-4199-bb04-179ab4605a9e {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:09:33 user nova-compute[74840]:   <uuid>58f2a38d-14cf-4199-bb04-179ab4605a9e</uuid>
Nov 08 12:09:33 user nova-compute[74840]:   <name>instance-00000006</name>
Nov 08 12:09:33 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:09:33 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:09:33 user nova-compute[74840]:   <metadata>
Nov 08 12:09:33 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:09:33 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:09:33 user nova-compute[74840]:       <nova:name>tempest-TestVolumeSwap-server-1629452286</nova:name>
Nov 08 12:09:33 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:09:33</nova:creationTime>
Nov 08 12:09:33 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:09:33 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:09:33 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:09:33 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:09:33 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:09:33 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:09:33 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:09:33 user nova-compute[74840]:       <nova:owner>
Nov 08 12:09:33 user nova-compute[74840]:         <nova:user uuid="3d0c7a84ad7c46969004b4040c5cb3d7">tempest-TestVolumeSwap-2072360936-project-member</nova:user>
Nov 08 12:09:33 user nova-compute[74840]:         <nova:project uuid="e0b4cf1a052c48c2a33f1f645c2b52a8">tempest-TestVolumeSwap-2072360936</nova:project>
Nov 08 12:09:33 user nova-compute[74840]:       </nova:owner>
Nov 08 12:09:33 user nova-compute[74840]:       <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:09:33 user nova-compute[74840]:       <nova:ports>
Nov 08 12:09:33 user nova-compute[74840]:         <nova:port uuid="62ca1e88-0819-443c-890f-05f6538b8f3e">
Nov 08 12:09:33 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 12:09:33 user nova-compute[74840]:         </nova:port>
Nov 08 12:09:33 user nova-compute[74840]:       </nova:ports>
Nov 08 12:09:33 user nova-compute[74840]:     </nova:instance>
Nov 08 12:09:33 user nova-compute[74840]:   </metadata>
Nov 08 12:09:33 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:09:33 user nova-compute[74840]:     <system>
Nov 08 12:09:33 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:09:33 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:09:33 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:09:33 user nova-compute[74840]:       <entry name="serial">58f2a38d-14cf-4199-bb04-179ab4605a9e</entry>
Nov 08 12:09:33 user nova-compute[74840]:       <entry name="uuid">58f2a38d-14cf-4199-bb04-179ab4605a9e</entry>
Nov 08 12:09:33 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:09:33 user nova-compute[74840]:     </system>
Nov 08 12:09:33 user nova-compute[74840]:   </sysinfo>
Nov 08 12:09:33 user nova-compute[74840]:   <os>
Nov 08 12:09:33 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:09:33 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:09:33 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:09:33 user nova-compute[74840]:   </os>
Nov 08 12:09:33 user nova-compute[74840]:   <features>
Nov 08 12:09:33 user nova-compute[74840]:     <acpi/>
Nov 08 12:09:33 user nova-compute[74840]:     <apic/>
Nov 08 12:09:33 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:09:33 user nova-compute[74840]:   </features>
Nov 08 12:09:33 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:09:33 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:09:33 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:09:33 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:09:33 user nova-compute[74840]:   </clock>
Nov 08 12:09:33 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:09:33 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:09:33 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:09:33 user nova-compute[74840]:   </cpu>
Nov 08 12:09:33 user nova-compute[74840]:   <devices>
Nov 08 12:09:33 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:09:33 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:09:33 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/58f2a38d-14cf-4199-bb04-179ab4605a9e/disk"/>
Nov 08 12:09:33 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:09:33 user nova-compute[74840]:     </disk>
Nov 08 12:09:33 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:09:33 user nova-compute[74840]:       <mac address="fa:16:3e:3b:d1:37"/>
Nov 08 12:09:33 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:09:33 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:09:33 user nova-compute[74840]:       <target dev="tap62ca1e88-08"/>
Nov 08 12:09:33 user nova-compute[74840]:     </interface>
Nov 08 12:09:33 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:09:33 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/58f2a38d-14cf-4199-bb04-179ab4605a9e/console.log" append="off"/>
Nov 08 12:09:33 user nova-compute[74840]:     </serial>
Nov 08 12:09:33 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:09:33 user nova-compute[74840]:     <video>
Nov 08 12:09:33 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:09:33 user nova-compute[74840]:     </video>
Nov 08 12:09:33 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:09:33 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:09:33 user nova-compute[74840]:     </rng>
Nov 08 12:09:33 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:09:33 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:09:33 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:09:33 user nova-compute[74840]:     </memballoon>
Nov 08 12:09:33 user nova-compute[74840]:   </devices>
Nov 08 12:09:33 user nova-compute[74840]: </domain>
Nov 08 12:09:33 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:09:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1629452286',display_name='tempest-TestVolumeSwap-server-1629452286',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1629452286',id=6,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6exY8SfNI/CUUXXb92KxNWgYjX2NcNT6pHGUBlYjoEhsM9TUD+mJVBMTG/PBbjkv5xvH+P17cCXsP2gTNLFxi0sZC7+DwCBmePqadVL6pp0w09KHcOTjTo/BlUCjybAg==',key_name='tempest-keypair-600142584',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0b4cf1a052c48c2a33f1f645c2b52a8',ramdisk_id='',reservation_id='r-bqu4wzxd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-2072360936',owner_user_name='tempest-TestVolumeSwap-2072360936-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:09:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d0c7a84ad7c46969004b4040c5cb3d7',uuid=58f2a38d-14cf-4199-bb04-179ab4605a9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62ca1e88-0819-443c-890f-05f6538b8f3e", "address": "fa:16:3e:3b:d1:37", "network": {"id": "6462e35c-7722-46f1-afee-a088965b85e8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-713817565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b4cf1a052c48c2a33f1f645c2b52a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62ca1e88-08", "ovs_interfaceid": "62ca1e88-0819-443c-890f-05f6538b8f3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Converting VIF {"id": "62ca1e88-0819-443c-890f-05f6538b8f3e", "address": "fa:16:3e:3b:d1:37", "network": {"id": "6462e35c-7722-46f1-afee-a088965b85e8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-713817565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b4cf1a052c48c2a33f1f645c2b52a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62ca1e88-08", "ovs_interfaceid": "62ca1e88-0819-443c-890f-05f6538b8f3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:d1:37,bridge_name='br-int',has_traffic_filtering=True,id=62ca1e88-0819-443c-890f-05f6538b8f3e,network=Network(6462e35c-7722-46f1-afee-a088965b85e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62ca1e88-08') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG os_vif [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:d1:37,bridge_name='br-int',has_traffic_filtering=True,id=62ca1e88-0819-443c-890f-05f6538b8f3e,network=Network(6462e35c-7722-46f1-afee-a088965b85e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62ca1e88-08') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e605ea08-a5c6-5d3e-8abd-ee4a69a9acdf', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap62ca1e88-08, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap62ca1e88-08, col_values=(('qos', UUID('c7ea2dc0-60ba-40ed-b7d2-d2f95ced3c87')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap62ca1e88-08, col_values=(('external_ids', {'iface-id': '62ca1e88-0819-443c-890f-05f6538b8f3e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:d1:37', 'vm-uuid': '58f2a38d-14cf-4199-bb04-179ab4605a9e'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:33 user nova-compute[74840]: INFO os_vif [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:d1:37,bridge_name='br-int',has_traffic_filtering=True,id=62ca1e88-0819-443c-890f-05f6538b8f3e,network=Network(6462e35c-7722-46f1-afee-a088965b85e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62ca1e88-08')
Nov 08 12:09:33 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] No VIF found with MAC fa:16:3e:3b:d1:37, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG nova.network.neutron [req-2cafad4b-e51f-4a90-b5e6-ca37cec21782 req-1a9e1d4f-ec2d-4b7e-b1f8-a378c942c397 service nova] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Updated VIF entry in instance network info cache for port 62ca1e88-0819-443c-890f-05f6538b8f3e. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG nova.network.neutron [req-2cafad4b-e51f-4a90-b5e6-ca37cec21782 req-1a9e1d4f-ec2d-4b7e-b1f8-a378c942c397 service nova] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Updating instance_info_cache with network_info: [{"id": "62ca1e88-0819-443c-890f-05f6538b8f3e", "address": "fa:16:3e:3b:d1:37", "network": {"id": "6462e35c-7722-46f1-afee-a088965b85e8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-713817565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b4cf1a052c48c2a33f1f645c2b52a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62ca1e88-08", "ovs_interfaceid": "62ca1e88-0819-443c-890f-05f6538b8f3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:09:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2cafad4b-e51f-4a90-b5e6-ca37cec21782 req-1a9e1d4f-ec2d-4b7e-b1f8-a378c942c397 service nova] Releasing lock "refresh_cache-58f2a38d-14cf-4199-bb04-179ab4605a9e" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:09:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:35 user nova-compute[74840]: DEBUG nova.compute.manager [req-df9cb99b-50b1-4281-a6a2-0d67182d2565 req-70b6fe95-2a31-4cd8-aced-b5e1e7a3a08b service nova] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Received event network-vif-plugged-62ca1e88-0819-443c-890f-05f6538b8f3e {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:09:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-df9cb99b-50b1-4281-a6a2-0d67182d2565 req-70b6fe95-2a31-4cd8-aced-b5e1e7a3a08b service nova] Acquiring lock "58f2a38d-14cf-4199-bb04-179ab4605a9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:09:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-df9cb99b-50b1-4281-a6a2-0d67182d2565 req-70b6fe95-2a31-4cd8-aced-b5e1e7a3a08b service nova] Lock "58f2a38d-14cf-4199-bb04-179ab4605a9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:09:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-df9cb99b-50b1-4281-a6a2-0d67182d2565 req-70b6fe95-2a31-4cd8-aced-b5e1e7a3a08b service nova] Lock "58f2a38d-14cf-4199-bb04-179ab4605a9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:09:35 user nova-compute[74840]: DEBUG nova.compute.manager [req-df9cb99b-50b1-4281-a6a2-0d67182d2565 req-70b6fe95-2a31-4cd8-aced-b5e1e7a3a08b service nova] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] No waiting events found dispatching network-vif-plugged-62ca1e88-0819-443c-890f-05f6538b8f3e {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:09:35 user nova-compute[74840]: WARNING nova.compute.manager [req-df9cb99b-50b1-4281-a6a2-0d67182d2565 req-70b6fe95-2a31-4cd8-aced-b5e1e7a3a08b service nova] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Received unexpected event network-vif-plugged-62ca1e88-0819-443c-890f-05f6538b8f3e for instance with vm_state building and task_state spawning.
Nov 08 12:09:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:37 user nova-compute[74840]: DEBUG nova.compute.manager [req-40f06875-452a-42dc-893d-91ddda911b78 req-25fb5dbd-c2b6-486e-8f1f-7b81be28f043 service nova] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Received event network-vif-plugged-62ca1e88-0819-443c-890f-05f6538b8f3e {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:09:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-40f06875-452a-42dc-893d-91ddda911b78 req-25fb5dbd-c2b6-486e-8f1f-7b81be28f043 service nova] Acquiring lock "58f2a38d-14cf-4199-bb04-179ab4605a9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:09:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-40f06875-452a-42dc-893d-91ddda911b78 req-25fb5dbd-c2b6-486e-8f1f-7b81be28f043 service nova] Lock "58f2a38d-14cf-4199-bb04-179ab4605a9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:09:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-40f06875-452a-42dc-893d-91ddda911b78 req-25fb5dbd-c2b6-486e-8f1f-7b81be28f043 service nova] Lock "58f2a38d-14cf-4199-bb04-179ab4605a9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:09:37 user nova-compute[74840]: DEBUG nova.compute.manager [req-40f06875-452a-42dc-893d-91ddda911b78 req-25fb5dbd-c2b6-486e-8f1f-7b81be28f043 service nova] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] No waiting events found dispatching network-vif-plugged-62ca1e88-0819-443c-890f-05f6538b8f3e {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:09:37 user nova-compute[74840]: WARNING nova.compute.manager [req-40f06875-452a-42dc-893d-91ddda911b78 req-25fb5dbd-c2b6-486e-8f1f-7b81be28f043 service nova] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Received unexpected event network-vif-plugged-62ca1e88-0819-443c-890f-05f6538b8f3e for instance with vm_state building and task_state spawning.
Nov 08 12:09:37 user nova-compute[74840]: DEBUG nova.compute.manager [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:09:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:09:37 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Instance spawned successfully.
Nov 08 12:09:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:09:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Found default for hw_cdrom_bus of ide {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:09:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Found default for hw_disk_bus of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:09:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:09:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:09:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Found default for hw_video_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:09:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Found default for hw_vif_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:09:37 user nova-compute[74840]: INFO nova.compute.manager [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Took 5.55 seconds to spawn the instance on the hypervisor.
Nov 08 12:09:37 user nova-compute[74840]: DEBUG nova.compute.manager [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:09:37 user nova-compute[74840]: INFO nova.compute.manager [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Took 6.37 seconds to build instance.
Nov 08 12:09:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d8b121f7-a615-400b-acbb-e42ddd9def96 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Lock "58f2a38d-14cf-4199-bb04-179ab4605a9e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.499s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:09:38 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:40 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:09:40 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Cleaning up deleted instances {{(pid=74840) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 12:09:40 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] There are 0 instances to clean {{(pid=74840) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 12:09:40 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:09:40 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74840) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 12:09:40 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:09:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:42 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:09:42 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:09:42 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:09:43 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:43 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:09:43 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:09:43 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:09:44 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:09:44 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:09:44 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Rebuilding the list of instances to heal {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 12:09:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "refresh_cache-43eae335-a4a0-40b2-8cd4-c7881cd397b1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:09:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquired lock "refresh_cache-43eae335-a4a0-40b2-8cd4-c7881cd397b1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:09:44 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Forcefully refreshing network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 12:09:44 user nova-compute[74840]: DEBUG nova.objects.instance [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lazy-loading 'info_cache' on Instance uuid 43eae335-a4a0-40b2-8cd4-c7881cd397b1 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:09:45 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Updating instance_info_cache with network_info: [{"id": "fb33b08e-aef7-4999-9121-3caf5d027586", "address": "fa:16:3e:8f:c3:d6", "network": {"id": "381cad9f-376a-4335-95a4-4824aa0d7fad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1035058856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ec082e08ddf4477a721e410fe944d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb33b08e-ae", "ovs_interfaceid": "fb33b08e-aef7-4999-9121-3caf5d027586", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:09:45 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Releasing lock "refresh_cache-43eae335-a4a0-40b2-8cd4-c7881cd397b1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:09:45 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Updated the network info_cache for instance {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 12:09:45 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:09:45 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:09:45 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:09:45 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:09:45 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:09:45 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:09:45 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2a38d-14cf-4199-bb04-179ab4605a9e/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:09:45 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2a38d-14cf-4199-bb04-179ab4605a9e/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:09:45 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2a38d-14cf-4199-bb04-179ab4605a9e/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:09:45 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2a38d-14cf-4199-bb04-179ab4605a9e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:09:45 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4647e942-c600-4a9c-95ba-a59064d04619/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:09:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4647e942-c600-4a9c-95ba-a59064d04619/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:09:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4647e942-c600-4a9c-95ba-a59064d04619/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:09:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4647e942-c600-4a9c-95ba-a59064d04619/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:09:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:09:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:09:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:09:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:09:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43eae335-a4a0-40b2-8cd4-c7881cd397b1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:09:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43eae335-a4a0-40b2-8cd4-c7881cd397b1/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:09:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43eae335-a4a0-40b2-8cd4-c7881cd397b1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:09:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43eae335-a4a0-40b2-8cd4-c7881cd397b1/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:09:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c06ed5e-4b10-44d1-b4b5-faea4dcd6849/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:09:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c06ed5e-4b10-44d1-b4b5-faea4dcd6849/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:09:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c06ed5e-4b10-44d1-b4b5-faea4dcd6849/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:09:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c06ed5e-4b10-44d1-b4b5-faea4dcd6849/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:09:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/684b8be2-7f8f-499f-8885-c9d1c86eef2f/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:09:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/684b8be2-7f8f-499f-8885-c9d1c86eef2f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:09:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/684b8be2-7f8f-499f-8885-c9d1c86eef2f/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:09:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/684b8be2-7f8f-499f-8885-c9d1c86eef2f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:09:48 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:09:48 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:09:48 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=7827MB free_disk=25.47058868408203GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:09:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:09:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:09:48 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 43eae335-a4a0-40b2-8cd4-c7881cd397b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:09:48 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:09:48 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 3b10fda0-9488-4089-8033-dd1c8e42af89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:09:48 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 684b8be2-7f8f-499f-8885-c9d1c86eef2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:09:48 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 4647e942-c600-4a9c-95ba-a59064d04619 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:09:48 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 58f2a38d-14cf-4199-bb04-179ab4605a9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:09:48 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:09:48 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:09:48 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:48 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:09:48 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:09:48 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:09:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.397s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:09:50 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:09:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:53 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:54 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Acquiring lock "1dc9229a-61a8-4f45-b011-5bb3e89d63d1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:09:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Lock "1dc9229a-61a8-4f45-b011-5bb3e89d63d1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:09:57 user nova-compute[74840]: DEBUG nova.compute.manager [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Starting instance... {{(pid=74840) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 12:09:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:09:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:09:57 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:09:57 user nova-compute[74840]: INFO nova.compute.claims [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Claim successful on node user
Nov 08 12:09:57 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Refreshing inventories for resource provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 12:09:57 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Updating ProviderTree inventory for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 12:09:57 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Updating inventory in ProviderTree for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 12:09:57 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Refreshing aggregate associations for resource provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e, aggregates: None {{(pid=74840) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 12:09:57 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Refreshing trait associations for resource provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=74840) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 12:09:57 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:09:57 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:09:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.470s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:09:57 user nova-compute[74840]: DEBUG nova.compute.manager [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Start building networks asynchronously for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 12:09:57 user nova-compute[74840]: DEBUG nova.compute.manager [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Allocating IP information in the background. {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 12:09:57 user nova-compute[74840]: DEBUG nova.network.neutron [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 12:09:57 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 12:09:57 user nova-compute[74840]: DEBUG nova.compute.manager [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Start building block device mappings for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 12:09:57 user nova-compute[74840]: DEBUG nova.policy [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd1f5907cbb834731a5b835c7c8c388cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2693bf5b1b2a46eb9c657d76934e93f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 12:09:58 user nova-compute[74840]: DEBUG nova.compute.manager [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Start spawning the instance on the hypervisor. {{(pid=74840) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 12:09:58 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:09:58 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Creating image(s)
Nov 08 12:09:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Acquiring lock "/opt/stack/data/nova/instances/1dc9229a-61a8-4f45-b011-5bb3e89d63d1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:09:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Lock "/opt/stack/data/nova/instances/1dc9229a-61a8-4f45-b011-5bb3e89d63d1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:09:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Lock "/opt/stack/data/nova/instances/1dc9229a-61a8-4f45-b011-5bb3e89d63d1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:09:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:09:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.204s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:09:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Acquiring lock "5d26578eba85497f494c575690c4248f381a0fe6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:09:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:09:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:09:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.204s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:09:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/1dc9229a-61a8-4f45-b011-5bb3e89d63d1/disk 1073741824 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:09:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/1dc9229a-61a8-4f45-b011-5bb3e89d63d1/disk 1073741824" returned: 0 in 0.053s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:09:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:09:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:09:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:58 user nova-compute[74840]: DEBUG nova.network.neutron [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Successfully created port: 0ca11215-a135-4be8-87dd-69e348e9fa62 {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:09:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.186s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:09:58 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1dc9229a-61a8-4f45-b011-5bb3e89d63d1/disk. size=1073741824 {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 12:09:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dc9229a-61a8-4f45-b011-5bb3e89d63d1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:09:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dc9229a-61a8-4f45-b011-5bb3e89d63d1/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:09:58 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Cannot resize image /opt/stack/data/nova/instances/1dc9229a-61a8-4f45-b011-5bb3e89d63d1/disk to a smaller size. {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 12:09:58 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Created local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 12:09:58 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Ensure instance console log exists: /opt/stack/data/nova/instances/1dc9229a-61a8-4f45-b011-5bb3e89d63d1/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:09:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:09:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:09:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:09:59 user nova-compute[74840]: DEBUG nova.network.neutron [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Successfully updated port: 0ca11215-a135-4be8-87dd-69e348e9fa62 {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:09:59 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Acquiring lock "refresh_cache-1dc9229a-61a8-4f45-b011-5bb3e89d63d1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:09:59 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Acquired lock "refresh_cache-1dc9229a-61a8-4f45-b011-5bb3e89d63d1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:09:59 user nova-compute[74840]: DEBUG nova.network.neutron [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:09:59 user nova-compute[74840]: DEBUG nova.compute.manager [req-08269fae-4908-4c9f-9543-db6f5bc6a10e req-b01af284-b077-4e02-b481-610cbaf0c64e service nova] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Received event network-changed-0ca11215-a135-4be8-87dd-69e348e9fa62 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:09:59 user nova-compute[74840]: DEBUG nova.compute.manager [req-08269fae-4908-4c9f-9543-db6f5bc6a10e req-b01af284-b077-4e02-b481-610cbaf0c64e service nova] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Refreshing instance network info cache due to event network-changed-0ca11215-a135-4be8-87dd-69e348e9fa62. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:09:59 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-08269fae-4908-4c9f-9543-db6f5bc6a10e req-b01af284-b077-4e02-b481-610cbaf0c64e service nova] Acquiring lock "refresh_cache-1dc9229a-61a8-4f45-b011-5bb3e89d63d1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:09:59 user nova-compute[74840]: DEBUG nova.network.neutron [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:09:59 user nova-compute[74840]: DEBUG nova.network.neutron [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Updating instance_info_cache with network_info: [{"id": "0ca11215-a135-4be8-87dd-69e348e9fa62", "address": "fa:16:3e:b6:a8:fa", "network": {"id": "ca79a5ac-b9b5-4c23-bb4b-c471878fc7df", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-908944889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2693bf5b1b2a46eb9c657d76934e93f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca11215-a1", "ovs_interfaceid": "0ca11215-a135-4be8-87dd-69e348e9fa62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:09:59 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Releasing lock "refresh_cache-1dc9229a-61a8-4f45-b011-5bb3e89d63d1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:09:59 user nova-compute[74840]: DEBUG nova.compute.manager [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Instance network_info: |[{"id": "0ca11215-a135-4be8-87dd-69e348e9fa62", "address": "fa:16:3e:b6:a8:fa", "network": {"id": "ca79a5ac-b9b5-4c23-bb4b-c471878fc7df", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-908944889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2693bf5b1b2a46eb9c657d76934e93f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca11215-a1", "ovs_interfaceid": "0ca11215-a135-4be8-87dd-69e348e9fa62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 12:09:59 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-08269fae-4908-4c9f-9543-db6f5bc6a10e req-b01af284-b077-4e02-b481-610cbaf0c64e service nova] Acquired lock "refresh_cache-1dc9229a-61a8-4f45-b011-5bb3e89d63d1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:09:59 user nova-compute[74840]: DEBUG nova.network.neutron [req-08269fae-4908-4c9f-9543-db6f5bc6a10e req-b01af284-b077-4e02-b481-610cbaf0c64e service nova] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Refreshing network info cache for port 0ca11215-a135-4be8-87dd-69e348e9fa62 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:09:59 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Start _get_guest_xml network_info=[{"id": "0ca11215-a135-4be8-87dd-69e348e9fa62", "address": "fa:16:3e:b6:a8:fa", "network": {"id": "ca79a5ac-b9b5-4c23-bb4b-c471878fc7df", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-908944889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2693bf5b1b2a46eb9c657d76934e93f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca11215-a1", "ovs_interfaceid": "0ca11215-a135-4be8-87dd-69e348e9fa62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'image_id': '4fa17706-d304-4117-a420-dab994c703dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:09:59 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:09:59 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:09:59 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:09:59 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:09:59 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:09:59 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:09:59 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:09:59 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:09:59 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:09:59 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:09:59 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:09:59 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:09:59 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:09:59 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:09:59 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:09:59 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:09:59 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:09:59 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:09:59 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:09:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1239468947',display_name='tempest-VolumesAssistedSnapshotsTest-server-1239468947',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1239468947',id=7,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMkyByPosTjH5Z5CIWpY7U9AIDHUNrzPF4sEtlm0aqiGf23HowcGv4Wsoia1fbd6Xo0YVFn53JJGQ/C34aCvhlO+vCZjH0MGkkZ3971moMWTEI/prFc6g+1Nl9yX/fymA==',key_name='tempest-keypair-1919960346',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2693bf5b1b2a46eb9c657d76934e93f2',ramdisk_id='',reservation_id='r-jd6xjka0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1208282605',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1208282605-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:09:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d1f5907cbb834731a5b835c7c8c388cc',uuid=1dc9229a-61a8-4f45-b011-5bb3e89d63d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ca11215-a135-4be8-87dd-69e348e9fa62", "address": "fa:16:3e:b6:a8:fa", "network": {"id": "ca79a5ac-b9b5-4c23-bb4b-c471878fc7df", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-908944889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2693bf5b1b2a46eb9c657d76934e93f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca11215-a1", "ovs_interfaceid": "0ca11215-a135-4be8-87dd-69e348e9fa62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:09:59 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Converting VIF {"id": "0ca11215-a135-4be8-87dd-69e348e9fa62", "address": "fa:16:3e:b6:a8:fa", "network": {"id": "ca79a5ac-b9b5-4c23-bb4b-c471878fc7df", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-908944889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2693bf5b1b2a46eb9c657d76934e93f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca11215-a1", "ovs_interfaceid": "0ca11215-a135-4be8-87dd-69e348e9fa62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:09:59 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:a8:fa,bridge_name='br-int',has_traffic_filtering=True,id=0ca11215-a135-4be8-87dd-69e348e9fa62,network=Network(ca79a5ac-b9b5-4c23-bb4b-c471878fc7df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca11215-a1') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:09:59 user nova-compute[74840]: DEBUG nova.objects.instance [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Lazy-loading 'pci_devices' on Instance uuid 1dc9229a-61a8-4f45-b011-5bb3e89d63d1 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:09:59 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:09:59 user nova-compute[74840]:   <uuid>1dc9229a-61a8-4f45-b011-5bb3e89d63d1</uuid>
Nov 08 12:09:59 user nova-compute[74840]:   <name>instance-00000007</name>
Nov 08 12:09:59 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:09:59 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:09:59 user nova-compute[74840]:   <metadata>
Nov 08 12:09:59 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:09:59 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:09:59 user nova-compute[74840]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1239468947</nova:name>
Nov 08 12:09:59 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:09:59</nova:creationTime>
Nov 08 12:09:59 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:09:59 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:09:59 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:09:59 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:09:59 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:09:59 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:09:59 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:09:59 user nova-compute[74840]:       <nova:owner>
Nov 08 12:09:59 user nova-compute[74840]:         <nova:user uuid="d1f5907cbb834731a5b835c7c8c388cc">tempest-VolumesAssistedSnapshotsTest-1208282605-project-member</nova:user>
Nov 08 12:09:59 user nova-compute[74840]:         <nova:project uuid="2693bf5b1b2a46eb9c657d76934e93f2">tempest-VolumesAssistedSnapshotsTest-1208282605</nova:project>
Nov 08 12:09:59 user nova-compute[74840]:       </nova:owner>
Nov 08 12:09:59 user nova-compute[74840]:       <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:09:59 user nova-compute[74840]:       <nova:ports>
Nov 08 12:09:59 user nova-compute[74840]:         <nova:port uuid="0ca11215-a135-4be8-87dd-69e348e9fa62">
Nov 08 12:09:59 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 12:09:59 user nova-compute[74840]:         </nova:port>
Nov 08 12:09:59 user nova-compute[74840]:       </nova:ports>
Nov 08 12:09:59 user nova-compute[74840]:     </nova:instance>
Nov 08 12:09:59 user nova-compute[74840]:   </metadata>
Nov 08 12:09:59 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:09:59 user nova-compute[74840]:     <system>
Nov 08 12:09:59 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:09:59 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:09:59 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:09:59 user nova-compute[74840]:       <entry name="serial">1dc9229a-61a8-4f45-b011-5bb3e89d63d1</entry>
Nov 08 12:09:59 user nova-compute[74840]:       <entry name="uuid">1dc9229a-61a8-4f45-b011-5bb3e89d63d1</entry>
Nov 08 12:09:59 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:09:59 user nova-compute[74840]:     </system>
Nov 08 12:09:59 user nova-compute[74840]:   </sysinfo>
Nov 08 12:09:59 user nova-compute[74840]:   <os>
Nov 08 12:09:59 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:09:59 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:09:59 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:09:59 user nova-compute[74840]:   </os>
Nov 08 12:09:59 user nova-compute[74840]:   <features>
Nov 08 12:09:59 user nova-compute[74840]:     <acpi/>
Nov 08 12:09:59 user nova-compute[74840]:     <apic/>
Nov 08 12:09:59 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:09:59 user nova-compute[74840]:   </features>
Nov 08 12:09:59 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:09:59 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:09:59 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:09:59 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:09:59 user nova-compute[74840]:   </clock>
Nov 08 12:09:59 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:09:59 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:09:59 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:09:59 user nova-compute[74840]:   </cpu>
Nov 08 12:09:59 user nova-compute[74840]:   <devices>
Nov 08 12:09:59 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:09:59 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:09:59 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/1dc9229a-61a8-4f45-b011-5bb3e89d63d1/disk"/>
Nov 08 12:09:59 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:09:59 user nova-compute[74840]:     </disk>
Nov 08 12:09:59 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:09:59 user nova-compute[74840]:       <mac address="fa:16:3e:b6:a8:fa"/>
Nov 08 12:09:59 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:09:59 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:09:59 user nova-compute[74840]:       <target dev="tap0ca11215-a1"/>
Nov 08 12:09:59 user nova-compute[74840]:     </interface>
Nov 08 12:09:59 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:09:59 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/1dc9229a-61a8-4f45-b011-5bb3e89d63d1/console.log" append="off"/>
Nov 08 12:09:59 user nova-compute[74840]:     </serial>
Nov 08 12:09:59 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:09:59 user nova-compute[74840]:     <video>
Nov 08 12:09:59 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:09:59 user nova-compute[74840]:     </video>
Nov 08 12:09:59 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:09:59 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:09:59 user nova-compute[74840]:     </rng>
Nov 08 12:09:59 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:09:59 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:09:59 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:09:59 user nova-compute[74840]:     </memballoon>
Nov 08 12:09:59 user nova-compute[74840]:   </devices>
Nov 08 12:09:59 user nova-compute[74840]: </domain>
Nov 08 12:09:59 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:09:59 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:09:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1239468947',display_name='tempest-VolumesAssistedSnapshotsTest-server-1239468947',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1239468947',id=7,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMkyByPosTjH5Z5CIWpY7U9AIDHUNrzPF4sEtlm0aqiGf23HowcGv4Wsoia1fbd6Xo0YVFn53JJGQ/C34aCvhlO+vCZjH0MGkkZ3971moMWTEI/prFc6g+1Nl9yX/fymA==',key_name='tempest-keypair-1919960346',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2693bf5b1b2a46eb9c657d76934e93f2',ramdisk_id='',reservation_id='r-jd6xjka0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1208282605',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1208282605-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:09:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d1f5907cbb834731a5b835c7c8c388cc',uuid=1dc9229a-61a8-4f45-b011-5bb3e89d63d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ca11215-a135-4be8-87dd-69e348e9fa62", "address": "fa:16:3e:b6:a8:fa", "network": {"id": "ca79a5ac-b9b5-4c23-bb4b-c471878fc7df", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-908944889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2693bf5b1b2a46eb9c657d76934e93f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca11215-a1", "ovs_interfaceid": "0ca11215-a135-4be8-87dd-69e348e9fa62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:09:59 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Converting VIF {"id": "0ca11215-a135-4be8-87dd-69e348e9fa62", "address": "fa:16:3e:b6:a8:fa", "network": {"id": "ca79a5ac-b9b5-4c23-bb4b-c471878fc7df", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-908944889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2693bf5b1b2a46eb9c657d76934e93f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca11215-a1", "ovs_interfaceid": "0ca11215-a135-4be8-87dd-69e348e9fa62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:09:59 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:a8:fa,bridge_name='br-int',has_traffic_filtering=True,id=0ca11215-a135-4be8-87dd-69e348e9fa62,network=Network(ca79a5ac-b9b5-4c23-bb4b-c471878fc7df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca11215-a1') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:09:59 user nova-compute[74840]: DEBUG os_vif [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:a8:fa,bridge_name='br-int',has_traffic_filtering=True,id=0ca11215-a135-4be8-87dd-69e348e9fa62,network=Network(ca79a5ac-b9b5-4c23-bb4b-c471878fc7df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca11215-a1') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:09:59 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:09:59 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:09:59 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:10:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:10:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2a150e01-cc4d-5a55-b833-40a892accbb3', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:10:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:10:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:10:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:10:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ca11215-a1, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:10:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ca11215-a1, col_values=(('qos', UUID('810de839-4f29-45a9-acc3-50a17667f11a')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:10:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ca11215-a1, col_values=(('external_ids', {'iface-id': '0ca11215-a135-4be8-87dd-69e348e9fa62', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:a8:fa', 'vm-uuid': '1dc9229a-61a8-4f45-b011-5bb3e89d63d1'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:10:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:10:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:10:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:10:00 user nova-compute[74840]: INFO os_vif [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:a8:fa,bridge_name='br-int',has_traffic_filtering=True,id=0ca11215-a135-4be8-87dd-69e348e9fa62,network=Network(ca79a5ac-b9b5-4c23-bb4b-c471878fc7df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca11215-a1')
Nov 08 12:10:00 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:10:00 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] No VIF found with MAC fa:16:3e:b6:a8:fa, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:10:00 user nova-compute[74840]: DEBUG nova.network.neutron [req-08269fae-4908-4c9f-9543-db6f5bc6a10e req-b01af284-b077-4e02-b481-610cbaf0c64e service nova] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Updated VIF entry in instance network info cache for port 0ca11215-a135-4be8-87dd-69e348e9fa62. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:10:00 user nova-compute[74840]: DEBUG nova.network.neutron [req-08269fae-4908-4c9f-9543-db6f5bc6a10e req-b01af284-b077-4e02-b481-610cbaf0c64e service nova] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Updating instance_info_cache with network_info: [{"id": "0ca11215-a135-4be8-87dd-69e348e9fa62", "address": "fa:16:3e:b6:a8:fa", "network": {"id": "ca79a5ac-b9b5-4c23-bb4b-c471878fc7df", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-908944889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2693bf5b1b2a46eb9c657d76934e93f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca11215-a1", "ovs_interfaceid": "0ca11215-a135-4be8-87dd-69e348e9fa62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:10:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-08269fae-4908-4c9f-9543-db6f5bc6a10e req-b01af284-b077-4e02-b481-610cbaf0c64e service nova] Releasing lock "refresh_cache-1dc9229a-61a8-4f45-b011-5bb3e89d63d1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:10:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:10:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:10:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:10:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:10:01 user nova-compute[74840]: DEBUG nova.compute.manager [req-9693ab2a-a687-4b58-bb70-dc1a9b8c0ec7 req-3f9f4eb9-cb12-407e-900a-bfd97b4ee229 service nova] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Received event network-vif-plugged-0ca11215-a135-4be8-87dd-69e348e9fa62 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:10:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9693ab2a-a687-4b58-bb70-dc1a9b8c0ec7 req-3f9f4eb9-cb12-407e-900a-bfd97b4ee229 service nova] Acquiring lock "1dc9229a-61a8-4f45-b011-5bb3e89d63d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:10:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9693ab2a-a687-4b58-bb70-dc1a9b8c0ec7 req-3f9f4eb9-cb12-407e-900a-bfd97b4ee229 service nova] Lock "1dc9229a-61a8-4f45-b011-5bb3e89d63d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:10:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9693ab2a-a687-4b58-bb70-dc1a9b8c0ec7 req-3f9f4eb9-cb12-407e-900a-bfd97b4ee229 service nova] Lock "1dc9229a-61a8-4f45-b011-5bb3e89d63d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:10:01 user nova-compute[74840]: DEBUG nova.compute.manager [req-9693ab2a-a687-4b58-bb70-dc1a9b8c0ec7 req-3f9f4eb9-cb12-407e-900a-bfd97b4ee229 service nova] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] No waiting events found dispatching network-vif-plugged-0ca11215-a135-4be8-87dd-69e348e9fa62 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:10:01 user nova-compute[74840]: WARNING nova.compute.manager [req-9693ab2a-a687-4b58-bb70-dc1a9b8c0ec7 req-3f9f4eb9-cb12-407e-900a-bfd97b4ee229 service nova] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Received unexpected event network-vif-plugged-0ca11215-a135-4be8-87dd-69e348e9fa62 for instance with vm_state building and task_state spawning.
Nov 08 12:10:02 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:10:02 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:10:02 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:10:03 user nova-compute[74840]: DEBUG nova.compute.manager [req-798ec3d9-f1eb-485f-86bc-f8be757ef426 req-925261a0-1420-4ebb-9038-ec96e767b4a9 service nova] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Received event network-vif-plugged-0ca11215-a135-4be8-87dd-69e348e9fa62 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:10:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-798ec3d9-f1eb-485f-86bc-f8be757ef426 req-925261a0-1420-4ebb-9038-ec96e767b4a9 service nova] Acquiring lock "1dc9229a-61a8-4f45-b011-5bb3e89d63d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:10:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-798ec3d9-f1eb-485f-86bc-f8be757ef426 req-925261a0-1420-4ebb-9038-ec96e767b4a9 service nova] Lock "1dc9229a-61a8-4f45-b011-5bb3e89d63d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:10:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-798ec3d9-f1eb-485f-86bc-f8be757ef426 req-925261a0-1420-4ebb-9038-ec96e767b4a9 service nova] Lock "1dc9229a-61a8-4f45-b011-5bb3e89d63d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:10:03 user nova-compute[74840]: DEBUG nova.compute.manager [req-798ec3d9-f1eb-485f-86bc-f8be757ef426 req-925261a0-1420-4ebb-9038-ec96e767b4a9 service nova] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] No waiting events found dispatching network-vif-plugged-0ca11215-a135-4be8-87dd-69e348e9fa62 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:10:03 user nova-compute[74840]: WARNING nova.compute.manager [req-798ec3d9-f1eb-485f-86bc-f8be757ef426 req-925261a0-1420-4ebb-9038-ec96e767b4a9 service nova] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Received unexpected event network-vif-plugged-0ca11215-a135-4be8-87dd-69e348e9fa62 for instance with vm_state building and task_state spawning.
Nov 08 12:10:03 user nova-compute[74840]: DEBUG nova.compute.manager [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:10:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:10:03 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Instance spawned successfully.
Nov 08 12:10:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:10:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Found default for hw_cdrom_bus of ide {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:10:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Found default for hw_disk_bus of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:10:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:10:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:10:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Found default for hw_video_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:10:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Found default for hw_vif_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:10:04 user nova-compute[74840]: INFO nova.compute.manager [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Took 6.12 seconds to spawn the instance on the hypervisor.
Nov 08 12:10:04 user nova-compute[74840]: DEBUG nova.compute.manager [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:10:04 user nova-compute[74840]: INFO nova.compute.manager [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Took 7.11 seconds to build instance.
Nov 08 12:10:04 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-61855a9c-d83a-4b6a-b48e-a3a2c10f2280 tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Lock "1dc9229a-61a8-4f45-b011-5bb3e89d63d1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.207s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:10:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:10:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:10:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:10:15 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:10:15 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:10:15 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 12:10:15 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:10:15 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:10:15 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:10:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:10:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:10:25 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:10:25 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:10:30 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:10:30 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:10:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:10:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:10:36 user nova-compute[74840]: DEBUG nova.compute.manager [req-cbe75211-08c6-48e7-aa41-f1a1c4cd926d req-bc9432d1-191e-4db7-8429-42fa45af46dc service nova] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Received event network-changed-fb33b08e-aef7-4999-9121-3caf5d027586 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:10:36 user nova-compute[74840]: DEBUG nova.compute.manager [req-cbe75211-08c6-48e7-aa41-f1a1c4cd926d req-bc9432d1-191e-4db7-8429-42fa45af46dc service nova] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Refreshing instance network info cache due to event network-changed-fb33b08e-aef7-4999-9121-3caf5d027586. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:10:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-cbe75211-08c6-48e7-aa41-f1a1c4cd926d req-bc9432d1-191e-4db7-8429-42fa45af46dc service nova] Acquiring lock "refresh_cache-43eae335-a4a0-40b2-8cd4-c7881cd397b1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:10:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-cbe75211-08c6-48e7-aa41-f1a1c4cd926d req-bc9432d1-191e-4db7-8429-42fa45af46dc service nova] Acquired lock "refresh_cache-43eae335-a4a0-40b2-8cd4-c7881cd397b1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:10:36 user nova-compute[74840]: DEBUG nova.network.neutron [req-cbe75211-08c6-48e7-aa41-f1a1c4cd926d req-bc9432d1-191e-4db7-8429-42fa45af46dc service nova] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Refreshing network info cache for port fb33b08e-aef7-4999-9121-3caf5d027586 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:10:37 user nova-compute[74840]: DEBUG nova.network.neutron [req-cbe75211-08c6-48e7-aa41-f1a1c4cd926d req-bc9432d1-191e-4db7-8429-42fa45af46dc service nova] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Updated VIF entry in instance network info cache for port fb33b08e-aef7-4999-9121-3caf5d027586. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:10:37 user nova-compute[74840]: DEBUG nova.network.neutron [req-cbe75211-08c6-48e7-aa41-f1a1c4cd926d req-bc9432d1-191e-4db7-8429-42fa45af46dc service nova] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Updating instance_info_cache with network_info: [{"id": "fb33b08e-aef7-4999-9121-3caf5d027586", "address": "fa:16:3e:8f:c3:d6", "network": {"id": "381cad9f-376a-4335-95a4-4824aa0d7fad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1035058856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ec082e08ddf4477a721e410fe944d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb33b08e-ae", "ovs_interfaceid": "fb33b08e-aef7-4999-9121-3caf5d027586", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:10:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-cbe75211-08c6-48e7-aa41-f1a1c4cd926d req-bc9432d1-191e-4db7-8429-42fa45af46dc service nova] Releasing lock "refresh_cache-43eae335-a4a0-40b2-8cd4-c7881cd397b1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:10:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:10:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:10:42 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:10:42 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "43eae335-a4a0-40b2-8cd4-c7881cd397b1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:10:42 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "43eae335-a4a0-40b2-8cd4-c7881cd397b1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:10:42 user nova-compute[74840]: DEBUG nova.objects.instance [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lazy-loading 'flavor' on Instance uuid 43eae335-a4a0-40b2-8cd4-c7881cd397b1 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:10:42 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "43eae335-a4a0-40b2-8cd4-c7881cd397b1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.102s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:10:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "43eae335-a4a0-40b2-8cd4-c7881cd397b1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:10:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "43eae335-a4a0-40b2-8cd4-c7881cd397b1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:10:43 user nova-compute[74840]: INFO nova.compute.manager [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Attaching volume 08a44583-de0d-44ca-a02a-fa9d906720c9 to /dev/vdb
Nov 08 12:10:43 user nova-compute[74840]: DEBUG os_brick.utils [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:10:43 user nova-compute[74840]: INFO oslo.privsep.daemon [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpxuyar8wn/privsep.sock']
Nov 08 12:10:43 user sudo[85685]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpxuyar8wn/privsep.sock
Nov 08 12:10:43 user sudo[85685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 08 12:10:43 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:10:43 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:10:44 user sudo[85685]: pam_unix(sudo:session): session closed for user root
Nov 08 12:10:44 user nova-compute[74840]: INFO oslo.privsep.daemon [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Spawned new privsep daemon via rootwrap
Nov 08 12:10:44 user nova-compute[74840]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 08 12:10:44 user nova-compute[74840]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 08 12:10:44 user nova-compute[74840]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 08 12:10:44 user nova-compute[74840]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85688
Nov 08 12:10:44 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d10ac7-6947-475d-86c3-82a692c2e3e5]: (2,) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:10:44 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:10:44 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:10:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:10:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:10:44 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[694f31b9-19f9-4606-a65b-4a4287291abb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c8228a11e03c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:10:44 user nova-compute[74840]: WARNING os_brick.initiator.connectors.nvmeof [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 08 12:10:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:10:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:10:44 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f2e02f-c7e5-4a9a-85e0-f7f1f0be5df6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:10:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:10:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:10:44 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8663a7-94aa-447f-bc86-d8ad328ce33d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:10:44 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada2f9a4-0aaa-43e5-8a0e-29ecbfc8f72f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:10:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Running cmd (subprocess): nvme version {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:10:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] 'nvme version' failed. Not Retrying. {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:10:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "refresh_cache-9c06ed5e-4b10-44d1-b4b5-faea4dcd6849" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:10:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquired lock "refresh_cache-9c06ed5e-4b10-44d1-b4b5-faea4dcd6849" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:10:44 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Forcefully refreshing network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 12:10:44 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] nvme not present on system {{(pid=74840) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 12:10:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:10:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:10:44 user nova-compute[74840]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 12:10:44 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1abb7e45-3504-4d1b-9134-30c2fce156e3]: (4, '') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:10:44 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74840) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 12:10:44 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 12:10:44 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] LIGHTOS: no hostnqn found. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 12:10:44 user nova-compute[74840]: DEBUG os_brick.utils [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] <== get_connector_properties: return (1757ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c8228a11e03c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:10:44 user nova-compute[74840]: DEBUG nova.virt.block_device [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Updating existing volume attachment record: 28015576-5522-4660-a216-0fb49ba09b73 {{(pid=74840) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 12:10:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:10:45 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Updating instance_info_cache with network_info: [{"id": "2cc86a4c-4952-4765-831c-a1919e56193f", "address": "fa:16:3e:e8:ed:67", "network": {"id": "e629cfa0-f295-42b5-9e17-b273bfa2a1c9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-185728581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863c5c6a90544832a7a4cad6917978c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc86a4c-49", "ovs_interfaceid": "2cc86a4c-4952-4765-831c-a1919e56193f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:10:45 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Releasing lock "refresh_cache-9c06ed5e-4b10-44d1-b4b5-faea4dcd6849" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:10:45 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Updated the network info_cache for instance {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 12:10:45 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:10:45 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:10:45 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:10:45 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:10:45 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:10:45 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:10:45 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:10:45 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:10:45 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:10:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:10:45 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2a38d-14cf-4199-bb04-179ab4605a9e/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:10:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2a38d-14cf-4199-bb04-179ab4605a9e/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:10:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2a38d-14cf-4199-bb04-179ab4605a9e/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:10:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2a38d-14cf-4199-bb04-179ab4605a9e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:10:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4647e942-c600-4a9c-95ba-a59064d04619/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:10:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4647e942-c600-4a9c-95ba-a59064d04619/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:10:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4647e942-c600-4a9c-95ba-a59064d04619/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:10:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4647e942-c600-4a9c-95ba-a59064d04619/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:10:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dc9229a-61a8-4f45-b011-5bb3e89d63d1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:10:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dc9229a-61a8-4f45-b011-5bb3e89d63d1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:10:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dc9229a-61a8-4f45-b011-5bb3e89d63d1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:10:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dc9229a-61a8-4f45-b011-5bb3e89d63d1/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:10:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:10:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:10:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:10:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:10:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43eae335-a4a0-40b2-8cd4-c7881cd397b1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:10:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43eae335-a4a0-40b2-8cd4-c7881cd397b1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:10:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43eae335-a4a0-40b2-8cd4-c7881cd397b1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:10:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43eae335-a4a0-40b2-8cd4-c7881cd397b1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:10:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c06ed5e-4b10-44d1-b4b5-faea4dcd6849/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:10:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c06ed5e-4b10-44d1-b4b5-faea4dcd6849/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:10:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c06ed5e-4b10-44d1-b4b5-faea4dcd6849/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:10:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c06ed5e-4b10-44d1-b4b5-faea4dcd6849/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:10:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/684b8be2-7f8f-499f-8885-c9d1c86eef2f/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:10:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/684b8be2-7f8f-499f-8885-c9d1c86eef2f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:10:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/684b8be2-7f8f-499f-8885-c9d1c86eef2f/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:10:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/684b8be2-7f8f-499f-8885-c9d1c86eef2f/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:10:49 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:10:49 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:10:49 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=7779MB free_disk=25.419841766357422GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:10:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:10:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:10:49 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 43eae335-a4a0-40b2-8cd4-c7881cd397b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:10:49 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:10:49 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 3b10fda0-9488-4089-8033-dd1c8e42af89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:10:49 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 684b8be2-7f8f-499f-8885-c9d1c86eef2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:10:49 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 4647e942-c600-4a9c-95ba-a59064d04619 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:10:49 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 58f2a38d-14cf-4199-bb04-179ab4605a9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:10:49 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 1dc9229a-61a8-4f45-b011-5bb3e89d63d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:10:49 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:10:49 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:10:49 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:10:49 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:10:49 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:10:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.492s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:10:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:10:50 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:10:50 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:10:51 user nova-compute[74840]: DEBUG nova.compute.manager [req-2aa2d91d-a5be-494d-9ab5-0a564cb1fadc req-048965b4-784d-4707-af55-4bd27d3d7029 service nova] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Received event network-changed-b48b5298-045f-463d-9585-fbb5feb869bf {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:10:51 user nova-compute[74840]: DEBUG nova.compute.manager [req-2aa2d91d-a5be-494d-9ab5-0a564cb1fadc req-048965b4-784d-4707-af55-4bd27d3d7029 service nova] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Refreshing instance network info cache due to event network-changed-b48b5298-045f-463d-9585-fbb5feb869bf. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:10:51 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2aa2d91d-a5be-494d-9ab5-0a564cb1fadc req-048965b4-784d-4707-af55-4bd27d3d7029 service nova] Acquiring lock "refresh_cache-3b10fda0-9488-4089-8033-dd1c8e42af89" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:10:51 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2aa2d91d-a5be-494d-9ab5-0a564cb1fadc req-048965b4-784d-4707-af55-4bd27d3d7029 service nova] Acquired lock "refresh_cache-3b10fda0-9488-4089-8033-dd1c8e42af89" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:10:51 user nova-compute[74840]: DEBUG nova.network.neutron [req-2aa2d91d-a5be-494d-9ab5-0a564cb1fadc req-048965b4-784d-4707-af55-4bd27d3d7029 service nova] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Refreshing network info cache for port b48b5298-045f-463d-9585-fbb5feb869bf {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:10:52 user nova-compute[74840]: DEBUG nova.network.neutron [req-2aa2d91d-a5be-494d-9ab5-0a564cb1fadc req-048965b4-784d-4707-af55-4bd27d3d7029 service nova] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Updated VIF entry in instance network info cache for port b48b5298-045f-463d-9585-fbb5feb869bf. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:10:52 user nova-compute[74840]: DEBUG nova.network.neutron [req-2aa2d91d-a5be-494d-9ab5-0a564cb1fadc req-048965b4-784d-4707-af55-4bd27d3d7029 service nova] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Updating instance_info_cache with network_info: [{"id": "b48b5298-045f-463d-9585-fbb5feb869bf", "address": "fa:16:3e:19:58:1f", "network": {"id": "9dec89b0-562f-482c-aec1-d024351d0bd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-237264167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a544910dc2c4b169c986fa74b5979d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48b5298-04", "ovs_interfaceid": "b48b5298-045f-463d-9585-fbb5feb869bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:10:52 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2aa2d91d-a5be-494d-9ab5-0a564cb1fadc req-048965b4-784d-4707-af55-4bd27d3d7029 service nova] Releasing lock "refresh_cache-3b10fda0-9488-4089-8033-dd1c8e42af89" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:10:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:10:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:10:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Acquiring lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:10:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:10:57 user nova-compute[74840]: DEBUG nova.compute.manager [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Starting instance... {{(pid=74840) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 12:10:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:10:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:10:57 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:10:57 user nova-compute[74840]: INFO nova.compute.claims [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Claim successful on node user
Nov 08 12:10:57 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:10:57 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:10:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.478s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:10:57 user nova-compute[74840]: DEBUG nova.compute.manager [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Start building networks asynchronously for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 12:10:58 user nova-compute[74840]: DEBUG nova.compute.manager [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Allocating IP information in the background. {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 12:10:58 user nova-compute[74840]: DEBUG nova.network.neutron [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 12:10:58 user nova-compute[74840]: DEBUG nova.policy [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c2856d02455a4163a74b4f5956719920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71995e354fd546fd8d41823c548b1a22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 12:10:58 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 12:10:58 user nova-compute[74840]: DEBUG nova.compute.manager [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Start building block device mappings for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 12:10:58 user nova-compute[74840]: INFO nova.virt.block_device [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Booting with volume dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc at /dev/vda
Nov 08 12:10:58 user nova-compute[74840]: DEBUG os_brick.utils [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:10:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:10:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:10:58 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53494e4-2ca5-40be-bf7a-149723cb9f2e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c8228a11e03c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:10:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:10:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:10:58 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae8ef50-45ec-4879-95fd-14a197a33470]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:10:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:10:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:10:58 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6103d8-5c99-46d7-86a1-5b5f2ad7bd60]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:10:58 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2c6544-1bb2-4261-a127-07ae08dc0730]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:10:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Running cmd (subprocess): nvme version {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:10:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] 'nvme version' failed. Not Retrying. {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:10:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.nvmeof [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] nvme not present on system {{(pid=74840) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 12:10:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:10:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:10:58 user nova-compute[74840]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 12:10:58 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2b7d20-c6bc-4bcf-b2ea-022d9314ba53]: (4, '') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:10:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74840) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 12:10:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 12:10:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] LIGHTOS: no hostnqn found. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 12:10:58 user nova-compute[74840]: DEBUG os_brick.utils [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c8228a11e03c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:10:58 user nova-compute[74840]: DEBUG nova.virt.block_device [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Updating existing volume attachment record: cd07f780-a8b4-4c4a-9a81-9f4c2ac41d5b {{(pid=74840) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 12:10:59 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:10:59 user nova-compute[74840]: DEBUG nova.network.neutron [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Successfully created port: 38640df8-91ab-4bb6-89f1-ac84843d0e1c {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:10:59 user nova-compute[74840]: DEBUG nova.network.neutron [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Successfully created port: 7a2393a4-2d55-49cc-b4af-189d3ab24c1e {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:11:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:00 user nova-compute[74840]: DEBUG nova.network.neutron [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Successfully created port: 77c96b94-7c85-4356-8da8-bb90854ead5e {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:11:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-52b6262e-a1d2-45b6-bd11-22895f55cfb7 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Acquiring lock "9c06ed5e-4b10-44d1-b4b5-faea4dcd6849" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:11:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-52b6262e-a1d2-45b6-bd11-22895f55cfb7 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Lock "9c06ed5e-4b10-44d1-b4b5-faea4dcd6849" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:11:00 user nova-compute[74840]: DEBUG nova.objects.instance [None req-52b6262e-a1d2-45b6-bd11-22895f55cfb7 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Lazy-loading 'flavor' on Instance uuid 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:11:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-52b6262e-a1d2-45b6-bd11-22895f55cfb7 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Lock "9c06ed5e-4b10-44d1-b4b5-faea4dcd6849" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:11:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-52b6262e-a1d2-45b6-bd11-22895f55cfb7 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Acquiring lock "9c06ed5e-4b10-44d1-b4b5-faea4dcd6849" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:11:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-52b6262e-a1d2-45b6-bd11-22895f55cfb7 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Lock "9c06ed5e-4b10-44d1-b4b5-faea4dcd6849" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:11:00 user nova-compute[74840]: INFO nova.compute.manager [None req-52b6262e-a1d2-45b6-bd11-22895f55cfb7 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Attaching volume 912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c to /dev/vdb
Nov 08 12:11:00 user nova-compute[74840]: DEBUG os_brick.utils [None req-52b6262e-a1d2-45b6-bd11-22895f55cfb7 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:11:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:00 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ad32bd-8b38-433b-b4b8-75a4194b0133]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c8228a11e03c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:00 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[be56b2cd-6941-40dc-9e66-63cbeb9c5afd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:00 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f6bafc-a7eb-4463-ae9e-7ac00b19895e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:00 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[07869ee2-67f8-4285-8b7a-a06b4faec8ee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-52b6262e-a1d2-45b6-bd11-22895f55cfb7 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Running cmd (subprocess): nvme version {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-52b6262e-a1d2-45b6-bd11-22895f55cfb7 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] 'nvme version' failed. Not Retrying. {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:11:00 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52b6262e-a1d2-45b6-bd11-22895f55cfb7 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] nvme not present on system {{(pid=74840) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 12:11:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:11:00 user nova-compute[74840]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 12:11:00 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[537a7e29-a36e-4014-b271-ce8c1d41a131]: (4, '') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:00 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-52b6262e-a1d2-45b6-bd11-22895f55cfb7 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74840) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 12:11:00 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-52b6262e-a1d2-45b6-bd11-22895f55cfb7 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 12:11:00 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-52b6262e-a1d2-45b6-bd11-22895f55cfb7 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] LIGHTOS: no hostnqn found. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 12:11:00 user nova-compute[74840]: DEBUG os_brick.utils [None req-52b6262e-a1d2-45b6-bd11-22895f55cfb7 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c8228a11e03c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:11:00 user nova-compute[74840]: DEBUG nova.virt.block_device [None req-52b6262e-a1d2-45b6-bd11-22895f55cfb7 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Updating existing volume attachment record: 0e230155-6068-4b8b-840b-a5a2ef1ae2e6 {{(pid=74840) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 12:11:00 user nova-compute[74840]: DEBUG nova.network.neutron [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Successfully created port: 0f88f24e-b28a-4e36-bef3-1fa13084f370 {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:11:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:01 user nova-compute[74840]: DEBUG nova.network.neutron [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Successfully created port: b80b0e8d-2bc7-4e85-8843-c9d8c7931014 {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:11:02 user nova-compute[74840]: DEBUG nova.network.neutron [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Successfully updated port: 38640df8-91ab-4bb6-89f1-ac84843d0e1c {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:11:02 user nova-compute[74840]: DEBUG nova.compute.manager [req-a73f463f-b47a-4f4b-9ccc-3aebd1b53bfa req-a761ca50-8808-4fa3-9712-685cad33b370 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received event network-changed-38640df8-91ab-4bb6-89f1-ac84843d0e1c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:11:02 user nova-compute[74840]: DEBUG nova.compute.manager [req-a73f463f-b47a-4f4b-9ccc-3aebd1b53bfa req-a761ca50-8808-4fa3-9712-685cad33b370 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Refreshing instance network info cache due to event network-changed-38640df8-91ab-4bb6-89f1-ac84843d0e1c. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:11:02 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a73f463f-b47a-4f4b-9ccc-3aebd1b53bfa req-a761ca50-8808-4fa3-9712-685cad33b370 service nova] Acquiring lock "refresh_cache-d2dbd607-cf11-4d81-9639-c84e79d65fcd" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:11:02 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a73f463f-b47a-4f4b-9ccc-3aebd1b53bfa req-a761ca50-8808-4fa3-9712-685cad33b370 service nova] Acquired lock "refresh_cache-d2dbd607-cf11-4d81-9639-c84e79d65fcd" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:11:02 user nova-compute[74840]: DEBUG nova.network.neutron [req-a73f463f-b47a-4f4b-9ccc-3aebd1b53bfa req-a761ca50-8808-4fa3-9712-685cad33b370 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Refreshing network info cache for port 38640df8-91ab-4bb6-89f1-ac84843d0e1c {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:11:02 user nova-compute[74840]: DEBUG nova.network.neutron [req-a73f463f-b47a-4f4b-9ccc-3aebd1b53bfa req-a761ca50-8808-4fa3-9712-685cad33b370 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:11:02 user nova-compute[74840]: DEBUG nova.network.neutron [req-a73f463f-b47a-4f4b-9ccc-3aebd1b53bfa req-a761ca50-8808-4fa3-9712-685cad33b370 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:11:02 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a73f463f-b47a-4f4b-9ccc-3aebd1b53bfa req-a761ca50-8808-4fa3-9712-685cad33b370 service nova] Releasing lock "refresh_cache-d2dbd607-cf11-4d81-9639-c84e79d65fcd" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:11:02 user nova-compute[74840]: DEBUG nova.network.neutron [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Successfully updated port: 65988447-7cce-4be7-87dd-4fd49e351040 {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:11:03 user nova-compute[74840]: DEBUG nova.compute.manager [req-0a71d693-5d21-48a6-969f-39dc2508bb18 req-b9b964ca-c92f-4105-959d-7cf20a0a1b3e service nova] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Received event network-changed-b910fb2a-440c-426f-a000-064149073835 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:11:03 user nova-compute[74840]: DEBUG nova.compute.manager [req-0a71d693-5d21-48a6-969f-39dc2508bb18 req-b9b964ca-c92f-4105-959d-7cf20a0a1b3e service nova] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Refreshing instance network info cache due to event network-changed-b910fb2a-440c-426f-a000-064149073835. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:11:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0a71d693-5d21-48a6-969f-39dc2508bb18 req-b9b964ca-c92f-4105-959d-7cf20a0a1b3e service nova] Acquiring lock "refresh_cache-684b8be2-7f8f-499f-8885-c9d1c86eef2f" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:11:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0a71d693-5d21-48a6-969f-39dc2508bb18 req-b9b964ca-c92f-4105-959d-7cf20a0a1b3e service nova] Acquired lock "refresh_cache-684b8be2-7f8f-499f-8885-c9d1c86eef2f" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:11:03 user nova-compute[74840]: DEBUG nova.network.neutron [req-0a71d693-5d21-48a6-969f-39dc2508bb18 req-b9b964ca-c92f-4105-959d-7cf20a0a1b3e service nova] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Refreshing network info cache for port b910fb2a-440c-426f-a000-064149073835 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:11:03 user nova-compute[74840]: DEBUG nova.network.neutron [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Successfully updated port: 3e6aa660-8be2-44d4-aece-59b38a00ff02 {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:11:03 user nova-compute[74840]: DEBUG nova.network.neutron [req-0a71d693-5d21-48a6-969f-39dc2508bb18 req-b9b964ca-c92f-4105-959d-7cf20a0a1b3e service nova] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Updated VIF entry in instance network info cache for port b910fb2a-440c-426f-a000-064149073835. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:11:03 user nova-compute[74840]: DEBUG nova.network.neutron [req-0a71d693-5d21-48a6-969f-39dc2508bb18 req-b9b964ca-c92f-4105-959d-7cf20a0a1b3e service nova] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Updating instance_info_cache with network_info: [{"id": "b910fb2a-440c-426f-a000-064149073835", "address": "fa:16:3e:fd:8e:63", "network": {"id": "bfa1d7ef-3436-4676-a399-ead8194a958a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-3950314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd51d983b3aa441dabb1543296f0bb70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb910fb2a-44", "ovs_interfaceid": "b910fb2a-440c-426f-a000-064149073835", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:11:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0a71d693-5d21-48a6-969f-39dc2508bb18 req-b9b964ca-c92f-4105-959d-7cf20a0a1b3e service nova] Releasing lock "refresh_cache-684b8be2-7f8f-499f-8885-c9d1c86eef2f" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:11:04 user nova-compute[74840]: DEBUG nova.network.neutron [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Successfully updated port: 7a2393a4-2d55-49cc-b4af-189d3ab24c1e {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:11:04 user nova-compute[74840]: DEBUG nova.compute.manager [req-da63445c-1e7d-4f2c-8e8d-4c9578dd0716 req-ab74df22-cbc2-41d1-a981-b59a5bea7d46 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received event network-changed-65988447-7cce-4be7-87dd-4fd49e351040 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:11:04 user nova-compute[74840]: DEBUG nova.compute.manager [req-da63445c-1e7d-4f2c-8e8d-4c9578dd0716 req-ab74df22-cbc2-41d1-a981-b59a5bea7d46 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Refreshing instance network info cache due to event network-changed-65988447-7cce-4be7-87dd-4fd49e351040. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:11:04 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-da63445c-1e7d-4f2c-8e8d-4c9578dd0716 req-ab74df22-cbc2-41d1-a981-b59a5bea7d46 service nova] Acquiring lock "refresh_cache-d2dbd607-cf11-4d81-9639-c84e79d65fcd" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:11:04 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-da63445c-1e7d-4f2c-8e8d-4c9578dd0716 req-ab74df22-cbc2-41d1-a981-b59a5bea7d46 service nova] Acquired lock "refresh_cache-d2dbd607-cf11-4d81-9639-c84e79d65fcd" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:11:04 user nova-compute[74840]: DEBUG nova.network.neutron [req-da63445c-1e7d-4f2c-8e8d-4c9578dd0716 req-ab74df22-cbc2-41d1-a981-b59a5bea7d46 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Refreshing network info cache for port 65988447-7cce-4be7-87dd-4fd49e351040 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:11:04 user nova-compute[74840]: DEBUG nova.network.neutron [req-da63445c-1e7d-4f2c-8e8d-4c9578dd0716 req-ab74df22-cbc2-41d1-a981-b59a5bea7d46 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:11:04 user nova-compute[74840]: DEBUG nova.network.neutron [req-da63445c-1e7d-4f2c-8e8d-4c9578dd0716 req-ab74df22-cbc2-41d1-a981-b59a5bea7d46 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:11:04 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-da63445c-1e7d-4f2c-8e8d-4c9578dd0716 req-ab74df22-cbc2-41d1-a981-b59a5bea7d46 service nova] Releasing lock "refresh_cache-d2dbd607-cf11-4d81-9639-c84e79d65fcd" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:11:04 user nova-compute[74840]: DEBUG nova.compute.manager [req-da63445c-1e7d-4f2c-8e8d-4c9578dd0716 req-ab74df22-cbc2-41d1-a981-b59a5bea7d46 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received event network-changed-3e6aa660-8be2-44d4-aece-59b38a00ff02 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:11:04 user nova-compute[74840]: DEBUG nova.compute.manager [req-da63445c-1e7d-4f2c-8e8d-4c9578dd0716 req-ab74df22-cbc2-41d1-a981-b59a5bea7d46 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Refreshing instance network info cache due to event network-changed-3e6aa660-8be2-44d4-aece-59b38a00ff02. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:11:04 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-da63445c-1e7d-4f2c-8e8d-4c9578dd0716 req-ab74df22-cbc2-41d1-a981-b59a5bea7d46 service nova] Acquiring lock "refresh_cache-d2dbd607-cf11-4d81-9639-c84e79d65fcd" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:11:04 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-da63445c-1e7d-4f2c-8e8d-4c9578dd0716 req-ab74df22-cbc2-41d1-a981-b59a5bea7d46 service nova] Acquired lock "refresh_cache-d2dbd607-cf11-4d81-9639-c84e79d65fcd" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:11:04 user nova-compute[74840]: DEBUG nova.network.neutron [req-da63445c-1e7d-4f2c-8e8d-4c9578dd0716 req-ab74df22-cbc2-41d1-a981-b59a5bea7d46 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Refreshing network info cache for port 3e6aa660-8be2-44d4-aece-59b38a00ff02 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:11:04 user nova-compute[74840]: DEBUG nova.network.neutron [req-da63445c-1e7d-4f2c-8e8d-4c9578dd0716 req-ab74df22-cbc2-41d1-a981-b59a5bea7d46 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:11:04 user nova-compute[74840]: DEBUG nova.network.neutron [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Successfully updated port: 77c96b94-7c85-4356-8da8-bb90854ead5e {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:11:04 user nova-compute[74840]: DEBUG nova.network.neutron [req-da63445c-1e7d-4f2c-8e8d-4c9578dd0716 req-ab74df22-cbc2-41d1-a981-b59a5bea7d46 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:11:04 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-da63445c-1e7d-4f2c-8e8d-4c9578dd0716 req-ab74df22-cbc2-41d1-a981-b59a5bea7d46 service nova] Releasing lock "refresh_cache-d2dbd607-cf11-4d81-9639-c84e79d65fcd" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:11:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:06 user nova-compute[74840]: DEBUG nova.network.neutron [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Successfully updated port: 0f88f24e-b28a-4e36-bef3-1fa13084f370 {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:11:06 user nova-compute[74840]: DEBUG nova.compute.manager [req-6f22b9eb-a449-4fd0-810e-e8f44551970c req-c30df192-fd39-41fd-a6f5-737df6fba726 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received event network-changed-7a2393a4-2d55-49cc-b4af-189d3ab24c1e {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:11:06 user nova-compute[74840]: DEBUG nova.compute.manager [req-6f22b9eb-a449-4fd0-810e-e8f44551970c req-c30df192-fd39-41fd-a6f5-737df6fba726 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Refreshing instance network info cache due to event network-changed-7a2393a4-2d55-49cc-b4af-189d3ab24c1e. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:11:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-6f22b9eb-a449-4fd0-810e-e8f44551970c req-c30df192-fd39-41fd-a6f5-737df6fba726 service nova] Acquiring lock "refresh_cache-d2dbd607-cf11-4d81-9639-c84e79d65fcd" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:11:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-6f22b9eb-a449-4fd0-810e-e8f44551970c req-c30df192-fd39-41fd-a6f5-737df6fba726 service nova] Acquired lock "refresh_cache-d2dbd607-cf11-4d81-9639-c84e79d65fcd" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:11:06 user nova-compute[74840]: DEBUG nova.network.neutron [req-6f22b9eb-a449-4fd0-810e-e8f44551970c req-c30df192-fd39-41fd-a6f5-737df6fba726 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Refreshing network info cache for port 7a2393a4-2d55-49cc-b4af-189d3ab24c1e {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:11:06 user nova-compute[74840]: DEBUG nova.network.neutron [req-6f22b9eb-a449-4fd0-810e-e8f44551970c req-c30df192-fd39-41fd-a6f5-737df6fba726 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:11:06 user nova-compute[74840]: DEBUG nova.network.neutron [req-6f22b9eb-a449-4fd0-810e-e8f44551970c req-c30df192-fd39-41fd-a6f5-737df6fba726 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:11:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-6f22b9eb-a449-4fd0-810e-e8f44551970c req-c30df192-fd39-41fd-a6f5-737df6fba726 service nova] Releasing lock "refresh_cache-d2dbd607-cf11-4d81-9639-c84e79d65fcd" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:11:06 user nova-compute[74840]: DEBUG nova.compute.manager [req-6f22b9eb-a449-4fd0-810e-e8f44551970c req-c30df192-fd39-41fd-a6f5-737df6fba726 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received event network-changed-77c96b94-7c85-4356-8da8-bb90854ead5e {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:11:06 user nova-compute[74840]: DEBUG nova.compute.manager [req-6f22b9eb-a449-4fd0-810e-e8f44551970c req-c30df192-fd39-41fd-a6f5-737df6fba726 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Refreshing instance network info cache due to event network-changed-77c96b94-7c85-4356-8da8-bb90854ead5e. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:11:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-6f22b9eb-a449-4fd0-810e-e8f44551970c req-c30df192-fd39-41fd-a6f5-737df6fba726 service nova] Acquiring lock "refresh_cache-d2dbd607-cf11-4d81-9639-c84e79d65fcd" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:11:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-6f22b9eb-a449-4fd0-810e-e8f44551970c req-c30df192-fd39-41fd-a6f5-737df6fba726 service nova] Acquired lock "refresh_cache-d2dbd607-cf11-4d81-9639-c84e79d65fcd" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:11:06 user nova-compute[74840]: DEBUG nova.network.neutron [req-6f22b9eb-a449-4fd0-810e-e8f44551970c req-c30df192-fd39-41fd-a6f5-737df6fba726 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Refreshing network info cache for port 77c96b94-7c85-4356-8da8-bb90854ead5e {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:11:06 user nova-compute[74840]: DEBUG nova.network.neutron [req-6f22b9eb-a449-4fd0-810e-e8f44551970c req-c30df192-fd39-41fd-a6f5-737df6fba726 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:11:06 user nova-compute[74840]: DEBUG nova.network.neutron [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Successfully updated port: b80b0e8d-2bc7-4e85-8843-c9d8c7931014 {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:11:06 user nova-compute[74840]: DEBUG nova.network.neutron [req-6f22b9eb-a449-4fd0-810e-e8f44551970c req-c30df192-fd39-41fd-a6f5-737df6fba726 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:11:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Acquiring lock "refresh_cache-d2dbd607-cf11-4d81-9639-c84e79d65fcd" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:11:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-6f22b9eb-a449-4fd0-810e-e8f44551970c req-c30df192-fd39-41fd-a6f5-737df6fba726 service nova] Releasing lock "refresh_cache-d2dbd607-cf11-4d81-9639-c84e79d65fcd" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:11:06 user nova-compute[74840]: DEBUG nova.compute.manager [req-6f22b9eb-a449-4fd0-810e-e8f44551970c req-c30df192-fd39-41fd-a6f5-737df6fba726 service nova] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Received event network-changed-bf46d9d3-89c8-43be-b311-e9c6b68fcb9e {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:11:06 user nova-compute[74840]: DEBUG nova.compute.manager [req-6f22b9eb-a449-4fd0-810e-e8f44551970c req-c30df192-fd39-41fd-a6f5-737df6fba726 service nova] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Refreshing instance network info cache due to event network-changed-bf46d9d3-89c8-43be-b311-e9c6b68fcb9e. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:11:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-6f22b9eb-a449-4fd0-810e-e8f44551970c req-c30df192-fd39-41fd-a6f5-737df6fba726 service nova] Acquiring lock "refresh_cache-4647e942-c600-4a9c-95ba-a59064d04619" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:11:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-6f22b9eb-a449-4fd0-810e-e8f44551970c req-c30df192-fd39-41fd-a6f5-737df6fba726 service nova] Acquired lock "refresh_cache-4647e942-c600-4a9c-95ba-a59064d04619" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:11:06 user nova-compute[74840]: DEBUG nova.network.neutron [req-6f22b9eb-a449-4fd0-810e-e8f44551970c req-c30df192-fd39-41fd-a6f5-737df6fba726 service nova] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Refreshing network info cache for port bf46d9d3-89c8-43be-b311-e9c6b68fcb9e {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:11:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Acquired lock "refresh_cache-d2dbd607-cf11-4d81-9639-c84e79d65fcd" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:11:06 user nova-compute[74840]: DEBUG nova.network.neutron [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:11:07 user nova-compute[74840]: DEBUG nova.network.neutron [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:11:07 user nova-compute[74840]: DEBUG nova.network.neutron [req-6f22b9eb-a449-4fd0-810e-e8f44551970c req-c30df192-fd39-41fd-a6f5-737df6fba726 service nova] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Updated VIF entry in instance network info cache for port bf46d9d3-89c8-43be-b311-e9c6b68fcb9e. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:11:07 user nova-compute[74840]: DEBUG nova.network.neutron [req-6f22b9eb-a449-4fd0-810e-e8f44551970c req-c30df192-fd39-41fd-a6f5-737df6fba726 service nova] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Updating instance_info_cache with network_info: [{"id": "bf46d9d3-89c8-43be-b311-e9c6b68fcb9e", "address": "fa:16:3e:84:44:b2", "network": {"id": "c40fb022-567d-4eee-8ac6-14b45b43c92b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1575943545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8d34c1c5dea4b59b332d650f2639c20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf46d9d3-89", "ovs_interfaceid": "bf46d9d3-89c8-43be-b311-e9c6b68fcb9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:11:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-6f22b9eb-a449-4fd0-810e-e8f44551970c req-c30df192-fd39-41fd-a6f5-737df6fba726 service nova] Releasing lock "refresh_cache-4647e942-c600-4a9c-95ba-a59064d04619" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:11:07 user nova-compute[74840]: DEBUG nova.compute.manager [req-6f22b9eb-a449-4fd0-810e-e8f44551970c req-c30df192-fd39-41fd-a6f5-737df6fba726 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received event network-changed-0f88f24e-b28a-4e36-bef3-1fa13084f370 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:11:07 user nova-compute[74840]: DEBUG nova.compute.manager [req-6f22b9eb-a449-4fd0-810e-e8f44551970c req-c30df192-fd39-41fd-a6f5-737df6fba726 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Refreshing instance network info cache due to event network-changed-0f88f24e-b28a-4e36-bef3-1fa13084f370. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:11:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-6f22b9eb-a449-4fd0-810e-e8f44551970c req-c30df192-fd39-41fd-a6f5-737df6fba726 service nova] Acquiring lock "refresh_cache-d2dbd607-cf11-4d81-9639-c84e79d65fcd" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:11:08 user nova-compute[74840]: DEBUG nova.compute.manager [req-271f230f-3053-409d-87b9-48cd2ffcd1fc req-40d7f735-ddc6-4744-aa90-238fdbabf6ad service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received event network-changed-b80b0e8d-2bc7-4e85-8843-c9d8c7931014 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:11:08 user nova-compute[74840]: DEBUG nova.compute.manager [req-271f230f-3053-409d-87b9-48cd2ffcd1fc req-40d7f735-ddc6-4744-aa90-238fdbabf6ad service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Refreshing instance network info cache due to event network-changed-b80b0e8d-2bc7-4e85-8843-c9d8c7931014. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:11:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-271f230f-3053-409d-87b9-48cd2ffcd1fc req-40d7f735-ddc6-4744-aa90-238fdbabf6ad service nova] Acquiring lock "refresh_cache-d2dbd607-cf11-4d81-9639-c84e79d65fcd" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:11:08 user nova-compute[74840]: DEBUG nova.network.neutron [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Updating instance_info_cache with network_info: [{"id": "38640df8-91ab-4bb6-89f1-ac84843d0e1c", "address": "fa:16:3e:7b:5b:86", "network": {"id": "ab262498-b88d-4054-a45b-cd8fe41731e6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1982652154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38640df8-91", "ovs_interfaceid": "38640df8-91ab-4bb6-89f1-ac84843d0e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "65988447-7cce-4be7-87dd-4fd49e351040", "address": "fa:16:3e:92:b6:34", "network": {"id": "4998659b-781d-44e7-9601-d14cd5e39410", "bridge": "br-int", "label": "tempest-device-tagging-net1-756241958", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65988447-7c", "ovs_interfaceid": "65988447-7cce-4be7-87dd-4fd49e351040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3e6aa660-8be2-44d4-aece-59b38a00ff02", "address": "fa:16:3e:25:8f:ae", "network": {"id": "4998659b-781d-44e7-9601-d14cd5e39410", "bridge": "br-int", "label": "tempest-device-tagging-net1-756241958", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e6aa660-8b", "ovs_interfaceid": "3e6aa660-8be2-44d4-aece-59b38a00ff02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7a2393a4-2d55-49cc-b4af-189d3ab24c1e", "address": "fa:16:3e:64:5a:54", "network": {"id": "4998659b-781d-44e7-9601-d14cd5e39410", "bridge": "br-int", "label": "tempest-device-tagging-net1-756241958", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2393a4-2d", "ovs_interfaceid": "7a2393a4-2d55-49cc-b4af-189d3ab24c1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "77c96b94-7c85-4356-8da8-bb90854ead5e", "address": "fa:16:3e:21:2e:ad", "network": {"id": "4998659b-781d-44e7-9601-d14cd5e39410", "bridge": "br-int", "label": "tempest-device-tagging-net1-756241958", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c96b94-7c", "ovs_interfaceid": "77c96b94-7c85-4356-8da8-bb90854ead5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0f88f24e-b28a-4e36-bef3-1fa13084f370", "address": "fa:16:3e:c4:eb:48", "network": {"id": "2242fb46-3f42-4d3e-808c-ebdd55268fe5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388499652", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f88f24e-b2", "ovs_interfaceid": "0f88f24e-b28a-4e36-bef3-1fa13084f370", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b80b0e8d-2bc7-4e85-8843-c9d8c7931014", "address": "fa:16:3e:0b:f1:33", "network": {"id": "2242fb46-3f42-4d3e-808c-ebdd55268fe5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388499652", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb80b0e8d-2b", "ovs_interfaceid": "b80b0e8d-2bc7-4e85-8843-c9d8c7931014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:11:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Releasing lock "refresh_cache-d2dbd607-cf11-4d81-9639-c84e79d65fcd" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:11:08 user nova-compute[74840]: DEBUG nova.compute.manager [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Instance network_info: |[{"id": "38640df8-91ab-4bb6-89f1-ac84843d0e1c", "address": "fa:16:3e:7b:5b:86", "network": {"id": "ab262498-b88d-4054-a45b-cd8fe41731e6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1982652154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38640df8-91", "ovs_interfaceid": "38640df8-91ab-4bb6-89f1-ac84843d0e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "65988447-7cce-4be7-87dd-4fd49e351040", "address": "fa:16:3e:92:b6:34", "network": {"id": "4998659b-781d-44e7-9601-d14cd5e39410", "bridge": "br-int", "label": "tempest-device-tagging-net1-756241958", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65988447-7c", "ovs_interfaceid": "65988447-7cce-4be7-87dd-4fd49e351040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3e6aa660-8be2-44d4-aece-59b38a00ff02", "address": "fa:16:3e:25:8f:ae", "network": {"id": "4998659b-781d-44e7-9601-d14cd5e39410", "bridge": "br-int", "label": "tempest-device-tagging-net1-756241958", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e6aa660-8b", "ovs_interfaceid": "3e6aa660-8be2-44d4-aece-59b38a00ff02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7a2393a4-2d55-49cc-b4af-189d3ab24c1e", "address": "fa:16:3e:64:5a:54", "network": {"id": "4998659b-781d-44e7-9601-d14cd5e39410", "bridge": "br-int", "label": "tempest-device-tagging-net1-756241958", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2393a4-2d", "ovs_interfaceid": "7a2393a4-2d55-49cc-b4af-189d3ab24c1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "77c96b94-7c85-4356-8da8-bb90854ead5e", "address": "fa:16:3e:21:2e:ad", "network": {"id": "4998659b-781d-44e7-9601-d14cd5e39410", "bridge": "br-int", "label": "tempest-device-tagging-net1-756241958", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c96b94-7c", "ovs_interfaceid": "77c96b94-7c85-4356-8da8-bb90854ead5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0f88f24e-b28a-4e36-bef3-1fa13084f370", "address": "fa:16:3e:c4:eb:48", "network": {"id": "2242fb46-3f42-4d3e-808c-ebdd55268fe5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388499652", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f88f24e-b2", "ovs_interfaceid": "0f88f24e-b28a-4e36-bef3-1fa13084f370", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b80b0e8d-2bc7-4e85-8843-c9d8c7931014", "address": "fa:16:3e:0b:f1:33", "network": {"id": "2242fb46-3f42-4d3e-808c-ebdd55268fe5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388499652", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb80b0e8d-2b", "ovs_interfaceid": "b80b0e8d-2bc7-4e85-8843-c9d8c7931014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 12:11:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-6f22b9eb-a449-4fd0-810e-e8f44551970c req-c30df192-fd39-41fd-a6f5-737df6fba726 service nova] Acquired lock "refresh_cache-d2dbd607-cf11-4d81-9639-c84e79d65fcd" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:11:08 user nova-compute[74840]: DEBUG nova.network.neutron [req-6f22b9eb-a449-4fd0-810e-e8f44551970c req-c30df192-fd39-41fd-a6f5-737df6fba726 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Refreshing network info cache for port 0f88f24e-b28a-4e36-bef3-1fa13084f370 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:11:09 user nova-compute[74840]: DEBUG nova.network.neutron [req-6f22b9eb-a449-4fd0-810e-e8f44551970c req-c30df192-fd39-41fd-a6f5-737df6fba726 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Updated VIF entry in instance network info cache for port 0f88f24e-b28a-4e36-bef3-1fa13084f370. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:11:09 user nova-compute[74840]: DEBUG nova.network.neutron [req-6f22b9eb-a449-4fd0-810e-e8f44551970c req-c30df192-fd39-41fd-a6f5-737df6fba726 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Updating instance_info_cache with network_info: [{"id": "38640df8-91ab-4bb6-89f1-ac84843d0e1c", "address": "fa:16:3e:7b:5b:86", "network": {"id": "ab262498-b88d-4054-a45b-cd8fe41731e6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1982652154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38640df8-91", "ovs_interfaceid": "38640df8-91ab-4bb6-89f1-ac84843d0e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "65988447-7cce-4be7-87dd-4fd49e351040", "address": "fa:16:3e:92:b6:34", "network": {"id": "4998659b-781d-44e7-9601-d14cd5e39410", "bridge": "br-int", "label": "tempest-device-tagging-net1-756241958", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65988447-7c", "ovs_interfaceid": "65988447-7cce-4be7-87dd-4fd49e351040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3e6aa660-8be2-44d4-aece-59b38a00ff02", "address": "fa:16:3e:25:8f:ae", "network": {"id": "4998659b-781d-44e7-9601-d14cd5e39410", "bridge": "br-int", "label": "tempest-device-tagging-net1-756241958", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e6aa660-8b", "ovs_interfaceid": "3e6aa660-8be2-44d4-aece-59b38a00ff02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7a2393a4-2d55-49cc-b4af-189d3ab24c1e", "address": "fa:16:3e:64:5a:54", "network": {"id": "4998659b-781d-44e7-9601-d14cd5e39410", "bridge": "br-int", "label": "tempest-device-tagging-net1-756241958", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2393a4-2d", "ovs_interfaceid": "7a2393a4-2d55-49cc-b4af-189d3ab24c1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "77c96b94-7c85-4356-8da8-bb90854ead5e", "address": "fa:16:3e:21:2e:ad", "network": {"id": "4998659b-781d-44e7-9601-d14cd5e39410", "bridge": "br-int", "label": "tempest-device-tagging-net1-756241958", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c96b94-7c", "ovs_interfaceid": "77c96b94-7c85-4356-8da8-bb90854ead5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0f88f24e-b28a-4e36-bef3-1fa13084f370", "address": "fa:16:3e:c4:eb:48", "network": {"id": "2242fb46-3f42-4d3e-808c-ebdd55268fe5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388499652", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f88f24e-b2", "ovs_interfaceid": "0f88f24e-b28a-4e36-bef3-1fa13084f370", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b80b0e8d-2bc7-4e85-8843-c9d8c7931014", "address": "fa:16:3e:0b:f1:33", "network": {"id": "2242fb46-3f42-4d3e-808c-ebdd55268fe5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388499652", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb80b0e8d-2b", "ovs_interfaceid": "b80b0e8d-2bc7-4e85-8843-c9d8c7931014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:11:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-6f22b9eb-a449-4fd0-810e-e8f44551970c req-c30df192-fd39-41fd-a6f5-737df6fba726 service nova] Releasing lock "refresh_cache-d2dbd607-cf11-4d81-9639-c84e79d65fcd" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:11:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-271f230f-3053-409d-87b9-48cd2ffcd1fc req-40d7f735-ddc6-4744-aa90-238fdbabf6ad service nova] Acquired lock "refresh_cache-d2dbd607-cf11-4d81-9639-c84e79d65fcd" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:11:09 user nova-compute[74840]: DEBUG nova.network.neutron [req-271f230f-3053-409d-87b9-48cd2ffcd1fc req-40d7f735-ddc6-4744-aa90-238fdbabf6ad service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Refreshing network info cache for port b80b0e8d-2bc7-4e85-8843-c9d8c7931014 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:11:09 user nova-compute[74840]: DEBUG nova.network.neutron [req-271f230f-3053-409d-87b9-48cd2ffcd1fc req-40d7f735-ddc6-4744-aa90-238fdbabf6ad service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Updated VIF entry in instance network info cache for port b80b0e8d-2bc7-4e85-8843-c9d8c7931014. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:11:09 user nova-compute[74840]: DEBUG nova.network.neutron [req-271f230f-3053-409d-87b9-48cd2ffcd1fc req-40d7f735-ddc6-4744-aa90-238fdbabf6ad service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Updating instance_info_cache with network_info: [{"id": "38640df8-91ab-4bb6-89f1-ac84843d0e1c", "address": "fa:16:3e:7b:5b:86", "network": {"id": "ab262498-b88d-4054-a45b-cd8fe41731e6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1982652154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38640df8-91", "ovs_interfaceid": "38640df8-91ab-4bb6-89f1-ac84843d0e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "65988447-7cce-4be7-87dd-4fd49e351040", "address": "fa:16:3e:92:b6:34", "network": {"id": "4998659b-781d-44e7-9601-d14cd5e39410", "bridge": "br-int", "label": "tempest-device-tagging-net1-756241958", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65988447-7c", "ovs_interfaceid": "65988447-7cce-4be7-87dd-4fd49e351040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3e6aa660-8be2-44d4-aece-59b38a00ff02", "address": "fa:16:3e:25:8f:ae", "network": {"id": "4998659b-781d-44e7-9601-d14cd5e39410", "bridge": "br-int", "label": "tempest-device-tagging-net1-756241958", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e6aa660-8b", "ovs_interfaceid": "3e6aa660-8be2-44d4-aece-59b38a00ff02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7a2393a4-2d55-49cc-b4af-189d3ab24c1e", "address": "fa:16:3e:64:5a:54", "network": {"id": "4998659b-781d-44e7-9601-d14cd5e39410", "bridge": "br-int", "label": "tempest-device-tagging-net1-756241958", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2393a4-2d", "ovs_interfaceid": "7a2393a4-2d55-49cc-b4af-189d3ab24c1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "77c96b94-7c85-4356-8da8-bb90854ead5e", "address": "fa:16:3e:21:2e:ad", "network": {"id": "4998659b-781d-44e7-9601-d14cd5e39410", "bridge": "br-int", "label": "tempest-device-tagging-net1-756241958", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c96b94-7c", "ovs_interfaceid": "77c96b94-7c85-4356-8da8-bb90854ead5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0f88f24e-b28a-4e36-bef3-1fa13084f370", "address": "fa:16:3e:c4:eb:48", "network": {"id": "2242fb46-3f42-4d3e-808c-ebdd55268fe5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388499652", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f88f24e-b2", "ovs_interfaceid": "0f88f24e-b28a-4e36-bef3-1fa13084f370", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b80b0e8d-2bc7-4e85-8843-c9d8c7931014", "address": "fa:16:3e:0b:f1:33", "network": {"id": "2242fb46-3f42-4d3e-808c-ebdd55268fe5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388499652", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb80b0e8d-2b", "ovs_interfaceid": "b80b0e8d-2bc7-4e85-8843-c9d8c7931014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:11:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-271f230f-3053-409d-87b9-48cd2ffcd1fc req-40d7f735-ddc6-4744-aa90-238fdbabf6ad service nova] Releasing lock "refresh_cache-d2dbd607-cf11-4d81-9639-c84e79d65fcd" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG os_brick.initiator.connector [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Factory for ISCSI on None {{(pid=74840) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Calling os-brick to attach iSCSI Volume {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UcaVlIsJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:11:10 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:11:10 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:11:10 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:11:10 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:11:10 user nova-compute[74840]: INFO os_brick.initiator.connectors.iscsi [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 12:11:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 -p 172.16.0.220:3260 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75b3957-5b59-4c85-b2be-d13fae0eee19]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 12:11:10 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff49772-e453-4320-9619-72c0483f351a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9] added\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9] added
Nov 08 12:11:10 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4f42b9-d51b-42f4-a7a9-26f37fbd5789]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[678e6db1-9e81-4fe6-97e9-6d3494641694]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UcaVlIsJ {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UcaVlIsJ" returned: 0 in 0.016s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bba99c9-f2de-417b-90a3-fb0031ed7fb1]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UcaVlIsJ'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd300c1-1cda-4c17-b87f-9f4770bb6023]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[be61efb6-deec-4237-be45-91d1064b61d0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 12:11:10 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 12:11:10 user nova-compute[74840]:  {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:11:10 user nova-compute[74840]: WARNING os_brick.initiator.connectors.iscsi [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 12:11:10 user nova-compute[74840]: 
Nov 08 12:11:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 -p 172.16.0.220:3260 --login {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca60aef5-2614-4b6a-ab7a-d8c33ed4da88]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9, portal: 172.16.0.220,3260]
Nov 08 12:11:10 user nova-compute[74840]: Login to [iface: default, target: iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9, portal: 172.16.0.220,3260] successful.
Nov 08 12:11:10 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[54efff49-8934-412a-ab34-1ff1ce5f470b]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6a99d8-7a2a-4835-b4c2-4ebcebbce7fd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)
Nov 08 12:11:10 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)
Nov 08 12:11:10 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Connected to 172.16.0.220:3260 {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74840) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74840) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9caf24f1-f919-4310-8c64-83e260f584f7]: (4, ('- - 0', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UcaVlIsJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 12:11:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:11 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:11:11 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23336636130633365', 'path': '/dev/sdb'} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:11:11 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336636130633365', 'path': '/dev/sdb'} {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 12:11:11 user nova-compute[74840]: DEBUG nova.objects.instance [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lazy-loading 'flavor' on Instance uuid 43eae335-a4a0-40b2-8cd4-c7881cd397b1 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:11:11 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 12:11:11 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:11:11 user nova-compute[74840]:   <source dev="/dev/sdb"/>
Nov 08 12:11:11 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:11:11 user nova-compute[74840]:   <serial>08a44583-de0d-44ca-a02a-fa9d906720c9</serial>
Nov 08 12:11:11 user nova-compute[74840]: </disk>
Nov 08 12:11:11 user nova-compute[74840]:  {{(pid=74840) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 12:11:11 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:11:11 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:11:11 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] No VIF found with MAC fa:16:3e:8f:c3:d6, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:11:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-3cdb3043-9760-492a-951b-7caf7f146b4c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "43eae335-a4a0-40b2-8cd4-c7881cd397b1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.093s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:11:15 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:15 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "972edb8d-69b8-4447-9170-1c1f73814345" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:11:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "972edb8d-69b8-4447-9170-1c1f73814345" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:11:16 user nova-compute[74840]: DEBUG nova.compute.manager [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Starting instance... {{(pid=74840) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 12:11:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:11:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:11:16 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:11:16 user nova-compute[74840]: INFO nova.compute.claims [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Claim successful on node user
Nov 08 12:11:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Acquiring lock "28ccd7b3-8bbe-42e7-aa00-612b3703ae79" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:11:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Lock "28ccd7b3-8bbe-42e7-aa00-612b3703ae79" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:11:16 user nova-compute[74840]: DEBUG nova.compute.manager [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Starting instance... {{(pid=74840) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 12:11:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:11:16 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:11:16 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:11:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.506s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:11:17 user nova-compute[74840]: DEBUG nova.compute.manager [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Start building networks asynchronously for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 12:11:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.135s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:11:17 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:11:17 user nova-compute[74840]: INFO nova.compute.claims [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Claim successful on node user
Nov 08 12:11:17 user nova-compute[74840]: DEBUG nova.compute.manager [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Allocating IP information in the background. {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 12:11:17 user nova-compute[74840]: DEBUG nova.network.neutron [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 12:11:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Acquiring lock "4647e942-c600-4a9c-95ba-a59064d04619" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:11:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Lock "4647e942-c600-4a9c-95ba-a59064d04619" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:11:17 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 12:11:17 user nova-compute[74840]: DEBUG nova.objects.instance [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Lazy-loading 'flavor' on Instance uuid 4647e942-c600-4a9c-95ba-a59064d04619 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:11:17 user nova-compute[74840]: DEBUG nova.compute.manager [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Start building block device mappings for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 12:11:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Lock "4647e942-c600-4a9c-95ba-a59064d04619" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:11:17 user nova-compute[74840]: DEBUG nova.policy [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e172625e7f334a2b896b2738bbf49aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec082e08ddf4477a721e410fe944d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 12:11:17 user nova-compute[74840]: DEBUG nova.compute.manager [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Start spawning the instance on the hypervisor. {{(pid=74840) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 12:11:17 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:11:17 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Creating image(s)
Nov 08 12:11:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "/opt/stack/data/nova/instances/972edb8d-69b8-4447-9170-1c1f73814345/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:11:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "/opt/stack/data/nova/instances/972edb8d-69b8-4447-9170-1c1f73814345/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:11:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "/opt/stack/data/nova/instances/972edb8d-69b8-4447-9170-1c1f73814345/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:11:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Acquiring lock "4647e942-c600-4a9c-95ba-a59064d04619" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:11:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Lock "4647e942-c600-4a9c-95ba-a59064d04619" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:11:17 user nova-compute[74840]: INFO nova.compute.manager [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Attaching volume 6034cc77-4e09-4ecd-a6be-9786d7fac2ff to /dev/sdc
Nov 08 12:11:17 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:11:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.235s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "5d26578eba85497f494c575690c4248f381a0fe6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:11:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:11:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:17 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:11:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.619s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:11:17 user nova-compute[74840]: DEBUG nova.compute.manager [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Start building networks asynchronously for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 12:11:17 user nova-compute[74840]: DEBUG os_brick.utils [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:11:17 user nova-compute[74840]: DEBUG nova.compute.manager [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Allocating IP information in the background. {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 12:11:17 user nova-compute[74840]: DEBUG nova.network.neutron [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 12:11:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:17 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 12:11:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:17 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72ac29c-6be2-4350-8533-021c584f224f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c8228a11e03c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.245s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/972edb8d-69b8-4447-9170-1c1f73814345/disk 1073741824 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:17 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[486a394b-cab0-4218-8d68-3e9a928ae0b8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:17 user nova-compute[74840]: DEBUG nova.compute.manager [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Start building block device mappings for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 12:11:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/972edb8d-69b8-4447-9170-1c1f73814345/disk 1073741824" returned: 0 in 0.057s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.305s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:11:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:17 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[2286c97d-c8a4-4b28-9294-597035b6d264]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:17 user nova-compute[74840]: DEBUG nova.policy [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0cab11962ef3472a864f830d45396c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c961954c4a0440a93d9738ca5ab0026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 12:11:17 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be6088f-b24d-40da-b9cf-8cf1b18b766d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Running cmd (subprocess): nvme version {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:17 user nova-compute[74840]: INFO nova.virt.block_device [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Booting with volume 2a571b42-9e1d-4406-b369-12722b22f097 at /dev/vda
Nov 08 12:11:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] 'nvme version' failed. Not Retrying. {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:11:17 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.nvmeof [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] nvme not present on system {{(pid=74840) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 12:11:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:11:17 user nova-compute[74840]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 12:11:17 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[162dfdbc-c40d-4dd5-9668-099f4d34d9bd]: (4, '') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:17 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74840) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 12:11:17 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 12:11:17 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] LIGHTOS: no hostnqn found. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 12:11:17 user nova-compute[74840]: DEBUG os_brick.utils [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] <== get_connector_properties: return (242ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c8228a11e03c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:11:17 user nova-compute[74840]: DEBUG nova.virt.block_device [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Updating existing volume attachment record: dfe294fb-49dd-4b08-95b0-9040f1251f3a {{(pid=74840) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 12:11:18 user nova-compute[74840]: DEBUG os_brick.utils [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:11:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.219s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:18 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Checking if we can resize image /opt/stack/data/nova/instances/972edb8d-69b8-4447-9170-1c1f73814345/disk. size=1073741824 {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 12:11:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972edb8d-69b8-4447-9170-1c1f73814345/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:18 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee040df-6071-45fd-92d1-810a61eea22e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c8228a11e03c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.026s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:18 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[970fc9fa-6d48-4a9e-a6a1-298e2630e3ac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:18 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9cae23-06ed-4d45-bfcc-7a73bfa1af00]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:18 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d081e1-d7da-4421-8b24-6a047a39e217]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Running cmd (subprocess): nvme version {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] 'nvme version' failed. Not Retrying. {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:11:18 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.nvmeof [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] nvme not present on system {{(pid=74840) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 12:11:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:11:18 user nova-compute[74840]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 12:11:18 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7519cc-6731-48a9-8c01-ac2213686f55]: (4, '') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:18 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74840) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 12:11:18 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 12:11:18 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] LIGHTOS: no hostnqn found. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 12:11:18 user nova-compute[74840]: DEBUG os_brick.utils [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] <== get_connector_properties: return (191ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c8228a11e03c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:11:18 user nova-compute[74840]: DEBUG nova.virt.block_device [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Updating existing volume attachment record: 98bc9b16-2ea1-416d-a7c8-95b453c43fba {{(pid=74840) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 12:11:18 user nova-compute[74840]: DEBUG nova.network.neutron [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Successfully created port: 804195be-3aed-40e6-9d0a-954fd997af14 {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:11:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972edb8d-69b8-4447-9170-1c1f73814345/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:18 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Cannot resize image /opt/stack/data/nova/instances/972edb8d-69b8-4447-9170-1c1f73814345/disk to a smaller size. {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 12:11:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Created local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 12:11:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Ensure instance console log exists: /opt/stack/data/nova/instances/972edb8d-69b8-4447-9170-1c1f73814345/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:11:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:11:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:11:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:11:18 user nova-compute[74840]: DEBUG nova.network.neutron [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Successfully created port: bd22c195-e803-484d-811a-aeeb04326bd0 {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:11:18 user nova-compute[74840]: DEBUG nova.network.neutron [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Successfully updated port: 804195be-3aed-40e6-9d0a-954fd997af14 {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:11:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "refresh_cache-972edb8d-69b8-4447-9170-1c1f73814345" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:11:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquired lock "refresh_cache-972edb8d-69b8-4447-9170-1c1f73814345" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:11:18 user nova-compute[74840]: DEBUG nova.network.neutron [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:11:18 user nova-compute[74840]: DEBUG nova.compute.manager [req-0fa6dd7e-1840-4bfe-8bf5-cf6057d806f3 req-5a746bf8-4061-4a44-a741-0acf4e3ba167 service nova] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Received event network-changed-804195be-3aed-40e6-9d0a-954fd997af14 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:11:18 user nova-compute[74840]: DEBUG nova.compute.manager [req-0fa6dd7e-1840-4bfe-8bf5-cf6057d806f3 req-5a746bf8-4061-4a44-a741-0acf4e3ba167 service nova] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Refreshing instance network info cache due to event network-changed-804195be-3aed-40e6-9d0a-954fd997af14. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:11:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0fa6dd7e-1840-4bfe-8bf5-cf6057d806f3 req-5a746bf8-4061-4a44-a741-0acf4e3ba167 service nova] Acquiring lock "refresh_cache-972edb8d-69b8-4447-9170-1c1f73814345" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:11:19 user nova-compute[74840]: DEBUG nova.network.neutron [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:11:19 user nova-compute[74840]: DEBUG nova.network.neutron [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Updating instance_info_cache with network_info: [{"id": "804195be-3aed-40e6-9d0a-954fd997af14", "address": "fa:16:3e:ba:fd:4c", "network": {"id": "381cad9f-376a-4335-95a4-4824aa0d7fad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1035058856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ec082e08ddf4477a721e410fe944d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804195be-3a", "ovs_interfaceid": "804195be-3aed-40e6-9d0a-954fd997af14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:11:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Releasing lock "refresh_cache-972edb8d-69b8-4447-9170-1c1f73814345" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:11:19 user nova-compute[74840]: DEBUG nova.compute.manager [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Instance network_info: |[{"id": "804195be-3aed-40e6-9d0a-954fd997af14", "address": "fa:16:3e:ba:fd:4c", "network": {"id": "381cad9f-376a-4335-95a4-4824aa0d7fad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1035058856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ec082e08ddf4477a721e410fe944d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804195be-3a", "ovs_interfaceid": "804195be-3aed-40e6-9d0a-954fd997af14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 12:11:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0fa6dd7e-1840-4bfe-8bf5-cf6057d806f3 req-5a746bf8-4061-4a44-a741-0acf4e3ba167 service nova] Acquired lock "refresh_cache-972edb8d-69b8-4447-9170-1c1f73814345" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:11:19 user nova-compute[74840]: DEBUG nova.network.neutron [req-0fa6dd7e-1840-4bfe-8bf5-cf6057d806f3 req-5a746bf8-4061-4a44-a741-0acf4e3ba167 service nova] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Refreshing network info cache for port 804195be-3aed-40e6-9d0a-954fd997af14 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:11:19 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Start _get_guest_xml network_info=[{"id": "804195be-3aed-40e6-9d0a-954fd997af14", "address": "fa:16:3e:ba:fd:4c", "network": {"id": "381cad9f-376a-4335-95a4-4824aa0d7fad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1035058856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ec082e08ddf4477a721e410fe944d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804195be-3a", "ovs_interfaceid": "804195be-3aed-40e6-9d0a-954fd997af14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'image_id': '4fa17706-d304-4117-a420-dab994c703dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:11:19 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:11:19 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:11:19 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:11:19 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:11:19 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:11:19 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:11:19 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:11:19 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:11:19 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:11:19 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:11:19 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:11:19 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:11:19 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:11:19 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:11:19 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:11:19 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:11:19 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:11:19 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:11:19 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:11:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1880516201',display_name='tempest-AttachVolumeNegativeTest-server-1880516201',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1880516201',id=9,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIoml0vInjRpaeaoO/uEWcy+sGwmwvvQoVqRZqz1TWvdPEvRKpVYnYquAeVoOXEbsvy71nEMT5ycphhT5SLXWy8OIPigxxFGem2BDWUWcPtZsrm2GQciEMzWfDylA78S7A==',key_name='tempest-keypair-933257025',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ec082e08ddf4477a721e410fe944d10',ramdisk_id='',reservation_id='r-mt0sy8sj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1526881991',owner_user_name='tempest-AttachVolumeNegativeTest-1526881991-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:11:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e172625e7f334a2b896b2738bbf49aa8',uuid=972edb8d-69b8-4447-9170-1c1f73814345,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "804195be-3aed-40e6-9d0a-954fd997af14", "address": "fa:16:3e:ba:fd:4c", "network": {"id": "381cad9f-376a-4335-95a4-4824aa0d7fad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1035058856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ec082e08ddf4477a721e410fe944d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804195be-3a", "ovs_interfaceid": "804195be-3aed-40e6-9d0a-954fd997af14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:11:19 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Converting VIF {"id": "804195be-3aed-40e6-9d0a-954fd997af14", "address": "fa:16:3e:ba:fd:4c", "network": {"id": "381cad9f-376a-4335-95a4-4824aa0d7fad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1035058856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ec082e08ddf4477a721e410fe944d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804195be-3a", "ovs_interfaceid": "804195be-3aed-40e6-9d0a-954fd997af14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:11:19 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:fd:4c,bridge_name='br-int',has_traffic_filtering=True,id=804195be-3aed-40e6-9d0a-954fd997af14,network=Network(381cad9f-376a-4335-95a4-4824aa0d7fad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap804195be-3a') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:11:19 user nova-compute[74840]: DEBUG nova.objects.instance [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lazy-loading 'pci_devices' on Instance uuid 972edb8d-69b8-4447-9170-1c1f73814345 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:11:19 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:11:19 user nova-compute[74840]:   <uuid>972edb8d-69b8-4447-9170-1c1f73814345</uuid>
Nov 08 12:11:19 user nova-compute[74840]:   <name>instance-00000009</name>
Nov 08 12:11:19 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:11:19 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:11:19 user nova-compute[74840]:   <metadata>
Nov 08 12:11:19 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:11:19 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:11:19 user nova-compute[74840]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1880516201</nova:name>
Nov 08 12:11:19 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:11:19</nova:creationTime>
Nov 08 12:11:19 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:11:19 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:11:19 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:11:19 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:11:19 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:11:19 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:11:19 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:11:19 user nova-compute[74840]:       <nova:owner>
Nov 08 12:11:19 user nova-compute[74840]:         <nova:user uuid="e172625e7f334a2b896b2738bbf49aa8">tempest-AttachVolumeNegativeTest-1526881991-project-member</nova:user>
Nov 08 12:11:19 user nova-compute[74840]:         <nova:project uuid="3ec082e08ddf4477a721e410fe944d10">tempest-AttachVolumeNegativeTest-1526881991</nova:project>
Nov 08 12:11:19 user nova-compute[74840]:       </nova:owner>
Nov 08 12:11:19 user nova-compute[74840]:       <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:11:19 user nova-compute[74840]:       <nova:ports>
Nov 08 12:11:19 user nova-compute[74840]:         <nova:port uuid="804195be-3aed-40e6-9d0a-954fd997af14">
Nov 08 12:11:19 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 12:11:19 user nova-compute[74840]:         </nova:port>
Nov 08 12:11:19 user nova-compute[74840]:       </nova:ports>
Nov 08 12:11:19 user nova-compute[74840]:     </nova:instance>
Nov 08 12:11:19 user nova-compute[74840]:   </metadata>
Nov 08 12:11:19 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:11:19 user nova-compute[74840]:     <system>
Nov 08 12:11:19 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:11:19 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:11:19 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:11:19 user nova-compute[74840]:       <entry name="serial">972edb8d-69b8-4447-9170-1c1f73814345</entry>
Nov 08 12:11:19 user nova-compute[74840]:       <entry name="uuid">972edb8d-69b8-4447-9170-1c1f73814345</entry>
Nov 08 12:11:19 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:11:19 user nova-compute[74840]:     </system>
Nov 08 12:11:19 user nova-compute[74840]:   </sysinfo>
Nov 08 12:11:19 user nova-compute[74840]:   <os>
Nov 08 12:11:19 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:11:19 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:11:19 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:11:19 user nova-compute[74840]:   </os>
Nov 08 12:11:19 user nova-compute[74840]:   <features>
Nov 08 12:11:19 user nova-compute[74840]:     <acpi/>
Nov 08 12:11:19 user nova-compute[74840]:     <apic/>
Nov 08 12:11:19 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:11:19 user nova-compute[74840]:   </features>
Nov 08 12:11:19 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:11:19 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:11:19 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:11:19 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:11:19 user nova-compute[74840]:   </clock>
Nov 08 12:11:19 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:11:19 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:11:19 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:11:19 user nova-compute[74840]:   </cpu>
Nov 08 12:11:19 user nova-compute[74840]:   <devices>
Nov 08 12:11:19 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:11:19 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:11:19 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/972edb8d-69b8-4447-9170-1c1f73814345/disk"/>
Nov 08 12:11:19 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:11:19 user nova-compute[74840]:     </disk>
Nov 08 12:11:19 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:11:19 user nova-compute[74840]:       <mac address="fa:16:3e:ba:fd:4c"/>
Nov 08 12:11:19 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:11:19 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:11:19 user nova-compute[74840]:       <target dev="tap804195be-3a"/>
Nov 08 12:11:19 user nova-compute[74840]:     </interface>
Nov 08 12:11:19 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:11:19 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/972edb8d-69b8-4447-9170-1c1f73814345/console.log" append="off"/>
Nov 08 12:11:19 user nova-compute[74840]:     </serial>
Nov 08 12:11:19 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:11:19 user nova-compute[74840]:     <video>
Nov 08 12:11:19 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:11:19 user nova-compute[74840]:     </video>
Nov 08 12:11:19 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:11:19 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:11:19 user nova-compute[74840]:     </rng>
Nov 08 12:11:19 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:11:19 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:11:19 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:11:19 user nova-compute[74840]:     </memballoon>
Nov 08 12:11:19 user nova-compute[74840]:   </devices>
Nov 08 12:11:19 user nova-compute[74840]: </domain>
Nov 08 12:11:19 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:11:19 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:11:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1880516201',display_name='tempest-AttachVolumeNegativeTest-server-1880516201',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1880516201',id=9,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIoml0vInjRpaeaoO/uEWcy+sGwmwvvQoVqRZqz1TWvdPEvRKpVYnYquAeVoOXEbsvy71nEMT5ycphhT5SLXWy8OIPigxxFGem2BDWUWcPtZsrm2GQciEMzWfDylA78S7A==',key_name='tempest-keypair-933257025',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ec082e08ddf4477a721e410fe944d10',ramdisk_id='',reservation_id='r-mt0sy8sj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1526881991',owner_user_name='tempest-AttachVolumeNegativeTest-1526881991-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:11:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e172625e7f334a2b896b2738bbf49aa8',uuid=972edb8d-69b8-4447-9170-1c1f73814345,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "804195be-3aed-40e6-9d0a-954fd997af14", "address": "fa:16:3e:ba:fd:4c", "network": {"id": "381cad9f-376a-4335-95a4-4824aa0d7fad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1035058856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ec082e08ddf4477a721e410fe944d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804195be-3a", "ovs_interfaceid": "804195be-3aed-40e6-9d0a-954fd997af14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:11:19 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Converting VIF {"id": "804195be-3aed-40e6-9d0a-954fd997af14", "address": "fa:16:3e:ba:fd:4c", "network": {"id": "381cad9f-376a-4335-95a4-4824aa0d7fad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1035058856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ec082e08ddf4477a721e410fe944d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804195be-3a", "ovs_interfaceid": "804195be-3aed-40e6-9d0a-954fd997af14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:11:19 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:fd:4c,bridge_name='br-int',has_traffic_filtering=True,id=804195be-3aed-40e6-9d0a-954fd997af14,network=Network(381cad9f-376a-4335-95a4-4824aa0d7fad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap804195be-3a') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:11:19 user nova-compute[74840]: DEBUG os_vif [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:fd:4c,bridge_name='br-int',has_traffic_filtering=True,id=804195be-3aed-40e6-9d0a-954fd997af14,network=Network(381cad9f-376a-4335-95a4-4824aa0d7fad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap804195be-3a') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:11:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:11:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:11:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2c950ca4-7312-58b8-9e37-b58b77d33981', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:11:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:11:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap804195be-3a, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:11:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap804195be-3a, col_values=(('qos', UUID('3f134983-eace-46c9-8c77-b3cd24c5ed7a')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:11:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap804195be-3a, col_values=(('external_ids', {'iface-id': '804195be-3aed-40e6-9d0a-954fd997af14', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:fd:4c', 'vm-uuid': '972edb8d-69b8-4447-9170-1c1f73814345'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:11:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:11:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:19 user nova-compute[74840]: INFO os_vif [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:fd:4c,bridge_name='br-int',has_traffic_filtering=True,id=804195be-3aed-40e6-9d0a-954fd997af14,network=Network(381cad9f-376a-4335-95a4-4824aa0d7fad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap804195be-3a')
Nov 08 12:11:19 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:11:19 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] No VIF found with MAC fa:16:3e:ba:fd:4c, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:11:19 user nova-compute[74840]: DEBUG nova.network.neutron [req-0fa6dd7e-1840-4bfe-8bf5-cf6057d806f3 req-5a746bf8-4061-4a44-a741-0acf4e3ba167 service nova] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Updated VIF entry in instance network info cache for port 804195be-3aed-40e6-9d0a-954fd997af14. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:11:19 user nova-compute[74840]: DEBUG nova.network.neutron [req-0fa6dd7e-1840-4bfe-8bf5-cf6057d806f3 req-5a746bf8-4061-4a44-a741-0acf4e3ba167 service nova] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Updating instance_info_cache with network_info: [{"id": "804195be-3aed-40e6-9d0a-954fd997af14", "address": "fa:16:3e:ba:fd:4c", "network": {"id": "381cad9f-376a-4335-95a4-4824aa0d7fad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1035058856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ec082e08ddf4477a721e410fe944d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804195be-3a", "ovs_interfaceid": "804195be-3aed-40e6-9d0a-954fd997af14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:11:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0fa6dd7e-1840-4bfe-8bf5-cf6057d806f3 req-5a746bf8-4061-4a44-a741-0acf4e3ba167 service nova] Releasing lock "refresh_cache-972edb8d-69b8-4447-9170-1c1f73814345" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:11:20 user nova-compute[74840]: DEBUG nova.network.neutron [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Successfully updated port: bd22c195-e803-484d-811a-aeeb04326bd0 {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:11:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Acquiring lock "refresh_cache-28ccd7b3-8bbe-42e7-aa00-612b3703ae79" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:11:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Acquired lock "refresh_cache-28ccd7b3-8bbe-42e7-aa00-612b3703ae79" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:11:20 user nova-compute[74840]: DEBUG nova.network.neutron [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:11:20 user nova-compute[74840]: DEBUG nova.compute.manager [req-f5da8d9e-fac2-4af4-b572-dc406afcab2b req-1fb7de04-6472-4eec-bc1a-5cb71c1d8a5e service nova] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Received event network-changed-bd22c195-e803-484d-811a-aeeb04326bd0 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:11:20 user nova-compute[74840]: DEBUG nova.compute.manager [req-f5da8d9e-fac2-4af4-b572-dc406afcab2b req-1fb7de04-6472-4eec-bc1a-5cb71c1d8a5e service nova] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Refreshing instance network info cache due to event network-changed-bd22c195-e803-484d-811a-aeeb04326bd0. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:11:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-f5da8d9e-fac2-4af4-b572-dc406afcab2b req-1fb7de04-6472-4eec-bc1a-5cb71c1d8a5e service nova] Acquiring lock "refresh_cache-28ccd7b3-8bbe-42e7-aa00-612b3703ae79" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:11:20 user nova-compute[74840]: DEBUG nova.network.neutron [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:11:20 user nova-compute[74840]: DEBUG nova.network.neutron [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Updating instance_info_cache with network_info: [{"id": "bd22c195-e803-484d-811a-aeeb04326bd0", "address": "fa:16:3e:ee:6e:72", "network": {"id": "d0c950e1-4e6d-42f7-bbbb-7164603882bc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1883968250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c961954c4a0440a93d9738ca5ab0026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd22c195-e8", "ovs_interfaceid": "bd22c195-e803-484d-811a-aeeb04326bd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:11:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Releasing lock "refresh_cache-28ccd7b3-8bbe-42e7-aa00-612b3703ae79" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:11:20 user nova-compute[74840]: DEBUG nova.compute.manager [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Instance network_info: |[{"id": "bd22c195-e803-484d-811a-aeeb04326bd0", "address": "fa:16:3e:ee:6e:72", "network": {"id": "d0c950e1-4e6d-42f7-bbbb-7164603882bc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1883968250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c961954c4a0440a93d9738ca5ab0026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd22c195-e8", "ovs_interfaceid": "bd22c195-e803-484d-811a-aeeb04326bd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 12:11:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-f5da8d9e-fac2-4af4-b572-dc406afcab2b req-1fb7de04-6472-4eec-bc1a-5cb71c1d8a5e service nova] Acquired lock "refresh_cache-28ccd7b3-8bbe-42e7-aa00-612b3703ae79" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:11:20 user nova-compute[74840]: DEBUG nova.network.neutron [req-f5da8d9e-fac2-4af4-b572-dc406afcab2b req-1fb7de04-6472-4eec-bc1a-5cb71c1d8a5e service nova] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Refreshing network info cache for port bd22c195-e803-484d-811a-aeeb04326bd0 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:11:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:21 user nova-compute[74840]: DEBUG nova.network.neutron [req-f5da8d9e-fac2-4af4-b572-dc406afcab2b req-1fb7de04-6472-4eec-bc1a-5cb71c1d8a5e service nova] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Updated VIF entry in instance network info cache for port bd22c195-e803-484d-811a-aeeb04326bd0. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:11:21 user nova-compute[74840]: DEBUG nova.network.neutron [req-f5da8d9e-fac2-4af4-b572-dc406afcab2b req-1fb7de04-6472-4eec-bc1a-5cb71c1d8a5e service nova] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Updating instance_info_cache with network_info: [{"id": "bd22c195-e803-484d-811a-aeeb04326bd0", "address": "fa:16:3e:ee:6e:72", "network": {"id": "d0c950e1-4e6d-42f7-bbbb-7164603882bc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1883968250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c961954c4a0440a93d9738ca5ab0026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd22c195-e8", "ovs_interfaceid": "bd22c195-e803-484d-811a-aeeb04326bd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:11:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-f5da8d9e-fac2-4af4-b572-dc406afcab2b req-1fb7de04-6472-4eec-bc1a-5cb71c1d8a5e service nova] Releasing lock "refresh_cache-28ccd7b3-8bbe-42e7-aa00-612b3703ae79" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:11:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:21 user nova-compute[74840]: DEBUG nova.compute.manager [req-b7d2764b-3c6a-4e30-888d-840ca5824773 req-43f2a168-5d01-4108-bb7f-7bdb4b50cdfc service nova] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Received event network-vif-plugged-804195be-3aed-40e6-9d0a-954fd997af14 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:11:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-b7d2764b-3c6a-4e30-888d-840ca5824773 req-43f2a168-5d01-4108-bb7f-7bdb4b50cdfc service nova] Acquiring lock "972edb8d-69b8-4447-9170-1c1f73814345-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:11:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-b7d2764b-3c6a-4e30-888d-840ca5824773 req-43f2a168-5d01-4108-bb7f-7bdb4b50cdfc service nova] Lock "972edb8d-69b8-4447-9170-1c1f73814345-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:11:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-b7d2764b-3c6a-4e30-888d-840ca5824773 req-43f2a168-5d01-4108-bb7f-7bdb4b50cdfc service nova] Lock "972edb8d-69b8-4447-9170-1c1f73814345-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:11:21 user nova-compute[74840]: DEBUG nova.compute.manager [req-b7d2764b-3c6a-4e30-888d-840ca5824773 req-43f2a168-5d01-4108-bb7f-7bdb4b50cdfc service nova] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] No waiting events found dispatching network-vif-plugged-804195be-3aed-40e6-9d0a-954fd997af14 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:11:21 user nova-compute[74840]: WARNING nova.compute.manager [req-b7d2764b-3c6a-4e30-888d-840ca5824773 req-43f2a168-5d01-4108-bb7f-7bdb4b50cdfc service nova] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Received unexpected event network-vif-plugged-804195be-3aed-40e6-9d0a-954fd997af14 for instance with vm_state building and task_state spawning.
Nov 08 12:11:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:22 user nova-compute[74840]: DEBUG nova.compute.manager [req-3269c402-57f7-4873-9c8d-2457d996b233 req-fc791561-78f1-41bd-ad79-834d4babb47b service nova] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Received event network-changed-62ca1e88-0819-443c-890f-05f6538b8f3e {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:11:22 user nova-compute[74840]: DEBUG nova.compute.manager [req-3269c402-57f7-4873-9c8d-2457d996b233 req-fc791561-78f1-41bd-ad79-834d4babb47b service nova] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Refreshing instance network info cache due to event network-changed-62ca1e88-0819-443c-890f-05f6538b8f3e. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:11:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3269c402-57f7-4873-9c8d-2457d996b233 req-fc791561-78f1-41bd-ad79-834d4babb47b service nova] Acquiring lock "refresh_cache-58f2a38d-14cf-4199-bb04-179ab4605a9e" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:11:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3269c402-57f7-4873-9c8d-2457d996b233 req-fc791561-78f1-41bd-ad79-834d4babb47b service nova] Acquired lock "refresh_cache-58f2a38d-14cf-4199-bb04-179ab4605a9e" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:11:22 user nova-compute[74840]: DEBUG nova.network.neutron [req-3269c402-57f7-4873-9c8d-2457d996b233 req-fc791561-78f1-41bd-ad79-834d4babb47b service nova] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Refreshing network info cache for port 62ca1e88-0819-443c-890f-05f6538b8f3e {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:11:23 user nova-compute[74840]: DEBUG nova.network.neutron [req-3269c402-57f7-4873-9c8d-2457d996b233 req-fc791561-78f1-41bd-ad79-834d4babb47b service nova] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Updated VIF entry in instance network info cache for port 62ca1e88-0819-443c-890f-05f6538b8f3e. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:11:23 user nova-compute[74840]: DEBUG nova.network.neutron [req-3269c402-57f7-4873-9c8d-2457d996b233 req-fc791561-78f1-41bd-ad79-834d4babb47b service nova] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Updating instance_info_cache with network_info: [{"id": "62ca1e88-0819-443c-890f-05f6538b8f3e", "address": "fa:16:3e:3b:d1:37", "network": {"id": "6462e35c-7722-46f1-afee-a088965b85e8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-713817565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b4cf1a052c48c2a33f1f645c2b52a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62ca1e88-08", "ovs_interfaceid": "62ca1e88-0819-443c-890f-05f6538b8f3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:11:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3269c402-57f7-4873-9c8d-2457d996b233 req-fc791561-78f1-41bd-ad79-834d4babb47b service nova] Releasing lock "refresh_cache-58f2a38d-14cf-4199-bb04-179ab4605a9e" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:11:23 user nova-compute[74840]: DEBUG nova.compute.manager [req-e039dafe-0164-43e8-ad68-4c7b605200fc req-21304dca-36fc-4520-8f21-359cba7d3a43 service nova] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Received event network-vif-plugged-804195be-3aed-40e6-9d0a-954fd997af14 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:11:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e039dafe-0164-43e8-ad68-4c7b605200fc req-21304dca-36fc-4520-8f21-359cba7d3a43 service nova] Acquiring lock "972edb8d-69b8-4447-9170-1c1f73814345-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:11:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e039dafe-0164-43e8-ad68-4c7b605200fc req-21304dca-36fc-4520-8f21-359cba7d3a43 service nova] Lock "972edb8d-69b8-4447-9170-1c1f73814345-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:11:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e039dafe-0164-43e8-ad68-4c7b605200fc req-21304dca-36fc-4520-8f21-359cba7d3a43 service nova] Lock "972edb8d-69b8-4447-9170-1c1f73814345-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:11:23 user nova-compute[74840]: DEBUG nova.compute.manager [req-e039dafe-0164-43e8-ad68-4c7b605200fc req-21304dca-36fc-4520-8f21-359cba7d3a43 service nova] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] No waiting events found dispatching network-vif-plugged-804195be-3aed-40e6-9d0a-954fd997af14 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:11:23 user nova-compute[74840]: WARNING nova.compute.manager [req-e039dafe-0164-43e8-ad68-4c7b605200fc req-21304dca-36fc-4520-8f21-359cba7d3a43 service nova] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Received unexpected event network-vif-plugged-804195be-3aed-40e6-9d0a-954fd997af14 for instance with vm_state building and task_state spawning.
Nov 08 12:11:23 user nova-compute[74840]: DEBUG nova.compute.manager [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:11:23 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:11:23 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Instance spawned successfully.
Nov 08 12:11:23 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:11:23 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Found default for hw_cdrom_bus of ide {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:11:23 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Found default for hw_disk_bus of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:11:23 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:11:23 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:11:23 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Found default for hw_video_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:11:23 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Found default for hw_vif_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:11:24 user nova-compute[74840]: INFO nova.compute.manager [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Took 6.78 seconds to spawn the instance on the hypervisor.
Nov 08 12:11:24 user nova-compute[74840]: DEBUG nova.compute.manager [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:11:24 user nova-compute[74840]: INFO nova.compute.manager [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Took 7.69 seconds to build instance.
Nov 08 12:11:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-44ed3e0a-6851-4f21-9cc5-30757a94e098 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "972edb8d-69b8-4447-9170-1c1f73814345" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.845s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:11:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:25 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:25 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:28 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:29 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:30 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Acquiring lock "09d9af99-7d2c-4c14-b60a-d8d9a09a238a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:11:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Lock "09d9af99-7d2c-4c14-b60a-d8d9a09a238a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:11:37 user nova-compute[74840]: DEBUG nova.compute.manager [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Starting instance... {{(pid=74840) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 12:11:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:11:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:11:37 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:11:37 user nova-compute[74840]: INFO nova.compute.claims [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Claim successful on node user
Nov 08 12:11:37 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:11:37 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:11:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.500s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:11:37 user nova-compute[74840]: DEBUG nova.compute.manager [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Start building networks asynchronously for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 12:11:37 user nova-compute[74840]: DEBUG nova.compute.manager [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Allocating IP information in the background. {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 12:11:37 user nova-compute[74840]: DEBUG nova.network.neutron [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 12:11:37 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 12:11:37 user nova-compute[74840]: DEBUG nova.compute.manager [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Start building block device mappings for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 12:11:38 user nova-compute[74840]: DEBUG nova.policy [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0100bdf083284c259124c8e0cd54c206', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61425acd382749c4b5aa3be318d960dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 12:11:38 user nova-compute[74840]: DEBUG nova.compute.manager [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Start spawning the instance on the hypervisor. {{(pid=74840) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 12:11:38 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:11:38 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Creating image(s)
Nov 08 12:11:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Acquiring lock "/opt/stack/data/nova/instances/09d9af99-7d2c-4c14-b60a-d8d9a09a238a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:11:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Lock "/opt/stack/data/nova/instances/09d9af99-7d2c-4c14-b60a-d8d9a09a238a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:11:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Lock "/opt/stack/data/nova/instances/09d9af99-7d2c-4c14-b60a-d8d9a09a238a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:11:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.191s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Acquiring lock "5d26578eba85497f494c575690c4248f381a0fe6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:11:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:11:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.176s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/09d9af99-7d2c-4c14-b60a-d8d9a09a238a/disk 1073741824 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/09d9af99-7d2c-4c14-b60a-d8d9a09a238a/disk 1073741824" returned: 0 in 0.054s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:11:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:38 user nova-compute[74840]: DEBUG nova.network.neutron [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Successfully created port: e9f1881c-9e7c-4bfb-a707-001e0661d547 {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:11:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.192s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:38 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Checking if we can resize image /opt/stack/data/nova/instances/09d9af99-7d2c-4c14-b60a-d8d9a09a238a/disk. size=1073741824 {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 12:11:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09d9af99-7d2c-4c14-b60a-d8d9a09a238a/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09d9af99-7d2c-4c14-b60a-d8d9a09a238a/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:38 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Cannot resize image /opt/stack/data/nova/instances/09d9af99-7d2c-4c14-b60a-d8d9a09a238a/disk to a smaller size. {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 12:11:38 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Created local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 12:11:38 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Ensure instance console log exists: /opt/stack/data/nova/instances/09d9af99-7d2c-4c14-b60a-d8d9a09a238a/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:11:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:11:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:11:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG nova.network.neutron [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Successfully updated port: e9f1881c-9e7c-4bfb-a707-001e0661d547 {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Acquiring lock "refresh_cache-09d9af99-7d2c-4c14-b60a-d8d9a09a238a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Acquired lock "refresh_cache-09d9af99-7d2c-4c14-b60a-d8d9a09a238a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG nova.network.neutron [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG nova.compute.manager [req-a353b521-77d5-472f-a8dc-805be29cc244 req-5ce2c6b8-87f1-4f38-b22e-1d162a2327ce service nova] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Received event network-changed-e9f1881c-9e7c-4bfb-a707-001e0661d547 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG nova.compute.manager [req-a353b521-77d5-472f-a8dc-805be29cc244 req-5ce2c6b8-87f1-4f38-b22e-1d162a2327ce service nova] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Refreshing instance network info cache due to event network-changed-e9f1881c-9e7c-4bfb-a707-001e0661d547. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a353b521-77d5-472f-a8dc-805be29cc244 req-5ce2c6b8-87f1-4f38-b22e-1d162a2327ce service nova] Acquiring lock "refresh_cache-09d9af99-7d2c-4c14-b60a-d8d9a09a238a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG nova.network.neutron [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG nova.network.neutron [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Updating instance_info_cache with network_info: [{"id": "e9f1881c-9e7c-4bfb-a707-001e0661d547", "address": "fa:16:3e:21:ee:48", "network": {"id": "bb983406-3cd0-4bcf-be98-e896ecde4afa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-652426848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61425acd382749c4b5aa3be318d960dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9f1881c-9e", "ovs_interfaceid": "e9f1881c-9e7c-4bfb-a707-001e0661d547", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Releasing lock "refresh_cache-09d9af99-7d2c-4c14-b60a-d8d9a09a238a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG nova.compute.manager [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Instance network_info: |[{"id": "e9f1881c-9e7c-4bfb-a707-001e0661d547", "address": "fa:16:3e:21:ee:48", "network": {"id": "bb983406-3cd0-4bcf-be98-e896ecde4afa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-652426848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61425acd382749c4b5aa3be318d960dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9f1881c-9e", "ovs_interfaceid": "e9f1881c-9e7c-4bfb-a707-001e0661d547", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a353b521-77d5-472f-a8dc-805be29cc244 req-5ce2c6b8-87f1-4f38-b22e-1d162a2327ce service nova] Acquired lock "refresh_cache-09d9af99-7d2c-4c14-b60a-d8d9a09a238a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG nova.network.neutron [req-a353b521-77d5-472f-a8dc-805be29cc244 req-5ce2c6b8-87f1-4f38-b22e-1d162a2327ce service nova] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Refreshing network info cache for port e9f1881c-9e7c-4bfb-a707-001e0661d547 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Start _get_guest_xml network_info=[{"id": "e9f1881c-9e7c-4bfb-a707-001e0661d547", "address": "fa:16:3e:21:ee:48", "network": {"id": "bb983406-3cd0-4bcf-be98-e896ecde4afa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-652426848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61425acd382749c4b5aa3be318d960dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9f1881c-9e", "ovs_interfaceid": "e9f1881c-9e7c-4bfb-a707-001e0661d547", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'image_id': '4fa17706-d304-4117-a420-dab994c703dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:11:39 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:11:39 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:11:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:11:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1132875793',display_name='tempest-VolumesActionsTest-instance-1132875793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1132875793',id=11,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61425acd382749c4b5aa3be318d960dc',ramdisk_id='',reservation_id='r-4nq6e3aq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1993355233',owner_user_name='tempest-VolumesActionsTest-1993355233-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:11:38Z,user_data=None,user_id='0100bdf083284c259124c8e0cd54c206',uuid=09d9af99-7d2c-4c14-b60a-d8d9a09a238a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9f1881c-9e7c-4bfb-a707-001e0661d547", "address": "fa:16:3e:21:ee:48", "network": {"id": "bb983406-3cd0-4bcf-be98-e896ecde4afa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-652426848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61425acd382749c4b5aa3be318d960dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9f1881c-9e", "ovs_interfaceid": "e9f1881c-9e7c-4bfb-a707-001e0661d547", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Converting VIF {"id": "e9f1881c-9e7c-4bfb-a707-001e0661d547", "address": "fa:16:3e:21:ee:48", "network": {"id": "bb983406-3cd0-4bcf-be98-e896ecde4afa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-652426848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61425acd382749c4b5aa3be318d960dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9f1881c-9e", "ovs_interfaceid": "e9f1881c-9e7c-4bfb-a707-001e0661d547", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:ee:48,bridge_name='br-int',has_traffic_filtering=True,id=e9f1881c-9e7c-4bfb-a707-001e0661d547,network=Network(bb983406-3cd0-4bcf-be98-e896ecde4afa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9f1881c-9e') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG nova.objects.instance [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Lazy-loading 'pci_devices' on Instance uuid 09d9af99-7d2c-4c14-b60a-d8d9a09a238a {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:11:39 user nova-compute[74840]:   <uuid>09d9af99-7d2c-4c14-b60a-d8d9a09a238a</uuid>
Nov 08 12:11:39 user nova-compute[74840]:   <name>instance-0000000b</name>
Nov 08 12:11:39 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:11:39 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:11:39 user nova-compute[74840]:   <metadata>
Nov 08 12:11:39 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:11:39 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:11:39 user nova-compute[74840]:       <nova:name>tempest-VolumesActionsTest-instance-1132875793</nova:name>
Nov 08 12:11:39 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:11:39</nova:creationTime>
Nov 08 12:11:39 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:11:39 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:11:39 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:11:39 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:11:39 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:11:39 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:11:39 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:11:39 user nova-compute[74840]:       <nova:owner>
Nov 08 12:11:39 user nova-compute[74840]:         <nova:user uuid="0100bdf083284c259124c8e0cd54c206">tempest-VolumesActionsTest-1993355233-project-member</nova:user>
Nov 08 12:11:39 user nova-compute[74840]:         <nova:project uuid="61425acd382749c4b5aa3be318d960dc">tempest-VolumesActionsTest-1993355233</nova:project>
Nov 08 12:11:39 user nova-compute[74840]:       </nova:owner>
Nov 08 12:11:39 user nova-compute[74840]:       <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:11:39 user nova-compute[74840]:       <nova:ports>
Nov 08 12:11:39 user nova-compute[74840]:         <nova:port uuid="e9f1881c-9e7c-4bfb-a707-001e0661d547">
Nov 08 12:11:39 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 12:11:39 user nova-compute[74840]:         </nova:port>
Nov 08 12:11:39 user nova-compute[74840]:       </nova:ports>
Nov 08 12:11:39 user nova-compute[74840]:     </nova:instance>
Nov 08 12:11:39 user nova-compute[74840]:   </metadata>
Nov 08 12:11:39 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:11:39 user nova-compute[74840]:     <system>
Nov 08 12:11:39 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:11:39 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:11:39 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:11:39 user nova-compute[74840]:       <entry name="serial">09d9af99-7d2c-4c14-b60a-d8d9a09a238a</entry>
Nov 08 12:11:39 user nova-compute[74840]:       <entry name="uuid">09d9af99-7d2c-4c14-b60a-d8d9a09a238a</entry>
Nov 08 12:11:39 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:11:39 user nova-compute[74840]:     </system>
Nov 08 12:11:39 user nova-compute[74840]:   </sysinfo>
Nov 08 12:11:39 user nova-compute[74840]:   <os>
Nov 08 12:11:39 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:11:39 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:11:39 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:11:39 user nova-compute[74840]:   </os>
Nov 08 12:11:39 user nova-compute[74840]:   <features>
Nov 08 12:11:39 user nova-compute[74840]:     <acpi/>
Nov 08 12:11:39 user nova-compute[74840]:     <apic/>
Nov 08 12:11:39 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:11:39 user nova-compute[74840]:   </features>
Nov 08 12:11:39 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:11:39 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:11:39 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:11:39 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:11:39 user nova-compute[74840]:   </clock>
Nov 08 12:11:39 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:11:39 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:11:39 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:11:39 user nova-compute[74840]:   </cpu>
Nov 08 12:11:39 user nova-compute[74840]:   <devices>
Nov 08 12:11:39 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:11:39 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:11:39 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/09d9af99-7d2c-4c14-b60a-d8d9a09a238a/disk"/>
Nov 08 12:11:39 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:11:39 user nova-compute[74840]:     </disk>
Nov 08 12:11:39 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:11:39 user nova-compute[74840]:       <mac address="fa:16:3e:21:ee:48"/>
Nov 08 12:11:39 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:11:39 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:11:39 user nova-compute[74840]:       <target dev="tape9f1881c-9e"/>
Nov 08 12:11:39 user nova-compute[74840]:     </interface>
Nov 08 12:11:39 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:11:39 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/09d9af99-7d2c-4c14-b60a-d8d9a09a238a/console.log" append="off"/>
Nov 08 12:11:39 user nova-compute[74840]:     </serial>
Nov 08 12:11:39 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:11:39 user nova-compute[74840]:     <video>
Nov 08 12:11:39 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:11:39 user nova-compute[74840]:     </video>
Nov 08 12:11:39 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:11:39 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:11:39 user nova-compute[74840]:     </rng>
Nov 08 12:11:39 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:11:39 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:11:39 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:11:39 user nova-compute[74840]:     </memballoon>
Nov 08 12:11:39 user nova-compute[74840]:   </devices>
Nov 08 12:11:39 user nova-compute[74840]: </domain>
Nov 08 12:11:39 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:11:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1132875793',display_name='tempest-VolumesActionsTest-instance-1132875793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1132875793',id=11,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61425acd382749c4b5aa3be318d960dc',ramdisk_id='',reservation_id='r-4nq6e3aq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1993355233',owner_user_name='tempest-VolumesActionsTest-1993355233-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:11:38Z,user_data=None,user_id='0100bdf083284c259124c8e0cd54c206',uuid=09d9af99-7d2c-4c14-b60a-d8d9a09a238a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9f1881c-9e7c-4bfb-a707-001e0661d547", "address": "fa:16:3e:21:ee:48", "network": {"id": "bb983406-3cd0-4bcf-be98-e896ecde4afa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-652426848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61425acd382749c4b5aa3be318d960dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9f1881c-9e", "ovs_interfaceid": "e9f1881c-9e7c-4bfb-a707-001e0661d547", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Converting VIF {"id": "e9f1881c-9e7c-4bfb-a707-001e0661d547", "address": "fa:16:3e:21:ee:48", "network": {"id": "bb983406-3cd0-4bcf-be98-e896ecde4afa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-652426848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61425acd382749c4b5aa3be318d960dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9f1881c-9e", "ovs_interfaceid": "e9f1881c-9e7c-4bfb-a707-001e0661d547", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:ee:48,bridge_name='br-int',has_traffic_filtering=True,id=e9f1881c-9e7c-4bfb-a707-001e0661d547,network=Network(bb983406-3cd0-4bcf-be98-e896ecde4afa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9f1881c-9e') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG os_vif [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:ee:48,bridge_name='br-int',has_traffic_filtering=True,id=e9f1881c-9e7c-4bfb-a707-001e0661d547,network=Network(bb983406-3cd0-4bcf-be98-e896ecde4afa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9f1881c-9e') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '66c8c65b-6125-5704-a01f-ba0edae397ab', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9f1881c-9e, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape9f1881c-9e, col_values=(('qos', UUID('563f227d-36c2-4b87-9801-b0f66f4eb0aa')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape9f1881c-9e, col_values=(('external_ids', {'iface-id': 'e9f1881c-9e7c-4bfb-a707-001e0661d547', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:ee:48', 'vm-uuid': '09d9af99-7d2c-4c14-b60a-d8d9a09a238a'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:39 user nova-compute[74840]: INFO os_vif [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:ee:48,bridge_name='br-int',has_traffic_filtering=True,id=e9f1881c-9e7c-4bfb-a707-001e0661d547,network=Network(bb983406-3cd0-4bcf-be98-e896ecde4afa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9f1881c-9e')
Nov 08 12:11:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:11:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] No VIF found with MAC fa:16:3e:21:ee:48, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:11:40 user nova-compute[74840]: DEBUG nova.network.neutron [req-a353b521-77d5-472f-a8dc-805be29cc244 req-5ce2c6b8-87f1-4f38-b22e-1d162a2327ce service nova] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Updated VIF entry in instance network info cache for port e9f1881c-9e7c-4bfb-a707-001e0661d547. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:11:40 user nova-compute[74840]: DEBUG nova.network.neutron [req-a353b521-77d5-472f-a8dc-805be29cc244 req-5ce2c6b8-87f1-4f38-b22e-1d162a2327ce service nova] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Updating instance_info_cache with network_info: [{"id": "e9f1881c-9e7c-4bfb-a707-001e0661d547", "address": "fa:16:3e:21:ee:48", "network": {"id": "bb983406-3cd0-4bcf-be98-e896ecde4afa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-652426848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61425acd382749c4b5aa3be318d960dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9f1881c-9e", "ovs_interfaceid": "e9f1881c-9e7c-4bfb-a707-001e0661d547", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:11:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a353b521-77d5-472f-a8dc-805be29cc244 req-5ce2c6b8-87f1-4f38-b22e-1d162a2327ce service nova] Releasing lock "refresh_cache-09d9af99-7d2c-4c14-b60a-d8d9a09a238a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:11:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:41 user nova-compute[74840]: DEBUG nova.compute.manager [req-4ed8dd78-0132-4c07-93a9-0ce2d78de85f req-c54493b0-d3bf-4961-9a1b-8655bb14cc5e service nova] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Received event network-vif-plugged-e9f1881c-9e7c-4bfb-a707-001e0661d547 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:11:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4ed8dd78-0132-4c07-93a9-0ce2d78de85f req-c54493b0-d3bf-4961-9a1b-8655bb14cc5e service nova] Acquiring lock "09d9af99-7d2c-4c14-b60a-d8d9a09a238a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:11:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4ed8dd78-0132-4c07-93a9-0ce2d78de85f req-c54493b0-d3bf-4961-9a1b-8655bb14cc5e service nova] Lock "09d9af99-7d2c-4c14-b60a-d8d9a09a238a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:11:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4ed8dd78-0132-4c07-93a9-0ce2d78de85f req-c54493b0-d3bf-4961-9a1b-8655bb14cc5e service nova] Lock "09d9af99-7d2c-4c14-b60a-d8d9a09a238a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:11:41 user nova-compute[74840]: DEBUG nova.compute.manager [req-4ed8dd78-0132-4c07-93a9-0ce2d78de85f req-c54493b0-d3bf-4961-9a1b-8655bb14cc5e service nova] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] No waiting events found dispatching network-vif-plugged-e9f1881c-9e7c-4bfb-a707-001e0661d547 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:11:41 user nova-compute[74840]: WARNING nova.compute.manager [req-4ed8dd78-0132-4c07-93a9-0ce2d78de85f req-c54493b0-d3bf-4961-9a1b-8655bb14cc5e service nova] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Received unexpected event network-vif-plugged-e9f1881c-9e7c-4bfb-a707-001e0661d547 for instance with vm_state building and task_state spawning.
Nov 08 12:11:41 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52b6262e-a1d2-45b6-bd11-22895f55cfb7 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Calling os-brick to attach iSCSI Volume {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 12:11:41 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b6262e-a1d2-45b6-bd11-22895f55cfb7 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DoshetLT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:11:41 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-52b6262e-a1d2-45b6-bd11-22895f55cfb7 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:11:41 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-52b6262e-a1d2-45b6-bd11-22895f55cfb7 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:11:41 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-52b6262e-a1d2-45b6-bd11-22895f55cfb7 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:11:41 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-52b6262e-a1d2-45b6-bd11-22895f55cfb7 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:11:41 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-52b6262e-a1d2-45b6-bd11-22895f55cfb7 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:11:41 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-52b6262e-a1d2-45b6-bd11-22895f55cfb7 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:11:41 user nova-compute[74840]: INFO os_brick.initiator.connectors.iscsi [None req-52b6262e-a1d2-45b6-bd11-22895f55cfb7 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 12:11:41 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c -p 172.16.0.220:3260 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:41 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:41 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a81d73-9dc2-46f1-a98f-8f77e8a122a5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:41 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b6262e-a1d2-45b6-bd11-22895f55cfb7 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 12:11:41 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:11:41 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c -p 172.16.0.220:3260 --interface default --op new {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:41 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:41 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b58d9f9-baad-4e04-bd33-b5178ea38263]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c] added\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:41 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b6262e-a1d2-45b6-bd11-22895f55cfb7 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c] added
Nov 08 12:11:41 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:11:41 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:41 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:41 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[df248027-a0dc-4c82-a614-398d97af1c5b]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:41 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b6262e-a1d2-45b6-bd11-22895f55cfb7 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:11:41 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:41 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:41 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc3c307-2220-4ea2-8d84-6ee99865b8af]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:41 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b6262e-a1d2-45b6-bd11-22895f55cfb7 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:11:41 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DoshetLT {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:41 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DoshetLT" returned: 0 in 0.025s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:41 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2f2375-7e43-451d-8e8f-7c90241a305e]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:41 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b6262e-a1d2-45b6-bd11-22895f55cfb7 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DoshetLT'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:11:41 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:42 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:42 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee333462-3b4b-4a1d-af61-04770517c760]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:42 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b6262e-a1d2-45b6-bd11-22895f55cfb7 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:11:42 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:42 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:42 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e33a6d2-8bad-4846-a79d-3d14d6d7be6d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:42 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b6262e-a1d2-45b6-bd11-22895f55cfb7 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)
Nov 08 12:11:42 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:11:42 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b6262e-a1d2-45b6-bd11-22895f55cfb7 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)
Nov 08 12:11:42 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:11:42 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c -p 172.16.0.220:3260 --login {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:42 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:42 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[041f1d37-9918-4172-b3ec-aab6c540470c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:42 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b6262e-a1d2-45b6-bd11-22895f55cfb7 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c, portal: 172.16.0.220,3260]
Nov 08 12:11:42 user nova-compute[74840]: Login to [iface: default, target: iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c, portal: 172.16.0.220,3260] successful.
Nov 08 12:11:42 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:11:42 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:42 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:42 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd597a6b-4d25-44ac-a371-e48e8223030c]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:42 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b6262e-a1d2-45b6-bd11-22895f55cfb7 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:11:42 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:42 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:42 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eea7dcc-4120-45c7-a21a-8f1a064a2517]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:42 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b6262e-a1d2-45b6-bd11-22895f55cfb7 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)
Nov 08 12:11:42 user nova-compute[74840]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c (non-flash)
Nov 08 12:11:42 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:11:42 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b6262e-a1d2-45b6-bd11-22895f55cfb7 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)
Nov 08 12:11:42 user nova-compute[74840]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c (non-flash)
Nov 08 12:11:42 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:11:42 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-52b6262e-a1d2-45b6-bd11-22895f55cfb7 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:11:42 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b6262e-a1d2-45b6-bd11-22895f55cfb7 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Connected to 172.16.0.220:3260 {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 12:11:42 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-52b6262e-a1d2-45b6-bd11-22895f55cfb7 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74840) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 12:11:42 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-52b6262e-a1d2-45b6-bd11-22895f55cfb7 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74840) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 12:11:42 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:42 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:42 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b83be9c-d0da-48de-be44-43300675f47b]: (4, ('- - 0', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:42 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-52b6262e-a1d2-45b6-bd11-22895f55cfb7 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:11:42 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b6262e-a1d2-45b6-bd11-22895f55cfb7 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DoshetLT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 12:11:42 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-52b6262e-a1d2-45b6-bd11-22895f55cfb7 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b6262e-a1d2-45b6-bd11-22895f55cfb7 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23431396230646566', 'path': '/dev/sdc'} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52b6262e-a1d2-45b6-bd11-22895f55cfb7 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431396230646566', 'path': '/dev/sdc'} {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG nova.objects.instance [None req-52b6262e-a1d2-45b6-bd11-22895f55cfb7 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Lazy-loading 'flavor' on Instance uuid 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-52b6262e-a1d2-45b6-bd11-22895f55cfb7 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 12:11:43 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:11:43 user nova-compute[74840]:   <source dev="/dev/sdc"/>
Nov 08 12:11:43 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:11:43 user nova-compute[74840]:   <serial>912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c</serial>
Nov 08 12:11:43 user nova-compute[74840]: </disk>
Nov 08 12:11:43 user nova-compute[74840]:  {{(pid=74840) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Calling os-brick to attach iSCSI Volume {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kdAhrPnK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:11:43 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:11:43 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:11:43 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:11:43 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:11:43 user nova-compute[74840]: INFO os_brick.initiator.connectors.iscsi [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 12:11:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff -p 172.16.0.220:3260 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[612fd3fd-56e5-4ecf-bee6-bd65d24ef2a1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 12:11:43 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff -p 172.16.0.220:3260 --interface default --op new {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-52b6262e-a1d2-45b6-bd11-22895f55cfb7 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-52b6262e-a1d2-45b6-bd11-22895f55cfb7 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-52b6262e-a1d2-45b6-bd11-22895f55cfb7 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] No VIF found with MAC fa:16:3e:e8:ed:67, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc123b04-b1cb-446d-9135-4cd152cbed68]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff] added\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff] added
Nov 08 12:11:43 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG nova.compute.manager [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:43 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Instance spawned successfully.
Nov 08 12:11:43 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8219bda1-c9ec-4771-9553-7a29fd7920a5]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Found default for hw_cdrom_bus of ide {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Found default for hw_disk_bus of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Found default for hw_video_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Found default for hw_vif_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[841817d1-03a5-4a5e-92c6-de69e6c8ec65]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kdAhrPnK {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG nova.compute.manager [req-cd64a033-f8bb-4a28-a7f2-8aba60df28d3 req-b5594118-fd8c-4bee-8f5f-5edc022d9929 service nova] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Received event network-vif-plugged-e9f1881c-9e7c-4bfb-a707-001e0661d547 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-cd64a033-f8bb-4a28-a7f2-8aba60df28d3 req-b5594118-fd8c-4bee-8f5f-5edc022d9929 service nova] Acquiring lock "09d9af99-7d2c-4c14-b60a-d8d9a09a238a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-cd64a033-f8bb-4a28-a7f2-8aba60df28d3 req-b5594118-fd8c-4bee-8f5f-5edc022d9929 service nova] Lock "09d9af99-7d2c-4c14-b60a-d8d9a09a238a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-cd64a033-f8bb-4a28-a7f2-8aba60df28d3 req-b5594118-fd8c-4bee-8f5f-5edc022d9929 service nova] Lock "09d9af99-7d2c-4c14-b60a-d8d9a09a238a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG nova.compute.manager [req-cd64a033-f8bb-4a28-a7f2-8aba60df28d3 req-b5594118-fd8c-4bee-8f5f-5edc022d9929 service nova] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] No waiting events found dispatching network-vif-plugged-e9f1881c-9e7c-4bfb-a707-001e0661d547 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:11:43 user nova-compute[74840]: WARNING nova.compute.manager [req-cd64a033-f8bb-4a28-a7f2-8aba60df28d3 req-b5594118-fd8c-4bee-8f5f-5edc022d9929 service nova] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Received unexpected event network-vif-plugged-e9f1881c-9e7c-4bfb-a707-001e0661d547 for instance with vm_state building and task_state spawning.
Nov 08 12:11:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kdAhrPnK" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9106c3-e25e-47fa-b877-e3bdf8b019d4]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kdAhrPnK'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce4c931-3a80-4cc1-a20a-9f6177132574]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:43 user nova-compute[74840]: INFO nova.compute.manager [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Took 5.78 seconds to spawn the instance on the hypervisor.
Nov 08 12:11:43 user nova-compute[74840]: DEBUG nova.compute.manager [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d85f42c-23ba-4bd6-b79f-58f24aa96930]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)
Nov 08 12:11:43 user nova-compute[74840]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c (non-flash)
Nov 08 12:11:43 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)
Nov 08 12:11:43 user nova-compute[74840]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c (non-flash)
Nov 08 12:11:43 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff -p 172.16.0.220:3260 --login {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fde819f7-22ea-430e-8941-974e90fbc767 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Acquiring lock "58f2a38d-14cf-4199-bb04-179ab4605a9e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fde819f7-22ea-430e-8941-974e90fbc767 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Lock "58f2a38d-14cf-4199-bb04-179ab4605a9e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG nova.objects.instance [None req-fde819f7-22ea-430e-8941-974e90fbc767 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Lazy-loading 'flavor' on Instance uuid 58f2a38d-14cf-4199-bb04-179ab4605a9e {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac17e1e-a132-4f49-ae95-d9165613ed49]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff, portal: 172.16.0.220,3260]
Nov 08 12:11:43 user nova-compute[74840]: Login to [iface: default, target: iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff, portal: 172.16.0.220,3260] successful.
Nov 08 12:11:43 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:11:43 user nova-compute[74840]: INFO nova.compute.manager [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Took 6.75 seconds to build instance.
Nov 08 12:11:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4341622b-091b-40e5-b63b-8090ea6243d0 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Lock "09d9af99-7d2c-4c14-b60a-d8d9a09a238a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.854s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47ab2e8-b75e-4deb-994d-ba4567f2acba]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fde819f7-22ea-430e-8941-974e90fbc767 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Lock "58f2a38d-14cf-4199-bb04-179ab4605a9e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:11:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f48d033-cc3a-440d-8b42-cd2d043daf8b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)
Nov 08 12:11:44 user nova-compute[74840]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c (non-flash)
Nov 08 12:11:44 user nova-compute[74840]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff (non-flash)
Nov 08 12:11:44 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)
Nov 08 12:11:44 user nova-compute[74840]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c (non-flash)
Nov 08 12:11:44 user nova-compute[74840]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff (non-flash)
Nov 08 12:11:44 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Connected to 172.16.0.220:3260 {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=74840) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74840) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.027s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c34836c-70dc-4363-aed1-809b977791db]: (4, ('- - 0', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kdAhrPnK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-52b6262e-a1d2-45b6-bd11-22895f55cfb7 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Lock "9c06ed5e-4b10-44d1-b4b5-faea4dcd6849" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 43.510s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fc60e32c-2503-4c55-8346-1bb1a25093d8 tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Acquiring lock "684b8be2-7f8f-499f-8885-c9d1c86eef2f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fc60e32c-2503-4c55-8346-1bb1a25093d8 tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Lock "684b8be2-7f8f-499f-8885-c9d1c86eef2f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG nova.objects.instance [None req-fc60e32c-2503-4c55-8346-1bb1a25093d8 tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Lazy-loading 'flavor' on Instance uuid 684b8be2-7f8f-499f-8885-c9d1c86eef2f {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fc60e32c-2503-4c55-8346-1bb1a25093d8 tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Lock "684b8be2-7f8f-499f-8885-c9d1c86eef2f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fde819f7-22ea-430e-8941-974e90fbc767 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Acquiring lock "58f2a38d-14cf-4199-bb04-179ab4605a9e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fde819f7-22ea-430e-8941-974e90fbc767 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Lock "58f2a38d-14cf-4199-bb04-179ab4605a9e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:11:44 user nova-compute[74840]: INFO nova.compute.manager [None req-fde819f7-22ea-430e-8941-974e90fbc767 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Attaching volume 35c629c2-7ea0-4334-8343-3636f67c578a to /dev/vdb
Nov 08 12:11:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fc60e32c-2503-4c55-8346-1bb1a25093d8 tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Acquiring lock "684b8be2-7f8f-499f-8885-c9d1c86eef2f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fc60e32c-2503-4c55-8346-1bb1a25093d8 tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Lock "684b8be2-7f8f-499f-8885-c9d1c86eef2f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:11:44 user nova-compute[74840]: INFO nova.compute.manager [None req-fc60e32c-2503-4c55-8346-1bb1a25093d8 tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Attaching volume 6fdafe3f-ba8f-4013-aa39-ab6138a937ad to /dev/vdb
Nov 08 12:11:44 user nova-compute[74840]: DEBUG os_brick.utils [None req-fde819f7-22ea-430e-8941-974e90fbc767 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b83f96-41b0-4bb3-b703-ae84e5105b1a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c8228a11e03c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca04c1c-6932-4fa4-ad44-52b74cb1bb46]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG os_brick.utils [None req-fc60e32c-2503-4c55-8346-1bb1a25093d8 tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1bf3d5e-d4c8-44a4-b2e0-929cf70854ba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c8228a11e03c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0396ee-1d1b-429a-bd0a-05cc5ebdceb3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[54dffa1f-51cf-4a7d-80c8-610cd0fc5057]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-fde819f7-22ea-430e-8941-974e90fbc767 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Running cmd (subprocess): nvme version {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-fde819f7-22ea-430e-8941-974e90fbc767 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] 'nvme version' failed. Not Retrying. {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdfbd852-656e-46b4-87c8-176fcfd861c4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fde819f7-22ea-430e-8941-974e90fbc767 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] nvme not present on system {{(pid=74840) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5d5836-caee-44fb-9f1d-e813ca32b7e2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:11:44 user nova-compute[74840]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 12:11:44 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c29154-cc5f-4eaf-acd4-ce24db982b0a]: (4, '') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-fde819f7-22ea-430e-8941-974e90fbc767 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74840) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-fde819f7-22ea-430e-8941-974e90fbc767 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-fde819f7-22ea-430e-8941-974e90fbc767 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] LIGHTOS: no hostnqn found. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG os_brick.utils [None req-fde819f7-22ea-430e-8941-974e90fbc767 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c8228a11e03c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG nova.virt.block_device [None req-fde819f7-22ea-430e-8941-974e90fbc767 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Updating existing volume attachment record: 0f56b8a2-d7f5-4959-a1c9-817fbe6ed936 {{(pid=74840) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d14c8b2-c2c4-4461-a89b-229f46f7853f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-fc60e32c-2503-4c55-8346-1bb1a25093d8 tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Running cmd (subprocess): nvme version {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-fc60e32c-2503-4c55-8346-1bb1a25093d8 tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] 'nvme version' failed. Not Retrying. {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fc60e32c-2503-4c55-8346-1bb1a25093d8 tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] nvme not present on system {{(pid=74840) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "refresh_cache-3b10fda0-9488-4089-8033-dd1c8e42af89" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquired lock "refresh_cache-3b10fda0-9488-4089-8033-dd1c8e42af89" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Forcefully refreshing network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:11:44 user nova-compute[74840]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 12:11:44 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[73abf9e1-0e33-44f9-bdc7-eac29d9778f0]: (4, '') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-fc60e32c-2503-4c55-8346-1bb1a25093d8 tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74840) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-fc60e32c-2503-4c55-8346-1bb1a25093d8 tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-fc60e32c-2503-4c55-8346-1bb1a25093d8 tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] LIGHTOS: no hostnqn found. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG os_brick.utils [None req-fc60e32c-2503-4c55-8346-1bb1a25093d8 tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] <== get_connector_properties: return (197ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c8228a11e03c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:11:44 user nova-compute[74840]: DEBUG nova.virt.block_device [None req-fc60e32c-2503-4c55-8346-1bb1a25093d8 tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Updating existing volume attachment record: f6f44eec-2188-402e-b37c-76db4477823d {{(pid=74840) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 12:11:45 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:11:45 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '23164343939613462', 'path': '/dev/sdd'} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:11:45 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164343939613462', 'path': '/dev/sdd'} {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 12:11:45 user nova-compute[74840]: DEBUG nova.objects.instance [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Lazy-loading 'flavor' on Instance uuid 4647e942-c600-4a9c-95ba-a59064d04619 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:11:45 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 12:11:45 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:11:45 user nova-compute[74840]:   <source dev="/dev/sdd"/>
Nov 08 12:11:45 user nova-compute[74840]:   <target dev="sdc" bus="scsi"/>
Nov 08 12:11:45 user nova-compute[74840]:   <serial>6034cc77-4e09-4ecd-a6be-9786d7fac2ff</serial>
Nov 08 12:11:45 user nova-compute[74840]:   <address type="drive" controller="0" unit="2"/>
Nov 08 12:11:45 user nova-compute[74840]: </disk>
Nov 08 12:11:45 user nova-compute[74840]:  {{(pid=74840) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 12:11:45 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e5e707f2-d02d-4813-81c8-6ff35d88fd45 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Acquiring lock "9c06ed5e-4b10-44d1-b4b5-faea4dcd6849" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:11:45 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e5e707f2-d02d-4813-81c8-6ff35d88fd45 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Lock "9c06ed5e-4b10-44d1-b4b5-faea4dcd6849" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:11:45 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e5e707f2-d02d-4813-81c8-6ff35d88fd45 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Acquiring lock "9c06ed5e-4b10-44d1-b4b5-faea4dcd6849-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:11:45 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e5e707f2-d02d-4813-81c8-6ff35d88fd45 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Lock "9c06ed5e-4b10-44d1-b4b5-faea4dcd6849-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:11:45 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e5e707f2-d02d-4813-81c8-6ff35d88fd45 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Lock "9c06ed5e-4b10-44d1-b4b5-faea4dcd6849-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:11:45 user nova-compute[74840]: INFO nova.compute.manager [None req-e5e707f2-d02d-4813-81c8-6ff35d88fd45 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Terminating instance
Nov 08 12:11:45 user nova-compute[74840]: DEBUG nova.compute.manager [None req-e5e707f2-d02d-4813-81c8-6ff35d88fd45 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Start destroying the instance on the hypervisor. {{(pid=74840) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 12:11:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:45 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] No BDM found with device name sda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:11:45 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:11:45 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:11:45 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] No VIF found with MAC fa:16:3e:84:44:b2, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:11:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Updating instance_info_cache with network_info: [{"id": "b48b5298-045f-463d-9585-fbb5feb869bf", "address": "fa:16:3e:19:58:1f", "network": {"id": "9dec89b0-562f-482c-aec1-d024351d0bd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-237264167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a544910dc2c4b169c986fa74b5979d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48b5298-04", "ovs_interfaceid": "b48b5298-045f-463d-9585-fbb5feb869bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:46 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Instance destroyed successfully.
Nov 08 12:11:46 user nova-compute[74840]: DEBUG nova.objects.instance [None req-e5e707f2-d02d-4813-81c8-6ff35d88fd45 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Lazy-loading 'resources' on Instance uuid 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Releasing lock "refresh_cache-3b10fda0-9488-4089-8033-dd1c8e42af89" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Updated the network info_cache for instance {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-e5e707f2-d02d-4813-81c8-6ff35d88fd45 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:08:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-72142012',display_name='tempest-DeleteServersTestJSON-server-72142012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-72142012',id=2,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:09:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='863c5c6a90544832a7a4cad6917978c0',ramdisk_id='',reservation_id='r-zsfo70h0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-956668807',owner_user_name='tempest-DeleteServersTestJSON-956668807-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:09:06Z,user_data=None,user_id='50959a9651d643cfb93a860ef57cbc34',uuid=9c06ed5e-4b10-44d1-b4b5-faea4dcd6849,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2cc86a4c-4952-4765-831c-a1919e56193f", "address": "fa:16:3e:e8:ed:67", "network": {"id": "e629cfa0-f295-42b5-9e17-b273bfa2a1c9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-185728581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863c5c6a90544832a7a4cad6917978c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc86a4c-49", "ovs_interfaceid": "2cc86a4c-4952-4765-831c-a1919e56193f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-e5e707f2-d02d-4813-81c8-6ff35d88fd45 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Converting VIF {"id": "2cc86a4c-4952-4765-831c-a1919e56193f", "address": "fa:16:3e:e8:ed:67", "network": {"id": "e629cfa0-f295-42b5-9e17-b273bfa2a1c9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-185728581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863c5c6a90544832a7a4cad6917978c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc86a4c-49", "ovs_interfaceid": "2cc86a4c-4952-4765-831c-a1919e56193f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-e5e707f2-d02d-4813-81c8-6ff35d88fd45 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:ed:67,bridge_name='br-int',has_traffic_filtering=True,id=2cc86a4c-4952-4765-831c-a1919e56193f,network=Network(e629cfa0-f295-42b5-9e17-b273bfa2a1c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cc86a4c-49') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG os_vif [None req-e5e707f2-d02d-4813-81c8-6ff35d88fd45 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:ed:67,bridge_name='br-int',has_traffic_filtering=True,id=2cc86a4c-4952-4765-831c-a1919e56193f,network=Network(e629cfa0-f295-42b5-9e17-b273bfa2a1c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cc86a4c-49') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2cc86a4c-49, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG nova.compute.manager [req-acfda11b-6339-45ae-aa4b-57eff5f11500 req-c7439354-c0ec-47f3-8ef3-72ecf5c762fa service nova] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Received event network-vif-unplugged-2cc86a4c-4952-4765-831c-a1919e56193f {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-acfda11b-6339-45ae-aa4b-57eff5f11500 req-c7439354-c0ec-47f3-8ef3-72ecf5c762fa service nova] Acquiring lock "9c06ed5e-4b10-44d1-b4b5-faea4dcd6849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-acfda11b-6339-45ae-aa4b-57eff5f11500 req-c7439354-c0ec-47f3-8ef3-72ecf5c762fa service nova] Lock "9c06ed5e-4b10-44d1-b4b5-faea4dcd6849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-acfda11b-6339-45ae-aa4b-57eff5f11500 req-c7439354-c0ec-47f3-8ef3-72ecf5c762fa service nova] Lock "9c06ed5e-4b10-44d1-b4b5-faea4dcd6849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG nova.compute.manager [req-acfda11b-6339-45ae-aa4b-57eff5f11500 req-c7439354-c0ec-47f3-8ef3-72ecf5c762fa service nova] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] No waiting events found dispatching network-vif-unplugged-2cc86a4c-4952-4765-831c-a1919e56193f {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG nova.compute.manager [req-acfda11b-6339-45ae-aa4b-57eff5f11500 req-c7439354-c0ec-47f3-8ef3-72ecf5c762fa service nova] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Received event network-vif-unplugged-2cc86a4c-4952-4765-831c-a1919e56193f for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4b82d6c9-3371-4aa2-812b-0538a8d0e19f) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:11:46 user nova-compute[74840]: INFO os_vif [None req-e5e707f2-d02d-4813-81c8-6ff35d88fd45 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:ed:67,bridge_name='br-int',has_traffic_filtering=True,id=2cc86a4c-4952-4765-831c-a1919e56193f,network=Network(e629cfa0-f295-42b5-9e17-b273bfa2a1c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cc86a4c-49')
Nov 08 12:11:46 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5e707f2-d02d-4813-81c8-6ff35d88fd45 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e707f2-d02d-4813-81c8-6ff35d88fd45 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DoshetLT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:11:46 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-e5e707f2-d02d-4813-81c8-6ff35d88fd45 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:11:46 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-e5e707f2-d02d-4813-81c8-6ff35d88fd45 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-e5e707f2-d02d-4813-81c8-6ff35d88fd45 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce866d7-2d41-4511-84e5-dcb9dca19314]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e707f2-d02d-4813-81c8-6ff35d88fd45 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 12:11:46 user nova-compute[74840]: No targets found.
Nov 08 12:11:46 user nova-compute[74840]: iSNS:
Nov 08 12:11:46 user nova-compute[74840]: No targets found.
Nov 08 12:11:46 user nova-compute[74840]: STATIC:
Nov 08 12:11:46 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff
Nov 08 12:11:46 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:11:46 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:11:46 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9
Nov 08 12:11:46 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:11:46 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:11:46 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c
Nov 08 12:11:46 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:11:46 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:11:46 user nova-compute[74840]: FIRMWARE:
Nov 08 12:11:46 user nova-compute[74840]: No targets found.
Nov 08 12:11:46 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e707f2-d02d-4813-81c8-6ff35d88fd45 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 12:11:46 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 12:11:46 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e707f2-d02d-4813-81c8-6ff35d88fd45 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.035s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0d4dd3-674d-412f-9788-d8b2f8a54460]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfca029e-3ff9-42ea-a662-d98021bbad68]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e707f2-d02d-4813-81c8-6ff35d88fd45 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)
Nov 08 12:11:46 user nova-compute[74840]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c (non-flash)
Nov 08 12:11:46 user nova-compute[74840]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff (non-flash)
Nov 08 12:11:46 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e707f2-d02d-4813-81c8-6ff35d88fd45 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)
Nov 08 12:11:46 user nova-compute[74840]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c (non-flash)
Nov 08 12:11:46 user nova-compute[74840]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff (non-flash)
Nov 08 12:11:46 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e707f2-d02d-4813-81c8-6ff35d88fd45 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7f4106050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c'): ({'sdc'}, set())}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-e5e707f2-d02d-4813-81c8-6ff35d88fd45 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Removing single pathed devices sdc {{(pid=74840) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1475825-ab0f-47ee-9c97-57c11ad15742]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1887ef-90f6-4c12-a5d3-dceec3559264]: (4, ('ok\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-e5e707f2-d02d-4813-81c8-6ff35d88fd45 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Flushing IO for device /dev/sdc {{(pid=74840) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f411c176-91a6-4e84-9e06-0d7e82b2b36a]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-e5e707f2-d02d-4813-81c8-6ff35d88fd45 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74840) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43eae335-a4a0-40b2-8cd4-c7881cd397b1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb8965c-876c-46f1-bad1-be299da4c891]: (4, ('1', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-e5e707f2-d02d-4813-81c8-6ff35d88fd45 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-e5e707f2-d02d-4813-81c8-6ff35d88fd45 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] SCSI volumes sdc have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e707f2-d02d-4813-81c8-6ff35d88fd45 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c')] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[2925612e-ebb6-4e4e-80c3-794ac2590e4f]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e707f2-d02d-4813-81c8-6ff35d88fd45 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c -p 172.16.0.220:3260 --logout {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78de482-141a-4669-966b-4a561b6f0728]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e707f2-d02d-4813-81c8-6ff35d88fd45 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c, portal: 172.16.0.220,3260]
Nov 08 12:11:46 user nova-compute[74840]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c, portal: 172.16.0.220,3260] successful.
Nov 08 12:11:46 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c -p 172.16.0.220:3260 --op delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:912a9b64-fa3e-43a1-ae0a-2fcc50d0e68c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[83092ab4-c614-4321-bfd8-64f85b117b71]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e707f2-d02d-4813-81c8-6ff35d88fd45 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-e5e707f2-d02d-4813-81c8-6ff35d88fd45 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.427s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5e707f2-d02d-4813-81c8-6ff35d88fd45 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] <== disconnect_volume: return (429ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5e707f2-d02d-4813-81c8-6ff35d88fd45 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 12:11:46 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-e5e707f2-d02d-4813-81c8-6ff35d88fd45 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Deleting instance files /opt/stack/data/nova/instances/9c06ed5e-4b10-44d1-b4b5-faea4dcd6849_del
Nov 08 12:11:46 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-e5e707f2-d02d-4813-81c8-6ff35d88fd45 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Deletion of /opt/stack/data/nova/instances/9c06ed5e-4b10-44d1-b4b5-faea4dcd6849_del complete
Nov 08 12:11:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43eae335-a4a0-40b2-8cd4-c7881cd397b1/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43eae335-a4a0-40b2-8cd4-c7881cd397b1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-e5e707f2-d02d-4813-81c8-6ff35d88fd45 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74840) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 08 12:11:46 user nova-compute[74840]: INFO nova.virt.libvirt.host [None req-e5e707f2-d02d-4813-81c8-6ff35d88fd45 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] UEFI support detected
Nov 08 12:11:46 user nova-compute[74840]: INFO nova.compute.manager [None req-e5e707f2-d02d-4813-81c8-6ff35d88fd45 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Took 1.57 seconds to destroy the instance on the hypervisor.
Nov 08 12:11:46 user nova-compute[74840]: DEBUG oslo.service.loopingcall [None req-e5e707f2-d02d-4813-81c8-6ff35d88fd45 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74840) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG nova.compute.manager [-] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Deallocating network for instance {{(pid=74840) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] deallocate_for_instance() {{(pid=74840) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43eae335-a4a0-40b2-8cd4-c7881cd397b1/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972edb8d-69b8-4447-9170-1c1f73814345/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972edb8d-69b8-4447-9170-1c1f73814345/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972edb8d-69b8-4447-9170-1c1f73814345/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972edb8d-69b8-4447-9170-1c1f73814345/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dc9229a-61a8-4f45-b011-5bb3e89d63d1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:47 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:11:47 user nova-compute[74840]: INFO nova.compute.manager [-] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Took 0.79 seconds to deallocate network for instance.
Nov 08 12:11:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dc9229a-61a8-4f45-b011-5bb3e89d63d1/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dc9229a-61a8-4f45-b011-5bb3e89d63d1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dc9229a-61a8-4f45-b011-5bb3e89d63d1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:47 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Error from libvirt while getting description of instance-00000002: [Error Code 42] Domain not found: no domain with matching uuid '9c06ed5e-4b10-44d1-b4b5-faea4dcd6849' (instance-00000002): libvirt.libvirtError: Domain not found: no domain with matching uuid '9c06ed5e-4b10-44d1-b4b5-faea4dcd6849' (instance-00000002)
Nov 08 12:11:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09d9af99-7d2c-4c14-b60a-d8d9a09a238a/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09d9af99-7d2c-4c14-b60a-d8d9a09a238a/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09d9af99-7d2c-4c14-b60a-d8d9a09a238a/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:48 user nova-compute[74840]: DEBUG nova.compute.manager [req-03552688-713b-438f-bcad-7b17b7da307a req-78b2ee3a-a051-46cb-ae5f-d108e5ee0a67 service nova] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Received event network-changed-0ca11215-a135-4be8-87dd-69e348e9fa62 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:11:48 user nova-compute[74840]: DEBUG nova.compute.manager [req-03552688-713b-438f-bcad-7b17b7da307a req-78b2ee3a-a051-46cb-ae5f-d108e5ee0a67 service nova] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Refreshing instance network info cache due to event network-changed-0ca11215-a135-4be8-87dd-69e348e9fa62. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:11:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-03552688-713b-438f-bcad-7b17b7da307a req-78b2ee3a-a051-46cb-ae5f-d108e5ee0a67 service nova] Acquiring lock "refresh_cache-1dc9229a-61a8-4f45-b011-5bb3e89d63d1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:11:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-03552688-713b-438f-bcad-7b17b7da307a req-78b2ee3a-a051-46cb-ae5f-d108e5ee0a67 service nova] Acquired lock "refresh_cache-1dc9229a-61a8-4f45-b011-5bb3e89d63d1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:11:48 user nova-compute[74840]: DEBUG nova.network.neutron [req-03552688-713b-438f-bcad-7b17b7da307a req-78b2ee3a-a051-46cb-ae5f-d108e5ee0a67 service nova] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Refreshing network info cache for port 0ca11215-a135-4be8-87dd-69e348e9fa62 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:11:48 user nova-compute[74840]: DEBUG nova.compute.manager [req-7afcd2d8-e8ec-4132-af66-d7af8796ce79 req-6e47f2bb-8406-4ac3-82d7-d96c48e2d621 service nova] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Received event network-vif-plugged-2cc86a4c-4952-4765-831c-a1919e56193f {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:11:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-7afcd2d8-e8ec-4132-af66-d7af8796ce79 req-6e47f2bb-8406-4ac3-82d7-d96c48e2d621 service nova] Acquiring lock "9c06ed5e-4b10-44d1-b4b5-faea4dcd6849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:11:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-7afcd2d8-e8ec-4132-af66-d7af8796ce79 req-6e47f2bb-8406-4ac3-82d7-d96c48e2d621 service nova] Lock "9c06ed5e-4b10-44d1-b4b5-faea4dcd6849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:11:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-7afcd2d8-e8ec-4132-af66-d7af8796ce79 req-6e47f2bb-8406-4ac3-82d7-d96c48e2d621 service nova] Lock "9c06ed5e-4b10-44d1-b4b5-faea4dcd6849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:11:48 user nova-compute[74840]: DEBUG nova.compute.manager [req-7afcd2d8-e8ec-4132-af66-d7af8796ce79 req-6e47f2bb-8406-4ac3-82d7-d96c48e2d621 service nova] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] No waiting events found dispatching network-vif-plugged-2cc86a4c-4952-4765-831c-a1919e56193f {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:11:48 user nova-compute[74840]: WARNING nova.compute.manager [req-7afcd2d8-e8ec-4132-af66-d7af8796ce79 req-6e47f2bb-8406-4ac3-82d7-d96c48e2d621 service nova] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Received unexpected event network-vif-plugged-2cc86a4c-4952-4765-831c-a1919e56193f for instance with vm_state active and task_state deleting.
Nov 08 12:11:48 user nova-compute[74840]: DEBUG nova.compute.manager [req-7afcd2d8-e8ec-4132-af66-d7af8796ce79 req-6e47f2bb-8406-4ac3-82d7-d96c48e2d621 service nova] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Received event network-vif-deleted-2cc86a4c-4952-4765-831c-a1919e56193f {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:11:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09d9af99-7d2c-4c14-b60a-d8d9a09a238a/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2a38d-14cf-4199-bb04-179ab4605a9e/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2a38d-14cf-4199-bb04-179ab4605a9e/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2a38d-14cf-4199-bb04-179ab4605a9e/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2a38d-14cf-4199-bb04-179ab4605a9e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:48 user nova-compute[74840]: DEBUG nova.network.neutron [req-03552688-713b-438f-bcad-7b17b7da307a req-78b2ee3a-a051-46cb-ae5f-d108e5ee0a67 service nova] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Updated VIF entry in instance network info cache for port 0ca11215-a135-4be8-87dd-69e348e9fa62. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:11:48 user nova-compute[74840]: DEBUG nova.network.neutron [req-03552688-713b-438f-bcad-7b17b7da307a req-78b2ee3a-a051-46cb-ae5f-d108e5ee0a67 service nova] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Updating instance_info_cache with network_info: [{"id": "0ca11215-a135-4be8-87dd-69e348e9fa62", "address": "fa:16:3e:b6:a8:fa", "network": {"id": "ca79a5ac-b9b5-4c23-bb4b-c471878fc7df", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-908944889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2693bf5b1b2a46eb9c657d76934e93f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca11215-a1", "ovs_interfaceid": "0ca11215-a135-4be8-87dd-69e348e9fa62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:11:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-03552688-713b-438f-bcad-7b17b7da307a req-78b2ee3a-a051-46cb-ae5f-d108e5ee0a67 service nova] Releasing lock "refresh_cache-1dc9229a-61a8-4f45-b011-5bb3e89d63d1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:11:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/684b8be2-7f8f-499f-8885-c9d1c86eef2f/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/684b8be2-7f8f-499f-8885-c9d1c86eef2f/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/684b8be2-7f8f-499f-8885-c9d1c86eef2f/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/684b8be2-7f8f-499f-8885-c9d1c86eef2f/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4647e942-c600-4a9c-95ba-a59064d04619/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4647e942-c600-4a9c-95ba-a59064d04619/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4647e942-c600-4a9c-95ba-a59064d04619/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:11:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4647e942-c600-4a9c-95ba-a59064d04619/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:11:50 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdd (sdc) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:11:50 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:11:50 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:11:50 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=7882MB free_disk=25.376182556152344GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:11:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:11:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:11:50 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 43eae335-a4a0-40b2-8cd4-c7881cd397b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:11:50 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:11:50 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 3b10fda0-9488-4089-8033-dd1c8e42af89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:11:50 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 684b8be2-7f8f-499f-8885-c9d1c86eef2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:11:50 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 4647e942-c600-4a9c-95ba-a59064d04619 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:11:50 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 58f2a38d-14cf-4199-bb04-179ab4605a9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:11:50 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 1dc9229a-61a8-4f45-b011-5bb3e89d63d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:11:50 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance d2dbd607-cf11-4d81-9639-c84e79d65fcd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:11:50 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 972edb8d-69b8-4447-9170-1c1f73814345 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:11:50 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 28ccd7b3-8bbe-42e7-aa00-612b3703ae79 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:11:50 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 09d9af99-7d2c-4c14-b60a-d8d9a09a238a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:11:50 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:11:50 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:11:50 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:11:50 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:11:50 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:11:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.520s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:11:51 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:51 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:52 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:11:52 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:11:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:11:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:12:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:12:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:12:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:12:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:12:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-307e1dcf-760e-4231-a789-c70a040f8f5a tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Lock "4647e942-c600-4a9c-95ba-a59064d04619" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 50.402s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:12:08 user nova-compute[74840]: INFO nova.compute.manager [None req-e5e707f2-d02d-4813-81c8-6ff35d88fd45 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] [instance: 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849] Took 21.26 seconds to detach 1 volumes for instance.
Nov 08 12:12:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-2b578964-d34c-412d-96e1-e66d0029bc99 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] Acquiring lock "1dc9229a-61a8-4f45-b011-5bb3e89d63d1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:12:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-2b578964-d34c-412d-96e1-e66d0029bc99 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] Lock "1dc9229a-61a8-4f45-b011-5bb3e89d63d1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:12:08 user nova-compute[74840]: DEBUG nova.objects.instance [None req-2b578964-d34c-412d-96e1-e66d0029bc99 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] Lazy-loading 'flavor' on Instance uuid 1dc9229a-61a8-4f45-b011-5bb3e89d63d1 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:12:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e5e707f2-d02d-4813-81c8-6ff35d88fd45 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:12:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e5e707f2-d02d-4813-81c8-6ff35d88fd45 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:12:08 user nova-compute[74840]: INFO nova.virt.block_device [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Booting with volume ae8e04aa-d9df-41b6-bbc3-146d58486e6b at /dev/vdb
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-2b578964-d34c-412d-96e1-e66d0029bc99 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] Lock "1dc9229a-61a8-4f45-b011-5bb3e89d63d1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.095s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG nova.compute.manager [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Start spawning the instance on the hypervisor. {{(pid=74840) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:12:09 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Creating image(s)
Nov 08 12:12:09 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Did not create local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Ensure instance console log exists: /opt/stack/data/nova/instances/28ccd7b3-8bbe-42e7-aa00-612b3703ae79/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Start _get_guest_xml network_info=[{"id": "bd22c195-e803-484d-811a-aeeb04326bd0", "address": "fa:16:3e:ee:6e:72", "network": {"id": "d0c950e1-4e6d-42f7-bbbb-7164603882bc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1883968250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c961954c4a0440a93d9738ca5ab0026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd22c195-e8", "ovs_interfaceid": "bd22c195-e803-484d-811a-aeeb04326bd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '98bc9b16-2ea1-416d-a7c8-95b453c43fba', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BXnlZryS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '28ccd7b3-8bbe-42e7-aa00-612b3703ae79', 'attached_at': '', 'detached_at': '', 'volume_id': '2a571b42-9e1d-4406-b369-12722b22f097', 'serial': '2a571b42-9e1d-4406-b369-12722b22f097'}, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:12:09 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:12:09 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:12:09 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Calling os-brick to attach iSCSI Volume {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BXnlZryS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:12:09 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:12:09 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:12:09 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:12:09 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:12:09 user nova-compute[74840]: INFO os_brick.initiator.connectors.iscsi [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 -p 172.16.0.220:3260 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.volume.cinder [None req-fde819f7-22ea-430e-8941-974e90fbc767 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Update attachment failed for attachment 0f56b8a2-d7f5-4959-a1c9-817fbe6ed936. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-aba34450-3d81-4ff9-8647-de7c6b5a4fb1) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-aba34450-3d81-4ff9-8647-de7c6b5a4fb1)
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9781523a-a372-42db-a58f-0651da29caee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 12:12:09 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 -p 172.16.0.220:3260 --interface default --op new {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [None req-fde819f7-22ea-430e-8941-974e90fbc767 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Failed to attach 35c629c2-7ea0-4334-8343-3636f67c578a at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-aba34450-3d81-4ff9-8647-de7c6b5a4fb1)
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Traceback (most recent call last):
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e]     ret_val = method(obj, context, *args, **kwargs)
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e]     self._do_attach(context, instance, volume, volume_api,
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e]     self._volume_attach(context, volume, connector, instance,
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e]     connection_info = volume_api.attachment_update(
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e]     res = method(self, ctx, *args, **kwargs)
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e]     with excutils.save_and_reraise_exception():
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e]     self.force_reraise()
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e]     raise self.value
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e]     context, '3.44', skip_version_check=True).attachments.update(
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e]     return method.func(obj, *args, **kwargs)
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e]     resp = self._update('/attachments/%s' % id, body)
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e]     return self._cs_request(url, 'PUT', **kwargs)
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e]     return self.request(url, method, **kwargs)
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e]     raise exceptions.from_response(resp, body)
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-aba34450-3d81-4ff9-8647-de7c6b5a4fb1)
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] 
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c601e8f-e9a9-49dc-9f26-f0aa64f320d9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097] added\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097] added
Nov 08 12:12:09 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4c9e4d-c91b-4f46-a0ca-1d81c50862d9]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG os_brick.utils [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[0099f051-d15c-4c79-8f0b-e98a8bf6ae3e]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BXnlZryS {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-2b578964-d34c-412d-96e1-e66d0029bc99 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] Acquiring lock "1dc9229a-61a8-4f45-b011-5bb3e89d63d1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-2b578964-d34c-412d-96e1-e66d0029bc99 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] Lock "1dc9229a-61a8-4f45-b011-5bb3e89d63d1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:12:09 user nova-compute[74840]: INFO nova.compute.manager [None req-2b578964-d34c-412d-96e1-e66d0029bc99 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Attaching volume 8c2e4313-24a9-43ea-8300-27d209de8fb4 to /dev/vdb
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ffc645-3d1c-4aac-a359-96382e829ad2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c8228a11e03c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BXnlZryS" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17c5a06-27ec-48b3-8305-2f7dbd321008]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BXnlZryS'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c7174d-65f0-4117-88b6-214e1b01a19d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15ff34a-6584-4835-9356-1a40280f7460]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eaee5b8-94e5-4ca0-97ac-fdd8a2b3f302]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5782ad9-8ad1-4acf-8ce8-43dff4adf250]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Running cmd (subprocess): nvme version {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] 'nvme version' failed. Not Retrying. {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.nvmeof [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] nvme not present on system {{(pid=74840) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-e5e707f2-d02d-4813-81c8-6ff35d88fd45 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[326d9577-3113-4f3c-b89c-f688cd51777f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)
Nov 08 12:12:09 user nova-compute[74840]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff (non-flash)
Nov 08 12:12:09 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)
Nov 08 12:12:09 user nova-compute[74840]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff (non-flash)
Nov 08 12:12:09 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:12:09 user nova-compute[74840]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[76dcb187-6e75-438c-b127-011bab1a48de]: (4, '') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 -p 172.16.0.220:3260 --login {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74840) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] LIGHTOS: no hostnqn found. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG os_brick.utils [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c8228a11e03c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG nova.virt.block_device [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Updating existing volume attachment record: f9d2fc80-42e8-4e6f-aea7-11c13279c7a5 {{(pid=74840) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fde819f7-22ea-430e-8941-974e90fbc767 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Lock "58f2a38d-14cf-4199-bb04-179ab4605a9e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.093s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-e5e707f2-d02d-4813-81c8-6ff35d88fd45 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG os_brick.utils [None req-2b578964-d34c-412d-96e1-e66d0029bc99 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c64a66-3245-4b6c-9833-e8afedec1a2d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c8228a11e03c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b709d8-92fa-4a3f-b9f0-5bade256f805]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e5e707f2-d02d-4813-81c8-6ff35d88fd45 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.584s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097, portal: 172.16.0.220,3260]
Nov 08 12:12:09 user nova-compute[74840]: Login to [iface: default, target: iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097, portal: 172.16.0.220,3260] successful.
Nov 08 12:12:09 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3cff2c7-725e-4d08-9224-9e94eef02769]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ced1ee-2858-4df7-92d0-92644ce7fb59]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:09 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-e5e707f2-d02d-4813-81c8-6ff35d88fd45 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Deleted allocations for instance 9c06ed5e-4b10-44d1-b4b5-faea4dcd6849
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server [None req-fde819f7-22ea-430e-8941-974e90fbc767 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-aba34450-3d81-4ff9-8647-de7c6b5a4fb1)
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-aba34450-3d81-4ff9-8647-de7c6b5a4fb1)
Nov 08 12:12:09 user nova-compute[74840]: ERROR oslo_messaging.rpc.server 
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3befcdde-705d-40ab-995c-175d25929725]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[363d94e2-4378-4ad7-a423-96776c8184cd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-2b578964-d34c-412d-96e1-e66d0029bc99 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] Running cmd (subprocess): nvme version {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-2b578964-d34c-412d-96e1-e66d0029bc99 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b9fb02-e391-43b8-99c4-c6809efafd67]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2b578964-d34c-412d-96e1-e66d0029bc99 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] nvme not present on system {{(pid=74840) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)
Nov 08 12:12:09 user nova-compute[74840]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff (non-flash)
Nov 08 12:12:09 user nova-compute[74840]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)
Nov 08 12:12:09 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)
Nov 08 12:12:09 user nova-compute[74840]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff (non-flash)
Nov 08 12:12:09 user nova-compute[74840]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)
Nov 08 12:12:09 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.463s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Connected to 172.16.0.220:3260 {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] HCTL ('34', '-', '-', 0) found on session 5 with lun 0 {{(pid=74840) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74840) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:12:09 user nova-compute[74840]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa89476-fbdf-4329-8ff3-575b81ca5ab7]: (4, '') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-2b578964-d34c-412d-96e1-e66d0029bc99 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74840) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-2b578964-d34c-412d-96e1-e66d0029bc99 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-2b578964-d34c-412d-96e1-e66d0029bc99 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] LIGHTOS: no hostnqn found. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG os_brick.utils [None req-2b578964-d34c-412d-96e1-e66d0029bc99 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c8228a11e03c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG nova.virt.block_device [None req-2b578964-d34c-412d-96e1-e66d0029bc99 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Updating existing volume attachment record: 8b111cb2-1b0e-43e1-b80e-c3a333daebb3 {{(pid=74840) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7a1d63-b6ae-44cf-9a5c-d6118835947a]: (4, ('- - 0', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-77420d84-19d8-4c26-a0de-85bc7e38bdb8 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Acquiring lock "4647e942-c600-4a9c-95ba-a59064d04619" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-77420d84-19d8-4c26-a0de-85bc7e38bdb8 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Lock "4647e942-c600-4a9c-95ba-a59064d04619" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Searching for a device in session 5 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BXnlZryS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 12:12:09 user nova-compute[74840]: INFO nova.compute.manager [None req-77420d84-19d8-4c26-a0de-85bc7e38bdb8 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Detaching volume 6034cc77-4e09-4ecd-a6be-9786d7fac2ff
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.volume.cinder [None req-fc60e32c-2503-4c55-8346-1bb1a25093d8 tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Update attachment failed for attachment f6f44eec-2188-402e-b37c-76db4477823d. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-9db5e552-1d5d-4d20-83b7-7661b0bca2b7) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-9db5e552-1d5d-4d20-83b7-7661b0bca2b7)
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e5e707f2-d02d-4813-81c8-6ff35d88fd45 tempest-DeleteServersTestJSON-956668807 tempest-DeleteServersTestJSON-956668807-project-member] Lock "9c06ed5e-4b10-44d1-b4b5-faea4dcd6849" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 24.587s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [None req-fc60e32c-2503-4c55-8346-1bb1a25093d8 tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Failed to attach 6fdafe3f-ba8f-4013-aa39-ab6138a937ad at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-9db5e552-1d5d-4d20-83b7-7661b0bca2b7)
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Traceback (most recent call last):
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f]     ret_val = method(obj, context, *args, **kwargs)
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f]     self._do_attach(context, instance, volume, volume_api,
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f]     self._volume_attach(context, volume, connector, instance,
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f]     connection_info = volume_api.attachment_update(
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f]     res = method(self, ctx, *args, **kwargs)
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f]     with excutils.save_and_reraise_exception():
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f]     self.force_reraise()
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f]     raise self.value
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f]     context, '3.44', skip_version_check=True).attachments.update(
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f]     return method.func(obj, *args, **kwargs)
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f]     resp = self._update('/attachments/%s' % id, body)
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f]     return self._cs_request(url, 'PUT', **kwargs)
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f]     return self.request(url, method, **kwargs)
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f]     raise exceptions.from_response(resp, body)
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-9db5e552-1d5d-4d20-83b7-7661b0bca2b7)
Nov 08 12:12:09 user nova-compute[74840]: ERROR nova.compute.manager [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] 
Nov 08 12:12:09 user nova-compute[74840]: INFO nova.virt.block_device [None req-77420d84-19d8-4c26-a0de-85bc7e38bdb8 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Attempting to driver detach volume 6034cc77-4e09-4ecd-a6be-9786d7fac2ff from mountpoint /dev/sdc
Nov 08 12:12:09 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-77420d84-19d8-4c26-a0de-85bc7e38bdb8 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Attempting to detach device sdc from instance 4647e942-c600-4a9c-95ba-a59064d04619 from the persistent domain config. {{(pid=74840) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-77420d84-19d8-4c26-a0de-85bc7e38bdb8 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 12:12:09 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:12:09 user nova-compute[74840]:   <source dev="/dev/sdd"/>
Nov 08 12:12:09 user nova-compute[74840]:   <target dev="sdc" bus="scsi"/>
Nov 08 12:12:09 user nova-compute[74840]:   <serial>6034cc77-4e09-4ecd-a6be-9786d7fac2ff</serial>
Nov 08 12:12:09 user nova-compute[74840]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 08 12:12:09 user nova-compute[74840]: </disk>
Nov 08 12:12:09 user nova-compute[74840]:  {{(pid=74840) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 12:12:09 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-77420d84-19d8-4c26-a0de-85bc7e38bdb8 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Successfully detached device sdc from instance 4647e942-c600-4a9c-95ba-a59064d04619 from the persistent domain config.
Nov 08 12:12:09 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-77420d84-19d8-4c26-a0de-85bc7e38bdb8 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 4647e942-c600-4a9c-95ba-a59064d04619 from the live domain config. {{(pid=74840) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-77420d84-19d8-4c26-a0de-85bc7e38bdb8 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 12:12:09 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:12:09 user nova-compute[74840]:   <source dev="/dev/sdd"/>
Nov 08 12:12:09 user nova-compute[74840]:   <target dev="sdc" bus="scsi"/>
Nov 08 12:12:09 user nova-compute[74840]:   <serial>6034cc77-4e09-4ecd-a6be-9786d7fac2ff</serial>
Nov 08 12:12:09 user nova-compute[74840]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 08 12:12:09 user nova-compute[74840]: </disk>
Nov 08 12:12:09 user nova-compute[74840]:  {{(pid=74840) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 12:12:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fc60e32c-2503-4c55-8346-1bb1a25093d8 tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Lock "684b8be2-7f8f-499f-8885-c9d1c86eef2f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.460s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server [None req-fc60e32c-2503-4c55-8346-1bb1a25093d8 tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-9db5e552-1d5d-4d20-83b7-7661b0bca2b7)
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-9db5e552-1d5d-4d20-83b7-7661b0bca2b7)
Nov 08 12:12:10 user nova-compute[74840]: ERROR oslo_messaging.rpc.server 
Nov 08 12:12:10 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-77420d84-19d8-4c26-a0de-85bc7e38bdb8 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 4647e942-c600-4a9c-95ba-a59064d04619 {{(pid=74840) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 12:12:10 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.523s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:12:10 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] <== connect_volume: return (1526ms) {'type': 'block', 'scsi_wwn': '23965633037613630', 'path': '/dev/sdc'} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:12:10 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965633037613630', 'path': '/dev/sdc'} {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 12:12:10 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:11:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-791461388',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-791461388',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHpDLhfsQbuoiOAJZjQdzHvpPhC/nzLrrMQESJ5Ldi9eYg8zkak82Rki/GHtRFnLyoKBsr3ji4PDu9fap5vsgpePAUrrP6MvAc2bSYV1GEi6T2SkCHIaBKds2SkXizZsQ==',key_name='tempest-keypair-1117122950',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c961954c4a0440a93d9738ca5ab0026',ramdisk_id='',reservation_id='r-pbsbcfi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-874131883',owner_user_name='tempest-ServerActionsV293TestJSON-874131883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:11:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cab11962ef3472a864f830d45396c4c',uuid=28ccd7b3-8bbe-42e7-aa00-612b3703ae79,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd22c195-e803-484d-811a-aeeb04326bd0", "address": "fa:16:3e:ee:6e:72", "network": {"id": "d0c950e1-4e6d-42f7-bbbb-7164603882bc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1883968250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c961954c4a0440a93d9738ca5ab0026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd22c195-e8", "ovs_interfaceid": "bd22c195-e803-484d-811a-aeeb04326bd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:12:10 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Converting VIF {"id": "bd22c195-e803-484d-811a-aeeb04326bd0", "address": "fa:16:3e:ee:6e:72", "network": {"id": "d0c950e1-4e6d-42f7-bbbb-7164603882bc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1883968250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c961954c4a0440a93d9738ca5ab0026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd22c195-e8", "ovs_interfaceid": "bd22c195-e803-484d-811a-aeeb04326bd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:12:10 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:6e:72,bridge_name='br-int',has_traffic_filtering=True,id=bd22c195-e803-484d-811a-aeeb04326bd0,network=Network(d0c950e1-4e6d-42f7-bbbb-7164603882bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd22c195-e8') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:12:10 user nova-compute[74840]: DEBUG nova.objects.instance [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Lazy-loading 'pci_devices' on Instance uuid 28ccd7b3-8bbe-42e7-aa00-612b3703ae79 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:12:10 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:12:10 user nova-compute[74840]:   <uuid>28ccd7b3-8bbe-42e7-aa00-612b3703ae79</uuid>
Nov 08 12:12:10 user nova-compute[74840]:   <name>instance-0000000a</name>
Nov 08 12:12:10 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:12:10 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:12:10 user nova-compute[74840]:   <metadata>
Nov 08 12:12:10 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:12:10 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:12:10 user nova-compute[74840]:       <nova:name>tempest-ServerActionsV293TestJSON-server-791461388</nova:name>
Nov 08 12:12:10 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:12:09</nova:creationTime>
Nov 08 12:12:10 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:12:10 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:12:10 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:12:10 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:12:10 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:12:10 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:12:10 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:12:10 user nova-compute[74840]:       <nova:owner>
Nov 08 12:12:10 user nova-compute[74840]:         <nova:user uuid="0cab11962ef3472a864f830d45396c4c">tempest-ServerActionsV293TestJSON-874131883-project-member</nova:user>
Nov 08 12:12:10 user nova-compute[74840]:         <nova:project uuid="0c961954c4a0440a93d9738ca5ab0026">tempest-ServerActionsV293TestJSON-874131883</nova:project>
Nov 08 12:12:10 user nova-compute[74840]:       </nova:owner>
Nov 08 12:12:10 user nova-compute[74840]:       <nova:ports>
Nov 08 12:12:10 user nova-compute[74840]:         <nova:port uuid="bd22c195-e803-484d-811a-aeeb04326bd0">
Nov 08 12:12:10 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 12:12:10 user nova-compute[74840]:         </nova:port>
Nov 08 12:12:10 user nova-compute[74840]:       </nova:ports>
Nov 08 12:12:10 user nova-compute[74840]:     </nova:instance>
Nov 08 12:12:10 user nova-compute[74840]:   </metadata>
Nov 08 12:12:10 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:12:10 user nova-compute[74840]:     <system>
Nov 08 12:12:10 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:12:10 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:12:10 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:12:10 user nova-compute[74840]:       <entry name="serial">28ccd7b3-8bbe-42e7-aa00-612b3703ae79</entry>
Nov 08 12:12:10 user nova-compute[74840]:       <entry name="uuid">28ccd7b3-8bbe-42e7-aa00-612b3703ae79</entry>
Nov 08 12:12:10 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:12:10 user nova-compute[74840]:     </system>
Nov 08 12:12:10 user nova-compute[74840]:   </sysinfo>
Nov 08 12:12:10 user nova-compute[74840]:   <os>
Nov 08 12:12:10 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:12:10 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:12:10 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:12:10 user nova-compute[74840]:   </os>
Nov 08 12:12:10 user nova-compute[74840]:   <features>
Nov 08 12:12:10 user nova-compute[74840]:     <acpi/>
Nov 08 12:12:10 user nova-compute[74840]:     <apic/>
Nov 08 12:12:10 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:12:10 user nova-compute[74840]:   </features>
Nov 08 12:12:10 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:12:10 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:12:10 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:12:10 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:12:10 user nova-compute[74840]:   </clock>
Nov 08 12:12:10 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:12:10 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:12:10 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:12:10 user nova-compute[74840]:   </cpu>
Nov 08 12:12:10 user nova-compute[74840]:   <devices>
Nov 08 12:12:10 user nova-compute[74840]:     <disk type="block" device="disk">
Nov 08 12:12:10 user nova-compute[74840]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:12:10 user nova-compute[74840]:       <source dev="/dev/sdc"/>
Nov 08 12:12:10 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:12:10 user nova-compute[74840]:       <serial>2a571b42-9e1d-4406-b369-12722b22f097</serial>
Nov 08 12:12:10 user nova-compute[74840]:     </disk>
Nov 08 12:12:10 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:12:10 user nova-compute[74840]:       <mac address="fa:16:3e:ee:6e:72"/>
Nov 08 12:12:10 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:12:10 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:12:10 user nova-compute[74840]:       <target dev="tapbd22c195-e8"/>
Nov 08 12:12:10 user nova-compute[74840]:     </interface>
Nov 08 12:12:10 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:12:10 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/28ccd7b3-8bbe-42e7-aa00-612b3703ae79/console.log" append="off"/>
Nov 08 12:12:10 user nova-compute[74840]:     </serial>
Nov 08 12:12:10 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:12:10 user nova-compute[74840]:     <video>
Nov 08 12:12:10 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:12:10 user nova-compute[74840]:     </video>
Nov 08 12:12:10 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:12:10 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:12:10 user nova-compute[74840]:     </rng>
Nov 08 12:12:10 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:12:10 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:12:10 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:12:10 user nova-compute[74840]:     </memballoon>
Nov 08 12:12:10 user nova-compute[74840]:   </devices>
Nov 08 12:12:10 user nova-compute[74840]: </domain>
Nov 08 12:12:10 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:12:10 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:11:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-791461388',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-791461388',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHpDLhfsQbuoiOAJZjQdzHvpPhC/nzLrrMQESJ5Ldi9eYg8zkak82Rki/GHtRFnLyoKBsr3ji4PDu9fap5vsgpePAUrrP6MvAc2bSYV1GEi6T2SkCHIaBKds2SkXizZsQ==',key_name='tempest-keypair-1117122950',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c961954c4a0440a93d9738ca5ab0026',ramdisk_id='',reservation_id='r-pbsbcfi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-874131883',owner_user_name='tempest-ServerActionsV293TestJSON-874131883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:11:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cab11962ef3472a864f830d45396c4c',uuid=28ccd7b3-8bbe-42e7-aa00-612b3703ae79,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd22c195-e803-484d-811a-aeeb04326bd0", "address": "fa:16:3e:ee:6e:72", "network": {"id": "d0c950e1-4e6d-42f7-bbbb-7164603882bc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1883968250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c961954c4a0440a93d9738ca5ab0026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd22c195-e8", "ovs_interfaceid": "bd22c195-e803-484d-811a-aeeb04326bd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:12:10 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Converting VIF {"id": "bd22c195-e803-484d-811a-aeeb04326bd0", "address": "fa:16:3e:ee:6e:72", "network": {"id": "d0c950e1-4e6d-42f7-bbbb-7164603882bc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1883968250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c961954c4a0440a93d9738ca5ab0026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd22c195-e8", "ovs_interfaceid": "bd22c195-e803-484d-811a-aeeb04326bd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:12:10 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:6e:72,bridge_name='br-int',has_traffic_filtering=True,id=bd22c195-e803-484d-811a-aeeb04326bd0,network=Network(d0c950e1-4e6d-42f7-bbbb-7164603882bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd22c195-e8') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:12:10 user nova-compute[74840]: DEBUG os_vif [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:6e:72,bridge_name='br-int',has_traffic_filtering=True,id=bd22c195-e803-484d-811a-aeeb04326bd0,network=Network(d0c950e1-4e6d-42f7-bbbb-7164603882bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd22c195-e8') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:12:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:12:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:12:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:12:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:12:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c831015d-30f5-5e52-92d1-aa678e757cf7', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:12:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:12:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:12:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:12:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd22c195-e8, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:12:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbd22c195-e8, col_values=(('qos', UUID('71f68de1-2a0e-4c46-8b77-d4c0ed4c1c80')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:12:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbd22c195-e8, col_values=(('external_ids', {'iface-id': 'bd22c195-e803-484d-811a-aeeb04326bd0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:6e:72', 'vm-uuid': '28ccd7b3-8bbe-42e7-aa00-612b3703ae79'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:12:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:12:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:12:10 user nova-compute[74840]: INFO os_vif [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:6e:72,bridge_name='br-int',has_traffic_filtering=True,id=bd22c195-e803-484d-811a-aeeb04326bd0,network=Network(d0c950e1-4e6d-42f7-bbbb-7164603882bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd22c195-e8')
Nov 08 12:12:10 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:12:10 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] No VIF found with MAC fa:16:3e:ee:6e:72, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:12:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:12:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:12:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:12:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:12:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:12:12 user nova-compute[74840]: DEBUG nova.compute.manager [req-f435400e-7929-4a12-bb5c-bf6bc4c7c737 req-7b4b31d7-fe4e-4aa6-bec6-ba0ae48a5dd1 service nova] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Received event network-vif-plugged-bd22c195-e803-484d-811a-aeeb04326bd0 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:12:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-f435400e-7929-4a12-bb5c-bf6bc4c7c737 req-7b4b31d7-fe4e-4aa6-bec6-ba0ae48a5dd1 service nova] Acquiring lock "28ccd7b3-8bbe-42e7-aa00-612b3703ae79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:12:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-f435400e-7929-4a12-bb5c-bf6bc4c7c737 req-7b4b31d7-fe4e-4aa6-bec6-ba0ae48a5dd1 service nova] Lock "28ccd7b3-8bbe-42e7-aa00-612b3703ae79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:12:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-f435400e-7929-4a12-bb5c-bf6bc4c7c737 req-7b4b31d7-fe4e-4aa6-bec6-ba0ae48a5dd1 service nova] Lock "28ccd7b3-8bbe-42e7-aa00-612b3703ae79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:12:12 user nova-compute[74840]: DEBUG nova.compute.manager [req-f435400e-7929-4a12-bb5c-bf6bc4c7c737 req-7b4b31d7-fe4e-4aa6-bec6-ba0ae48a5dd1 service nova] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] No waiting events found dispatching network-vif-plugged-bd22c195-e803-484d-811a-aeeb04326bd0 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:12:12 user nova-compute[74840]: WARNING nova.compute.manager [req-f435400e-7929-4a12-bb5c-bf6bc4c7c737 req-7b4b31d7-fe4e-4aa6-bec6-ba0ae48a5dd1 service nova] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Received unexpected event network-vif-plugged-bd22c195-e803-484d-811a-aeeb04326bd0 for instance with vm_state building and task_state spawning.
Nov 08 12:12:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:12:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:12:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:12:14 user nova-compute[74840]: DEBUG nova.compute.manager [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:12:14 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:12:14 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Instance spawned successfully.
Nov 08 12:12:14 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:12:14 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Found default for hw_cdrom_bus of ide {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:12:14 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Found default for hw_disk_bus of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:12:14 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:12:14 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:12:14 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Found default for hw_video_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:12:14 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Found default for hw_vif_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:12:14 user nova-compute[74840]: INFO nova.compute.manager [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Took 5.38 seconds to spawn the instance on the hypervisor.
Nov 08 12:12:14 user nova-compute[74840]: DEBUG nova.compute.manager [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:12:14 user nova-compute[74840]: DEBUG nova.compute.manager [req-ed30ab89-2a1d-410c-8900-143fa706a804 req-61c497ca-9eda-4435-af92-7e090a7873a9 service nova] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Received event network-vif-plugged-bd22c195-e803-484d-811a-aeeb04326bd0 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:12:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-ed30ab89-2a1d-410c-8900-143fa706a804 req-61c497ca-9eda-4435-af92-7e090a7873a9 service nova] Acquiring lock "28ccd7b3-8bbe-42e7-aa00-612b3703ae79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:12:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-ed30ab89-2a1d-410c-8900-143fa706a804 req-61c497ca-9eda-4435-af92-7e090a7873a9 service nova] Lock "28ccd7b3-8bbe-42e7-aa00-612b3703ae79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:12:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-ed30ab89-2a1d-410c-8900-143fa706a804 req-61c497ca-9eda-4435-af92-7e090a7873a9 service nova] Lock "28ccd7b3-8bbe-42e7-aa00-612b3703ae79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:12:14 user nova-compute[74840]: DEBUG nova.compute.manager [req-ed30ab89-2a1d-410c-8900-143fa706a804 req-61c497ca-9eda-4435-af92-7e090a7873a9 service nova] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] No waiting events found dispatching network-vif-plugged-bd22c195-e803-484d-811a-aeeb04326bd0 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:12:14 user nova-compute[74840]: WARNING nova.compute.manager [req-ed30ab89-2a1d-410c-8900-143fa706a804 req-61c497ca-9eda-4435-af92-7e090a7873a9 service nova] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Received unexpected event network-vif-plugged-bd22c195-e803-484d-811a-aeeb04326bd0 for instance with vm_state building and task_state spawning.
Nov 08 12:12:14 user nova-compute[74840]: INFO nova.compute.manager [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Took 57.74 seconds to build instance.
Nov 08 12:12:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-49a8f229-576e-4355-8ab9-4ab404b9f458 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Lock "28ccd7b3-8bbe-42e7-aa00-612b3703ae79" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 57.876s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:12:15 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:12:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:12:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:12:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:12:25 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:12:30 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-77420d84-19d8-4c26-a0de-85bc7e38bdb8 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 4647e942-c600-4a9c-95ba-a59064d04619 is timed out.
Nov 08 12:12:30 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-77420d84-19d8-4c26-a0de-85bc7e38bdb8 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Successfully detached device sdc from instance 4647e942-c600-4a9c-95ba-a59064d04619 from the live domain config.
Nov 08 12:12:30 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77420d84-19d8-4c26-a0de-85bc7e38bdb8 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 12:12:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-77420d84-19d8-4c26-a0de-85bc7e38bdb8 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kdAhrPnK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:12:30 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-77420d84-19d8-4c26-a0de-85bc7e38bdb8 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:12:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-77420d84-19d8-4c26-a0de-85bc7e38bdb8 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:12:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-77420d84-19d8-4c26-a0de-85bc7e38bdb8 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:12:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:30 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3bd614-c05f-444b-96a5-458f88f1bc6a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-77420d84-19d8-4c26-a0de-85bc7e38bdb8 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 12:12:30 user nova-compute[74840]: No targets found.
Nov 08 12:12:30 user nova-compute[74840]: iSNS:
Nov 08 12:12:30 user nova-compute[74840]: No targets found.
Nov 08 12:12:30 user nova-compute[74840]: STATIC:
Nov 08 12:12:30 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097
Nov 08 12:12:30 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:12:30 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:12:30 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff
Nov 08 12:12:30 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:12:30 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:12:30 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9
Nov 08 12:12:30 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:12:30 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:12:30 user nova-compute[74840]: FIRMWARE:
Nov 08 12:12:30 user nova-compute[74840]: No targets found.
Nov 08 12:12:30 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:12:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-77420d84-19d8-4c26-a0de-85bc7e38bdb8 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 12:12:30 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 12:12:30 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 12:12:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-77420d84-19d8-4c26-a0de-85bc7e38bdb8 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 12:12:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:30 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef460cc-2603-4995-b560-f5038f0e7511]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:30 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b75875c-a708-4653-816b-43d490e7064c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-77420d84-19d8-4c26-a0de-85bc7e38bdb8 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)
Nov 08 12:12:30 user nova-compute[74840]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff (non-flash)
Nov 08 12:12:30 user nova-compute[74840]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)
Nov 08 12:12:30 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:12:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-77420d84-19d8-4c26-a0de-85bc7e38bdb8 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)
Nov 08 12:12:30 user nova-compute[74840]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff (non-flash)
Nov 08 12:12:30 user nova-compute[74840]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)
Nov 08 12:12:30 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:12:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-77420d84-19d8-4c26-a0de-85bc7e38bdb8 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7ec1332e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff'): ({'sdd'}, set())}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 12:12:30 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-77420d84-19d8-4c26-a0de-85bc7e38bdb8 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Removing single pathed devices sdd {{(pid=74840) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 12:12:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:30 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca46e684-6c02-415d-a8e7-e52b7956e9e9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:30 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[94971941-ca3c-46d0-8976-780e944b4532]: (4, ('ok\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:30 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-77420d84-19d8-4c26-a0de-85bc7e38bdb8 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Flushing IO for device /dev/sdd {{(pid=74840) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 12:12:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:30 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ed2d68-1612-465e-8a27-e25638087e4d]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:30 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-77420d84-19d8-4c26-a0de-85bc7e38bdb8 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74840) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 12:12:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:30 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ef3b2d-1157-4662-8335-3d28b3dbc42d]: (4, ('1', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:30 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-77420d84-19d8-4c26-a0de-85bc7e38bdb8 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 12:12:30 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-77420d84-19d8-4c26-a0de-85bc7e38bdb8 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] SCSI volumes sdd have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 12:12:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-77420d84-19d8-4c26-a0de-85bc7e38bdb8 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff')] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 12:12:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:30 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d98bac9-f548-417e-a1f4-9ff4d44bc82d]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-77420d84-19d8-4c26-a0de-85bc7e38bdb8 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:12:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff -p 172.16.0.220:3260 --logout {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:30 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad21340-6d34-459f-8f88-01548cab57cd]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-77420d84-19d8-4c26-a0de-85bc7e38bdb8 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff, portal: 172.16.0.220,3260]
Nov 08 12:12:30 user nova-compute[74840]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff, portal: 172.16.0.220,3260] successful.
Nov 08 12:12:30 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:12:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff -p 172.16.0.220:3260 --op delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6034cc77-4e09-4ecd-a6be-9786d7fac2ff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:30 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e957dd13-5e16-4ca7-93c7-12c51b4c2ce9]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-77420d84-19d8-4c26-a0de-85bc7e38bdb8 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:12:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-77420d84-19d8-4c26-a0de-85bc7e38bdb8 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:12:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-77420d84-19d8-4c26-a0de-85bc7e38bdb8 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] <== disconnect_volume: return (336ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:12:30 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77420d84-19d8-4c26-a0de-85bc7e38bdb8 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 12:12:30 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:12:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:12:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:12:31 user nova-compute[74840]: DEBUG nova.objects.instance [None req-77420d84-19d8-4c26-a0de-85bc7e38bdb8 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Lazy-loading 'flavor' on Instance uuid 4647e942-c600-4a9c-95ba-a59064d04619 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:12:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-77420d84-19d8-4c26-a0de-85bc7e38bdb8 tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Lock "4647e942-c600-4a9c-95ba-a59064d04619" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.953s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:12:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c32a3987-6f6b-4f20-ad2a-40236cfcf27c tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Acquiring lock "4647e942-c600-4a9c-95ba-a59064d04619" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:12:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c32a3987-6f6b-4f20-ad2a-40236cfcf27c tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Lock "4647e942-c600-4a9c-95ba-a59064d04619" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:12:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c32a3987-6f6b-4f20-ad2a-40236cfcf27c tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Acquiring lock "4647e942-c600-4a9c-95ba-a59064d04619-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:12:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c32a3987-6f6b-4f20-ad2a-40236cfcf27c tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Lock "4647e942-c600-4a9c-95ba-a59064d04619-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:12:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c32a3987-6f6b-4f20-ad2a-40236cfcf27c tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Lock "4647e942-c600-4a9c-95ba-a59064d04619-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:12:32 user nova-compute[74840]: INFO nova.compute.manager [None req-c32a3987-6f6b-4f20-ad2a-40236cfcf27c tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Terminating instance
Nov 08 12:12:32 user nova-compute[74840]: DEBUG nova.compute.manager [None req-c32a3987-6f6b-4f20-ad2a-40236cfcf27c tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Start destroying the instance on the hypervisor. {{(pid=74840) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 12:12:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:12:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:12:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:12:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:12:32 user nova-compute[74840]: DEBUG nova.compute.manager [req-0fff6b50-718d-4622-b7b2-a1f3038592d4 req-a2b79f13-15f5-4290-9c7a-2c4e9899c220 service nova] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Received event network-vif-unplugged-bf46d9d3-89c8-43be-b311-e9c6b68fcb9e {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:12:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0fff6b50-718d-4622-b7b2-a1f3038592d4 req-a2b79f13-15f5-4290-9c7a-2c4e9899c220 service nova] Acquiring lock "4647e942-c600-4a9c-95ba-a59064d04619-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:12:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0fff6b50-718d-4622-b7b2-a1f3038592d4 req-a2b79f13-15f5-4290-9c7a-2c4e9899c220 service nova] Lock "4647e942-c600-4a9c-95ba-a59064d04619-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:12:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0fff6b50-718d-4622-b7b2-a1f3038592d4 req-a2b79f13-15f5-4290-9c7a-2c4e9899c220 service nova] Lock "4647e942-c600-4a9c-95ba-a59064d04619-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:12:32 user nova-compute[74840]: DEBUG nova.compute.manager [req-0fff6b50-718d-4622-b7b2-a1f3038592d4 req-a2b79f13-15f5-4290-9c7a-2c4e9899c220 service nova] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] No waiting events found dispatching network-vif-unplugged-bf46d9d3-89c8-43be-b311-e9c6b68fcb9e {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:12:32 user nova-compute[74840]: DEBUG nova.compute.manager [req-0fff6b50-718d-4622-b7b2-a1f3038592d4 req-a2b79f13-15f5-4290-9c7a-2c4e9899c220 service nova] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Received event network-vif-unplugged-bf46d9d3-89c8-43be-b311-e9c6b68fcb9e for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:12:32 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Instance destroyed successfully.
Nov 08 12:12:32 user nova-compute[74840]: DEBUG nova.objects.instance [None req-c32a3987-6f6b-4f20-ad2a-40236cfcf27c tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Lazy-loading 'resources' on Instance uuid 4647e942-c600-4a9c-95ba-a59064d04619 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:12:33 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-c32a3987-6f6b-4f20-ad2a-40236cfcf27c tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:09:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-261667012',display_name='tempest-AttachSCSIVolumeTestJSON-server-261667012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-261667012',id=5,image_ref='3406d889-0335-4bdc-84d9-0f98ada5c11a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOfxgYUfKvo74kGCGXAkc7EgNkeogTmyx9QsDwXy07UN7URUO0RM2LfP+tpg18lKKXctslOHwapdvtF+bpBDofEN2nSncWmfPaEwUv1nSwfR4ko4wf9dT9AoRawwkprGAw==',key_name='tempest-keypair-1416255561',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:09:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e8d34c1c5dea4b59b332d650f2639c20',ramdisk_id='',reservation_id='r-tes958mw',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3406d889-0335-4bdc-84d9-0f98ada5c11a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-424545312',owner_user_name='tempest-AttachSCSIVolumeTestJSON-424545312-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:09:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1041650fc2f4bc3aa7313d901af94a2',uuid=4647e942-c600-4a9c-95ba-a59064d04619,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf46d9d3-89c8-43be-b311-e9c6b68fcb9e", "address": "fa:16:3e:84:44:b2", "network": {"id": "c40fb022-567d-4eee-8ac6-14b45b43c92b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1575943545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8d34c1c5dea4b59b332d650f2639c20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf46d9d3-89", "ovs_interfaceid": "bf46d9d3-89c8-43be-b311-e9c6b68fcb9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:12:33 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-c32a3987-6f6b-4f20-ad2a-40236cfcf27c tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Converting VIF {"id": "bf46d9d3-89c8-43be-b311-e9c6b68fcb9e", "address": "fa:16:3e:84:44:b2", "network": {"id": "c40fb022-567d-4eee-8ac6-14b45b43c92b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1575943545-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8d34c1c5dea4b59b332d650f2639c20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf46d9d3-89", "ovs_interfaceid": "bf46d9d3-89c8-43be-b311-e9c6b68fcb9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:12:33 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-c32a3987-6f6b-4f20-ad2a-40236cfcf27c tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:44:b2,bridge_name='br-int',has_traffic_filtering=True,id=bf46d9d3-89c8-43be-b311-e9c6b68fcb9e,network=Network(c40fb022-567d-4eee-8ac6-14b45b43c92b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf46d9d3-89') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:12:33 user nova-compute[74840]: DEBUG os_vif [None req-c32a3987-6f6b-4f20-ad2a-40236cfcf27c tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:44:b2,bridge_name='br-int',has_traffic_filtering=True,id=bf46d9d3-89c8-43be-b311-e9c6b68fcb9e,network=Network(c40fb022-567d-4eee-8ac6-14b45b43c92b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf46d9d3-89') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:12:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:12:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf46d9d3-89, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:12:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:12:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:12:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:12:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ab729347-dfb9-4955-ad61-b0496f980db9) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:12:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:12:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:12:33 user nova-compute[74840]: INFO os_vif [None req-c32a3987-6f6b-4f20-ad2a-40236cfcf27c tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:44:b2,bridge_name='br-int',has_traffic_filtering=True,id=bf46d9d3-89c8-43be-b311-e9c6b68fcb9e,network=Network(c40fb022-567d-4eee-8ac6-14b45b43c92b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf46d9d3-89')
Nov 08 12:12:33 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-c32a3987-6f6b-4f20-ad2a-40236cfcf27c tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Deleting instance files /opt/stack/data/nova/instances/4647e942-c600-4a9c-95ba-a59064d04619_del
Nov 08 12:12:33 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-c32a3987-6f6b-4f20-ad2a-40236cfcf27c tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Deletion of /opt/stack/data/nova/instances/4647e942-c600-4a9c-95ba-a59064d04619_del complete
Nov 08 12:12:33 user nova-compute[74840]: INFO nova.compute.manager [None req-c32a3987-6f6b-4f20-ad2a-40236cfcf27c tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 08 12:12:33 user nova-compute[74840]: DEBUG oslo.service.loopingcall [None req-c32a3987-6f6b-4f20-ad2a-40236cfcf27c tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74840) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 12:12:33 user nova-compute[74840]: DEBUG nova.compute.manager [-] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Deallocating network for instance {{(pid=74840) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 12:12:33 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] deallocate_for_instance() {{(pid=74840) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 12:12:34 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:12:34 user nova-compute[74840]: INFO nova.compute.manager [-] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Took 1.08 seconds to deallocate network for instance.
Nov 08 12:12:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c32a3987-6f6b-4f20-ad2a-40236cfcf27c tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:12:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c32a3987-6f6b-4f20-ad2a-40236cfcf27c tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:12:34 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-c32a3987-6f6b-4f20-ad2a-40236cfcf27c tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:12:34 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-c32a3987-6f6b-4f20-ad2a-40236cfcf27c tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:12:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c32a3987-6f6b-4f20-ad2a-40236cfcf27c tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.326s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:12:34 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-c32a3987-6f6b-4f20-ad2a-40236cfcf27c tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Deleted allocations for instance 4647e942-c600-4a9c-95ba-a59064d04619
Nov 08 12:12:34 user nova-compute[74840]: DEBUG nova.compute.manager [req-d661496b-31b7-4c83-8f87-86d8104f707e req-967c26ec-285d-44ac-a559-cb2134600abd service nova] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Received event network-vif-plugged-bf46d9d3-89c8-43be-b311-e9c6b68fcb9e {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:12:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-d661496b-31b7-4c83-8f87-86d8104f707e req-967c26ec-285d-44ac-a559-cb2134600abd service nova] Acquiring lock "4647e942-c600-4a9c-95ba-a59064d04619-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:12:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-d661496b-31b7-4c83-8f87-86d8104f707e req-967c26ec-285d-44ac-a559-cb2134600abd service nova] Lock "4647e942-c600-4a9c-95ba-a59064d04619-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:12:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-d661496b-31b7-4c83-8f87-86d8104f707e req-967c26ec-285d-44ac-a559-cb2134600abd service nova] Lock "4647e942-c600-4a9c-95ba-a59064d04619-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:12:34 user nova-compute[74840]: DEBUG nova.compute.manager [req-d661496b-31b7-4c83-8f87-86d8104f707e req-967c26ec-285d-44ac-a559-cb2134600abd service nova] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] No waiting events found dispatching network-vif-plugged-bf46d9d3-89c8-43be-b311-e9c6b68fcb9e {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:12:34 user nova-compute[74840]: WARNING nova.compute.manager [req-d661496b-31b7-4c83-8f87-86d8104f707e req-967c26ec-285d-44ac-a559-cb2134600abd service nova] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Received unexpected event network-vif-plugged-bf46d9d3-89c8-43be-b311-e9c6b68fcb9e for instance with vm_state deleted and task_state None.
Nov 08 12:12:34 user nova-compute[74840]: DEBUG nova.compute.manager [req-d661496b-31b7-4c83-8f87-86d8104f707e req-967c26ec-285d-44ac-a559-cb2134600abd service nova] [instance: 4647e942-c600-4a9c-95ba-a59064d04619] Received event network-vif-deleted-bf46d9d3-89c8-43be-b311-e9c6b68fcb9e {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:12:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c32a3987-6f6b-4f20-ad2a-40236cfcf27c tempest-AttachSCSIVolumeTestJSON-424545312 tempest-AttachSCSIVolumeTestJSON-424545312-project-member] Lock "4647e942-c600-4a9c-95ba-a59064d04619" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.545s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:12:35 user nova-compute[74840]: INFO nova.virt.block_device [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Booting with volume 644305b8-0b29-4439-920c-b802be80bd60 at /dev/vdc
Nov 08 12:12:35 user nova-compute[74840]: DEBUG os_brick.utils [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:12:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:35 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5446e939-94d5-45e5-be36-8b7231bffb85]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c8228a11e03c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:35 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b917af66-ec93-48d0-9672-b9c7ccabb6f1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:35 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e1f2e8-0ca9-41a5-aa46-12df50a5fc22]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:35 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[20826d64-2b68-4d8f-b324-b90e9019ab77]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Running cmd (subprocess): nvme version {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] 'nvme version' failed. Not Retrying. {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:12:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.nvmeof [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] nvme not present on system {{(pid=74840) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 12:12:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:12:35 user nova-compute[74840]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 12:12:35 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d38fb51-9f18-420e-985e-8a581db28573]: (4, '') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74840) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 12:12:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 12:12:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] LIGHTOS: no hostnqn found. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 12:12:35 user nova-compute[74840]: DEBUG os_brick.utils [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c8228a11e03c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:12:35 user nova-compute[74840]: DEBUG nova.virt.block_device [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Updating existing volume attachment record: 654bf1d1-80a7-4ecb-a9f3-10d2490696e2 {{(pid=74840) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 12:12:35 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b578964-d34c-412d-96e1-e66d0029bc99 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Calling os-brick to attach iSCSI Volume {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 12:12:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b578964-d34c-412d-96e1-e66d0029bc99 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8c2e4313-24a9-43ea-8300-27d209de8fb4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uxoqcyAj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:12:35 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-2b578964-d34c-412d-96e1-e66d0029bc99 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:12:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-2b578964-d34c-412d-96e1-e66d0029bc99 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:12:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-2b578964-d34c-412d-96e1-e66d0029bc99 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:12:35 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-2b578964-d34c-412d-96e1-e66d0029bc99 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:12:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-2b578964-d34c-412d-96e1-e66d0029bc99 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c2e4313-24a9-43ea-8300-27d209de8fb4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:12:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-2b578964-d34c-412d-96e1-e66d0029bc99 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c2e4313-24a9-43ea-8300-27d209de8fb4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:12:35 user nova-compute[74840]: INFO os_brick.initiator.connectors.iscsi [None req-2b578964-d34c-412d-96e1-e66d0029bc99 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 12:12:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2e4313-24a9-43ea-8300-27d209de8fb4 -p 172.16.0.220:3260 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2e4313-24a9-43ea-8300-27d209de8fb4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:35 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a4922a-96f4-4a23-8d4a-0b92ab84e30f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b578964-d34c-412d-96e1-e66d0029bc99 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 12:12:35 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:12:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2e4313-24a9-43ea-8300-27d209de8fb4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2e4313-24a9-43ea-8300-27d209de8fb4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:35 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9989e7db-2f0b-4a69-a163-2a6ff7ec81ca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c2e4313-24a9-43ea-8300-27d209de8fb4] added\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b578964-d34c-412d-96e1-e66d0029bc99 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c2e4313-24a9-43ea-8300-27d209de8fb4] added
Nov 08 12:12:35 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:12:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2e4313-24a9-43ea-8300-27d209de8fb4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2e4313-24a9-43ea-8300-27d209de8fb4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.060s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:35 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3318b9ce-b9e6-406b-8240-97d7315bc210]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b578964-d34c-412d-96e1-e66d0029bc99 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:12:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2e4313-24a9-43ea-8300-27d209de8fb4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2e4313-24a9-43ea-8300-27d209de8fb4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:35 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[253b68b4-5295-4ffc-a3ce-aaa4beea4cc6]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b578964-d34c-412d-96e1-e66d0029bc99 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:12:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2e4313-24a9-43ea-8300-27d209de8fb4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uxoqcyAj {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2e4313-24a9-43ea-8300-27d209de8fb4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uxoqcyAj" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:35 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[0afb8c5b-0de5-4621-bc14-b7fb1c84e7a6]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b578964-d34c-412d-96e1-e66d0029bc99 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uxoqcyAj'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:12:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2e4313-24a9-43ea-8300-27d209de8fb4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:36 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2e4313-24a9-43ea-8300-27d209de8fb4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:36 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc9c574-ad5b-484d-8efb-9cad06ff3a4c]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:36 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b578964-d34c-412d-96e1-e66d0029bc99 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:12:36 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:36 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:36 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[464863ff-0c4c-4559-8b86-44af5a1a65ed]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:36 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b578964-d34c-412d-96e1-e66d0029bc99 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)
Nov 08 12:12:36 user nova-compute[74840]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)
Nov 08 12:12:36 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:12:36 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b578964-d34c-412d-96e1-e66d0029bc99 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)
Nov 08 12:12:36 user nova-compute[74840]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)
Nov 08 12:12:36 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:12:36 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2e4313-24a9-43ea-8300-27d209de8fb4 -p 172.16.0.220:3260 --login {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:12:36 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2e4313-24a9-43ea-8300-27d209de8fb4 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:36 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1561b8fe-1ed6-4b4a-90a6-07822ed6f979]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c2e4313-24a9-43ea-8300-27d209de8fb4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8c2e4313-24a9-43ea-8300-27d209de8fb4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:36 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b578964-d34c-412d-96e1-e66d0029bc99 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c2e4313-24a9-43ea-8300-27d209de8fb4, portal: 172.16.0.220,3260]
Nov 08 12:12:36 user nova-compute[74840]: Login to [iface: default, target: iqn.2010-10.org.openstack:8c2e4313-24a9-43ea-8300-27d209de8fb4, portal: 172.16.0.220,3260] successful.
Nov 08 12:12:36 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:12:36 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2e4313-24a9-43ea-8300-27d209de8fb4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:36 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2e4313-24a9-43ea-8300-27d209de8fb4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:36 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc60611-3875-4206-82d1-043e8aa2696b]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:36 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b578964-d34c-412d-96e1-e66d0029bc99 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:12:36 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:36 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:36 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73760b8-fcf3-47f3-b937-5b34b558f98e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c2e4313-24a9-43ea-8300-27d209de8fb4 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:36 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b578964-d34c-412d-96e1-e66d0029bc99 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)
Nov 08 12:12:36 user nova-compute[74840]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)
Nov 08 12:12:36 user nova-compute[74840]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c2e4313-24a9-43ea-8300-27d209de8fb4 (non-flash)
Nov 08 12:12:36 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:12:36 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b578964-d34c-412d-96e1-e66d0029bc99 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)
Nov 08 12:12:36 user nova-compute[74840]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)
Nov 08 12:12:36 user nova-compute[74840]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c2e4313-24a9-43ea-8300-27d209de8fb4 (non-flash)
Nov 08 12:12:36 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:12:36 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-2b578964-d34c-412d-96e1-e66d0029bc99 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c2e4313-24a9-43ea-8300-27d209de8fb4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:12:36 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b578964-d34c-412d-96e1-e66d0029bc99 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] Connected to 172.16.0.220:3260 {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 12:12:36 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-2b578964-d34c-412d-96e1-e66d0029bc99 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] HCTL ('35', '-', '-', 0) found on session 6 with lun 0 {{(pid=74840) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 12:12:36 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-2b578964-d34c-412d-96e1-e66d0029bc99 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=74840) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 12:12:36 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:36 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:36 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb1e26d-e509-4eda-9bfe-51f485dcd338]: (4, ('- - 0', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:36 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-2b578964-d34c-412d-96e1-e66d0029bc99 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] Searching for a device in session 6 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:12:36 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b578964-d34c-412d-96e1-e66d0029bc99 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8c2e4313-24a9-43ea-8300-27d209de8fb4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uxoqcyAj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 12:12:37 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-2b578964-d34c-412d-96e1-e66d0029bc99 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:12:37 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b578964-d34c-412d-96e1-e66d0029bc99 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] <== connect_volume: return (1388ms) {'type': 'block', 'scsi_wwn': '23538656465366261', 'path': '/dev/sdd'} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:12:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b578964-d34c-412d-96e1-e66d0029bc99 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538656465366261', 'path': '/dev/sdd'} {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 12:12:37 user nova-compute[74840]: DEBUG nova.objects.instance [None req-2b578964-d34c-412d-96e1-e66d0029bc99 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] Lazy-loading 'flavor' on Instance uuid 1dc9229a-61a8-4f45-b011-5bb3e89d63d1 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:12:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-2b578964-d34c-412d-96e1-e66d0029bc99 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] attach device xml: <disk type="block" device="disk">
Nov 08 12:12:37 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:12:37 user nova-compute[74840]:   <source dev="/dev/sdd"/>
Nov 08 12:12:37 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:12:37 user nova-compute[74840]:   <serial>8c2e4313-24a9-43ea-8300-27d209de8fb4</serial>
Nov 08 12:12:37 user nova-compute[74840]: </disk>
Nov 08 12:12:37 user nova-compute[74840]:  {{(pid=74840) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 12:12:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-2b578964-d34c-412d-96e1-e66d0029bc99 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:12:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-2b578964-d34c-412d-96e1-e66d0029bc99 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:12:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-2b578964-d34c-412d-96e1-e66d0029bc99 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] No VIF found with MAC fa:16:3e:b6:a8:fa, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:12:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-2b578964-d34c-412d-96e1-e66d0029bc99 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] Lock "1dc9229a-61a8-4f45-b011-5bb3e89d63d1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.555s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:12:38 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:12:38 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-42e35326-34de-445c-8bcd-a9360a540e10 tempest-VolumesAssistedSnapshotsTest-1999495328 tempest-VolumesAssistedSnapshotsTest-1999495328-project] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] volume_snapshot_create: create_info: {'snapshot_id': '1e5eb7df-9d53-49a0-9207-9bae45f1b877', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74840) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 08 12:12:38 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-42e35326-34de-445c-8bcd-a9360a540e10 tempest-VolumesAssistedSnapshotsTest-1999495328 tempest-VolumesAssistedSnapshotsTest-1999495328-project] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] snap xml: <domainsnapshot>
Nov 08 12:12:38 user nova-compute[74840]:   <disks>
Nov 08 12:12:38 user nova-compute[74840]:     <disk name="/dev/sdd" snapshot="external" type="file">
Nov 08 12:12:38 user nova-compute[74840]:       <source file="/dev/new_file"/>
Nov 08 12:12:38 user nova-compute[74840]:     </disk>
Nov 08 12:12:38 user nova-compute[74840]:     <disk name="vda" snapshot="no"/>
Nov 08 12:12:38 user nova-compute[74840]:   </disks>
Nov 08 12:12:38 user nova-compute[74840]: </domainsnapshot>
Nov 08 12:12:38 user nova-compute[74840]:  {{(pid=74840) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 08 12:12:38 user nova-compute[74840]: DEBUG nova.objects.instance [None req-42e35326-34de-445c-8bcd-a9360a540e10 tempest-VolumesAssistedSnapshotsTest-1999495328 tempest-VolumesAssistedSnapshotsTest-1999495328-project] Lazy-loading 'system_metadata' on Instance uuid 1dc9229a-61a8-4f45-b011-5bb3e89d63d1 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:12:38 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-42e35326-34de-445c-8bcd-a9360a540e10 tempest-VolumesAssistedSnapshotsTest-1999495328 tempest-VolumesAssistedSnapshotsTest-1999495328-project] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver [None req-42e35326-34de-445c-8bcd-a9360a540e10 tempest-VolumesAssistedSnapshotsTest-1999495328 tempest-VolumesAssistedSnapshotsTest-1999495328-project] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Traceback (most recent call last):
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1]     rv = execute(f, *args, **kwargs)
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1]     six.reraise(c, e, tb)
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1]     raise value
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1]     rv = meth(*args, **kwargs)
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] 
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver [None req-42e35326-34de-445c-8bcd-a9360a540e10 tempest-VolumesAssistedSnapshotsTest-1999495328 tempest-VolumesAssistedSnapshotsTest-1999495328-project] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Traceback (most recent call last):
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1]     self._volume_snapshot_create(context, instance, guest,
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1]     rv = execute(f, *args, **kwargs)
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1]     six.reraise(c, e, tb)
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1]     raise value
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1]     rv = meth(*args, **kwargs)
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] 
Nov 08 12:12:38 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-e2876836-c575-4919-a7ab-c14c68662b62 tempest-VolumesAssistedSnapshotsTest-1999495328 tempest-VolumesAssistedSnapshotsTest-1999495328-project] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] volume_snapshot_delete: delete_info: {'volume_id': '8c2e4313-24a9-43ea-8300-27d209de8fb4'} {{(pid=74840) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver [None req-e2876836-c575-4919-a7ab-c14c68662b62 tempest-VolumesAssistedSnapshotsTest-1999495328 tempest-VolumesAssistedSnapshotsTest-1999495328-project] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Traceback (most recent call last):
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1]     if delete_info['type'] != 'qcow2':
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] KeyError: 'type'
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] 
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver [None req-42e35326-34de-445c-8bcd-a9360a540e10 tempest-VolumesAssistedSnapshotsTest-1999495328 tempest-VolumesAssistedSnapshotsTest-1999495328-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 1e5eb7df-9d53-49a0-9207-9bae45f1b877 could not be found.
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver     raise value
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver 
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver 
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 1e5eb7df-9d53-49a0-9207-9bae45f1b877 could not be found. (HTTP 404) (Request-ID: req-f1038f2f-0eb9-40d6-b4c7-938aa2479c05)
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver 
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver 
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 1e5eb7df-9d53-49a0-9207-9bae45f1b877 could not be found.
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver 
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server [None req-42e35326-34de-445c-8bcd-a9360a540e10 tempest-VolumesAssistedSnapshotsTest-1999495328 tempest-VolumesAssistedSnapshotsTest-1999495328-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     raise value
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server 
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver [None req-e2876836-c575-4919-a7ab-c14c68662b62 tempest-VolumesAssistedSnapshotsTest-1999495328 tempest-VolumesAssistedSnapshotsTest-1999495328-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver 
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver 
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-a19d96e6-16fd-4715-ad58-d635c3f43dfa)
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver 
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver 
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 08 12:12:38 user nova-compute[74840]: ERROR nova.virt.libvirt.driver 
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server [None req-e2876836-c575-4919-a7ab-c14c68662b62 tempest-VolumesAssistedSnapshotsTest-1999495328 tempest-VolumesAssistedSnapshotsTest-1999495328-project] Exception during message handling: KeyError: 'type'
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 08 12:12:38 user nova-compute[74840]: ERROR oslo_messaging.rpc.server 
Nov 08 12:12:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d4b3f56d-0559-4eb1-b3f2-722b46cbccf4 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] Acquiring lock "1dc9229a-61a8-4f45-b011-5bb3e89d63d1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:12:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d4b3f56d-0559-4eb1-b3f2-722b46cbccf4 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] Lock "1dc9229a-61a8-4f45-b011-5bb3e89d63d1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:12:39 user nova-compute[74840]: INFO nova.compute.manager [None req-d4b3f56d-0559-4eb1-b3f2-722b46cbccf4 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Detaching volume 8c2e4313-24a9-43ea-8300-27d209de8fb4
Nov 08 12:12:39 user nova-compute[74840]: INFO nova.virt.block_device [None req-d4b3f56d-0559-4eb1-b3f2-722b46cbccf4 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Attempting to driver detach volume 8c2e4313-24a9-43ea-8300-27d209de8fb4 from mountpoint /dev/vdb
Nov 08 12:12:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-d4b3f56d-0559-4eb1-b3f2-722b46cbccf4 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] Attempting to detach device vdb from instance 1dc9229a-61a8-4f45-b011-5bb3e89d63d1 from the persistent domain config. {{(pid=74840) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 12:12:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-d4b3f56d-0559-4eb1-b3f2-722b46cbccf4 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] detach device xml: <disk type="block" device="disk">
Nov 08 12:12:39 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:12:39 user nova-compute[74840]:   <source dev="/dev/sdd"/>
Nov 08 12:12:39 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:12:39 user nova-compute[74840]:   <serial>8c2e4313-24a9-43ea-8300-27d209de8fb4</serial>
Nov 08 12:12:39 user nova-compute[74840]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 12:12:39 user nova-compute[74840]: </disk>
Nov 08 12:12:39 user nova-compute[74840]:  {{(pid=74840) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 12:12:39 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-d4b3f56d-0559-4eb1-b3f2-722b46cbccf4 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] Successfully detached device vdb from instance 1dc9229a-61a8-4f45-b011-5bb3e89d63d1 from the persistent domain config.
Nov 08 12:12:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-d4b3f56d-0559-4eb1-b3f2-722b46cbccf4 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1dc9229a-61a8-4f45-b011-5bb3e89d63d1 from the live domain config. {{(pid=74840) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 12:12:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-d4b3f56d-0559-4eb1-b3f2-722b46cbccf4 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] detach device xml: <disk type="block" device="disk">
Nov 08 12:12:39 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:12:39 user nova-compute[74840]:   <source dev="/dev/sdd"/>
Nov 08 12:12:39 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:12:39 user nova-compute[74840]:   <serial>8c2e4313-24a9-43ea-8300-27d209de8fb4</serial>
Nov 08 12:12:39 user nova-compute[74840]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 12:12:39 user nova-compute[74840]: </disk>
Nov 08 12:12:39 user nova-compute[74840]:  {{(pid=74840) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 12:12:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-d4b3f56d-0559-4eb1-b3f2-722b46cbccf4 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1dc9229a-61a8-4f45-b011-5bb3e89d63d1 {{(pid=74840) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 12:12:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:12:42 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:12:43 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:12:44 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:12:44 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:12:45 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "refresh_cache-684b8be2-7f8f-499f-8885-c9d1c86eef2f" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:12:45 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquired lock "refresh_cache-684b8be2-7f8f-499f-8885-c9d1c86eef2f" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:12:45 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Forcefully refreshing network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 12:12:45 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Updating instance_info_cache with network_info: [{"id": "b910fb2a-440c-426f-a000-064149073835", "address": "fa:16:3e:fd:8e:63", "network": {"id": "bfa1d7ef-3436-4676-a399-ead8194a958a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-3950314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd51d983b3aa441dabb1543296f0bb70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb910fb2a-44", "ovs_interfaceid": "b910fb2a-440c-426f-a000-064149073835", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:12:45 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Releasing lock "refresh_cache-684b8be2-7f8f-499f-8885-c9d1c86eef2f" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:12:45 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Updated the network info_cache for instance {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 12:12:45 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:12:45 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:12:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:12:46 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:12:46 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:12:46 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:12:47 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:12:47 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:12:47 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:12:47 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:12:47 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:12:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43eae335-a4a0-40b2-8cd4-c7881cd397b1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:48 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:12:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43eae335-a4a0-40b2-8cd4-c7881cd397b1/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43eae335-a4a0-40b2-8cd4-c7881cd397b1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43eae335-a4a0-40b2-8cd4-c7881cd397b1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:12:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972edb8d-69b8-4447-9170-1c1f73814345/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972edb8d-69b8-4447-9170-1c1f73814345/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972edb8d-69b8-4447-9170-1c1f73814345/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972edb8d-69b8-4447-9170-1c1f73814345/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dc9229a-61a8-4f45-b011-5bb3e89d63d1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dc9229a-61a8-4f45-b011-5bb3e89d63d1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dc9229a-61a8-4f45-b011-5bb3e89d63d1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dc9229a-61a8-4f45-b011-5bb3e89d63d1/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09d9af99-7d2c-4c14-b60a-d8d9a09a238a/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09d9af99-7d2c-4c14-b60a-d8d9a09a238a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09d9af99-7d2c-4c14-b60a-d8d9a09a238a/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09d9af99-7d2c-4c14-b60a-d8d9a09a238a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:12:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2a38d-14cf-4199-bb04-179ab4605a9e/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2a38d-14cf-4199-bb04-179ab4605a9e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2a38d-14cf-4199-bb04-179ab4605a9e/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b4b719f4-99d2-4d7b-8207-c6c04a5b4278 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Acquiring lock "3b10fda0-9488-4089-8033-dd1c8e42af89" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:12:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b4b719f4-99d2-4d7b-8207-c6c04a5b4278 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lock "3b10fda0-9488-4089-8033-dd1c8e42af89" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:12:49 user nova-compute[74840]: DEBUG nova.objects.instance [None req-b4b719f4-99d2-4d7b-8207-c6c04a5b4278 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lazy-loading 'flavor' on Instance uuid 3b10fda0-9488-4089-8033-dd1c8e42af89 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:12:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2a38d-14cf-4199-bb04-179ab4605a9e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b4b719f4-99d2-4d7b-8207-c6c04a5b4278 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lock "3b10fda0-9488-4089-8033-dd1c8e42af89" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.128s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:12:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b4b719f4-99d2-4d7b-8207-c6c04a5b4278 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Acquiring lock "3b10fda0-9488-4089-8033-dd1c8e42af89" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:12:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b4b719f4-99d2-4d7b-8207-c6c04a5b4278 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lock "3b10fda0-9488-4089-8033-dd1c8e42af89" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:12:50 user nova-compute[74840]: INFO nova.compute.manager [None req-b4b719f4-99d2-4d7b-8207-c6c04a5b4278 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Attaching volume 3d161c9a-4d64-4a8b-9525-225154403d22 to /dev/vdb
Nov 08 12:12:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/684b8be2-7f8f-499f-8885-c9d1c86eef2f/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:50 user nova-compute[74840]: DEBUG os_brick.utils [None req-b4b719f4-99d2-4d7b-8207-c6c04a5b4278 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:12:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:50 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3b6d1e-80dc-4aaf-97aa-5bede0ace19f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c8228a11e03c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:50 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe93efca-5487-4822-afea-f77c6cddbcf4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:50 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f719d43-feb5-4054-8dcf-1760f12e58ad]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:50 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1380956-5b3c-47a3-b10b-3496d9b3879e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-b4b719f4-99d2-4d7b-8207-c6c04a5b4278 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Running cmd (subprocess): nvme version {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-b4b719f4-99d2-4d7b-8207-c6c04a5b4278 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] 'nvme version' failed. Not Retrying. {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:12:50 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b4b719f4-99d2-4d7b-8207-c6c04a5b4278 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] nvme not present on system {{(pid=74840) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 12:12:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:12:50 user nova-compute[74840]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 12:12:50 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8796ade6-20af-435f-85f6-3d531e710f03]: (4, '') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:50 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-b4b719f4-99d2-4d7b-8207-c6c04a5b4278 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74840) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 12:12:50 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-b4b719f4-99d2-4d7b-8207-c6c04a5b4278 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 12:12:50 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-b4b719f4-99d2-4d7b-8207-c6c04a5b4278 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] LIGHTOS: no hostnqn found. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 12:12:50 user nova-compute[74840]: DEBUG os_brick.utils [None req-b4b719f4-99d2-4d7b-8207-c6c04a5b4278 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c8228a11e03c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:12:50 user nova-compute[74840]: DEBUG nova.virt.block_device [None req-b4b719f4-99d2-4d7b-8207-c6c04a5b4278 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Updating existing volume attachment record: 49eb3c79-af26-49f6-a789-6d144a73435d {{(pid=74840) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 12:12:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/684b8be2-7f8f-499f-8885-c9d1c86eef2f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/684b8be2-7f8f-499f-8885-c9d1c86eef2f/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/684b8be2-7f8f-499f-8885-c9d1c86eef2f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:51 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:12:51 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:12:51 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=7847MB free_disk=25.384021759033203GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:12:51 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:12:51 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:12:51 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 43eae335-a4a0-40b2-8cd4-c7881cd397b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:12:51 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 3b10fda0-9488-4089-8033-dd1c8e42af89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:12:51 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 684b8be2-7f8f-499f-8885-c9d1c86eef2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:12:51 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 58f2a38d-14cf-4199-bb04-179ab4605a9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:12:51 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 1dc9229a-61a8-4f45-b011-5bb3e89d63d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:12:51 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance d2dbd607-cf11-4d81-9639-c84e79d65fcd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:12:51 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 972edb8d-69b8-4447-9170-1c1f73814345 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:12:51 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 28ccd7b3-8bbe-42e7-aa00-612b3703ae79 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:12:51 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 09d9af99-7d2c-4c14-b60a-d8d9a09a238a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:12:51 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:12:51 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:12:51 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:12:51 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:12:51 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:12:51 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:12:51 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.579s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:12:52 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:12:52 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:12:52 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:12:53 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:12:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:12:59 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-d4b3f56d-0559-4eb1-b3f2-722b46cbccf4 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1dc9229a-61a8-4f45-b011-5bb3e89d63d1 is timed out.
Nov 08 12:12:59 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-d4b3f56d-0559-4eb1-b3f2-722b46cbccf4 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] Successfully detached device vdb from instance 1dc9229a-61a8-4f45-b011-5bb3e89d63d1 from the live domain config.
Nov 08 12:12:59 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4b3f56d-0559-4eb1-b3f2-722b46cbccf4 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 12:12:59 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4b3f56d-0559-4eb1-b3f2-722b46cbccf4 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:8c2e4313-24a9-43ea-8300-27d209de8fb4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uxoqcyAj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:12:59 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-d4b3f56d-0559-4eb1-b3f2-722b46cbccf4 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:12:59 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-d4b3f56d-0559-4eb1-b3f2-722b46cbccf4 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:12:59 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-d4b3f56d-0559-4eb1-b3f2-722b46cbccf4 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:12:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:59 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52f2526-0341-4253-8a5c-007c81b6bf2b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c2e4313-24a9-43ea-8300-27d209de8fb4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:59 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4b3f56d-0559-4eb1-b3f2-722b46cbccf4 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 12:12:59 user nova-compute[74840]: No targets found.
Nov 08 12:12:59 user nova-compute[74840]: iSNS:
Nov 08 12:12:59 user nova-compute[74840]: No targets found.
Nov 08 12:12:59 user nova-compute[74840]: STATIC:
Nov 08 12:12:59 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097
Nov 08 12:12:59 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:12:59 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:12:59 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9
Nov 08 12:12:59 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:12:59 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:12:59 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:8c2e4313-24a9-43ea-8300-27d209de8fb4
Nov 08 12:12:59 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:12:59 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:12:59 user nova-compute[74840]: FIRMWARE:
Nov 08 12:12:59 user nova-compute[74840]: No targets found.
Nov 08 12:12:59 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:12:59 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4b3f56d-0559-4eb1-b3f2-722b46cbccf4 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 12:12:59 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 12:12:59 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 12:12:59 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4b3f56d-0559-4eb1-b3f2-722b46cbccf4 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c2e4313-24a9-43ea-8300-27d209de8fb4', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 12:12:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:59 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c50fc2-8e4f-4a5c-9802-8cedf67a2034]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c2e4313-24a9-43ea-8300-27d209de8fb4\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.111s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:59 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30c5d4a-b7fe-4a1c-b803-6da8444833b9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c2e4313-24a9-43ea-8300-27d209de8fb4 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:59 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4b3f56d-0559-4eb1-b3f2-722b46cbccf4 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)
Nov 08 12:12:59 user nova-compute[74840]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)
Nov 08 12:12:59 user nova-compute[74840]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c2e4313-24a9-43ea-8300-27d209de8fb4 (non-flash)
Nov 08 12:12:59 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:12:59 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4b3f56d-0559-4eb1-b3f2-722b46cbccf4 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)
Nov 08 12:12:59 user nova-compute[74840]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)
Nov 08 12:12:59 user nova-compute[74840]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c2e4313-24a9-43ea-8300-27d209de8fb4 (non-flash)
Nov 08 12:12:59 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:12:59 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4b3f56d-0559-4eb1-b3f2-722b46cbccf4 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7d4677eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c2e4313-24a9-43ea-8300-27d209de8fb4'): ({'sdd'}, set())}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 12:12:59 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-d4b3f56d-0559-4eb1-b3f2-722b46cbccf4 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] Removing single pathed devices sdd {{(pid=74840) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 12:12:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:12:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:12:59 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3dec8b-622f-4612-a8f2-9031a927eccc]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:12:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.044s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:00 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f94cfe-c283-498a-9075-d4fce84af1e3]: (4, ('ok\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:00 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-d4b3f56d-0559-4eb1-b3f2-722b46cbccf4 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] Flushing IO for device /dev/sdd {{(pid=74840) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 12:13:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:00 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[4198af83-e227-4e32-b029-422023b2763f]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:00 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-d4b3f56d-0559-4eb1-b3f2-722b46cbccf4 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74840) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 12:13:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.073s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:00 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bb375e-e07a-44f9-806b-24f73d47604c]: (4, ('1', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:00 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-d4b3f56d-0559-4eb1-b3f2-722b46cbccf4 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 12:13:00 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-d4b3f56d-0559-4eb1-b3f2-722b46cbccf4 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] SCSI volumes sdd have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 12:13:00 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4b3f56d-0559-4eb1-b3f2-722b46cbccf4 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c2e4313-24a9-43ea-8300-27d209de8fb4')] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 12:13:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2e4313-24a9-43ea-8300-27d209de8fb4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2e4313-24a9-43ea-8300-27d209de8fb4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:00 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[363da427-62da-4f00-ad75-d62eb8eae868]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:00 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4b3f56d-0559-4eb1-b3f2-722b46cbccf4 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:13:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2e4313-24a9-43ea-8300-27d209de8fb4 -p 172.16.0.220:3260 --logout {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2e4313-24a9-43ea-8300-27d209de8fb4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:00 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1dcfc06-04b6-49dd-8aa0-1035e16d4e05]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:8c2e4313-24a9-43ea-8300-27d209de8fb4, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:8c2e4313-24a9-43ea-8300-27d209de8fb4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:00 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4b3f56d-0559-4eb1-b3f2-722b46cbccf4 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:8c2e4313-24a9-43ea-8300-27d209de8fb4, portal: 172.16.0.220,3260]
Nov 08 12:13:00 user nova-compute[74840]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:8c2e4313-24a9-43ea-8300-27d209de8fb4, portal: 172.16.0.220,3260] successful.
Nov 08 12:13:00 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:13:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c2e4313-24a9-43ea-8300-27d209de8fb4 -p 172.16.0.220:3260 --op delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c2e4313-24a9-43ea-8300-27d209de8fb4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:00 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c55050-02ef-4535-805b-96dfaa13a201]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:00 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4b3f56d-0559-4eb1-b3f2-722b46cbccf4 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:13:00 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-d4b3f56d-0559-4eb1-b3f2-722b46cbccf4 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.481s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:13:00 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4b3f56d-0559-4eb1-b3f2-722b46cbccf4 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] <== disconnect_volume: return (483ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:13:00 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4b3f56d-0559-4eb1-b3f2-722b46cbccf4 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 12:13:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:01 user nova-compute[74840]: DEBUG nova.objects.instance [None req-d4b3f56d-0559-4eb1-b3f2-722b46cbccf4 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] Lazy-loading 'flavor' on Instance uuid 1dc9229a-61a8-4f45-b011-5bb3e89d63d1 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:13:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d4b3f56d-0559-4eb1-b3f2-722b46cbccf4 tempest-VolumesAssistedSnapshotsTest-900201742 tempest-VolumesAssistedSnapshotsTest-900201742-project-admin] Lock "1dc9229a-61a8-4f45-b011-5bb3e89d63d1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.214s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:13:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:03 user nova-compute[74840]: DEBUG nova.compute.manager [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Start spawning the instance on the hypervisor. {{(pid=74840) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 12:13:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:13:03 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Creating image(s)
Nov 08 12:13:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Did not create local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 12:13:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Ensure instance console log exists: /opt/stack/data/nova/instances/d2dbd607-cf11-4d81-9639-c84e79d65fcd/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:13:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:13:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:13:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:13:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Start _get_guest_xml network_info=[{"id": "38640df8-91ab-4bb6-89f1-ac84843d0e1c", "address": "fa:16:3e:7b:5b:86", "network": {"id": "ab262498-b88d-4054-a45b-cd8fe41731e6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1982652154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38640df8-91", "ovs_interfaceid": "38640df8-91ab-4bb6-89f1-ac84843d0e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "65988447-7cce-4be7-87dd-4fd49e351040", "address": "fa:16:3e:92:b6:34", "network": {"id": "4998659b-781d-44e7-9601-d14cd5e39410", "bridge": "br-int", "label": "tempest-device-tagging-net1-756241958", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65988447-7c", "ovs_interfaceid": "65988447-7cce-4be7-87dd-4fd49e351040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3e6aa660-8be2-44d4-aece-59b38a00ff02", "address": "fa:16:3e:25:8f:ae", "network": {"id": "4998659b-781d-44e7-9601-d14cd5e39410", "bridge": "br-int", "label": "tempest-device-tagging-net1-756241958", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e6aa660-8b", "ovs_interfaceid": "3e6aa660-8be2-44d4-aece-59b38a00ff02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7a2393a4-2d55-49cc-b4af-189d3ab24c1e", "address": "fa:16:3e:64:5a:54", "network": {"id": "4998659b-781d-44e7-9601-d14cd5e39410", "bridge": "br-int", "label": "tempest-device-tagging-net1-756241958", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2393a4-2d", "ovs_interfaceid": "7a2393a4-2d55-49cc-b4af-189d3ab24c1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "77c96b94-7c85-4356-8da8-bb90854ead5e", "address": "fa:16:3e:21:2e:ad", "network": {"id": "4998659b-781d-44e7-9601-d14cd5e39410", "bridge": "br-int", "label": "tempest-device-tagging-net1-756241958", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c96b94-7c", "ovs_interfaceid": "77c96b94-7c85-4356-8da8-bb90854ead5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0f88f24e-b28a-4e36-bef3-1fa13084f370", "address": "fa:16:3e:c4:eb:48", "network": {"id": "2242fb46-3f42-4d3e-808c-ebdd55268fe5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388499652", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f88f24e-b2", "ovs_interfaceid": "0f88f24e-b28a-4e36-bef3-1fa13084f370", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b80b0e8d-2bc7-4e85-8843-c9d8c7931014", "address": "fa:16:3e:0b:f1:33", "network": {"id": "2242fb46-3f42-4d3e-808c-ebdd55268fe5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388499652", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb80b0e8d-2b", "ovs_interfaceid": "b80b0e8d-2bc7-4e85-8843-c9d8c7931014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'cd07f780-a8b4-4c4a-9a81-9f4c2ac41d5b', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uBlitSAY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd2dbd607-cf11-4d81-9639-c84e79d65fcd', 'attached_at': '', 'detached_at': '', 'volume_id': 'dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc', 'serial': 'dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc'}, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None}, {'attachment_id': 'f9d2fc80-42e8-4e6f-aea7-11c13279c7a5', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cQTWzeVq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd2dbd607-cf11-4d81-9639-c84e79d65fcd', 'attached_at': '', 'detached_at': '', 'volume_id': 'ae8e04aa-d9df-41b6-bbc3-146d58486e6b', 'serial': 'ae8e04aa-d9df-41b6-bbc3-146d58486e6b'}, 'boot_index': 1, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'volume_type': None}, {'attachment_id': '654bf1d1-80a7-4ecb-a9f3-10d2490696e2', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JPZiVOCl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd2dbd607-cf11-4d81-9639-c84e79d65fcd', 'attached_at': '', 'detached_at': '', 'volume_id': '644305b8-0b29-4439-920c-b802be80bd60', 'serial': '644305b8-0b29-4439-920c-b802be80bd60'}, 'boot_index': 2, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:13:03 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:13:03 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:13:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:13:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:13:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:13:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:13:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:13:03 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:13:03 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:13:03 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:13:03 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:13:03 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:13:03 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:13:03 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:13:03 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:13:03 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:13:03 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:13:03 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:13:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Calling os-brick to attach iSCSI Volume {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 12:13:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uBlitSAY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:13:03 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:13:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:13:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:13:03 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:13:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:13:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:13:03 user nova-compute[74840]: INFO os_brick.initiator.connectors.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 12:13:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc -p 172.16.0.220:3260 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:03 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[670e1a88-d619-475b-af55-66a6de8e4ac8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 12:13:03 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:13:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc -p 172.16.0.220:3260 --interface default --op new {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:03 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[254a2e8c-cc55-4022-85d4-359c9ee4f167]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc] added\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc] added
Nov 08 12:13:03 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:13:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:03 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b97560f-a268-46f4-9a90-23e6489d5bc1]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:13:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:03 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d14961f-46c1-4f96-ac59-9cba6a28f2a3]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:13:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uBlitSAY {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uBlitSAY" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:03 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb86e84f-5e62-453c-838d-37980b1a6111]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uBlitSAY'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:13:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:03 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0f9aef-7e96-4238-91a6-34f21e22d74f]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:13:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:04 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece095b8-dcfa-464d-b9a1-0c835f61816a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:04 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)
Nov 08 12:13:04 user nova-compute[74840]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)
Nov 08 12:13:04 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:13:04 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)
Nov 08 12:13:04 user nova-compute[74840]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)
Nov 08 12:13:04 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:13:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc -p 172.16.0.220:3260 --login {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:04 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8686d1ef-6363-45f4-b125-bee7b8b43c75]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:04 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc, portal: 172.16.0.220,3260]
Nov 08 12:13:04 user nova-compute[74840]: Login to [iface: default, target: iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc, portal: 172.16.0.220,3260] successful.
Nov 08 12:13:04 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:13:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:04 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[df05ce0a-9e1d-4130-b958-9d5ec42542c8]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:04 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:13:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:04 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e1cc18-2448-40db-96ac-922d9c65daa9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:04 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)
Nov 08 12:13:04 user nova-compute[74840]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)
Nov 08 12:13:04 user nova-compute[74840]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc (non-flash)
Nov 08 12:13:04 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:13:04 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)
Nov 08 12:13:04 user nova-compute[74840]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)
Nov 08 12:13:04 user nova-compute[74840]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc (non-flash)
Nov 08 12:13:04 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:13:04 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:13:04 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Connected to 172.16.0.220:3260 {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 12:13:04 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] HCTL ('35', '-', '-', 0) found on session 7 with lun 0 {{(pid=74840) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 12:13:04 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74840) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 12:13:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:04 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfe6648-537e-4029-be7b-45ffd6c7aec6]: (4, ('- - 0', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:04 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Searching for a device in session 7 and hctl ['35', '*', '*', 0] yield: None {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Searching for a device in session 7 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uBlitSAY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23237323935616562', 'path': '/dev/sdd'} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237323935616562', 'path': '/dev/sdd'} {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Calling os-brick to attach iSCSI Volume {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cQTWzeVq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:13:05 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:13:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:13:05 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:13:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:13:05 user nova-compute[74840]: INFO os_brick.initiator.connectors.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 12:13:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b -p 172.16.0.220:3260 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a22b63-8928-4126-94b8-f255ca36956e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 12:13:05 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b -p 172.16.0.220:3260 --interface default --op new {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5261a4cd-9e0c-4f10-a35d-cf8f2b4cc482]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b] added\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b] added
Nov 08 12:13:05 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3232fb-6f09-406c-aae3-3af4d44414aa]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af868e4-073a-4ea5-acb0-14250672d64c]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cQTWzeVq {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cQTWzeVq" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21f8eaf-9288-4a03-988f-bea4dabde882]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cQTWzeVq'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8be5039-d3d2-4f42-8ecf-fcffa77de11e]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bb4595-934b-4fbd-8215-d371ef2df97c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)
Nov 08 12:13:05 user nova-compute[74840]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)
Nov 08 12:13:05 user nova-compute[74840]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc (non-flash)
Nov 08 12:13:05 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)
Nov 08 12:13:05 user nova-compute[74840]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)
Nov 08 12:13:05 user nova-compute[74840]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc (non-flash)
Nov 08 12:13:05 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b -p 172.16.0.220:3260 --login {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[deec3222-7674-4a64-8cde-d3e8748caf83]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b, portal: 172.16.0.220,3260]
Nov 08 12:13:05 user nova-compute[74840]: Login to [iface: default, target: iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b, portal: 172.16.0.220,3260] successful.
Nov 08 12:13:05 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9808a34-5fe2-4262-98c6-9a7a140892ad]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3164a62b-02d2-4375-9e66-13b4402aee16]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)
Nov 08 12:13:05 user nova-compute[74840]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)
Nov 08 12:13:05 user nova-compute[74840]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc (non-flash)
Nov 08 12:13:05 user nova-compute[74840]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b (non-flash)
Nov 08 12:13:05 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)
Nov 08 12:13:05 user nova-compute[74840]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)
Nov 08 12:13:05 user nova-compute[74840]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc (non-flash)
Nov 08 12:13:05 user nova-compute[74840]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b (non-flash)
Nov 08 12:13:05 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Connected to 172.16.0.220:3260 {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] HCTL ('36', '-', '-', 0) found on session 8 with lun 0 {{(pid=74840) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74840) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fce6d71-eac9-4f73-8af2-dca660562b7f]: (4, ('- - 0', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Searching for a device in session 8 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:13:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cQTWzeVq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '26263613037343938', 'path': '/dev/sde'} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263613037343938', 'path': '/dev/sde'} {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Calling os-brick to attach iSCSI Volume {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JPZiVOCl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:13:06 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:13:06 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:13:06 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:13:06 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:13:06 user nova-compute[74840]: INFO os_brick.initiator.connectors.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 12:13:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60 -p 172.16.0.220:3260 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae16cef0-3d4a-477c-a506-a9b42f4a4a4d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 12:13:06 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60 -p 172.16.0.220:3260 --interface default --op new {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1cf65d-d811-405f-9361-cc0372e2dc3f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60] added\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60] added
Nov 08 12:13:06 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3084c5da-d545-409d-8f1c-e4e2519570a1]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5663b420-08b7-45da-8d52-be7a5e244814]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JPZiVOCl {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JPZiVOCl" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c2c800-a9a4-46df-9363-68ec35bab8ed]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JPZiVOCl'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf2bab8-50d8-4965-9c58-0068c23e9f94]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c157a72b-bf77-4bd8-8063-9126e625e0a4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)
Nov 08 12:13:06 user nova-compute[74840]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)
Nov 08 12:13:06 user nova-compute[74840]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc (non-flash)
Nov 08 12:13:06 user nova-compute[74840]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b (non-flash)
Nov 08 12:13:06 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)
Nov 08 12:13:06 user nova-compute[74840]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)
Nov 08 12:13:06 user nova-compute[74840]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc (non-flash)
Nov 08 12:13:06 user nova-compute[74840]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b (non-flash)
Nov 08 12:13:06 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60 -p 172.16.0.220:3260 --login {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[38df8d74-c0db-4026-a6a9-376853bda27d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60, portal: 172.16.0.220,3260]
Nov 08 12:13:06 user nova-compute[74840]: Login to [iface: default, target: iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60, portal: 172.16.0.220,3260] successful.
Nov 08 12:13:06 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4eb2d80-72b0-43ce-af15-79b58a38d716]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[154b41a9-aff2-4730-950b-48298f193980]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)
Nov 08 12:13:06 user nova-compute[74840]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)
Nov 08 12:13:06 user nova-compute[74840]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc (non-flash)
Nov 08 12:13:06 user nova-compute[74840]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b (non-flash)
Nov 08 12:13:06 user nova-compute[74840]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60 (non-flash)
Nov 08 12:13:06 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)
Nov 08 12:13:06 user nova-compute[74840]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)
Nov 08 12:13:06 user nova-compute[74840]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc (non-flash)
Nov 08 12:13:06 user nova-compute[74840]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b (non-flash)
Nov 08 12:13:06 user nova-compute[74840]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60 (non-flash)
Nov 08 12:13:06 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Connected to 172.16.0.220:3260 {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] HCTL ('37', '-', '-', 0) found on session 9 with lun 0 {{(pid=74840) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74840) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6afb53-07fd-4ad0-9434-5c23bac665c3]: (4, ('- - 0', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Searching for a device in session 9 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:13:06 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JPZiVOCl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 12:13:07 user nova-compute[74840]: DEBUG nova.compute.manager [req-66284ec7-c028-42fd-90e9-aba22ee4679c req-83dae9ce-0245-4283-b3a2-6c458ee1f6f4 service nova] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Received event network-changed-804195be-3aed-40e6-9d0a-954fd997af14 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:13:07 user nova-compute[74840]: DEBUG nova.compute.manager [req-66284ec7-c028-42fd-90e9-aba22ee4679c req-83dae9ce-0245-4283-b3a2-6c458ee1f6f4 service nova] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Refreshing instance network info cache due to event network-changed-804195be-3aed-40e6-9d0a-954fd997af14. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:13:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-66284ec7-c028-42fd-90e9-aba22ee4679c req-83dae9ce-0245-4283-b3a2-6c458ee1f6f4 service nova] Acquiring lock "refresh_cache-972edb8d-69b8-4447-9170-1c1f73814345" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:13:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-66284ec7-c028-42fd-90e9-aba22ee4679c req-83dae9ce-0245-4283-b3a2-6c458ee1f6f4 service nova] Acquired lock "refresh_cache-972edb8d-69b8-4447-9170-1c1f73814345" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:13:07 user nova-compute[74840]: DEBUG nova.network.neutron [req-66284ec7-c028-42fd-90e9-aba22ee4679c req-83dae9ce-0245-4283-b3a2-6c458ee1f6f4 service nova] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Refreshing network info cache for port 804195be-3aed-40e6-9d0a-954fd997af14 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:13:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-179872d8-71b1-4541-92b2-a396d58e5454 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "972edb8d-69b8-4447-9170-1c1f73814345" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:13:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-179872d8-71b1-4541-92b2-a396d58e5454 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "972edb8d-69b8-4447-9170-1c1f73814345" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:13:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-179872d8-71b1-4541-92b2-a396d58e5454 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "972edb8d-69b8-4447-9170-1c1f73814345-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:13:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-179872d8-71b1-4541-92b2-a396d58e5454 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "972edb8d-69b8-4447-9170-1c1f73814345-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:13:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-179872d8-71b1-4541-92b2-a396d58e5454 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "972edb8d-69b8-4447-9170-1c1f73814345-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:13:07 user nova-compute[74840]: INFO nova.compute.manager [None req-179872d8-71b1-4541-92b2-a396d58e5454 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Terminating instance
Nov 08 12:13:07 user nova-compute[74840]: DEBUG nova.compute.manager [None req-179872d8-71b1-4541-92b2-a396d58e5454 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Start destroying the instance on the hypervisor. {{(pid=74840) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 12:13:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:07 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.406s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:13:07 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] <== connect_volume: return (1407ms) {'type': 'block', 'scsi_wwn': '26366366239626235', 'path': '/dev/sdf'} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:13:07 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366366239626235', 'path': '/dev/sdf'} {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-467103825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-467103825',id=8,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZ5yB12feWvkkDrgRcMY7Hf4hO2W8Ls+no6Z45U+6vRbA1JCzU/OYbpBDI5J0S8zB8PP4ZuBH44tWe6fFVP49DWG3e3HxIQhdUjQvyeS1NhY7Ma9aKJ221mPUbEhRS7/Q==',key_name='tempest-keypair-1810663950',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71995e354fd546fd8d41823c548b1a22',ramdisk_id='',reservation_id='r-8aydahek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-403652028',owner_user_name='tempest-TaggedBootDevicesTest-403652028-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2856d02455a4163a74b4f5956719920',uuid=d2dbd607-cf11-4d81-9639-c84e79d65fcd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38640df8-91ab-4bb6-89f1-ac84843d0e1c", "address": "fa:16:3e:7b:5b:86", "network": {"id": "ab262498-b88d-4054-a45b-cd8fe41731e6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1982652154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38640df8-91", "ovs_interfaceid": "38640df8-91ab-4bb6-89f1-ac84843d0e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Converting VIF {"id": "38640df8-91ab-4bb6-89f1-ac84843d0e1c", "address": "fa:16:3e:7b:5b:86", "network": {"id": "ab262498-b88d-4054-a45b-cd8fe41731e6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1982652154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38640df8-91", "ovs_interfaceid": "38640df8-91ab-4bb6-89f1-ac84843d0e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:5b:86,bridge_name='br-int',has_traffic_filtering=True,id=38640df8-91ab-4bb6-89f1-ac84843d0e1c,network=Network(ab262498-b88d-4054-a45b-cd8fe41731e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38640df8-91') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-467103825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-467103825',id=8,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZ5yB12feWvkkDrgRcMY7Hf4hO2W8Ls+no6Z45U+6vRbA1JCzU/OYbpBDI5J0S8zB8PP4ZuBH44tWe6fFVP49DWG3e3HxIQhdUjQvyeS1NhY7Ma9aKJ221mPUbEhRS7/Q==',key_name='tempest-keypair-1810663950',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71995e354fd546fd8d41823c548b1a22',ramdisk_id='',reservation_id='r-8aydahek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-403652028',owner_user_name='tempest-TaggedBootDevicesTest-403652028-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2856d02455a4163a74b4f5956719920',uuid=d2dbd607-cf11-4d81-9639-c84e79d65fcd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65988447-7cce-4be7-87dd-4fd49e351040", "address": "fa:16:3e:92:b6:34", "network": {"id": "4998659b-781d-44e7-9601-d14cd5e39410", "bridge": "br-int", "label": "tempest-device-tagging-net1-756241958", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65988447-7c", "ovs_interfaceid": "65988447-7cce-4be7-87dd-4fd49e351040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Converting VIF {"id": "65988447-7cce-4be7-87dd-4fd49e351040", "address": "fa:16:3e:92:b6:34", "network": {"id": "4998659b-781d-44e7-9601-d14cd5e39410", "bridge": "br-int", "label": "tempest-device-tagging-net1-756241958", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65988447-7c", "ovs_interfaceid": "65988447-7cce-4be7-87dd-4fd49e351040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:b6:34,bridge_name='br-int',has_traffic_filtering=True,id=65988447-7cce-4be7-87dd-4fd49e351040,network=Network(4998659b-781d-44e7-9601-d14cd5e39410),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap65988447-7c') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-467103825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-467103825',id=8,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZ5yB12feWvkkDrgRcMY7Hf4hO2W8Ls+no6Z45U+6vRbA1JCzU/OYbpBDI5J0S8zB8PP4ZuBH44tWe6fFVP49DWG3e3HxIQhdUjQvyeS1NhY7Ma9aKJ221mPUbEhRS7/Q==',key_name='tempest-keypair-1810663950',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71995e354fd546fd8d41823c548b1a22',ramdisk_id='',reservation_id='r-8aydahek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-403652028',owner_user_name='tempest-TaggedBootDevicesTest-403652028-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2856d02455a4163a74b4f5956719920',uuid=d2dbd607-cf11-4d81-9639-c84e79d65fcd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e6aa660-8be2-44d4-aece-59b38a00ff02", "address": "fa:16:3e:25:8f:ae", "network": {"id": "4998659b-781d-44e7-9601-d14cd5e39410", "bridge": "br-int", "label": "tempest-device-tagging-net1-756241958", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e6aa660-8b", "ovs_interfaceid": "3e6aa660-8be2-44d4-aece-59b38a00ff02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Converting VIF {"id": "3e6aa660-8be2-44d4-aece-59b38a00ff02", "address": "fa:16:3e:25:8f:ae", "network": {"id": "4998659b-781d-44e7-9601-d14cd5e39410", "bridge": "br-int", "label": "tempest-device-tagging-net1-756241958", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e6aa660-8b", "ovs_interfaceid": "3e6aa660-8be2-44d4-aece-59b38a00ff02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:8f:ae,bridge_name='br-int',has_traffic_filtering=True,id=3e6aa660-8be2-44d4-aece-59b38a00ff02,network=Network(4998659b-781d-44e7-9601-d14cd5e39410),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3e6aa660-8b') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-467103825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-467103825',id=8,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZ5yB12feWvkkDrgRcMY7Hf4hO2W8Ls+no6Z45U+6vRbA1JCzU/OYbpBDI5J0S8zB8PP4ZuBH44tWe6fFVP49DWG3e3HxIQhdUjQvyeS1NhY7Ma9aKJ221mPUbEhRS7/Q==',key_name='tempest-keypair-1810663950',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71995e354fd546fd8d41823c548b1a22',ramdisk_id='',reservation_id='r-8aydahek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-403652028',owner_user_name='tempest-TaggedBootDevicesTest-403652028-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2856d02455a4163a74b4f5956719920',uuid=d2dbd607-cf11-4d81-9639-c84e79d65fcd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a2393a4-2d55-49cc-b4af-189d3ab24c1e", "address": "fa:16:3e:64:5a:54", "network": {"id": "4998659b-781d-44e7-9601-d14cd5e39410", "bridge": "br-int", "label": "tempest-device-tagging-net1-756241958", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2393a4-2d", "ovs_interfaceid": "7a2393a4-2d55-49cc-b4af-189d3ab24c1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Converting VIF {"id": "7a2393a4-2d55-49cc-b4af-189d3ab24c1e", "address": "fa:16:3e:64:5a:54", "network": {"id": "4998659b-781d-44e7-9601-d14cd5e39410", "bridge": "br-int", "label": "tempest-device-tagging-net1-756241958", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2393a4-2d", "ovs_interfaceid": "7a2393a4-2d55-49cc-b4af-189d3ab24c1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:5a:54,bridge_name='br-int',has_traffic_filtering=True,id=7a2393a4-2d55-49cc-b4af-189d3ab24c1e,network=Network(4998659b-781d-44e7-9601-d14cd5e39410),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a2393a4-2d') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-467103825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-467103825',id=8,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZ5yB12feWvkkDrgRcMY7Hf4hO2W8Ls+no6Z45U+6vRbA1JCzU/OYbpBDI5J0S8zB8PP4ZuBH44tWe6fFVP49DWG3e3HxIQhdUjQvyeS1NhY7Ma9aKJ221mPUbEhRS7/Q==',key_name='tempest-keypair-1810663950',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71995e354fd546fd8d41823c548b1a22',ramdisk_id='',reservation_id='r-8aydahek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-403652028',owner_user_name='tempest-TaggedBootDevicesTest-403652028-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2856d02455a4163a74b4f5956719920',uuid=d2dbd607-cf11-4d81-9639-c84e79d65fcd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77c96b94-7c85-4356-8da8-bb90854ead5e", "address": "fa:16:3e:21:2e:ad", "network": {"id": "4998659b-781d-44e7-9601-d14cd5e39410", "bridge": "br-int", "label": "tempest-device-tagging-net1-756241958", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c96b94-7c", "ovs_interfaceid": "77c96b94-7c85-4356-8da8-bb90854ead5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Converting VIF {"id": "77c96b94-7c85-4356-8da8-bb90854ead5e", "address": "fa:16:3e:21:2e:ad", "network": {"id": "4998659b-781d-44e7-9601-d14cd5e39410", "bridge": "br-int", "label": "tempest-device-tagging-net1-756241958", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c96b94-7c", "ovs_interfaceid": "77c96b94-7c85-4356-8da8-bb90854ead5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:2e:ad,bridge_name='br-int',has_traffic_filtering=True,id=77c96b94-7c85-4356-8da8-bb90854ead5e,network=Network(4998659b-781d-44e7-9601-d14cd5e39410),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77c96b94-7c') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-467103825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-467103825',id=8,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZ5yB12feWvkkDrgRcMY7Hf4hO2W8Ls+no6Z45U+6vRbA1JCzU/OYbpBDI5J0S8zB8PP4ZuBH44tWe6fFVP49DWG3e3HxIQhdUjQvyeS1NhY7Ma9aKJ221mPUbEhRS7/Q==',key_name='tempest-keypair-1810663950',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71995e354fd546fd8d41823c548b1a22',ramdisk_id='',reservation_id='r-8aydahek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-403652028',owner_user_name='tempest-TaggedBootDevicesTest-403652028-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2856d02455a4163a74b4f5956719920',uuid=d2dbd607-cf11-4d81-9639-c84e79d65fcd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f88f24e-b28a-4e36-bef3-1fa13084f370", "address": "fa:16:3e:c4:eb:48", "network": {"id": "2242fb46-3f42-4d3e-808c-ebdd55268fe5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388499652", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f88f24e-b2", "ovs_interfaceid": "0f88f24e-b28a-4e36-bef3-1fa13084f370", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Converting VIF {"id": "0f88f24e-b28a-4e36-bef3-1fa13084f370", "address": "fa:16:3e:c4:eb:48", "network": {"id": "2242fb46-3f42-4d3e-808c-ebdd55268fe5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388499652", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f88f24e-b2", "ovs_interfaceid": "0f88f24e-b28a-4e36-bef3-1fa13084f370", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:eb:48,bridge_name='br-int',has_traffic_filtering=True,id=0f88f24e-b28a-4e36-bef3-1fa13084f370,network=Network(2242fb46-3f42-4d3e-808c-ebdd55268fe5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f88f24e-b2') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-467103825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-467103825',id=8,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZ5yB12feWvkkDrgRcMY7Hf4hO2W8Ls+no6Z45U+6vRbA1JCzU/OYbpBDI5J0S8zB8PP4ZuBH44tWe6fFVP49DWG3e3HxIQhdUjQvyeS1NhY7Ma9aKJ221mPUbEhRS7/Q==',key_name='tempest-keypair-1810663950',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71995e354fd546fd8d41823c548b1a22',ramdisk_id='',reservation_id='r-8aydahek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-403652028',owner_user_name='tempest-TaggedBootDevicesTest-403652028-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2856d02455a4163a74b4f5956719920',uuid=d2dbd607-cf11-4d81-9639-c84e79d65fcd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b80b0e8d-2bc7-4e85-8843-c9d8c7931014", "address": "fa:16:3e:0b:f1:33", "network": {"id": "2242fb46-3f42-4d3e-808c-ebdd55268fe5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388499652", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb80b0e8d-2b", "ovs_interfaceid": "b80b0e8d-2bc7-4e85-8843-c9d8c7931014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Converting VIF {"id": "b80b0e8d-2bc7-4e85-8843-c9d8c7931014", "address": "fa:16:3e:0b:f1:33", "network": {"id": "2242fb46-3f42-4d3e-808c-ebdd55268fe5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388499652", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb80b0e8d-2b", "ovs_interfaceid": "b80b0e8d-2bc7-4e85-8843-c9d8c7931014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:f1:33,bridge_name='br-int',has_traffic_filtering=True,id=b80b0e8d-2bc7-4e85-8843-c9d8c7931014,network=Network(2242fb46-3f42-4d3e-808c-ebdd55268fe5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb80b0e8d-2b') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG nova.objects.instance [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Lazy-loading 'pci_devices' on Instance uuid d2dbd607-cf11-4d81-9639-c84e79d65fcd {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:13:08 user nova-compute[74840]:   <uuid>d2dbd607-cf11-4d81-9639-c84e79d65fcd</uuid>
Nov 08 12:13:08 user nova-compute[74840]:   <name>instance-00000008</name>
Nov 08 12:13:08 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:13:08 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:13:08 user nova-compute[74840]:   <metadata>
Nov 08 12:13:08 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:13:08 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:13:08 user nova-compute[74840]:       <nova:name>tempest-device-tagging-server-467103825</nova:name>
Nov 08 12:13:08 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:13:03</nova:creationTime>
Nov 08 12:13:08 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:13:08 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:13:08 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:13:08 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:13:08 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:13:08 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:13:08 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:13:08 user nova-compute[74840]:       <nova:owner>
Nov 08 12:13:08 user nova-compute[74840]:         <nova:user uuid="c2856d02455a4163a74b4f5956719920">tempest-TaggedBootDevicesTest-403652028-project-member</nova:user>
Nov 08 12:13:08 user nova-compute[74840]:         <nova:project uuid="71995e354fd546fd8d41823c548b1a22">tempest-TaggedBootDevicesTest-403652028</nova:project>
Nov 08 12:13:08 user nova-compute[74840]:       </nova:owner>
Nov 08 12:13:08 user nova-compute[74840]:       <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:13:08 user nova-compute[74840]:       <nova:ports>
Nov 08 12:13:08 user nova-compute[74840]:         <nova:port uuid="38640df8-91ab-4bb6-89f1-ac84843d0e1c">
Nov 08 12:13:08 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 12:13:08 user nova-compute[74840]:         </nova:port>
Nov 08 12:13:08 user nova-compute[74840]:         <nova:port uuid="65988447-7cce-4be7-87dd-4fd49e351040">
Nov 08 12:13:08 user nova-compute[74840]:           <nova:ip type="fixed" address="10.1.1.3" ipVersion="4"/>
Nov 08 12:13:08 user nova-compute[74840]:         </nova:port>
Nov 08 12:13:08 user nova-compute[74840]:         <nova:port uuid="3e6aa660-8be2-44d4-aece-59b38a00ff02">
Nov 08 12:13:08 user nova-compute[74840]:           <nova:ip type="fixed" address="10.1.1.211" ipVersion="4"/>
Nov 08 12:13:08 user nova-compute[74840]:         </nova:port>
Nov 08 12:13:08 user nova-compute[74840]:         <nova:port uuid="7a2393a4-2d55-49cc-b4af-189d3ab24c1e">
Nov 08 12:13:08 user nova-compute[74840]:           <nova:ip type="fixed" address="10.1.1.210" ipVersion="4"/>
Nov 08 12:13:08 user nova-compute[74840]:         </nova:port>
Nov 08 12:13:08 user nova-compute[74840]:         <nova:port uuid="77c96b94-7c85-4356-8da8-bb90854ead5e">
Nov 08 12:13:08 user nova-compute[74840]:           <nova:ip type="fixed" address="10.1.1.118" ipVersion="4"/>
Nov 08 12:13:08 user nova-compute[74840]:         </nova:port>
Nov 08 12:13:08 user nova-compute[74840]:         <nova:port uuid="0f88f24e-b28a-4e36-bef3-1fa13084f370">
Nov 08 12:13:08 user nova-compute[74840]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 08 12:13:08 user nova-compute[74840]:         </nova:port>
Nov 08 12:13:08 user nova-compute[74840]:         <nova:port uuid="b80b0e8d-2bc7-4e85-8843-c9d8c7931014">
Nov 08 12:13:08 user nova-compute[74840]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 08 12:13:08 user nova-compute[74840]:         </nova:port>
Nov 08 12:13:08 user nova-compute[74840]:       </nova:ports>
Nov 08 12:13:08 user nova-compute[74840]:     </nova:instance>
Nov 08 12:13:08 user nova-compute[74840]:   </metadata>
Nov 08 12:13:08 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:13:08 user nova-compute[74840]:     <system>
Nov 08 12:13:08 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:13:08 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:13:08 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:13:08 user nova-compute[74840]:       <entry name="serial">d2dbd607-cf11-4d81-9639-c84e79d65fcd</entry>
Nov 08 12:13:08 user nova-compute[74840]:       <entry name="uuid">d2dbd607-cf11-4d81-9639-c84e79d65fcd</entry>
Nov 08 12:13:08 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:13:08 user nova-compute[74840]:     </system>
Nov 08 12:13:08 user nova-compute[74840]:   </sysinfo>
Nov 08 12:13:08 user nova-compute[74840]:   <os>
Nov 08 12:13:08 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:13:08 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:13:08 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:13:08 user nova-compute[74840]:   </os>
Nov 08 12:13:08 user nova-compute[74840]:   <features>
Nov 08 12:13:08 user nova-compute[74840]:     <acpi/>
Nov 08 12:13:08 user nova-compute[74840]:     <apic/>
Nov 08 12:13:08 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:13:08 user nova-compute[74840]:   </features>
Nov 08 12:13:08 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:13:08 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:13:08 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:13:08 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:13:08 user nova-compute[74840]:   </clock>
Nov 08 12:13:08 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:13:08 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:13:08 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:13:08 user nova-compute[74840]:   </cpu>
Nov 08 12:13:08 user nova-compute[74840]:   <devices>
Nov 08 12:13:08 user nova-compute[74840]:     <disk type="file" device="cdrom">
Nov 08 12:13:08 user nova-compute[74840]:       <driver name="qemu" type="raw" cache="none"/>
Nov 08 12:13:08 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/d2dbd607-cf11-4d81-9639-c84e79d65fcd/disk.config"/>
Nov 08 12:13:08 user nova-compute[74840]:       <target dev="hda" bus="ide"/>
Nov 08 12:13:08 user nova-compute[74840]:     </disk>
Nov 08 12:13:08 user nova-compute[74840]:     <disk type="block" device="disk">
Nov 08 12:13:08 user nova-compute[74840]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:13:08 user nova-compute[74840]:       <source dev="/dev/sdd"/>
Nov 08 12:13:08 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:13:08 user nova-compute[74840]:       <serial>dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc</serial>
Nov 08 12:13:08 user nova-compute[74840]:     </disk>
Nov 08 12:13:08 user nova-compute[74840]:     <disk type="block" device="disk">
Nov 08 12:13:08 user nova-compute[74840]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:13:08 user nova-compute[74840]:       <source dev="/dev/sde"/>
Nov 08 12:13:08 user nova-compute[74840]:       <target dev="vdb" bus="virtio"/>
Nov 08 12:13:08 user nova-compute[74840]:       <serial>ae8e04aa-d9df-41b6-bbc3-146d58486e6b</serial>
Nov 08 12:13:08 user nova-compute[74840]:     </disk>
Nov 08 12:13:08 user nova-compute[74840]:     <disk type="block" device="disk">
Nov 08 12:13:08 user nova-compute[74840]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:13:08 user nova-compute[74840]:       <source dev="/dev/sdf"/>
Nov 08 12:13:08 user nova-compute[74840]:       <target dev="vdc" bus="virtio"/>
Nov 08 12:13:08 user nova-compute[74840]:       <serial>644305b8-0b29-4439-920c-b802be80bd60</serial>
Nov 08 12:13:08 user nova-compute[74840]:     </disk>
Nov 08 12:13:08 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:13:08 user nova-compute[74840]:       <mac address="fa:16:3e:7b:5b:86"/>
Nov 08 12:13:08 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:13:08 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:13:08 user nova-compute[74840]:       <target dev="tap38640df8-91"/>
Nov 08 12:13:08 user nova-compute[74840]:     </interface>
Nov 08 12:13:08 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:13:08 user nova-compute[74840]:       <mac address="fa:16:3e:92:b6:34"/>
Nov 08 12:13:08 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:13:08 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:13:08 user nova-compute[74840]:       <target dev="tap65988447-7c"/>
Nov 08 12:13:08 user nova-compute[74840]:     </interface>
Nov 08 12:13:08 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:13:08 user nova-compute[74840]:       <mac address="fa:16:3e:25:8f:ae"/>
Nov 08 12:13:08 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:13:08 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:13:08 user nova-compute[74840]:       <target dev="tap3e6aa660-8b"/>
Nov 08 12:13:08 user nova-compute[74840]:     </interface>
Nov 08 12:13:08 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:13:08 user nova-compute[74840]:       <mac address="fa:16:3e:64:5a:54"/>
Nov 08 12:13:08 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:13:08 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:13:08 user nova-compute[74840]:       <target dev="tap7a2393a4-2d"/>
Nov 08 12:13:08 user nova-compute[74840]:     </interface>
Nov 08 12:13:08 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:13:08 user nova-compute[74840]:       <mac address="fa:16:3e:21:2e:ad"/>
Nov 08 12:13:08 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:13:08 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:13:08 user nova-compute[74840]:       <target dev="tap77c96b94-7c"/>
Nov 08 12:13:08 user nova-compute[74840]:     </interface>
Nov 08 12:13:08 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:13:08 user nova-compute[74840]:       <mac address="fa:16:3e:c4:eb:48"/>
Nov 08 12:13:08 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:13:08 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:13:08 user nova-compute[74840]:       <target dev="tap0f88f24e-b2"/>
Nov 08 12:13:08 user nova-compute[74840]:     </interface>
Nov 08 12:13:08 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:13:08 user nova-compute[74840]:       <mac address="fa:16:3e:0b:f1:33"/>
Nov 08 12:13:08 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:13:08 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:13:08 user nova-compute[74840]:       <target dev="tapb80b0e8d-2b"/>
Nov 08 12:13:08 user nova-compute[74840]:     </interface>
Nov 08 12:13:08 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:13:08 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/d2dbd607-cf11-4d81-9639-c84e79d65fcd/console.log" append="off"/>
Nov 08 12:13:08 user nova-compute[74840]:     </serial>
Nov 08 12:13:08 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:13:08 user nova-compute[74840]:     <video>
Nov 08 12:13:08 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:13:08 user nova-compute[74840]:     </video>
Nov 08 12:13:08 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:13:08 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:13:08 user nova-compute[74840]:     </rng>
Nov 08 12:13:08 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:13:08 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:13:08 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:13:08 user nova-compute[74840]:     </memballoon>
Nov 08 12:13:08 user nova-compute[74840]:   </devices>
Nov 08 12:13:08 user nova-compute[74840]: </domain>
Nov 08 12:13:08 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-467103825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-467103825',id=8,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZ5yB12feWvkkDrgRcMY7Hf4hO2W8Ls+no6Z45U+6vRbA1JCzU/OYbpBDI5J0S8zB8PP4ZuBH44tWe6fFVP49DWG3e3HxIQhdUjQvyeS1NhY7Ma9aKJ221mPUbEhRS7/Q==',key_name='tempest-keypair-1810663950',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71995e354fd546fd8d41823c548b1a22',ramdisk_id='',reservation_id='r-8aydahek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-403652028',owner_user_name='tempest-TaggedBootDevicesTest-403652028-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2856d02455a4163a74b4f5956719920',uuid=d2dbd607-cf11-4d81-9639-c84e79d65fcd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38640df8-91ab-4bb6-89f1-ac84843d0e1c", "address": "fa:16:3e:7b:5b:86", "network": {"id": "ab262498-b88d-4054-a45b-cd8fe41731e6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1982652154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38640df8-91", "ovs_interfaceid": "38640df8-91ab-4bb6-89f1-ac84843d0e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Converting VIF {"id": "38640df8-91ab-4bb6-89f1-ac84843d0e1c", "address": "fa:16:3e:7b:5b:86", "network": {"id": "ab262498-b88d-4054-a45b-cd8fe41731e6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1982652154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38640df8-91", "ovs_interfaceid": "38640df8-91ab-4bb6-89f1-ac84843d0e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:5b:86,bridge_name='br-int',has_traffic_filtering=True,id=38640df8-91ab-4bb6-89f1-ac84843d0e1c,network=Network(ab262498-b88d-4054-a45b-cd8fe41731e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38640df8-91') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG os_vif [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:5b:86,bridge_name='br-int',has_traffic_filtering=True,id=38640df8-91ab-4bb6-89f1-ac84843d0e1c,network=Network(ab262498-b88d-4054-a45b-cd8fe41731e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38640df8-91') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '87effb81-8cb9-5876-b64e-97f8f0ec0959', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38640df8-91, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap38640df8-91, col_values=(('qos', UUID('a09e0638-04c0-4c21-a7dc-58506f7d78f0')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap38640df8-91, col_values=(('external_ids', {'iface-id': '38640df8-91ab-4bb6-89f1-ac84843d0e1c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:5b:86', 'vm-uuid': 'd2dbd607-cf11-4d81-9639-c84e79d65fcd'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:08 user nova-compute[74840]: INFO os_vif [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:5b:86,bridge_name='br-int',has_traffic_filtering=True,id=38640df8-91ab-4bb6-89f1-ac84843d0e1c,network=Network(ab262498-b88d-4054-a45b-cd8fe41731e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38640df8-91')
Nov 08 12:13:08 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-467103825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-467103825',id=8,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZ5yB12feWvkkDrgRcMY7Hf4hO2W8Ls+no6Z45U+6vRbA1JCzU/OYbpBDI5J0S8zB8PP4ZuBH44tWe6fFVP49DWG3e3HxIQhdUjQvyeS1NhY7Ma9aKJ221mPUbEhRS7/Q==',key_name='tempest-keypair-1810663950',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71995e354fd546fd8d41823c548b1a22',ramdisk_id='',reservation_id='r-8aydahek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-403652028',owner_user_name='tempest-TaggedBootDevicesTest-403652028-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2856d02455a4163a74b4f5956719920',uuid=d2dbd607-cf11-4d81-9639-c84e79d65fcd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65988447-7cce-4be7-87dd-4fd49e351040", "address": "fa:16:3e:92:b6:34", "network": {"id": "4998659b-781d-44e7-9601-d14cd5e39410", "bridge": "br-int", "label": "tempest-device-tagging-net1-756241958", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65988447-7c", "ovs_interfaceid": "65988447-7cce-4be7-87dd-4fd49e351040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Converting VIF {"id": "65988447-7cce-4be7-87dd-4fd49e351040", "address": "fa:16:3e:92:b6:34", "network": {"id": "4998659b-781d-44e7-9601-d14cd5e39410", "bridge": "br-int", "label": "tempest-device-tagging-net1-756241958", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65988447-7c", "ovs_interfaceid": "65988447-7cce-4be7-87dd-4fd49e351040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:b6:34,bridge_name='br-int',has_traffic_filtering=True,id=65988447-7cce-4be7-87dd-4fd49e351040,network=Network(4998659b-781d-44e7-9601-d14cd5e39410),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap65988447-7c') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG os_vif [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:b6:34,bridge_name='br-int',has_traffic_filtering=True,id=65988447-7cce-4be7-87dd-4fd49e351040,network=Network(4998659b-781d-44e7-9601-d14cd5e39410),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap65988447-7c') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '01a626af-7ce3-5e61-a5f6-4ccc1126c214', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap65988447-7c, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap65988447-7c, col_values=(('qos', UUID('ac87804a-7695-4a1f-a88f-a97a6bdec20d')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap65988447-7c, col_values=(('external_ids', {'iface-id': '65988447-7cce-4be7-87dd-4fd49e351040', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:b6:34', 'vm-uuid': 'd2dbd607-cf11-4d81-9639-c84e79d65fcd'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG nova.network.neutron [req-66284ec7-c028-42fd-90e9-aba22ee4679c req-83dae9ce-0245-4283-b3a2-6c458ee1f6f4 service nova] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Updated VIF entry in instance network info cache for port 804195be-3aed-40e6-9d0a-954fd997af14. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG nova.network.neutron [req-66284ec7-c028-42fd-90e9-aba22ee4679c req-83dae9ce-0245-4283-b3a2-6c458ee1f6f4 service nova] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Updating instance_info_cache with network_info: [{"id": "804195be-3aed-40e6-9d0a-954fd997af14", "address": "fa:16:3e:ba:fd:4c", "network": {"id": "381cad9f-376a-4335-95a4-4824aa0d7fad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1035058856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ec082e08ddf4477a721e410fe944d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804195be-3a", "ovs_interfaceid": "804195be-3aed-40e6-9d0a-954fd997af14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:08 user nova-compute[74840]: INFO os_vif [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:b6:34,bridge_name='br-int',has_traffic_filtering=True,id=65988447-7cce-4be7-87dd-4fd49e351040,network=Network(4998659b-781d-44e7-9601-d14cd5e39410),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap65988447-7c')
Nov 08 12:13:08 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-467103825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-467103825',id=8,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZ5yB12feWvkkDrgRcMY7Hf4hO2W8Ls+no6Z45U+6vRbA1JCzU/OYbpBDI5J0S8zB8PP4ZuBH44tWe6fFVP49DWG3e3HxIQhdUjQvyeS1NhY7Ma9aKJ221mPUbEhRS7/Q==',key_name='tempest-keypair-1810663950',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71995e354fd546fd8d41823c548b1a22',ramdisk_id='',reservation_id='r-8aydahek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-403652028',owner_user_name='tempest-TaggedBootDevicesTest-403652028-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2856d02455a4163a74b4f5956719920',uuid=d2dbd607-cf11-4d81-9639-c84e79d65fcd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e6aa660-8be2-44d4-aece-59b38a00ff02", "address": "fa:16:3e:25:8f:ae", "network": {"id": "4998659b-781d-44e7-9601-d14cd5e39410", "bridge": "br-int", "label": "tempest-device-tagging-net1-756241958", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e6aa660-8b", "ovs_interfaceid": "3e6aa660-8be2-44d4-aece-59b38a00ff02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Converting VIF {"id": "3e6aa660-8be2-44d4-aece-59b38a00ff02", "address": "fa:16:3e:25:8f:ae", "network": {"id": "4998659b-781d-44e7-9601-d14cd5e39410", "bridge": "br-int", "label": "tempest-device-tagging-net1-756241958", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e6aa660-8b", "ovs_interfaceid": "3e6aa660-8be2-44d4-aece-59b38a00ff02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:8f:ae,bridge_name='br-int',has_traffic_filtering=True,id=3e6aa660-8be2-44d4-aece-59b38a00ff02,network=Network(4998659b-781d-44e7-9601-d14cd5e39410),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3e6aa660-8b') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG os_vif [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:8f:ae,bridge_name='br-int',has_traffic_filtering=True,id=3e6aa660-8be2-44d4-aece-59b38a00ff02,network=Network(4998659b-781d-44e7-9601-d14cd5e39410),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3e6aa660-8b') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-66284ec7-c028-42fd-90e9-aba22ee4679c req-83dae9ce-0245-4283-b3a2-6c458ee1f6f4 service nova] Releasing lock "refresh_cache-972edb8d-69b8-4447-9170-1c1f73814345" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8548c44f-164a-59d3-a3a8-744caf739fda', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e6aa660-8b, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3e6aa660-8b, col_values=(('qos', UUID('6d4501a2-18d9-40ba-8d52-55597668015e')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3e6aa660-8b, col_values=(('external_ids', {'iface-id': '3e6aa660-8be2-44d4-aece-59b38a00ff02', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:8f:ae', 'vm-uuid': 'd2dbd607-cf11-4d81-9639-c84e79d65fcd'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:08 user nova-compute[74840]: INFO os_vif [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:8f:ae,bridge_name='br-int',has_traffic_filtering=True,id=3e6aa660-8be2-44d4-aece-59b38a00ff02,network=Network(4998659b-781d-44e7-9601-d14cd5e39410),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3e6aa660-8b')
Nov 08 12:13:08 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-467103825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-467103825',id=8,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZ5yB12feWvkkDrgRcMY7Hf4hO2W8Ls+no6Z45U+6vRbA1JCzU/OYbpBDI5J0S8zB8PP4ZuBH44tWe6fFVP49DWG3e3HxIQhdUjQvyeS1NhY7Ma9aKJ221mPUbEhRS7/Q==',key_name='tempest-keypair-1810663950',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71995e354fd546fd8d41823c548b1a22',ramdisk_id='',reservation_id='r-8aydahek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-403652028',owner_user_name='tempest-TaggedBootDevicesTest-403652028-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2856d02455a4163a74b4f5956719920',uuid=d2dbd607-cf11-4d81-9639-c84e79d65fcd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a2393a4-2d55-49cc-b4af-189d3ab24c1e", "address": "fa:16:3e:64:5a:54", "network": {"id": "4998659b-781d-44e7-9601-d14cd5e39410", "bridge": "br-int", "label": "tempest-device-tagging-net1-756241958", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2393a4-2d", "ovs_interfaceid": "7a2393a4-2d55-49cc-b4af-189d3ab24c1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Converting VIF {"id": "7a2393a4-2d55-49cc-b4af-189d3ab24c1e", "address": "fa:16:3e:64:5a:54", "network": {"id": "4998659b-781d-44e7-9601-d14cd5e39410", "bridge": "br-int", "label": "tempest-device-tagging-net1-756241958", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2393a4-2d", "ovs_interfaceid": "7a2393a4-2d55-49cc-b4af-189d3ab24c1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:5a:54,bridge_name='br-int',has_traffic_filtering=True,id=7a2393a4-2d55-49cc-b4af-189d3ab24c1e,network=Network(4998659b-781d-44e7-9601-d14cd5e39410),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a2393a4-2d') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG os_vif [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:5a:54,bridge_name='br-int',has_traffic_filtering=True,id=7a2393a4-2d55-49cc-b4af-189d3ab24c1e,network=Network(4998659b-781d-44e7-9601-d14cd5e39410),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a2393a4-2d') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '85021fcd-b989-5884-a6f2-655c31afc8f2', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a2393a4-2d, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7a2393a4-2d, col_values=(('qos', UUID('ed442bdf-1cfa-4791-9d0d-c634daa6d8d1')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7a2393a4-2d, col_values=(('external_ids', {'iface-id': '7a2393a4-2d55-49cc-b4af-189d3ab24c1e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:5a:54', 'vm-uuid': 'd2dbd607-cf11-4d81-9639-c84e79d65fcd'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:13:08 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Instance destroyed successfully.
Nov 08 12:13:08 user nova-compute[74840]: DEBUG nova.objects.instance [None req-179872d8-71b1-4541-92b2-a396d58e5454 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lazy-loading 'resources' on Instance uuid 972edb8d-69b8-4447-9170-1c1f73814345 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-179872d8-71b1-4541-92b2-a396d58e5454 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:11:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1880516201',display_name='tempest-AttachVolumeNegativeTest-server-1880516201',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1880516201',id=9,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIoml0vInjRpaeaoO/uEWcy+sGwmwvvQoVqRZqz1TWvdPEvRKpVYnYquAeVoOXEbsvy71nEMT5ycphhT5SLXWy8OIPigxxFGem2BDWUWcPtZsrm2GQciEMzWfDylA78S7A==',key_name='tempest-keypair-933257025',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:11:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ec082e08ddf4477a721e410fe944d10',ramdisk_id='',reservation_id='r-mt0sy8sj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1526881991',owner_user_name='tempest-AttachVolumeNegativeTest-1526881991-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:11:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e172625e7f334a2b896b2738bbf49aa8',uuid=972edb8d-69b8-4447-9170-1c1f73814345,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "804195be-3aed-40e6-9d0a-954fd997af14", "address": "fa:16:3e:ba:fd:4c", "network": {"id": "381cad9f-376a-4335-95a4-4824aa0d7fad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1035058856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ec082e08ddf4477a721e410fe944d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804195be-3a", "ovs_interfaceid": "804195be-3aed-40e6-9d0a-954fd997af14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-179872d8-71b1-4541-92b2-a396d58e5454 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Converting VIF {"id": "804195be-3aed-40e6-9d0a-954fd997af14", "address": "fa:16:3e:ba:fd:4c", "network": {"id": "381cad9f-376a-4335-95a4-4824aa0d7fad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1035058856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ec082e08ddf4477a721e410fe944d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap804195be-3a", "ovs_interfaceid": "804195be-3aed-40e6-9d0a-954fd997af14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-179872d8-71b1-4541-92b2-a396d58e5454 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:fd:4c,bridge_name='br-int',has_traffic_filtering=True,id=804195be-3aed-40e6-9d0a-954fd997af14,network=Network(381cad9f-376a-4335-95a4-4824aa0d7fad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap804195be-3a') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG os_vif [None req-179872d8-71b1-4541-92b2-a396d58e5454 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:fd:4c,bridge_name='br-int',has_traffic_filtering=True,id=804195be-3aed-40e6-9d0a-954fd997af14,network=Network(381cad9f-376a-4335-95a4-4824aa0d7fad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap804195be-3a') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:08 user nova-compute[74840]: INFO os_vif [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:5a:54,bridge_name='br-int',has_traffic_filtering=True,id=7a2393a4-2d55-49cc-b4af-189d3ab24c1e,network=Network(4998659b-781d-44e7-9601-d14cd5e39410),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a2393a4-2d')
Nov 08 12:13:08 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-467103825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-467103825',id=8,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZ5yB12feWvkkDrgRcMY7Hf4hO2W8Ls+no6Z45U+6vRbA1JCzU/OYbpBDI5J0S8zB8PP4ZuBH44tWe6fFVP49DWG3e3HxIQhdUjQvyeS1NhY7Ma9aKJ221mPUbEhRS7/Q==',key_name='tempest-keypair-1810663950',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71995e354fd546fd8d41823c548b1a22',ramdisk_id='',reservation_id='r-8aydahek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-403652028',owner_user_name='tempest-TaggedBootDevicesTest-403652028-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2856d02455a4163a74b4f5956719920',uuid=d2dbd607-cf11-4d81-9639-c84e79d65fcd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77c96b94-7c85-4356-8da8-bb90854ead5e", "address": "fa:16:3e:21:2e:ad", "network": {"id": "4998659b-781d-44e7-9601-d14cd5e39410", "bridge": "br-int", "label": "tempest-device-tagging-net1-756241958", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c96b94-7c", "ovs_interfaceid": "77c96b94-7c85-4356-8da8-bb90854ead5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Converting VIF {"id": "77c96b94-7c85-4356-8da8-bb90854ead5e", "address": "fa:16:3e:21:2e:ad", "network": {"id": "4998659b-781d-44e7-9601-d14cd5e39410", "bridge": "br-int", "label": "tempest-device-tagging-net1-756241958", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c96b94-7c", "ovs_interfaceid": "77c96b94-7c85-4356-8da8-bb90854ead5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:2e:ad,bridge_name='br-int',has_traffic_filtering=True,id=77c96b94-7c85-4356-8da8-bb90854ead5e,network=Network(4998659b-781d-44e7-9601-d14cd5e39410),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77c96b94-7c') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG os_vif [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:2e:ad,bridge_name='br-int',has_traffic_filtering=True,id=77c96b94-7c85-4356-8da8-bb90854ead5e,network=Network(4998659b-781d-44e7-9601-d14cd5e39410),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77c96b94-7c') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap804195be-3a, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3f134983-eace-46c9-8c77-b3cd24c5ed7a) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0b607dfb-1707-5791-ad58-432b53f3aa48', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:13:08 user nova-compute[74840]: INFO os_vif [None req-179872d8-71b1-4541-92b2-a396d58e5454 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:fd:4c,bridge_name='br-int',has_traffic_filtering=True,id=804195be-3aed-40e6-9d0a-954fd997af14,network=Network(381cad9f-376a-4335-95a4-4824aa0d7fad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap804195be-3a')
Nov 08 12:13:08 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-179872d8-71b1-4541-92b2-a396d58e5454 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Deleting instance files /opt/stack/data/nova/instances/972edb8d-69b8-4447-9170-1c1f73814345_del
Nov 08 12:13:08 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-179872d8-71b1-4541-92b2-a396d58e5454 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Deletion of /opt/stack/data/nova/instances/972edb8d-69b8-4447-9170-1c1f73814345_del complete
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap77c96b94-7c, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap77c96b94-7c, col_values=(('qos', UUID('c8206a2a-c70b-43de-bafd-995062cce176')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap77c96b94-7c, col_values=(('external_ids', {'iface-id': '77c96b94-7c85-4356-8da8-bb90854ead5e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:2e:ad', 'vm-uuid': 'd2dbd607-cf11-4d81-9639-c84e79d65fcd'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:13:08 user nova-compute[74840]: INFO nova.compute.manager [None req-179872d8-71b1-4541-92b2-a396d58e5454 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 08 12:13:08 user nova-compute[74840]: DEBUG oslo.service.loopingcall [None req-179872d8-71b1-4541-92b2-a396d58e5454 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74840) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG nova.compute.manager [-] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Deallocating network for instance {{(pid=74840) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] deallocate_for_instance() {{(pid=74840) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:08 user nova-compute[74840]: INFO os_vif [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:2e:ad,bridge_name='br-int',has_traffic_filtering=True,id=77c96b94-7c85-4356-8da8-bb90854ead5e,network=Network(4998659b-781d-44e7-9601-d14cd5e39410),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77c96b94-7c')
Nov 08 12:13:08 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-467103825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-467103825',id=8,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZ5yB12feWvkkDrgRcMY7Hf4hO2W8Ls+no6Z45U+6vRbA1JCzU/OYbpBDI5J0S8zB8PP4ZuBH44tWe6fFVP49DWG3e3HxIQhdUjQvyeS1NhY7Ma9aKJ221mPUbEhRS7/Q==',key_name='tempest-keypair-1810663950',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71995e354fd546fd8d41823c548b1a22',ramdisk_id='',reservation_id='r-8aydahek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-403652028',owner_user_name='tempest-TaggedBootDevicesTest-403652028-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2856d02455a4163a74b4f5956719920',uuid=d2dbd607-cf11-4d81-9639-c84e79d65fcd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f88f24e-b28a-4e36-bef3-1fa13084f370", "address": "fa:16:3e:c4:eb:48", "network": {"id": "2242fb46-3f42-4d3e-808c-ebdd55268fe5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388499652", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f88f24e-b2", "ovs_interfaceid": "0f88f24e-b28a-4e36-bef3-1fa13084f370", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Converting VIF {"id": "0f88f24e-b28a-4e36-bef3-1fa13084f370", "address": "fa:16:3e:c4:eb:48", "network": {"id": "2242fb46-3f42-4d3e-808c-ebdd55268fe5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388499652", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f88f24e-b2", "ovs_interfaceid": "0f88f24e-b28a-4e36-bef3-1fa13084f370", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:eb:48,bridge_name='br-int',has_traffic_filtering=True,id=0f88f24e-b28a-4e36-bef3-1fa13084f370,network=Network(2242fb46-3f42-4d3e-808c-ebdd55268fe5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f88f24e-b2') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG os_vif [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:eb:48,bridge_name='br-int',has_traffic_filtering=True,id=0f88f24e-b28a-4e36-bef3-1fa13084f370,network=Network(2242fb46-3f42-4d3e-808c-ebdd55268fe5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f88f24e-b2') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0d4bea22-e74b-5003-a1b0-45207059fad0', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f88f24e-b2, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0f88f24e-b2, col_values=(('qos', UUID('03565e1e-027c-4295-b294-fd90c03510f7')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0f88f24e-b2, col_values=(('external_ids', {'iface-id': '0f88f24e-b28a-4e36-bef3-1fa13084f370', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:eb:48', 'vm-uuid': 'd2dbd607-cf11-4d81-9639-c84e79d65fcd'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:13:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:09 user nova-compute[74840]: INFO os_vif [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:eb:48,bridge_name='br-int',has_traffic_filtering=True,id=0f88f24e-b28a-4e36-bef3-1fa13084f370,network=Network(2242fb46-3f42-4d3e-808c-ebdd55268fe5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f88f24e-b2')
Nov 08 12:13:09 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-467103825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-467103825',id=8,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZ5yB12feWvkkDrgRcMY7Hf4hO2W8Ls+no6Z45U+6vRbA1JCzU/OYbpBDI5J0S8zB8PP4ZuBH44tWe6fFVP49DWG3e3HxIQhdUjQvyeS1NhY7Ma9aKJ221mPUbEhRS7/Q==',key_name='tempest-keypair-1810663950',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71995e354fd546fd8d41823c548b1a22',ramdisk_id='',reservation_id='r-8aydahek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-403652028',owner_user_name='tempest-TaggedBootDevicesTest-403652028-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2856d02455a4163a74b4f5956719920',uuid=d2dbd607-cf11-4d81-9639-c84e79d65fcd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b80b0e8d-2bc7-4e85-8843-c9d8c7931014", "address": "fa:16:3e:0b:f1:33", "network": {"id": "2242fb46-3f42-4d3e-808c-ebdd55268fe5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388499652", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb80b0e8d-2b", "ovs_interfaceid": "b80b0e8d-2bc7-4e85-8843-c9d8c7931014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:13:09 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Converting VIF {"id": "b80b0e8d-2bc7-4e85-8843-c9d8c7931014", "address": "fa:16:3e:0b:f1:33", "network": {"id": "2242fb46-3f42-4d3e-808c-ebdd55268fe5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388499652", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb80b0e8d-2b", "ovs_interfaceid": "b80b0e8d-2bc7-4e85-8843-c9d8c7931014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:13:09 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:f1:33,bridge_name='br-int',has_traffic_filtering=True,id=b80b0e8d-2bc7-4e85-8843-c9d8c7931014,network=Network(2242fb46-3f42-4d3e-808c-ebdd55268fe5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb80b0e8d-2b') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:13:09 user nova-compute[74840]: DEBUG os_vif [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:f1:33,bridge_name='br-int',has_traffic_filtering=True,id=b80b0e8d-2bc7-4e85-8843-c9d8c7931014,network=Network(2242fb46-3f42-4d3e-808c-ebdd55268fe5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb80b0e8d-2b') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:13:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:13:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:13:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ee6aeabf-20eb-5a5d-b94a-2e6f6e0b5c93', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:13:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:13:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb80b0e8d-2b, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:13:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb80b0e8d-2b, col_values=(('qos', UUID('182665ff-28f1-41d1-8acf-da092f11a74d')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:13:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb80b0e8d-2b, col_values=(('external_ids', {'iface-id': 'b80b0e8d-2bc7-4e85-8843-c9d8c7931014', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:f1:33', 'vm-uuid': 'd2dbd607-cf11-4d81-9639-c84e79d65fcd'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:13:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:13:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:09 user nova-compute[74840]: INFO os_vif [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:f1:33,bridge_name='br-int',has_traffic_filtering=True,id=b80b0e8d-2bc7-4e85-8843-c9d8c7931014,network=Network(2242fb46-3f42-4d3e-808c-ebdd55268fe5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb80b0e8d-2b')
Nov 08 12:13:09 user nova-compute[74840]: DEBUG nova.compute.manager [req-db9809f6-3fd2-4ad6-9cee-140274c43389 req-feca435a-fe14-4f59-ac5d-fc781beea280 service nova] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Received event network-vif-unplugged-804195be-3aed-40e6-9d0a-954fd997af14 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:13:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-db9809f6-3fd2-4ad6-9cee-140274c43389 req-feca435a-fe14-4f59-ac5d-fc781beea280 service nova] Acquiring lock "972edb8d-69b8-4447-9170-1c1f73814345-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:13:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-db9809f6-3fd2-4ad6-9cee-140274c43389 req-feca435a-fe14-4f59-ac5d-fc781beea280 service nova] Lock "972edb8d-69b8-4447-9170-1c1f73814345-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:13:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-db9809f6-3fd2-4ad6-9cee-140274c43389 req-feca435a-fe14-4f59-ac5d-fc781beea280 service nova] Lock "972edb8d-69b8-4447-9170-1c1f73814345-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:13:09 user nova-compute[74840]: DEBUG nova.compute.manager [req-db9809f6-3fd2-4ad6-9cee-140274c43389 req-feca435a-fe14-4f59-ac5d-fc781beea280 service nova] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] No waiting events found dispatching network-vif-unplugged-804195be-3aed-40e6-9d0a-954fd997af14 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:13:09 user nova-compute[74840]: DEBUG nova.compute.manager [req-db9809f6-3fd2-4ad6-9cee-140274c43389 req-feca435a-fe14-4f59-ac5d-fc781beea280 service nova] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Received event network-vif-unplugged-804195be-3aed-40e6-9d0a-954fd997af14 for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:13:09 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] No BDM found with device name hda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:13:09 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:13:09 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] No VIF found with MAC fa:16:3e:7b:5b:86, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:13:09 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] No VIF found with MAC fa:16:3e:21:2e:ad, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:13:09 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Using config drive
Nov 08 12:13:09 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Creating config drive at /opt/stack/data/nova/instances/d2dbd607-cf11-4d81-9639-c84e79d65fcd/disk.config
Nov 08 12:13:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d2dbd607-cf11-4d81-9639-c84e79d65fcd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpir8p5_dw {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d2dbd607-cf11-4d81-9639-c84e79d65fcd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpir8p5_dw" returned: 0 in 0.057s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:10 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:13:10 user nova-compute[74840]: INFO nova.compute.manager [-] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Took 1.42 seconds to deallocate network for instance.
Nov 08 12:13:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-179872d8-71b1-4541-92b2-a396d58e5454 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:13:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-179872d8-71b1-4541-92b2-a396d58e5454 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:13:10 user nova-compute[74840]: DEBUG nova.compute.manager [req-59e904b8-30b6-4d0b-b573-fded8a455d7a req-238ce834-5aa5-473a-b125-7175a69a0951 service nova] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Received event network-vif-deleted-804195be-3aed-40e6-9d0a-954fd997af14 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:13:10 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-179872d8-71b1-4541-92b2-a396d58e5454 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:13:10 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-179872d8-71b1-4541-92b2-a396d58e5454 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:13:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-179872d8-71b1-4541-92b2-a396d58e5454 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.407s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:13:10 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-179872d8-71b1-4541-92b2-a396d58e5454 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Deleted allocations for instance 972edb8d-69b8-4447-9170-1c1f73814345
Nov 08 12:13:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-179872d8-71b1-4541-92b2-a396d58e5454 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "972edb8d-69b8-4447-9170-1c1f73814345" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.949s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:13:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:11 user nova-compute[74840]: DEBUG nova.compute.manager [req-29675607-b6f3-4c5e-b3f7-239161943842 req-c57392ff-3d02-4fe5-aece-52f4ab42ac5f service nova] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Received event network-vif-plugged-804195be-3aed-40e6-9d0a-954fd997af14 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:13:11 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-29675607-b6f3-4c5e-b3f7-239161943842 req-c57392ff-3d02-4fe5-aece-52f4ab42ac5f service nova] Acquiring lock "972edb8d-69b8-4447-9170-1c1f73814345-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:13:11 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-29675607-b6f3-4c5e-b3f7-239161943842 req-c57392ff-3d02-4fe5-aece-52f4ab42ac5f service nova] Lock "972edb8d-69b8-4447-9170-1c1f73814345-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:13:11 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-29675607-b6f3-4c5e-b3f7-239161943842 req-c57392ff-3d02-4fe5-aece-52f4ab42ac5f service nova] Lock "972edb8d-69b8-4447-9170-1c1f73814345-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:13:11 user nova-compute[74840]: DEBUG nova.compute.manager [req-29675607-b6f3-4c5e-b3f7-239161943842 req-c57392ff-3d02-4fe5-aece-52f4ab42ac5f service nova] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] No waiting events found dispatching network-vif-plugged-804195be-3aed-40e6-9d0a-954fd997af14 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:13:11 user nova-compute[74840]: WARNING nova.compute.manager [req-29675607-b6f3-4c5e-b3f7-239161943842 req-c57392ff-3d02-4fe5-aece-52f4ab42ac5f service nova] [instance: 972edb8d-69b8-4447-9170-1c1f73814345] Received unexpected event network-vif-plugged-804195be-3aed-40e6-9d0a-954fd997af14 for instance with vm_state deleted and task_state None.
Nov 08 12:13:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:12 user nova-compute[74840]: DEBUG nova.compute.manager [req-40dd90c7-85ed-473a-be74-9dbfe83fe1bf req-8c35f911-1e78-43c2-9d47-520dd0e53606 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received event network-vif-plugged-38640df8-91ab-4bb6-89f1-ac84843d0e1c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:13:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-40dd90c7-85ed-473a-be74-9dbfe83fe1bf req-8c35f911-1e78-43c2-9d47-520dd0e53606 service nova] Acquiring lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:13:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-40dd90c7-85ed-473a-be74-9dbfe83fe1bf req-8c35f911-1e78-43c2-9d47-520dd0e53606 service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:13:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-40dd90c7-85ed-473a-be74-9dbfe83fe1bf req-8c35f911-1e78-43c2-9d47-520dd0e53606 service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:13:12 user nova-compute[74840]: DEBUG nova.compute.manager [req-40dd90c7-85ed-473a-be74-9dbfe83fe1bf req-8c35f911-1e78-43c2-9d47-520dd0e53606 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] No waiting events found dispatching network-vif-plugged-38640df8-91ab-4bb6-89f1-ac84843d0e1c {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:13:12 user nova-compute[74840]: WARNING nova.compute.manager [req-40dd90c7-85ed-473a-be74-9dbfe83fe1bf req-8c35f911-1e78-43c2-9d47-520dd0e53606 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received unexpected event network-vif-plugged-38640df8-91ab-4bb6-89f1-ac84843d0e1c for instance with vm_state building and task_state spawning.
Nov 08 12:13:12 user nova-compute[74840]: DEBUG nova.compute.manager [req-40dd90c7-85ed-473a-be74-9dbfe83fe1bf req-8c35f911-1e78-43c2-9d47-520dd0e53606 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received event network-vif-plugged-38640df8-91ab-4bb6-89f1-ac84843d0e1c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:13:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-40dd90c7-85ed-473a-be74-9dbfe83fe1bf req-8c35f911-1e78-43c2-9d47-520dd0e53606 service nova] Acquiring lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:13:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-40dd90c7-85ed-473a-be74-9dbfe83fe1bf req-8c35f911-1e78-43c2-9d47-520dd0e53606 service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:13:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-40dd90c7-85ed-473a-be74-9dbfe83fe1bf req-8c35f911-1e78-43c2-9d47-520dd0e53606 service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:13:12 user nova-compute[74840]: DEBUG nova.compute.manager [req-40dd90c7-85ed-473a-be74-9dbfe83fe1bf req-8c35f911-1e78-43c2-9d47-520dd0e53606 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] No waiting events found dispatching network-vif-plugged-38640df8-91ab-4bb6-89f1-ac84843d0e1c {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:13:12 user nova-compute[74840]: WARNING nova.compute.manager [req-40dd90c7-85ed-473a-be74-9dbfe83fe1bf req-8c35f911-1e78-43c2-9d47-520dd0e53606 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received unexpected event network-vif-plugged-38640df8-91ab-4bb6-89f1-ac84843d0e1c for instance with vm_state building and task_state spawning.
Nov 08 12:13:12 user nova-compute[74840]: DEBUG nova.compute.manager [req-40dd90c7-85ed-473a-be74-9dbfe83fe1bf req-8c35f911-1e78-43c2-9d47-520dd0e53606 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received event network-vif-plugged-65988447-7cce-4be7-87dd-4fd49e351040 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:13:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-40dd90c7-85ed-473a-be74-9dbfe83fe1bf req-8c35f911-1e78-43c2-9d47-520dd0e53606 service nova] Acquiring lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:13:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-40dd90c7-85ed-473a-be74-9dbfe83fe1bf req-8c35f911-1e78-43c2-9d47-520dd0e53606 service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:13:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-40dd90c7-85ed-473a-be74-9dbfe83fe1bf req-8c35f911-1e78-43c2-9d47-520dd0e53606 service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:13:12 user nova-compute[74840]: DEBUG nova.compute.manager [req-40dd90c7-85ed-473a-be74-9dbfe83fe1bf req-8c35f911-1e78-43c2-9d47-520dd0e53606 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] No waiting events found dispatching network-vif-plugged-65988447-7cce-4be7-87dd-4fd49e351040 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:13:12 user nova-compute[74840]: WARNING nova.compute.manager [req-40dd90c7-85ed-473a-be74-9dbfe83fe1bf req-8c35f911-1e78-43c2-9d47-520dd0e53606 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received unexpected event network-vif-plugged-65988447-7cce-4be7-87dd-4fd49e351040 for instance with vm_state building and task_state spawning.
Nov 08 12:13:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:13 user nova-compute[74840]: DEBUG nova.compute.manager [req-b60111b3-da39-4e5e-89e6-0c216a5ae9b0 req-a7f3c183-6403-426f-9abf-dce0990d668e service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received event network-vif-plugged-3e6aa660-8be2-44d4-aece-59b38a00ff02 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:13:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-b60111b3-da39-4e5e-89e6-0c216a5ae9b0 req-a7f3c183-6403-426f-9abf-dce0990d668e service nova] Acquiring lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:13:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-b60111b3-da39-4e5e-89e6-0c216a5ae9b0 req-a7f3c183-6403-426f-9abf-dce0990d668e service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:13:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-b60111b3-da39-4e5e-89e6-0c216a5ae9b0 req-a7f3c183-6403-426f-9abf-dce0990d668e service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:13:13 user nova-compute[74840]: DEBUG nova.compute.manager [req-b60111b3-da39-4e5e-89e6-0c216a5ae9b0 req-a7f3c183-6403-426f-9abf-dce0990d668e service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] No waiting events found dispatching network-vif-plugged-3e6aa660-8be2-44d4-aece-59b38a00ff02 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:13:13 user nova-compute[74840]: WARNING nova.compute.manager [req-b60111b3-da39-4e5e-89e6-0c216a5ae9b0 req-a7f3c183-6403-426f-9abf-dce0990d668e service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received unexpected event network-vif-plugged-3e6aa660-8be2-44d4-aece-59b38a00ff02 for instance with vm_state building and task_state spawning.
Nov 08 12:13:13 user nova-compute[74840]: DEBUG nova.compute.manager [req-b60111b3-da39-4e5e-89e6-0c216a5ae9b0 req-a7f3c183-6403-426f-9abf-dce0990d668e service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received event network-vif-plugged-3e6aa660-8be2-44d4-aece-59b38a00ff02 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:13:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-b60111b3-da39-4e5e-89e6-0c216a5ae9b0 req-a7f3c183-6403-426f-9abf-dce0990d668e service nova] Acquiring lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:13:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-b60111b3-da39-4e5e-89e6-0c216a5ae9b0 req-a7f3c183-6403-426f-9abf-dce0990d668e service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:13:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-b60111b3-da39-4e5e-89e6-0c216a5ae9b0 req-a7f3c183-6403-426f-9abf-dce0990d668e service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:13:13 user nova-compute[74840]: DEBUG nova.compute.manager [req-b60111b3-da39-4e5e-89e6-0c216a5ae9b0 req-a7f3c183-6403-426f-9abf-dce0990d668e service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] No waiting events found dispatching network-vif-plugged-3e6aa660-8be2-44d4-aece-59b38a00ff02 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:13:13 user nova-compute[74840]: WARNING nova.compute.manager [req-b60111b3-da39-4e5e-89e6-0c216a5ae9b0 req-a7f3c183-6403-426f-9abf-dce0990d668e service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received unexpected event network-vif-plugged-3e6aa660-8be2-44d4-aece-59b38a00ff02 for instance with vm_state building and task_state spawning.
Nov 08 12:13:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:14 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:14 user nova-compute[74840]: DEBUG nova.compute.manager [req-9ea21b49-4f3f-4620-acba-002753430360 req-4431747e-7fc9-4c3a-9e41-13ca30bbf2b4 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received event network-vif-plugged-65988447-7cce-4be7-87dd-4fd49e351040 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:13:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9ea21b49-4f3f-4620-acba-002753430360 req-4431747e-7fc9-4c3a-9e41-13ca30bbf2b4 service nova] Acquiring lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:13:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9ea21b49-4f3f-4620-acba-002753430360 req-4431747e-7fc9-4c3a-9e41-13ca30bbf2b4 service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:13:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9ea21b49-4f3f-4620-acba-002753430360 req-4431747e-7fc9-4c3a-9e41-13ca30bbf2b4 service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:13:14 user nova-compute[74840]: DEBUG nova.compute.manager [req-9ea21b49-4f3f-4620-acba-002753430360 req-4431747e-7fc9-4c3a-9e41-13ca30bbf2b4 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] No waiting events found dispatching network-vif-plugged-65988447-7cce-4be7-87dd-4fd49e351040 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:13:14 user nova-compute[74840]: WARNING nova.compute.manager [req-9ea21b49-4f3f-4620-acba-002753430360 req-4431747e-7fc9-4c3a-9e41-13ca30bbf2b4 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received unexpected event network-vif-plugged-65988447-7cce-4be7-87dd-4fd49e351040 for instance with vm_state building and task_state spawning.
Nov 08 12:13:14 user nova-compute[74840]: DEBUG nova.compute.manager [req-9ea21b49-4f3f-4620-acba-002753430360 req-4431747e-7fc9-4c3a-9e41-13ca30bbf2b4 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received event network-vif-plugged-77c96b94-7c85-4356-8da8-bb90854ead5e {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:13:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9ea21b49-4f3f-4620-acba-002753430360 req-4431747e-7fc9-4c3a-9e41-13ca30bbf2b4 service nova] Acquiring lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:13:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9ea21b49-4f3f-4620-acba-002753430360 req-4431747e-7fc9-4c3a-9e41-13ca30bbf2b4 service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:13:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9ea21b49-4f3f-4620-acba-002753430360 req-4431747e-7fc9-4c3a-9e41-13ca30bbf2b4 service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:13:14 user nova-compute[74840]: DEBUG nova.compute.manager [req-9ea21b49-4f3f-4620-acba-002753430360 req-4431747e-7fc9-4c3a-9e41-13ca30bbf2b4 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] No waiting events found dispatching network-vif-plugged-77c96b94-7c85-4356-8da8-bb90854ead5e {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:13:14 user nova-compute[74840]: WARNING nova.compute.manager [req-9ea21b49-4f3f-4620-acba-002753430360 req-4431747e-7fc9-4c3a-9e41-13ca30bbf2b4 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received unexpected event network-vif-plugged-77c96b94-7c85-4356-8da8-bb90854ead5e for instance with vm_state building and task_state spawning.
Nov 08 12:13:14 user nova-compute[74840]: DEBUG nova.compute.manager [req-9ea21b49-4f3f-4620-acba-002753430360 req-4431747e-7fc9-4c3a-9e41-13ca30bbf2b4 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received event network-vif-plugged-77c96b94-7c85-4356-8da8-bb90854ead5e {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:13:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9ea21b49-4f3f-4620-acba-002753430360 req-4431747e-7fc9-4c3a-9e41-13ca30bbf2b4 service nova] Acquiring lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:13:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9ea21b49-4f3f-4620-acba-002753430360 req-4431747e-7fc9-4c3a-9e41-13ca30bbf2b4 service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:13:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9ea21b49-4f3f-4620-acba-002753430360 req-4431747e-7fc9-4c3a-9e41-13ca30bbf2b4 service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:13:14 user nova-compute[74840]: DEBUG nova.compute.manager [req-9ea21b49-4f3f-4620-acba-002753430360 req-4431747e-7fc9-4c3a-9e41-13ca30bbf2b4 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] No waiting events found dispatching network-vif-plugged-77c96b94-7c85-4356-8da8-bb90854ead5e {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:13:14 user nova-compute[74840]: WARNING nova.compute.manager [req-9ea21b49-4f3f-4620-acba-002753430360 req-4431747e-7fc9-4c3a-9e41-13ca30bbf2b4 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received unexpected event network-vif-plugged-77c96b94-7c85-4356-8da8-bb90854ead5e for instance with vm_state building and task_state spawning.
Nov 08 12:13:14 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:14 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:14 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:14 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:14 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:14 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:15 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:15 user nova-compute[74840]: DEBUG nova.compute.manager [req-4a9ef5ad-b40f-47d1-89fa-86fe212f1043 req-cc4d1921-5945-4633-a2d8-f8a9a2f95a8f service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received event network-vif-plugged-0f88f24e-b28a-4e36-bef3-1fa13084f370 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:13:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4a9ef5ad-b40f-47d1-89fa-86fe212f1043 req-cc4d1921-5945-4633-a2d8-f8a9a2f95a8f service nova] Acquiring lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:13:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4a9ef5ad-b40f-47d1-89fa-86fe212f1043 req-cc4d1921-5945-4633-a2d8-f8a9a2f95a8f service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:13:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4a9ef5ad-b40f-47d1-89fa-86fe212f1043 req-cc4d1921-5945-4633-a2d8-f8a9a2f95a8f service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:13:15 user nova-compute[74840]: DEBUG nova.compute.manager [req-4a9ef5ad-b40f-47d1-89fa-86fe212f1043 req-cc4d1921-5945-4633-a2d8-f8a9a2f95a8f service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] No waiting events found dispatching network-vif-plugged-0f88f24e-b28a-4e36-bef3-1fa13084f370 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:13:15 user nova-compute[74840]: WARNING nova.compute.manager [req-4a9ef5ad-b40f-47d1-89fa-86fe212f1043 req-cc4d1921-5945-4633-a2d8-f8a9a2f95a8f service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received unexpected event network-vif-plugged-0f88f24e-b28a-4e36-bef3-1fa13084f370 for instance with vm_state building and task_state spawning.
Nov 08 12:13:15 user nova-compute[74840]: DEBUG nova.compute.manager [req-4a9ef5ad-b40f-47d1-89fa-86fe212f1043 req-cc4d1921-5945-4633-a2d8-f8a9a2f95a8f service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received event network-vif-plugged-0f88f24e-b28a-4e36-bef3-1fa13084f370 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:13:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4a9ef5ad-b40f-47d1-89fa-86fe212f1043 req-cc4d1921-5945-4633-a2d8-f8a9a2f95a8f service nova] Acquiring lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:13:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4a9ef5ad-b40f-47d1-89fa-86fe212f1043 req-cc4d1921-5945-4633-a2d8-f8a9a2f95a8f service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:13:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4a9ef5ad-b40f-47d1-89fa-86fe212f1043 req-cc4d1921-5945-4633-a2d8-f8a9a2f95a8f service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:13:15 user nova-compute[74840]: DEBUG nova.compute.manager [req-4a9ef5ad-b40f-47d1-89fa-86fe212f1043 req-cc4d1921-5945-4633-a2d8-f8a9a2f95a8f service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] No waiting events found dispatching network-vif-plugged-0f88f24e-b28a-4e36-bef3-1fa13084f370 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:13:15 user nova-compute[74840]: WARNING nova.compute.manager [req-4a9ef5ad-b40f-47d1-89fa-86fe212f1043 req-cc4d1921-5945-4633-a2d8-f8a9a2f95a8f service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received unexpected event network-vif-plugged-0f88f24e-b28a-4e36-bef3-1fa13084f370 for instance with vm_state building and task_state spawning.
Nov 08 12:13:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:16 user nova-compute[74840]: DEBUG nova.compute.manager [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:13:16 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:13:16 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Instance spawned successfully.
Nov 08 12:13:16 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:13:16 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Found default for hw_cdrom_bus of ide {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:13:16 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Found default for hw_disk_bus of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:13:16 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:13:16 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:13:16 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Found default for hw_video_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:13:16 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Found default for hw_vif_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:13:16 user nova-compute[74840]: INFO nova.compute.manager [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Took 12.51 seconds to spawn the instance on the hypervisor.
Nov 08 12:13:16 user nova-compute[74840]: DEBUG nova.compute.manager [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:13:16 user nova-compute[74840]: INFO nova.compute.manager [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Took 138.91 seconds to build instance.
Nov 08 12:13:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-990f9f73-8ada-4995-9314-1aee30d6ad78 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 139.025s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:13:17 user nova-compute[74840]: DEBUG nova.compute.manager [req-bb0b7e6f-657a-4216-86f4-b0a7f66fc938 req-fcf24c55-009b-4269-ad16-f5ebc7ccf14f service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received event network-vif-plugged-7a2393a4-2d55-49cc-b4af-189d3ab24c1e {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:13:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-bb0b7e6f-657a-4216-86f4-b0a7f66fc938 req-fcf24c55-009b-4269-ad16-f5ebc7ccf14f service nova] Acquiring lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:13:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-bb0b7e6f-657a-4216-86f4-b0a7f66fc938 req-fcf24c55-009b-4269-ad16-f5ebc7ccf14f service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:13:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-bb0b7e6f-657a-4216-86f4-b0a7f66fc938 req-fcf24c55-009b-4269-ad16-f5ebc7ccf14f service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:13:17 user nova-compute[74840]: DEBUG nova.compute.manager [req-bb0b7e6f-657a-4216-86f4-b0a7f66fc938 req-fcf24c55-009b-4269-ad16-f5ebc7ccf14f service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] No waiting events found dispatching network-vif-plugged-7a2393a4-2d55-49cc-b4af-189d3ab24c1e {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:13:17 user nova-compute[74840]: WARNING nova.compute.manager [req-bb0b7e6f-657a-4216-86f4-b0a7f66fc938 req-fcf24c55-009b-4269-ad16-f5ebc7ccf14f service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received unexpected event network-vif-plugged-7a2393a4-2d55-49cc-b4af-189d3ab24c1e for instance with vm_state active and task_state None.
Nov 08 12:13:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Acquiring lock "a0b7a0e1-d0d1-4682-9218-ef44d1e461f1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:13:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Lock "a0b7a0e1-d0d1-4682-9218-ef44d1e461f1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:13:17 user nova-compute[74840]: DEBUG nova.compute.manager [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Starting instance... {{(pid=74840) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 12:13:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:13:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:13:17 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:13:17 user nova-compute[74840]: INFO nova.compute.claims [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Claim successful on node user
Nov 08 12:13:18 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:13:18 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:13:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.494s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:13:18 user nova-compute[74840]: DEBUG nova.compute.manager [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Start building networks asynchronously for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 12:13:18 user nova-compute[74840]: DEBUG nova.compute.manager [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Allocating IP information in the background. {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 12:13:18 user nova-compute[74840]: DEBUG nova.network.neutron [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 12:13:18 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 12:13:18 user nova-compute[74840]: DEBUG nova.compute.manager [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Start building block device mappings for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 12:13:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4b719f4-99d2-4d7b-8207-c6c04a5b4278 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Calling os-brick to attach iSCSI Volume {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 12:13:18 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b719f4-99d2-4d7b-8207-c6c04a5b4278 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WnvQHzjl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:13:18 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-b4b719f4-99d2-4d7b-8207-c6c04a5b4278 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:13:18 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-b4b719f4-99d2-4d7b-8207-c6c04a5b4278 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:13:18 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-b4b719f4-99d2-4d7b-8207-c6c04a5b4278 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:13:18 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-b4b719f4-99d2-4d7b-8207-c6c04a5b4278 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:13:18 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-b4b719f4-99d2-4d7b-8207-c6c04a5b4278 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:13:18 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-b4b719f4-99d2-4d7b-8207-c6c04a5b4278 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:13:18 user nova-compute[74840]: INFO os_brick.initiator.connectors.iscsi [None req-b4b719f4-99d2-4d7b-8207-c6c04a5b4278 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 12:13:18 user nova-compute[74840]: DEBUG nova.policy [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f26e5df3fa1c4715be2565af1dbb0a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65971596fc0642f3912bad70dc3e4e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 12:13:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:18 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6787d1d-0c90-45af-b253-aa19c9f48722]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:18 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b719f4-99d2-4d7b-8207-c6c04a5b4278 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 12:13:18 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:13:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --interface default --op new {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:18 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9847d321-9e59-4853-b49f-3381bc61d811]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22] added\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:18 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b719f4-99d2-4d7b-8207-c6c04a5b4278 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22] added
Nov 08 12:13:18 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:13:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:18 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fd764d-29ea-4b48-83af-4dc87f296910]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:18 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b719f4-99d2-4d7b-8207-c6c04a5b4278 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:13:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:18 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b3d253-19a7-4bc0-9faf-152978112a81]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:18 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b719f4-99d2-4d7b-8207-c6c04a5b4278 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:13:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WnvQHzjl {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:18 user nova-compute[74840]: DEBUG nova.compute.manager [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Start spawning the instance on the hypervisor. {{(pid=74840) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 12:13:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:13:18 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Creating image(s)
Nov 08 12:13:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Acquiring lock "/opt/stack/data/nova/instances/a0b7a0e1-d0d1-4682-9218-ef44d1e461f1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:13:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Lock "/opt/stack/data/nova/instances/a0b7a0e1-d0d1-4682-9218-ef44d1e461f1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:13:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Lock "/opt/stack/data/nova/instances/a0b7a0e1-d0d1-4682-9218-ef44d1e461f1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:13:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WnvQHzjl" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:18 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[05cd3055-8ec2-4d90-82e4-714f438c4d85]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:18 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b719f4-99d2-4d7b-8207-c6c04a5b4278 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WnvQHzjl'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:13:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:18 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[75364ed4-b2dd-48d2-b1fb-4fd4522e28db]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:18 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b719f4-99d2-4d7b-8207-c6c04a5b4278 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:13:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:18 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7cb47e6-8e64-4a43-9574-d2cca26ae017]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:18 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b719f4-99d2-4d7b-8207-c6c04a5b4278 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)
Nov 08 12:13:18 user nova-compute[74840]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)
Nov 08 12:13:18 user nova-compute[74840]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc (non-flash)
Nov 08 12:13:18 user nova-compute[74840]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b (non-flash)
Nov 08 12:13:18 user nova-compute[74840]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60 (non-flash)
Nov 08 12:13:18 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:13:18 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b719f4-99d2-4d7b-8207-c6c04a5b4278 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)
Nov 08 12:13:18 user nova-compute[74840]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)
Nov 08 12:13:18 user nova-compute[74840]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc (non-flash)
Nov 08 12:13:18 user nova-compute[74840]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b (non-flash)
Nov 08 12:13:18 user nova-compute[74840]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60 (non-flash)
Nov 08 12:13:18 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:13:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --login {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.222s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Acquiring lock "5d26578eba85497f494c575690c4248f381a0fe6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:13:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:13:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.202s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/a0b7a0e1-d0d1-4682-9218-ef44d1e461f1/disk 1073741824 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/a0b7a0e1-d0d1-4682-9218-ef44d1e461f1/disk 1073741824" returned: 0 in 0.050s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:13:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:19 user nova-compute[74840]: DEBUG nova.compute.manager [req-5331d195-333d-43a2-aea1-eefd808c5cf1 req-2e71d200-6697-4937-9480-f91531ec9032 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received event network-vif-plugged-7a2393a4-2d55-49cc-b4af-189d3ab24c1e {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:13:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-5331d195-333d-43a2-aea1-eefd808c5cf1 req-2e71d200-6697-4937-9480-f91531ec9032 service nova] Acquiring lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:13:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-5331d195-333d-43a2-aea1-eefd808c5cf1 req-2e71d200-6697-4937-9480-f91531ec9032 service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:13:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-5331d195-333d-43a2-aea1-eefd808c5cf1 req-2e71d200-6697-4937-9480-f91531ec9032 service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:13:19 user nova-compute[74840]: DEBUG nova.compute.manager [req-5331d195-333d-43a2-aea1-eefd808c5cf1 req-2e71d200-6697-4937-9480-f91531ec9032 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] No waiting events found dispatching network-vif-plugged-7a2393a4-2d55-49cc-b4af-189d3ab24c1e {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:13:19 user nova-compute[74840]: WARNING nova.compute.manager [req-5331d195-333d-43a2-aea1-eefd808c5cf1 req-2e71d200-6697-4937-9480-f91531ec9032 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received unexpected event network-vif-plugged-7a2393a4-2d55-49cc-b4af-189d3ab24c1e for instance with vm_state active and task_state None.
Nov 08 12:13:19 user nova-compute[74840]: DEBUG nova.compute.manager [req-5331d195-333d-43a2-aea1-eefd808c5cf1 req-2e71d200-6697-4937-9480-f91531ec9032 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received event network-vif-plugged-b80b0e8d-2bc7-4e85-8843-c9d8c7931014 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:13:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-5331d195-333d-43a2-aea1-eefd808c5cf1 req-2e71d200-6697-4937-9480-f91531ec9032 service nova] Acquiring lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:13:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-5331d195-333d-43a2-aea1-eefd808c5cf1 req-2e71d200-6697-4937-9480-f91531ec9032 service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:13:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-5331d195-333d-43a2-aea1-eefd808c5cf1 req-2e71d200-6697-4937-9480-f91531ec9032 service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:13:19 user nova-compute[74840]: DEBUG nova.compute.manager [req-5331d195-333d-43a2-aea1-eefd808c5cf1 req-2e71d200-6697-4937-9480-f91531ec9032 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] No waiting events found dispatching network-vif-plugged-b80b0e8d-2bc7-4e85-8843-c9d8c7931014 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:13:19 user nova-compute[74840]: WARNING nova.compute.manager [req-5331d195-333d-43a2-aea1-eefd808c5cf1 req-2e71d200-6697-4937-9480-f91531ec9032 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received unexpected event network-vif-plugged-b80b0e8d-2bc7-4e85-8843-c9d8c7931014 for instance with vm_state active and task_state None.
Nov 08 12:13:19 user nova-compute[74840]: DEBUG nova.compute.manager [req-5331d195-333d-43a2-aea1-eefd808c5cf1 req-2e71d200-6697-4937-9480-f91531ec9032 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received event network-vif-plugged-b80b0e8d-2bc7-4e85-8843-c9d8c7931014 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:13:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-5331d195-333d-43a2-aea1-eefd808c5cf1 req-2e71d200-6697-4937-9480-f91531ec9032 service nova] Acquiring lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:13:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-5331d195-333d-43a2-aea1-eefd808c5cf1 req-2e71d200-6697-4937-9480-f91531ec9032 service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:13:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-5331d195-333d-43a2-aea1-eefd808c5cf1 req-2e71d200-6697-4937-9480-f91531ec9032 service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:13:19 user nova-compute[74840]: DEBUG nova.compute.manager [req-5331d195-333d-43a2-aea1-eefd808c5cf1 req-2e71d200-6697-4937-9480-f91531ec9032 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] No waiting events found dispatching network-vif-plugged-b80b0e8d-2bc7-4e85-8843-c9d8c7931014 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:13:19 user nova-compute[74840]: WARNING nova.compute.manager [req-5331d195-333d-43a2-aea1-eefd808c5cf1 req-2e71d200-6697-4937-9480-f91531ec9032 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received unexpected event network-vif-plugged-b80b0e8d-2bc7-4e85-8843-c9d8c7931014 for instance with vm_state active and task_state None.
Nov 08 12:13:19 user nova-compute[74840]: DEBUG nova.network.neutron [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Successfully created port: 259ddaf9-a353-4528-a451-96ff20064ff1 {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:13:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.215s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:19 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a0b7a0e1-d0d1-4682-9218-ef44d1e461f1/disk. size=1073741824 {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 12:13:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0b7a0e1-d0d1-4682-9218-ef44d1e461f1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0b7a0e1-d0d1-4682-9218-ef44d1e461f1/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:19 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Cannot resize image /opt/stack/data/nova/instances/a0b7a0e1-d0d1-4682-9218-ef44d1e461f1/disk to a smaller size. {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 12:13:19 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Created local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 12:13:19 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Ensure instance console log exists: /opt/stack/data/nova/instances/a0b7a0e1-d0d1-4682-9218-ef44d1e461f1/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:13:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:13:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:13:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:13:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --login" returned: 0 in 1.088s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:19 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34e1e58-3f6f-4726-9143-0e2b7c20e508]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:19 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b719f4-99d2-4d7b-8207-c6c04a5b4278 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22, portal: 172.16.0.220,3260]
Nov 08 12:13:19 user nova-compute[74840]: Login to [iface: default, target: iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22, portal: 172.16.0.220,3260] successful.
Nov 08 12:13:19 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:13:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:19 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f1328b-9057-4528-873e-21ba0db43794]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:19 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b719f4-99d2-4d7b-8207-c6c04a5b4278 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:13:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:19 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d3fe94-d9ac-4809-8a04-ea133535362b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:19 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b719f4-99d2-4d7b-8207-c6c04a5b4278 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)
Nov 08 12:13:19 user nova-compute[74840]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)
Nov 08 12:13:19 user nova-compute[74840]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)
Nov 08 12:13:19 user nova-compute[74840]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc (non-flash)
Nov 08 12:13:19 user nova-compute[74840]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b (non-flash)
Nov 08 12:13:19 user nova-compute[74840]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60 (non-flash)
Nov 08 12:13:19 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:13:19 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b719f4-99d2-4d7b-8207-c6c04a5b4278 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)
Nov 08 12:13:19 user nova-compute[74840]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)
Nov 08 12:13:19 user nova-compute[74840]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)
Nov 08 12:13:19 user nova-compute[74840]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc (non-flash)
Nov 08 12:13:19 user nova-compute[74840]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b (non-flash)
Nov 08 12:13:19 user nova-compute[74840]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60 (non-flash)
Nov 08 12:13:19 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:13:19 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-b4b719f4-99d2-4d7b-8207-c6c04a5b4278 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.427s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:13:19 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b719f4-99d2-4d7b-8207-c6c04a5b4278 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Connected to 172.16.0.220:3260 {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 12:13:19 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-b4b719f4-99d2-4d7b-8207-c6c04a5b4278 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] HCTL ('38', '-', '-', 0) found on session 10 with lun 0 {{(pid=74840) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 12:13:19 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-b4b719f4-99d2-4d7b-8207-c6c04a5b4278 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74840) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 12:13:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc48c4c-c295-44c4-9578-62fa8b634cf8]: (4, ('- - 0', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-b4b719f4-99d2-4d7b-8207-c6c04a5b4278 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Searching for a device in session 10 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b719f4-99d2-4d7b-8207-c6c04a5b4278 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WnvQHzjl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG nova.network.neutron [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Successfully updated port: 259ddaf9-a353-4528-a451-96ff20064ff1 {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Acquiring lock "refresh_cache-a0b7a0e1-d0d1-4682-9218-ef44d1e461f1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Acquired lock "refresh_cache-a0b7a0e1-d0d1-4682-9218-ef44d1e461f1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG nova.network.neutron [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG nova.compute.manager [req-29b5e59b-5691-45b6-840c-73862be903ef req-a772346e-2244-4f17-87ce-3a1a95c05846 service nova] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Received event network-changed-259ddaf9-a353-4528-a451-96ff20064ff1 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG nova.compute.manager [req-29b5e59b-5691-45b6-840c-73862be903ef req-a772346e-2244-4f17-87ce-3a1a95c05846 service nova] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Refreshing instance network info cache due to event network-changed-259ddaf9-a353-4528-a451-96ff20064ff1. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-29b5e59b-5691-45b6-840c-73862be903ef req-a772346e-2244-4f17-87ce-3a1a95c05846 service nova] Acquiring lock "refresh_cache-a0b7a0e1-d0d1-4682-9218-ef44d1e461f1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG nova.network.neutron [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG nova.network.neutron [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Updating instance_info_cache with network_info: [{"id": "259ddaf9-a353-4528-a451-96ff20064ff1", "address": "fa:16:3e:8b:2d:b3", "network": {"id": "b976e3d8-8d34-4f01-942d-c751f6a68780", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-154778043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65971596fc0642f3912bad70dc3e4e07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259ddaf9-a3", "ovs_interfaceid": "259ddaf9-a353-4528-a451-96ff20064ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Releasing lock "refresh_cache-a0b7a0e1-d0d1-4682-9218-ef44d1e461f1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG nova.compute.manager [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Instance network_info: |[{"id": "259ddaf9-a353-4528-a451-96ff20064ff1", "address": "fa:16:3e:8b:2d:b3", "network": {"id": "b976e3d8-8d34-4f01-942d-c751f6a68780", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-154778043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65971596fc0642f3912bad70dc3e4e07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259ddaf9-a3", "ovs_interfaceid": "259ddaf9-a353-4528-a451-96ff20064ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-29b5e59b-5691-45b6-840c-73862be903ef req-a772346e-2244-4f17-87ce-3a1a95c05846 service nova] Acquired lock "refresh_cache-a0b7a0e1-d0d1-4682-9218-ef44d1e461f1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG nova.network.neutron [req-29b5e59b-5691-45b6-840c-73862be903ef req-a772346e-2244-4f17-87ce-3a1a95c05846 service nova] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Refreshing network info cache for port 259ddaf9-a353-4528-a451-96ff20064ff1 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Start _get_guest_xml network_info=[{"id": "259ddaf9-a353-4528-a451-96ff20064ff1", "address": "fa:16:3e:8b:2d:b3", "network": {"id": "b976e3d8-8d34-4f01-942d-c751f6a68780", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-154778043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65971596fc0642f3912bad70dc3e4e07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259ddaf9-a3", "ovs_interfaceid": "259ddaf9-a353-4528-a451-96ff20064ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'image_id': '4fa17706-d304-4117-a420-dab994c703dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:13:20 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:13:20 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:13:20 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:13:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1652328863',display_name='tempest-SnapshotDataIntegrityTests-server-1652328863',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1652328863',id=12,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHM/dg7SdKK5a9V4GEkbb3T2fQTNAH4Aw8YQ7uwF+Lkwv/PfkA+956TGTE2COo6c9c5IieNgxwFHUyb2et2Dq4VW5v/TKCQ6dadaXXelhZ7VklXHH2WSIvo0nbjYuAmtyg==',key_name='tempest-keypair-246279031',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65971596fc0642f3912bad70dc3e4e07',ramdisk_id='',reservation_id='r-nvtfufvt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-11119301',owner_user_name='tempest-SnapshotDataIntegrityTests-11119301-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:13:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f26e5df3fa1c4715be2565af1dbb0a03',uuid=a0b7a0e1-d0d1-4682-9218-ef44d1e461f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "259ddaf9-a353-4528-a451-96ff20064ff1", "address": "fa:16:3e:8b:2d:b3", "network": {"id": "b976e3d8-8d34-4f01-942d-c751f6a68780", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-154778043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65971596fc0642f3912bad70dc3e4e07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259ddaf9-a3", "ovs_interfaceid": "259ddaf9-a353-4528-a451-96ff20064ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Converting VIF {"id": "259ddaf9-a353-4528-a451-96ff20064ff1", "address": "fa:16:3e:8b:2d:b3", "network": {"id": "b976e3d8-8d34-4f01-942d-c751f6a68780", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-154778043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65971596fc0642f3912bad70dc3e4e07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259ddaf9-a3", "ovs_interfaceid": "259ddaf9-a353-4528-a451-96ff20064ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:2d:b3,bridge_name='br-int',has_traffic_filtering=True,id=259ddaf9-a353-4528-a451-96ff20064ff1,network=Network(b976e3d8-8d34-4f01-942d-c751f6a68780),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap259ddaf9-a3') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG nova.objects.instance [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Lazy-loading 'pci_devices' on Instance uuid a0b7a0e1-d0d1-4682-9218-ef44d1e461f1 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:13:20 user nova-compute[74840]:   <uuid>a0b7a0e1-d0d1-4682-9218-ef44d1e461f1</uuid>
Nov 08 12:13:20 user nova-compute[74840]:   <name>instance-0000000c</name>
Nov 08 12:13:20 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:13:20 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:13:20 user nova-compute[74840]:   <metadata>
Nov 08 12:13:20 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:13:20 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:13:20 user nova-compute[74840]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1652328863</nova:name>
Nov 08 12:13:20 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:13:20</nova:creationTime>
Nov 08 12:13:20 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:13:20 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:13:20 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:13:20 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:13:20 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:13:20 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:13:20 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:13:20 user nova-compute[74840]:       <nova:owner>
Nov 08 12:13:20 user nova-compute[74840]:         <nova:user uuid="f26e5df3fa1c4715be2565af1dbb0a03">tempest-SnapshotDataIntegrityTests-11119301-project-member</nova:user>
Nov 08 12:13:20 user nova-compute[74840]:         <nova:project uuid="65971596fc0642f3912bad70dc3e4e07">tempest-SnapshotDataIntegrityTests-11119301</nova:project>
Nov 08 12:13:20 user nova-compute[74840]:       </nova:owner>
Nov 08 12:13:20 user nova-compute[74840]:       <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:13:20 user nova-compute[74840]:       <nova:ports>
Nov 08 12:13:20 user nova-compute[74840]:         <nova:port uuid="259ddaf9-a353-4528-a451-96ff20064ff1">
Nov 08 12:13:20 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 08 12:13:20 user nova-compute[74840]:         </nova:port>
Nov 08 12:13:20 user nova-compute[74840]:       </nova:ports>
Nov 08 12:13:20 user nova-compute[74840]:     </nova:instance>
Nov 08 12:13:20 user nova-compute[74840]:   </metadata>
Nov 08 12:13:20 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:13:20 user nova-compute[74840]:     <system>
Nov 08 12:13:20 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:13:20 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:13:20 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:13:20 user nova-compute[74840]:       <entry name="serial">a0b7a0e1-d0d1-4682-9218-ef44d1e461f1</entry>
Nov 08 12:13:20 user nova-compute[74840]:       <entry name="uuid">a0b7a0e1-d0d1-4682-9218-ef44d1e461f1</entry>
Nov 08 12:13:20 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:13:20 user nova-compute[74840]:     </system>
Nov 08 12:13:20 user nova-compute[74840]:   </sysinfo>
Nov 08 12:13:20 user nova-compute[74840]:   <os>
Nov 08 12:13:20 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:13:20 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:13:20 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:13:20 user nova-compute[74840]:   </os>
Nov 08 12:13:20 user nova-compute[74840]:   <features>
Nov 08 12:13:20 user nova-compute[74840]:     <acpi/>
Nov 08 12:13:20 user nova-compute[74840]:     <apic/>
Nov 08 12:13:20 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:13:20 user nova-compute[74840]:   </features>
Nov 08 12:13:20 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:13:20 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:13:20 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:13:20 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:13:20 user nova-compute[74840]:   </clock>
Nov 08 12:13:20 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:13:20 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:13:20 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:13:20 user nova-compute[74840]:   </cpu>
Nov 08 12:13:20 user nova-compute[74840]:   <devices>
Nov 08 12:13:20 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:13:20 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:13:20 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/a0b7a0e1-d0d1-4682-9218-ef44d1e461f1/disk"/>
Nov 08 12:13:20 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:13:20 user nova-compute[74840]:     </disk>
Nov 08 12:13:20 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:13:20 user nova-compute[74840]:       <mac address="fa:16:3e:8b:2d:b3"/>
Nov 08 12:13:20 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:13:20 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:13:20 user nova-compute[74840]:       <target dev="tap259ddaf9-a3"/>
Nov 08 12:13:20 user nova-compute[74840]:     </interface>
Nov 08 12:13:20 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:13:20 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/a0b7a0e1-d0d1-4682-9218-ef44d1e461f1/console.log" append="off"/>
Nov 08 12:13:20 user nova-compute[74840]:     </serial>
Nov 08 12:13:20 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:13:20 user nova-compute[74840]:     <video>
Nov 08 12:13:20 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:13:20 user nova-compute[74840]:     </video>
Nov 08 12:13:20 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:13:20 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:13:20 user nova-compute[74840]:     </rng>
Nov 08 12:13:20 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:13:20 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:13:20 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:13:20 user nova-compute[74840]:     </memballoon>
Nov 08 12:13:20 user nova-compute[74840]:   </devices>
Nov 08 12:13:20 user nova-compute[74840]: </domain>
Nov 08 12:13:20 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:13:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1652328863',display_name='tempest-SnapshotDataIntegrityTests-server-1652328863',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1652328863',id=12,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHM/dg7SdKK5a9V4GEkbb3T2fQTNAH4Aw8YQ7uwF+Lkwv/PfkA+956TGTE2COo6c9c5IieNgxwFHUyb2et2Dq4VW5v/TKCQ6dadaXXelhZ7VklXHH2WSIvo0nbjYuAmtyg==',key_name='tempest-keypair-246279031',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65971596fc0642f3912bad70dc3e4e07',ramdisk_id='',reservation_id='r-nvtfufvt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-11119301',owner_user_name='tempest-SnapshotDataIntegrityTests-11119301-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:13:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f26e5df3fa1c4715be2565af1dbb0a03',uuid=a0b7a0e1-d0d1-4682-9218-ef44d1e461f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "259ddaf9-a353-4528-a451-96ff20064ff1", "address": "fa:16:3e:8b:2d:b3", "network": {"id": "b976e3d8-8d34-4f01-942d-c751f6a68780", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-154778043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65971596fc0642f3912bad70dc3e4e07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259ddaf9-a3", "ovs_interfaceid": "259ddaf9-a353-4528-a451-96ff20064ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Converting VIF {"id": "259ddaf9-a353-4528-a451-96ff20064ff1", "address": "fa:16:3e:8b:2d:b3", "network": {"id": "b976e3d8-8d34-4f01-942d-c751f6a68780", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-154778043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65971596fc0642f3912bad70dc3e4e07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259ddaf9-a3", "ovs_interfaceid": "259ddaf9-a353-4528-a451-96ff20064ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:2d:b3,bridge_name='br-int',has_traffic_filtering=True,id=259ddaf9-a353-4528-a451-96ff20064ff1,network=Network(b976e3d8-8d34-4f01-942d-c751f6a68780),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap259ddaf9-a3') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG os_vif [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:2d:b3,bridge_name='br-int',has_traffic_filtering=True,id=259ddaf9-a353-4528-a451-96ff20064ff1,network=Network(b976e3d8-8d34-4f01-942d-c751f6a68780),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap259ddaf9-a3') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f7ad0033-b228-5e2b-ab1d-b8d8904579bc', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap259ddaf9-a3, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap259ddaf9-a3, col_values=(('qos', UUID('553b3369-8ae4-4f77-b3dd-55c78d68a109')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap259ddaf9-a3, col_values=(('external_ids', {'iface-id': '259ddaf9-a353-4528-a451-96ff20064ff1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:2d:b3', 'vm-uuid': 'a0b7a0e1-d0d1-4682-9218-ef44d1e461f1'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:13:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:20 user nova-compute[74840]: INFO os_vif [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:2d:b3,bridge_name='br-int',has_traffic_filtering=True,id=259ddaf9-a353-4528-a451-96ff20064ff1,network=Network(b976e3d8-8d34-4f01-942d-c751f6a68780),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap259ddaf9-a3')
Nov 08 12:13:21 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:13:21 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] No VIF found with MAC fa:16:3e:8b:2d:b3, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:13:21 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-b4b719f4-99d2-4d7b-8207-c6c04a5b4278 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.482s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:13:21 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b719f4-99d2-4d7b-8207-c6c04a5b4278 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] <== connect_volume: return (2485ms) {'type': 'block', 'scsi_wwn': '26361373339653139', 'path': '/dev/sdg'} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:13:21 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4b719f4-99d2-4d7b-8207-c6c04a5b4278 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361373339653139', 'path': '/dev/sdg'} {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 12:13:21 user nova-compute[74840]: DEBUG nova.objects.instance [None req-b4b719f4-99d2-4d7b-8207-c6c04a5b4278 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lazy-loading 'flavor' on Instance uuid 3b10fda0-9488-4089-8033-dd1c8e42af89 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:13:21 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-b4b719f4-99d2-4d7b-8207-c6c04a5b4278 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 12:13:21 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:13:21 user nova-compute[74840]:   <source dev="/dev/sdg"/>
Nov 08 12:13:21 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:13:21 user nova-compute[74840]:   <serial>3d161c9a-4d64-4a8b-9525-225154403d22</serial>
Nov 08 12:13:21 user nova-compute[74840]: </disk>
Nov 08 12:13:21 user nova-compute[74840]:  {{(pid=74840) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 12:13:21 user nova-compute[74840]: DEBUG nova.network.neutron [req-29b5e59b-5691-45b6-840c-73862be903ef req-a772346e-2244-4f17-87ce-3a1a95c05846 service nova] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Updated VIF entry in instance network info cache for port 259ddaf9-a353-4528-a451-96ff20064ff1. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:13:21 user nova-compute[74840]: DEBUG nova.network.neutron [req-29b5e59b-5691-45b6-840c-73862be903ef req-a772346e-2244-4f17-87ce-3a1a95c05846 service nova] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Updating instance_info_cache with network_info: [{"id": "259ddaf9-a353-4528-a451-96ff20064ff1", "address": "fa:16:3e:8b:2d:b3", "network": {"id": "b976e3d8-8d34-4f01-942d-c751f6a68780", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-154778043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65971596fc0642f3912bad70dc3e4e07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259ddaf9-a3", "ovs_interfaceid": "259ddaf9-a353-4528-a451-96ff20064ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:13:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-29b5e59b-5691-45b6-840c-73862be903ef req-a772346e-2244-4f17-87ce-3a1a95c05846 service nova] Releasing lock "refresh_cache-a0b7a0e1-d0d1-4682-9218-ef44d1e461f1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:13:22 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b4b719f4-99d2-4d7b-8207-c6c04a5b4278 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:13:22 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b4b719f4-99d2-4d7b-8207-c6c04a5b4278 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:13:22 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b4b719f4-99d2-4d7b-8207-c6c04a5b4278 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] No VIF found with MAC fa:16:3e:19:58:1f, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:13:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b4b719f4-99d2-4d7b-8207-c6c04a5b4278 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lock "3b10fda0-9488-4089-8033-dd1c8e42af89" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 32.181s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:13:22 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:22 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:22 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:23 user nova-compute[74840]: DEBUG nova.compute.manager [req-4b8e2cd1-f412-4faf-93cf-9dc9e387f274 req-586ee39e-c471-4fac-a914-ae7ee422d7c8 service nova] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Received event network-vif-plugged-259ddaf9-a353-4528-a451-96ff20064ff1 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:13:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4b8e2cd1-f412-4faf-93cf-9dc9e387f274 req-586ee39e-c471-4fac-a914-ae7ee422d7c8 service nova] Acquiring lock "a0b7a0e1-d0d1-4682-9218-ef44d1e461f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:13:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4b8e2cd1-f412-4faf-93cf-9dc9e387f274 req-586ee39e-c471-4fac-a914-ae7ee422d7c8 service nova] Lock "a0b7a0e1-d0d1-4682-9218-ef44d1e461f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:13:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4b8e2cd1-f412-4faf-93cf-9dc9e387f274 req-586ee39e-c471-4fac-a914-ae7ee422d7c8 service nova] Lock "a0b7a0e1-d0d1-4682-9218-ef44d1e461f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:13:23 user nova-compute[74840]: DEBUG nova.compute.manager [req-4b8e2cd1-f412-4faf-93cf-9dc9e387f274 req-586ee39e-c471-4fac-a914-ae7ee422d7c8 service nova] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] No waiting events found dispatching network-vif-plugged-259ddaf9-a353-4528-a451-96ff20064ff1 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:13:23 user nova-compute[74840]: WARNING nova.compute.manager [req-4b8e2cd1-f412-4faf-93cf-9dc9e387f274 req-586ee39e-c471-4fac-a914-ae7ee422d7c8 service nova] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Received unexpected event network-vif-plugged-259ddaf9-a353-4528-a451-96ff20064ff1 for instance with vm_state building and task_state spawning.
Nov 08 12:13:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:25 user nova-compute[74840]: DEBUG nova.compute.manager [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Stashing vm_state: active {{(pid=74840) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 08 12:13:25 user nova-compute[74840]: DEBUG nova.compute.manager [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:13:25 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:13:25 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Instance spawned successfully.
Nov 08 12:13:25 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:13:25 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Found default for hw_cdrom_bus of ide {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:13:25 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Found default for hw_disk_bus of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:13:25 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:13:25 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:13:25 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Found default for hw_video_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:13:25 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Found default for hw_vif_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:13:25 user nova-compute[74840]: INFO nova.compute.manager [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Took 6.57 seconds to spawn the instance on the hypervisor.
Nov 08 12:13:25 user nova-compute[74840]: DEBUG nova.compute.manager [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:13:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:13:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:13:25 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:13:25 user nova-compute[74840]: INFO nova.compute.claims [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Claim successful on node user
Nov 08 12:13:25 user nova-compute[74840]: DEBUG nova.compute.manager [req-41cf2c7a-de78-46b2-81b3-3ac23a63c979 req-b2256cd7-be5b-4f9a-8ebb-e7e114166c36 service nova] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Received event network-vif-plugged-259ddaf9-a353-4528-a451-96ff20064ff1 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:13:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-41cf2c7a-de78-46b2-81b3-3ac23a63c979 req-b2256cd7-be5b-4f9a-8ebb-e7e114166c36 service nova] Acquiring lock "a0b7a0e1-d0d1-4682-9218-ef44d1e461f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:13:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-41cf2c7a-de78-46b2-81b3-3ac23a63c979 req-b2256cd7-be5b-4f9a-8ebb-e7e114166c36 service nova] Lock "a0b7a0e1-d0d1-4682-9218-ef44d1e461f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:13:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-41cf2c7a-de78-46b2-81b3-3ac23a63c979 req-b2256cd7-be5b-4f9a-8ebb-e7e114166c36 service nova] Lock "a0b7a0e1-d0d1-4682-9218-ef44d1e461f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:13:25 user nova-compute[74840]: DEBUG nova.compute.manager [req-41cf2c7a-de78-46b2-81b3-3ac23a63c979 req-b2256cd7-be5b-4f9a-8ebb-e7e114166c36 service nova] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] No waiting events found dispatching network-vif-plugged-259ddaf9-a353-4528-a451-96ff20064ff1 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:13:25 user nova-compute[74840]: WARNING nova.compute.manager [req-41cf2c7a-de78-46b2-81b3-3ac23a63c979 req-b2256cd7-be5b-4f9a-8ebb-e7e114166c36 service nova] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Received unexpected event network-vif-plugged-259ddaf9-a353-4528-a451-96ff20064ff1 for instance with vm_state active and task_state None.
Nov 08 12:13:25 user nova-compute[74840]: INFO nova.compute.manager [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Took 7.52 seconds to build instance.
Nov 08 12:13:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-23a61782-ae0e-4ecb-912f-feef6b9fb211 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Lock "a0b7a0e1-d0d1-4682-9218-ef44d1e461f1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.621s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:13:25 user nova-compute[74840]: INFO nova.compute.resource_tracker [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Updating resource usage from migration 71afe97b-bd77-44bf-a107-3616642fe417
Nov 08 12:13:25 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:13:25 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:13:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.493s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:13:25 user nova-compute[74840]: INFO nova.compute.manager [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Migrating
Nov 08 12:13:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:13:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:13:25 user nova-compute[74840]: INFO nova.compute.rpcapi [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 08 12:13:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:13:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Acquiring lock "refresh_cache-3b10fda0-9488-4089-8033-dd1c8e42af89" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:13:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Acquired lock "refresh_cache-3b10fda0-9488-4089-8033-dd1c8e42af89" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:13:25 user nova-compute[74840]: DEBUG nova.network.neutron [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:13:25 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:26 user nova-compute[74840]: DEBUG nova.network.neutron [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Updating instance_info_cache with network_info: [{"id": "b48b5298-045f-463d-9585-fbb5feb869bf", "address": "fa:16:3e:19:58:1f", "network": {"id": "9dec89b0-562f-482c-aec1-d024351d0bd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-237264167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a544910dc2c4b169c986fa74b5979d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48b5298-04", "ovs_interfaceid": "b48b5298-045f-463d-9585-fbb5feb869bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:13:26 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Releasing lock "refresh_cache-3b10fda0-9488-4089-8033-dd1c8e42af89" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:13:26 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Starting migrate_disk_and_power_off {{(pid=74840) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 08 12:13:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:27 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Instance destroyed successfully.
Nov 08 12:13:27 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:08:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-172158050',display_name='tempest-ServerActionsTestOtherB-server-172158050',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-172158050',id=3,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJKFMe0GKEBW9KmyXjqsjBsUl5GOfddH2uub399MmagL+sAbL8XpD7Zv97iB27MfsDGdoFheqqd0EDelgcb+/IZFf73OQgm/+DITCITQulDQXkqFfn6taEL9Zjc2Dr8/0g==',key_name='tempest-keypair-2038726199',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:09:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7a544910dc2c4b169c986fa74b5979d9',ramdisk_id='',reservation_id='r-o6735td4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1148036573',owner_user_name='tempest-ServerActionsTestOtherB-1148036573-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:13:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47ef9bdd58a147518d0a09267731b67c',uuid=3b10fda0-9488-4089-8033-dd1c8e42af89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b48b5298-045f-463d-9585-fbb5feb869bf", "address": "fa:16:3e:19:58:1f", "network": {"id": "9dec89b0-562f-482c-aec1-d024351d0bd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-237264167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-237264167-network", "vif_mac": "fa:16:3e:19:58:1f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a544910dc2c4b169c986fa74b5979d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48b5298-04", "ovs_interfaceid": "b48b5298-045f-463d-9585-fbb5feb869bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Converting VIF {"id": "b48b5298-045f-463d-9585-fbb5feb869bf", "address": "fa:16:3e:19:58:1f", "network": {"id": "9dec89b0-562f-482c-aec1-d024351d0bd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-237264167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-237264167-network", "vif_mac": "fa:16:3e:19:58:1f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a544910dc2c4b169c986fa74b5979d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48b5298-04", "ovs_interfaceid": "b48b5298-045f-463d-9585-fbb5feb869bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:58:1f,bridge_name='br-int',has_traffic_filtering=True,id=b48b5298-045f-463d-9585-fbb5feb869bf,network=Network(9dec89b0-562f-482c-aec1-d024351d0bd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb48b5298-04') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG os_vif [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:58:1f,bridge_name='br-int',has_traffic_filtering=True,id=b48b5298-045f-463d-9585-fbb5feb869bf,network=Network(9dec89b0-562f-482c-aec1-d024351d0bd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb48b5298-04') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb48b5298-04, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bf8886b0-ec1c-43ce-adaf-da8be49b4e3f) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:13:27 user nova-compute[74840]: INFO os_vif [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:58:1f,bridge_name='br-int',has_traffic_filtering=True,id=b48b5298-045f-463d-9585-fbb5feb869bf,network=Network(9dec89b0-562f-482c-aec1-d024351d0bd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb48b5298-04')
Nov 08 12:13:27 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WnvQHzjl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:13:27 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:13:27 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f4b65b-d375-4c8f-8580-3233d92085b5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 12:13:27 user nova-compute[74840]: No targets found.
Nov 08 12:13:27 user nova-compute[74840]: iSNS:
Nov 08 12:13:27 user nova-compute[74840]: No targets found.
Nov 08 12:13:27 user nova-compute[74840]: STATIC:
Nov 08 12:13:27 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22
Nov 08 12:13:27 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:13:27 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:13:27 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097
Nov 08 12:13:27 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:13:27 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:13:27 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc
Nov 08 12:13:27 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:13:27 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:13:27 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9
Nov 08 12:13:27 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:13:27 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:13:27 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60
Nov 08 12:13:27 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:13:27 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:13:27 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b
Nov 08 12:13:27 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:13:27 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:13:27 user nova-compute[74840]: FIRMWARE:
Nov 08 12:13:27 user nova-compute[74840]: No targets found.
Nov 08 12:13:27 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 12:13:27 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 12:13:27 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2cd8ddf-4efb-4f81-a76e-b952093899e8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[084eefe7-ca9f-4d2b-9b24-26a5d23ff883]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)
Nov 08 12:13:27 user nova-compute[74840]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)
Nov 08 12:13:27 user nova-compute[74840]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)
Nov 08 12:13:27 user nova-compute[74840]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc (non-flash)
Nov 08 12:13:27 user nova-compute[74840]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b (non-flash)
Nov 08 12:13:27 user nova-compute[74840]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60 (non-flash)
Nov 08 12:13:27 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)
Nov 08 12:13:27 user nova-compute[74840]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)
Nov 08 12:13:27 user nova-compute[74840]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)
Nov 08 12:13:27 user nova-compute[74840]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc (non-flash)
Nov 08 12:13:27 user nova-compute[74840]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b (non-flash)
Nov 08 12:13:27 user nova-compute[74840]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60 (non-flash)
Nov 08 12:13:27 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7f4267f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22'): ({'sdg'}, set())}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Removing single pathed devices sdg {{(pid=74840) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[24862ba6-981a-497b-b05e-35a7b9208320]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG nova.compute.manager [req-6b9357ea-47f1-44d2-a19f-a5e5f873b4d9 req-a59f8ffd-bb1e-4188-be78-3cd4fe96b0ab service nova] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Received event network-vif-unplugged-b48b5298-045f-463d-9585-fbb5feb869bf {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-6b9357ea-47f1-44d2-a19f-a5e5f873b4d9 req-a59f8ffd-bb1e-4188-be78-3cd4fe96b0ab service nova] Acquiring lock "3b10fda0-9488-4089-8033-dd1c8e42af89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-6b9357ea-47f1-44d2-a19f-a5e5f873b4d9 req-a59f8ffd-bb1e-4188-be78-3cd4fe96b0ab service nova] Lock "3b10fda0-9488-4089-8033-dd1c8e42af89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-6b9357ea-47f1-44d2-a19f-a5e5f873b4d9 req-a59f8ffd-bb1e-4188-be78-3cd4fe96b0ab service nova] Lock "3b10fda0-9488-4089-8033-dd1c8e42af89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG nova.compute.manager [req-6b9357ea-47f1-44d2-a19f-a5e5f873b4d9 req-a59f8ffd-bb1e-4188-be78-3cd4fe96b0ab service nova] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] No waiting events found dispatching network-vif-unplugged-b48b5298-045f-463d-9585-fbb5feb869bf {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:13:27 user nova-compute[74840]: WARNING nova.compute.manager [req-6b9357ea-47f1-44d2-a19f-a5e5f873b4d9 req-a59f8ffd-bb1e-4188-be78-3cd4fe96b0ab service nova] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Received unexpected event network-vif-unplugged-b48b5298-045f-463d-9585-fbb5feb869bf for instance with vm_state active and task_state resize_migrating.
Nov 08 12:13:27 user nova-compute[74840]: DEBUG nova.compute.manager [req-6b9357ea-47f1-44d2-a19f-a5e5f873b4d9 req-a59f8ffd-bb1e-4188-be78-3cd4fe96b0ab service nova] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Received event network-vif-plugged-b48b5298-045f-463d-9585-fbb5feb869bf {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-6b9357ea-47f1-44d2-a19f-a5e5f873b4d9 req-a59f8ffd-bb1e-4188-be78-3cd4fe96b0ab service nova] Acquiring lock "3b10fda0-9488-4089-8033-dd1c8e42af89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-6b9357ea-47f1-44d2-a19f-a5e5f873b4d9 req-a59f8ffd-bb1e-4188-be78-3cd4fe96b0ab service nova] Lock "3b10fda0-9488-4089-8033-dd1c8e42af89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-6b9357ea-47f1-44d2-a19f-a5e5f873b4d9 req-a59f8ffd-bb1e-4188-be78-3cd4fe96b0ab service nova] Lock "3b10fda0-9488-4089-8033-dd1c8e42af89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG nova.compute.manager [req-6b9357ea-47f1-44d2-a19f-a5e5f873b4d9 req-a59f8ffd-bb1e-4188-be78-3cd4fe96b0ab service nova] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] No waiting events found dispatching network-vif-plugged-b48b5298-045f-463d-9585-fbb5feb869bf {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:13:27 user nova-compute[74840]: WARNING nova.compute.manager [req-6b9357ea-47f1-44d2-a19f-a5e5f873b4d9 req-a59f8ffd-bb1e-4188-be78-3cd4fe96b0ab service nova] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Received unexpected event network-vif-plugged-b48b5298-045f-463d-9585-fbb5feb869bf for instance with vm_state active and task_state resize_migrating.
Nov 08 12:13:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.026s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[105e4af1-a828-4f04-b8bc-b8fc2ed94ad7]: (4, ('ok\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Flushing IO for device /dev/sdg {{(pid=74840) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[179e2553-0ef4-4b14-a4af-7a8e35ed1f28]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74840) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.036s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[260b401f-b37c-440b-a5fe-181164c80b07]: (4, ('1', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] SCSI volumes sdg have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22')] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3a1677-ce50-4705-8aeb-91322dfa86e5]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --logout {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbe721b-4dc0-4b5a-b665-5a80efe29ef9]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22, portal: 172.16.0.220,3260]
Nov 08 12:13:27 user nova-compute[74840]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22, portal: 172.16.0.220,3260] successful.
Nov 08 12:13:27 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --op delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.050s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[570a86eb-72d4-4493-afba-48ad2ba6cf42]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.419s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] <== disconnect_volume: return (422ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:28 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:28 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:13:28 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89_resize/disk /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:28 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] CMD "cp -r /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89_resize/disk /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk" returned: 0 in 0.349s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:28 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89_resize/disk.info /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk.info {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:28 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] CMD "cp -r /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89_resize/disk.info /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk.info" returned: 0 in 0.042s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:30 user nova-compute[74840]: DEBUG nova.network.neutron [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Port b48b5298-045f-463d-9585-fbb5feb869bf binding to destination host user is already ACTIVE {{(pid=74840) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 08 12:13:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Acquiring lock "3b10fda0-9488-4089-8033-dd1c8e42af89-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:13:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lock "3b10fda0-9488-4089-8033-dd1c8e42af89-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:13:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lock "3b10fda0-9488-4089-8033-dd1c8e42af89-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:13:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Acquiring lock "refresh_cache-3b10fda0-9488-4089-8033-dd1c8e42af89" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:13:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Acquired lock "refresh_cache-3b10fda0-9488-4089-8033-dd1c8e42af89" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:13:30 user nova-compute[74840]: DEBUG nova.network.neutron [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:13:31 user nova-compute[74840]: DEBUG nova.network.neutron [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Updating instance_info_cache with network_info: [{"id": "b48b5298-045f-463d-9585-fbb5feb869bf", "address": "fa:16:3e:19:58:1f", "network": {"id": "9dec89b0-562f-482c-aec1-d024351d0bd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-237264167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a544910dc2c4b169c986fa74b5979d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48b5298-04", "ovs_interfaceid": "b48b5298-045f-463d-9585-fbb5feb869bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:13:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Releasing lock "refresh_cache-3b10fda0-9488-4089-8033-dd1c8e42af89" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:13:31 user nova-compute[74840]: DEBUG os_brick.utils [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:13:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:31 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8871a00c-d275-488f-b5b2-7f59d22a04f7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c8228a11e03c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:31 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74ad5d7-6f33-4918-974a-a34959046c3e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:31 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f1ac0e-cd52-4d3b-9710-a3b85ee85383]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:31 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8690335-0e4f-43f1-909f-31939be09667]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Running cmd (subprocess): nvme version {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] 'nvme version' failed. Not Retrying. {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:13:31 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] nvme not present on system {{(pid=74840) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 12:13:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:13:31 user nova-compute[74840]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 12:13:31 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[288c9d75-3b15-48f2-983f-726676c9f807]: (4, '') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:13:31 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74840) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 12:13:31 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 12:13:31 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] LIGHTOS: no hostnqn found. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 12:13:31 user nova-compute[74840]: DEBUG os_brick.utils [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c8228a11e03c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:13:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:43 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:44 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:13:44 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:13:44 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:13:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "refresh_cache-58f2a38d-14cf-4199-bb04-179ab4605a9e" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:13:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquired lock "refresh_cache-58f2a38d-14cf-4199-bb04-179ab4605a9e" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:13:44 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Forcefully refreshing network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 12:13:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:45 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Updating instance_info_cache with network_info: [{"id": "62ca1e88-0819-443c-890f-05f6538b8f3e", "address": "fa:16:3e:3b:d1:37", "network": {"id": "6462e35c-7722-46f1-afee-a088965b85e8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-713817565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b4cf1a052c48c2a33f1f645c2b52a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62ca1e88-08", "ovs_interfaceid": "62ca1e88-0819-443c-890f-05f6538b8f3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:13:45 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Releasing lock "refresh_cache-58f2a38d-14cf-4199-bb04-179ab4605a9e" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:13:45 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Updated the network info_cache for instance {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 12:13:45 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:13:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:46 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:13:46 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:13:46 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:13:46 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:13:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-7509b3b3-a5d9-41cd-9b46-b4ec951a9787 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Acquiring lock "09d9af99-7d2c-4c14-b60a-d8d9a09a238a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:13:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-7509b3b3-a5d9-41cd-9b46-b4ec951a9787 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Lock "09d9af99-7d2c-4c14-b60a-d8d9a09a238a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:13:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-7509b3b3-a5d9-41cd-9b46-b4ec951a9787 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Acquiring lock "09d9af99-7d2c-4c14-b60a-d8d9a09a238a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:13:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-7509b3b3-a5d9-41cd-9b46-b4ec951a9787 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Lock "09d9af99-7d2c-4c14-b60a-d8d9a09a238a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:13:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-7509b3b3-a5d9-41cd-9b46-b4ec951a9787 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Lock "09d9af99-7d2c-4c14-b60a-d8d9a09a238a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:13:48 user nova-compute[74840]: INFO nova.compute.manager [None req-7509b3b3-a5d9-41cd-9b46-b4ec951a9787 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Terminating instance
Nov 08 12:13:48 user nova-compute[74840]: DEBUG nova.compute.manager [None req-7509b3b3-a5d9-41cd-9b46-b4ec951a9787 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Start destroying the instance on the hypervisor. {{(pid=74840) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 12:13:48 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:48 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:48 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:48 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:48 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:13:48 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:13:48 user nova-compute[74840]: DEBUG nova.compute.manager [req-b7aa6237-2ae5-4af1-a513-700fd385b21e req-c3bbcc7a-faf6-4521-864c-68a4e3d6d3cb service nova] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Received event network-vif-unplugged-e9f1881c-9e7c-4bfb-a707-001e0661d547 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:13:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-b7aa6237-2ae5-4af1-a513-700fd385b21e req-c3bbcc7a-faf6-4521-864c-68a4e3d6d3cb service nova] Acquiring lock "09d9af99-7d2c-4c14-b60a-d8d9a09a238a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:13:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-b7aa6237-2ae5-4af1-a513-700fd385b21e req-c3bbcc7a-faf6-4521-864c-68a4e3d6d3cb service nova] Lock "09d9af99-7d2c-4c14-b60a-d8d9a09a238a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:13:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-b7aa6237-2ae5-4af1-a513-700fd385b21e req-c3bbcc7a-faf6-4521-864c-68a4e3d6d3cb service nova] Lock "09d9af99-7d2c-4c14-b60a-d8d9a09a238a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:13:48 user nova-compute[74840]: DEBUG nova.compute.manager [req-b7aa6237-2ae5-4af1-a513-700fd385b21e req-c3bbcc7a-faf6-4521-864c-68a4e3d6d3cb service nova] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] No waiting events found dispatching network-vif-unplugged-e9f1881c-9e7c-4bfb-a707-001e0661d547 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:13:48 user nova-compute[74840]: DEBUG nova.compute.manager [req-b7aa6237-2ae5-4af1-a513-700fd385b21e req-c3bbcc7a-faf6-4521-864c-68a4e3d6d3cb service nova] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Received event network-vif-unplugged-e9f1881c-9e7c-4bfb-a707-001e0661d547 for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:13:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:13:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:13:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:13:48 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:13:49 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Instance destroyed successfully.
Nov 08 12:13:49 user nova-compute[74840]: DEBUG nova.objects.instance [None req-7509b3b3-a5d9-41cd-9b46-b4ec951a9787 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Lazy-loading 'resources' on Instance uuid 09d9af99-7d2c-4c14-b60a-d8d9a09a238a {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:13:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-7509b3b3-a5d9-41cd-9b46-b4ec951a9787 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:11:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1132875793',display_name='tempest-VolumesActionsTest-instance-1132875793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1132875793',id=11,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:11:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='61425acd382749c4b5aa3be318d960dc',ramdisk_id='',reservation_id='r-4nq6e3aq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1993355233',owner_user_name='tempest-VolumesActionsTest-1993355233-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:11:44Z,user_data=None,user_id='0100bdf083284c259124c8e0cd54c206',uuid=09d9af99-7d2c-4c14-b60a-d8d9a09a238a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9f1881c-9e7c-4bfb-a707-001e0661d547", "address": "fa:16:3e:21:ee:48", "network": {"id": "bb983406-3cd0-4bcf-be98-e896ecde4afa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-652426848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61425acd382749c4b5aa3be318d960dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9f1881c-9e", "ovs_interfaceid": "e9f1881c-9e7c-4bfb-a707-001e0661d547", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:13:49 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-7509b3b3-a5d9-41cd-9b46-b4ec951a9787 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Converting VIF {"id": "e9f1881c-9e7c-4bfb-a707-001e0661d547", "address": "fa:16:3e:21:ee:48", "network": {"id": "bb983406-3cd0-4bcf-be98-e896ecde4afa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-652426848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61425acd382749c4b5aa3be318d960dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9f1881c-9e", "ovs_interfaceid": "e9f1881c-9e7c-4bfb-a707-001e0661d547", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:13:49 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-7509b3b3-a5d9-41cd-9b46-b4ec951a9787 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:ee:48,bridge_name='br-int',has_traffic_filtering=True,id=e9f1881c-9e7c-4bfb-a707-001e0661d547,network=Network(bb983406-3cd0-4bcf-be98-e896ecde4afa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9f1881c-9e') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:13:49 user nova-compute[74840]: DEBUG os_vif [None req-7509b3b3-a5d9-41cd-9b46-b4ec951a9787 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:ee:48,bridge_name='br-int',has_traffic_filtering=True,id=e9f1881c-9e7c-4bfb-a707-001e0661d547,network=Network(bb983406-3cd0-4bcf-be98-e896ecde4afa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9f1881c-9e') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:13:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9f1881c-9e, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:13:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:13:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=563f227d-36c2-4b87-9801-b0f66f4eb0aa) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:13:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:49 user nova-compute[74840]: INFO os_vif [None req-7509b3b3-a5d9-41cd-9b46-b4ec951a9787 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:ee:48,bridge_name='br-int',has_traffic_filtering=True,id=e9f1881c-9e7c-4bfb-a707-001e0661d547,network=Network(bb983406-3cd0-4bcf-be98-e896ecde4afa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9f1881c-9e')
Nov 08 12:13:49 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-7509b3b3-a5d9-41cd-9b46-b4ec951a9787 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Deleting instance files /opt/stack/data/nova/instances/09d9af99-7d2c-4c14-b60a-d8d9a09a238a_del
Nov 08 12:13:49 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-7509b3b3-a5d9-41cd-9b46-b4ec951a9787 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Deletion of /opt/stack/data/nova/instances/09d9af99-7d2c-4c14-b60a-d8d9a09a238a_del complete
Nov 08 12:13:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0b7a0e1-d0d1-4682-9218-ef44d1e461f1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:49 user nova-compute[74840]: INFO nova.compute.manager [None req-7509b3b3-a5d9-41cd-9b46-b4ec951a9787 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Took 1.11 seconds to destroy the instance on the hypervisor.
Nov 08 12:13:49 user nova-compute[74840]: DEBUG oslo.service.loopingcall [None req-7509b3b3-a5d9-41cd-9b46-b4ec951a9787 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74840) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 12:13:49 user nova-compute[74840]: DEBUG nova.compute.manager [-] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Deallocating network for instance {{(pid=74840) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 12:13:49 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] deallocate_for_instance() {{(pid=74840) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 12:13:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0b7a0e1-d0d1-4682-9218-ef44d1e461f1/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0b7a0e1-d0d1-4682-9218-ef44d1e461f1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0b7a0e1-d0d1-4682-9218-ef44d1e461f1/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43eae335-a4a0-40b2-8cd4-c7881cd397b1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43eae335-a4a0-40b2-8cd4-c7881cd397b1/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43eae335-a4a0-40b2-8cd4-c7881cd397b1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:50 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:13:50 user nova-compute[74840]: INFO nova.compute.manager [-] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Took 0.71 seconds to deallocate network for instance.
Nov 08 12:13:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-7509b3b3-a5d9-41cd-9b46-b4ec951a9787 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:13:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-7509b3b3-a5d9-41cd-9b46-b4ec951a9787 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:13:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43eae335-a4a0-40b2-8cd4-c7881cd397b1/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:50 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:13:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dc9229a-61a8-4f45-b011-5bb3e89d63d1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dc9229a-61a8-4f45-b011-5bb3e89d63d1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dc9229a-61a8-4f45-b011-5bb3e89d63d1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:50 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-7509b3b3-a5d9-41cd-9b46-b4ec951a9787 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:13:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dc9229a-61a8-4f45-b011-5bb3e89d63d1/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:50 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Error from libvirt while getting description of instance-0000000b: [Error Code 42] Domain not found: no domain with matching uuid '09d9af99-7d2c-4c14-b60a-d8d9a09a238a' (instance-0000000b): libvirt.libvirtError: Domain not found: no domain with matching uuid '09d9af99-7d2c-4c14-b60a-d8d9a09a238a' (instance-0000000b)
Nov 08 12:13:50 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-7509b3b3-a5d9-41cd-9b46-b4ec951a9787 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:13:50 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:13:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2a38d-14cf-4199-bb04-179ab4605a9e/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-7509b3b3-a5d9-41cd-9b46-b4ec951a9787 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.740s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:13:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2a38d-14cf-4199-bb04-179ab4605a9e/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2a38d-14cf-4199-bb04-179ab4605a9e/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:50 user nova-compute[74840]: DEBUG nova.compute.manager [req-e7514a59-e213-4c73-b24a-1544fee842d1 req-3672abfd-3202-465e-a842-a5a98a9485e2 service nova] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Received event network-vif-plugged-e9f1881c-9e7c-4bfb-a707-001e0661d547 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:13:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e7514a59-e213-4c73-b24a-1544fee842d1 req-3672abfd-3202-465e-a842-a5a98a9485e2 service nova] Acquiring lock "09d9af99-7d2c-4c14-b60a-d8d9a09a238a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:13:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e7514a59-e213-4c73-b24a-1544fee842d1 req-3672abfd-3202-465e-a842-a5a98a9485e2 service nova] Lock "09d9af99-7d2c-4c14-b60a-d8d9a09a238a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:13:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e7514a59-e213-4c73-b24a-1544fee842d1 req-3672abfd-3202-465e-a842-a5a98a9485e2 service nova] Lock "09d9af99-7d2c-4c14-b60a-d8d9a09a238a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:13:50 user nova-compute[74840]: DEBUG nova.compute.manager [req-e7514a59-e213-4c73-b24a-1544fee842d1 req-3672abfd-3202-465e-a842-a5a98a9485e2 service nova] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] No waiting events found dispatching network-vif-plugged-e9f1881c-9e7c-4bfb-a707-001e0661d547 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:13:50 user nova-compute[74840]: WARNING nova.compute.manager [req-e7514a59-e213-4c73-b24a-1544fee842d1 req-3672abfd-3202-465e-a842-a5a98a9485e2 service nova] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Received unexpected event network-vif-plugged-e9f1881c-9e7c-4bfb-a707-001e0661d547 for instance with vm_state deleted and task_state None.
Nov 08 12:13:50 user nova-compute[74840]: DEBUG nova.compute.manager [req-e7514a59-e213-4c73-b24a-1544fee842d1 req-3672abfd-3202-465e-a842-a5a98a9485e2 service nova] [instance: 09d9af99-7d2c-4c14-b60a-d8d9a09a238a] Received event network-vif-deleted-e9f1881c-9e7c-4bfb-a707-001e0661d547 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:13:50 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-7509b3b3-a5d9-41cd-9b46-b4ec951a9787 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Deleted allocations for instance 09d9af99-7d2c-4c14-b60a-d8d9a09a238a
Nov 08 12:13:51 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:51 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-7509b3b3-a5d9-41cd-9b46-b4ec951a9787 tempest-VolumesActionsTest-1993355233 tempest-VolumesActionsTest-1993355233-project-member] Lock "09d9af99-7d2c-4c14-b60a-d8d9a09a238a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.939s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:13:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2a38d-14cf-4199-bb04-179ab4605a9e/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:51 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:13:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/684b8be2-7f8f-499f-8885-c9d1c86eef2f/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/684b8be2-7f8f-499f-8885-c9d1c86eef2f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/684b8be2-7f8f-499f-8885-c9d1c86eef2f/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:13:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/684b8be2-7f8f-499f-8885-c9d1c86eef2f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:13:52 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:13:52 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:13:52 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:13:52 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:13:52 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:13:52 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=7784MB free_disk=25.372684478759766GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:13:52 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:13:52 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:13:52 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Applying migration context for instance 3b10fda0-9488-4089-8033-dd1c8e42af89 as it has an incoming, in-progress migration 71afe97b-bd77-44bf-a107-3616642fe417. Migration status is post-migrating {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 08 12:13:52 user nova-compute[74840]: INFO nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Updating resource usage from migration 71afe97b-bd77-44bf-a107-3616642fe417
Nov 08 12:13:52 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 43eae335-a4a0-40b2-8cd4-c7881cd397b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:13:52 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 684b8be2-7f8f-499f-8885-c9d1c86eef2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:13:52 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 58f2a38d-14cf-4199-bb04-179ab4605a9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:13:52 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 1dc9229a-61a8-4f45-b011-5bb3e89d63d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:13:52 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance d2dbd607-cf11-4d81-9639-c84e79d65fcd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:13:52 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 28ccd7b3-8bbe-42e7-aa00-612b3703ae79 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:13:52 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance a0b7a0e1-d0d1-4682-9218-ef44d1e461f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:13:52 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Migration 71afe97b-bd77-44bf-a107-3616642fe417 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 08 12:13:52 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 3b10fda0-9488-4089-8033-dd1c8e42af89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:13:52 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:13:52 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=26GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:13:53 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:13:53 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:13:53 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:13:53 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.519s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:13:54 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:55 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:13:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b75aa69f-2f1d-4428-92d4-f5975beed4ce tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Acquiring lock "1dc9229a-61a8-4f45-b011-5bb3e89d63d1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:13:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b75aa69f-2f1d-4428-92d4-f5975beed4ce tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Lock "1dc9229a-61a8-4f45-b011-5bb3e89d63d1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:13:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b75aa69f-2f1d-4428-92d4-f5975beed4ce tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Acquiring lock "1dc9229a-61a8-4f45-b011-5bb3e89d63d1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:13:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b75aa69f-2f1d-4428-92d4-f5975beed4ce tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Lock "1dc9229a-61a8-4f45-b011-5bb3e89d63d1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:13:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b75aa69f-2f1d-4428-92d4-f5975beed4ce tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Lock "1dc9229a-61a8-4f45-b011-5bb3e89d63d1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:13:55 user nova-compute[74840]: INFO nova.compute.manager [None req-b75aa69f-2f1d-4428-92d4-f5975beed4ce tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Terminating instance
Nov 08 12:13:55 user nova-compute[74840]: DEBUG nova.compute.manager [None req-b75aa69f-2f1d-4428-92d4-f5975beed4ce tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Start destroying the instance on the hypervisor. {{(pid=74840) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 12:13:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:55 user nova-compute[74840]: DEBUG nova.compute.manager [req-7560a197-7681-4d47-81f2-8bd459c1a5d4 req-09a14a9c-dade-43cb-9b87-77ce0e861163 service nova] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Received event network-vif-unplugged-0ca11215-a135-4be8-87dd-69e348e9fa62 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:13:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-7560a197-7681-4d47-81f2-8bd459c1a5d4 req-09a14a9c-dade-43cb-9b87-77ce0e861163 service nova] Acquiring lock "1dc9229a-61a8-4f45-b011-5bb3e89d63d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:13:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-7560a197-7681-4d47-81f2-8bd459c1a5d4 req-09a14a9c-dade-43cb-9b87-77ce0e861163 service nova] Lock "1dc9229a-61a8-4f45-b011-5bb3e89d63d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:13:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-7560a197-7681-4d47-81f2-8bd459c1a5d4 req-09a14a9c-dade-43cb-9b87-77ce0e861163 service nova] Lock "1dc9229a-61a8-4f45-b011-5bb3e89d63d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:13:55 user nova-compute[74840]: DEBUG nova.compute.manager [req-7560a197-7681-4d47-81f2-8bd459c1a5d4 req-09a14a9c-dade-43cb-9b87-77ce0e861163 service nova] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] No waiting events found dispatching network-vif-unplugged-0ca11215-a135-4be8-87dd-69e348e9fa62 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:13:55 user nova-compute[74840]: DEBUG nova.compute.manager [req-7560a197-7681-4d47-81f2-8bd459c1a5d4 req-09a14a9c-dade-43cb-9b87-77ce0e861163 service nova] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Received event network-vif-unplugged-0ca11215-a135-4be8-87dd-69e348e9fa62 for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:13:56 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Instance destroyed successfully.
Nov 08 12:13:56 user nova-compute[74840]: DEBUG nova.objects.instance [None req-b75aa69f-2f1d-4428-92d4-f5975beed4ce tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Lazy-loading 'resources' on Instance uuid 1dc9229a-61a8-4f45-b011-5bb3e89d63d1 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:13:56 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-b75aa69f-2f1d-4428-92d4-f5975beed4ce tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:09:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1239468947',display_name='tempest-VolumesAssistedSnapshotsTest-server-1239468947',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1239468947',id=7,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMkyByPosTjH5Z5CIWpY7U9AIDHUNrzPF4sEtlm0aqiGf23HowcGv4Wsoia1fbd6Xo0YVFn53JJGQ/C34aCvhlO+vCZjH0MGkkZ3971moMWTEI/prFc6g+1Nl9yX/fymA==',key_name='tempest-keypair-1919960346',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:10:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2693bf5b1b2a46eb9c657d76934e93f2',ramdisk_id='',reservation_id='r-jd6xjka0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1208282605',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1208282605-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:10:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d1f5907cbb834731a5b835c7c8c388cc',uuid=1dc9229a-61a8-4f45-b011-5bb3e89d63d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ca11215-a135-4be8-87dd-69e348e9fa62", "address": "fa:16:3e:b6:a8:fa", "network": {"id": "ca79a5ac-b9b5-4c23-bb4b-c471878fc7df", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-908944889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2693bf5b1b2a46eb9c657d76934e93f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca11215-a1", "ovs_interfaceid": "0ca11215-a135-4be8-87dd-69e348e9fa62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:13:56 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-b75aa69f-2f1d-4428-92d4-f5975beed4ce tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Converting VIF {"id": "0ca11215-a135-4be8-87dd-69e348e9fa62", "address": "fa:16:3e:b6:a8:fa", "network": {"id": "ca79a5ac-b9b5-4c23-bb4b-c471878fc7df", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-908944889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2693bf5b1b2a46eb9c657d76934e93f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca11215-a1", "ovs_interfaceid": "0ca11215-a135-4be8-87dd-69e348e9fa62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:13:56 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-b75aa69f-2f1d-4428-92d4-f5975beed4ce tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:a8:fa,bridge_name='br-int',has_traffic_filtering=True,id=0ca11215-a135-4be8-87dd-69e348e9fa62,network=Network(ca79a5ac-b9b5-4c23-bb4b-c471878fc7df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca11215-a1') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:13:56 user nova-compute[74840]: DEBUG os_vif [None req-b75aa69f-2f1d-4428-92d4-f5975beed4ce tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:a8:fa,bridge_name='br-int',has_traffic_filtering=True,id=0ca11215-a135-4be8-87dd-69e348e9fa62,network=Network(ca79a5ac-b9b5-4c23-bb4b-c471878fc7df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca11215-a1') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:13:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ca11215-a1, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:13:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:13:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=810de839-4f29-45a9-acc3-50a17667f11a) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:13:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:56 user nova-compute[74840]: INFO os_vif [None req-b75aa69f-2f1d-4428-92d4-f5975beed4ce tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:a8:fa,bridge_name='br-int',has_traffic_filtering=True,id=0ca11215-a135-4be8-87dd-69e348e9fa62,network=Network(ca79a5ac-b9b5-4c23-bb4b-c471878fc7df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca11215-a1')
Nov 08 12:13:56 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-b75aa69f-2f1d-4428-92d4-f5975beed4ce tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Deleting instance files /opt/stack/data/nova/instances/1dc9229a-61a8-4f45-b011-5bb3e89d63d1_del
Nov 08 12:13:56 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-b75aa69f-2f1d-4428-92d4-f5975beed4ce tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Deletion of /opt/stack/data/nova/instances/1dc9229a-61a8-4f45-b011-5bb3e89d63d1_del complete
Nov 08 12:13:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:13:56 user nova-compute[74840]: INFO nova.compute.manager [None req-b75aa69f-2f1d-4428-92d4-f5975beed4ce tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 08 12:13:56 user nova-compute[74840]: DEBUG oslo.service.loopingcall [None req-b75aa69f-2f1d-4428-92d4-f5975beed4ce tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74840) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 12:13:56 user nova-compute[74840]: DEBUG nova.compute.manager [-] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Deallocating network for instance {{(pid=74840) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 12:13:56 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] deallocate_for_instance() {{(pid=74840) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 12:13:57 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:13:57 user nova-compute[74840]: INFO nova.compute.manager [-] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Took 1.06 seconds to deallocate network for instance.
Nov 08 12:13:57 user nova-compute[74840]: DEBUG nova.compute.manager [req-a7405d49-86bd-42ce-b444-412afe5386a1 req-e3ca3423-65e9-43f4-a8d2-d599d061db73 service nova] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Received event network-vif-deleted-0ca11215-a135-4be8-87dd-69e348e9fa62 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:13:57 user nova-compute[74840]: INFO nova.compute.manager [req-a7405d49-86bd-42ce-b444-412afe5386a1 req-e3ca3423-65e9-43f4-a8d2-d599d061db73 service nova] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Neutron deleted interface 0ca11215-a135-4be8-87dd-69e348e9fa62; detaching it from the instance and deleting it from the info cache
Nov 08 12:13:57 user nova-compute[74840]: DEBUG nova.network.neutron [req-a7405d49-86bd-42ce-b444-412afe5386a1 req-e3ca3423-65e9-43f4-a8d2-d599d061db73 service nova] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:13:57 user nova-compute[74840]: DEBUG nova.compute.manager [req-a7405d49-86bd-42ce-b444-412afe5386a1 req-e3ca3423-65e9-43f4-a8d2-d599d061db73 service nova] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Detach interface failed, port_id=0ca11215-a135-4be8-87dd-69e348e9fa62, reason: Instance 1dc9229a-61a8-4f45-b011-5bb3e89d63d1 could not be found. {{(pid=74840) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 12:13:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b75aa69f-2f1d-4428-92d4-f5975beed4ce tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:13:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b75aa69f-2f1d-4428-92d4-f5975beed4ce tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:13:57 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-b75aa69f-2f1d-4428-92d4-f5975beed4ce tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:13:57 user nova-compute[74840]: DEBUG nova.compute.manager [req-631a8a1a-1143-4ea7-8d4e-e1bc8d3b8def req-b1561519-a020-478a-ae7b-963c251b9cd0 service nova] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Received event network-vif-plugged-0ca11215-a135-4be8-87dd-69e348e9fa62 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:13:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-631a8a1a-1143-4ea7-8d4e-e1bc8d3b8def req-b1561519-a020-478a-ae7b-963c251b9cd0 service nova] Acquiring lock "1dc9229a-61a8-4f45-b011-5bb3e89d63d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:13:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-631a8a1a-1143-4ea7-8d4e-e1bc8d3b8def req-b1561519-a020-478a-ae7b-963c251b9cd0 service nova] Lock "1dc9229a-61a8-4f45-b011-5bb3e89d63d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:13:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-631a8a1a-1143-4ea7-8d4e-e1bc8d3b8def req-b1561519-a020-478a-ae7b-963c251b9cd0 service nova] Lock "1dc9229a-61a8-4f45-b011-5bb3e89d63d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:13:57 user nova-compute[74840]: DEBUG nova.compute.manager [req-631a8a1a-1143-4ea7-8d4e-e1bc8d3b8def req-b1561519-a020-478a-ae7b-963c251b9cd0 service nova] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] No waiting events found dispatching network-vif-plugged-0ca11215-a135-4be8-87dd-69e348e9fa62 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:13:57 user nova-compute[74840]: WARNING nova.compute.manager [req-631a8a1a-1143-4ea7-8d4e-e1bc8d3b8def req-b1561519-a020-478a-ae7b-963c251b9cd0 service nova] [instance: 1dc9229a-61a8-4f45-b011-5bb3e89d63d1] Received unexpected event network-vif-plugged-0ca11215-a135-4be8-87dd-69e348e9fa62 for instance with vm_state deleted and task_state None.
Nov 08 12:13:57 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-b75aa69f-2f1d-4428-92d4-f5975beed4ce tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:13:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b75aa69f-2f1d-4428-92d4-f5975beed4ce tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.384s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:13:57 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-b75aa69f-2f1d-4428-92d4-f5975beed4ce tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Deleted allocations for instance 1dc9229a-61a8-4f45-b011-5bb3e89d63d1
Nov 08 12:13:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b75aa69f-2f1d-4428-92d4-f5975beed4ce tempest-VolumesAssistedSnapshotsTest-1208282605 tempest-VolumesAssistedSnapshotsTest-1208282605-project-member] Lock "1dc9229a-61a8-4f45-b011-5bb3e89d63d1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.637s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:13:59 user nova-compute[74840]: DEBUG nova.compute.manager [req-f9aa6fbd-b308-4db9-b496-ab6efb84efdc req-6e0f872f-ed58-4a07-8d6e-18a402fe3939 service nova] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Received event network-changed-bd22c195-e803-484d-811a-aeeb04326bd0 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:13:59 user nova-compute[74840]: DEBUG nova.compute.manager [req-f9aa6fbd-b308-4db9-b496-ab6efb84efdc req-6e0f872f-ed58-4a07-8d6e-18a402fe3939 service nova] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Refreshing instance network info cache due to event network-changed-bd22c195-e803-484d-811a-aeeb04326bd0. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:13:59 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-f9aa6fbd-b308-4db9-b496-ab6efb84efdc req-6e0f872f-ed58-4a07-8d6e-18a402fe3939 service nova] Acquiring lock "refresh_cache-28ccd7b3-8bbe-42e7-aa00-612b3703ae79" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:13:59 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-f9aa6fbd-b308-4db9-b496-ab6efb84efdc req-6e0f872f-ed58-4a07-8d6e-18a402fe3939 service nova] Acquired lock "refresh_cache-28ccd7b3-8bbe-42e7-aa00-612b3703ae79" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:13:59 user nova-compute[74840]: DEBUG nova.network.neutron [req-f9aa6fbd-b308-4db9-b496-ab6efb84efdc req-6e0f872f-ed58-4a07-8d6e-18a402fe3939 service nova] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Refreshing network info cache for port bd22c195-e803-484d-811a-aeeb04326bd0 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:13:59 user nova-compute[74840]: DEBUG nova.network.neutron [req-f9aa6fbd-b308-4db9-b496-ab6efb84efdc req-6e0f872f-ed58-4a07-8d6e-18a402fe3939 service nova] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Updated VIF entry in instance network info cache for port bd22c195-e803-484d-811a-aeeb04326bd0. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:13:59 user nova-compute[74840]: DEBUG nova.network.neutron [req-f9aa6fbd-b308-4db9-b496-ab6efb84efdc req-6e0f872f-ed58-4a07-8d6e-18a402fe3939 service nova] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Updating instance_info_cache with network_info: [{"id": "bd22c195-e803-484d-811a-aeeb04326bd0", "address": "fa:16:3e:ee:6e:72", "network": {"id": "d0c950e1-4e6d-42f7-bbbb-7164603882bc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1883968250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c961954c4a0440a93d9738ca5ab0026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd22c195-e8", "ovs_interfaceid": "bd22c195-e803-484d-811a-aeeb04326bd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:13:59 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-f9aa6fbd-b308-4db9-b496-ab6efb84efdc req-6e0f872f-ed58-4a07-8d6e-18a402fe3939 service nova] Releasing lock "refresh_cache-28ccd7b3-8bbe-42e7-aa00-612b3703ae79" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:14:00 user nova-compute[74840]: INFO nova.compute.manager [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Rebuilding instance
Nov 08 12:14:00 user nova-compute[74840]: DEBUG nova.compute.manager [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:14:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1013fb3e-012d-4ca2-8f51-3a65a77e7e93 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "43eae335-a4a0-40b2-8cd4-c7881cd397b1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:14:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1013fb3e-012d-4ca2-8f51-3a65a77e7e93 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "43eae335-a4a0-40b2-8cd4-c7881cd397b1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:14:00 user nova-compute[74840]: INFO nova.compute.manager [None req-1013fb3e-012d-4ca2-8f51-3a65a77e7e93 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Detaching volume 08a44583-de0d-44ca-a02a-fa9d906720c9
Nov 08 12:14:00 user nova-compute[74840]: DEBUG nova.compute.manager [req-635a96c1-fd09-4a90-9101-c663d397ba7c req-0d2ad673-dd3c-43b7-beb0-9fa6f969eb44 service nova] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Received event network-vif-unplugged-bd22c195-e803-484d-811a-aeeb04326bd0 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:14:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-635a96c1-fd09-4a90-9101-c663d397ba7c req-0d2ad673-dd3c-43b7-beb0-9fa6f969eb44 service nova] Acquiring lock "28ccd7b3-8bbe-42e7-aa00-612b3703ae79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:14:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-635a96c1-fd09-4a90-9101-c663d397ba7c req-0d2ad673-dd3c-43b7-beb0-9fa6f969eb44 service nova] Lock "28ccd7b3-8bbe-42e7-aa00-612b3703ae79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:14:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-635a96c1-fd09-4a90-9101-c663d397ba7c req-0d2ad673-dd3c-43b7-beb0-9fa6f969eb44 service nova] Lock "28ccd7b3-8bbe-42e7-aa00-612b3703ae79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:14:00 user nova-compute[74840]: DEBUG nova.compute.manager [req-635a96c1-fd09-4a90-9101-c663d397ba7c req-0d2ad673-dd3c-43b7-beb0-9fa6f969eb44 service nova] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] No waiting events found dispatching network-vif-unplugged-bd22c195-e803-484d-811a-aeeb04326bd0 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:14:00 user nova-compute[74840]: WARNING nova.compute.manager [req-635a96c1-fd09-4a90-9101-c663d397ba7c req-0d2ad673-dd3c-43b7-beb0-9fa6f969eb44 service nova] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Received unexpected event network-vif-unplugged-bd22c195-e803-484d-811a-aeeb04326bd0 for instance with vm_state active and task_state rebuilding.
Nov 08 12:14:00 user nova-compute[74840]: INFO nova.virt.block_device [None req-1013fb3e-012d-4ca2-8f51-3a65a77e7e93 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Attempting to driver detach volume 08a44583-de0d-44ca-a02a-fa9d906720c9 from mountpoint /dev/vdb
Nov 08 12:14:00 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1013fb3e-012d-4ca2-8f51-3a65a77e7e93 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Attempting to detach device vdb from instance 43eae335-a4a0-40b2-8cd4-c7881cd397b1 from the persistent domain config. {{(pid=74840) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 12:14:00 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-1013fb3e-012d-4ca2-8f51-3a65a77e7e93 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 12:14:00 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:14:00 user nova-compute[74840]:   <source dev="/dev/sdb"/>
Nov 08 12:14:00 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:14:00 user nova-compute[74840]:   <serial>08a44583-de0d-44ca-a02a-fa9d906720c9</serial>
Nov 08 12:14:00 user nova-compute[74840]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 12:14:00 user nova-compute[74840]: </disk>
Nov 08 12:14:00 user nova-compute[74840]:  {{(pid=74840) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 12:14:00 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-1013fb3e-012d-4ca2-8f51-3a65a77e7e93 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Successfully detached device vdb from instance 43eae335-a4a0-40b2-8cd4-c7881cd397b1 from the persistent domain config.
Nov 08 12:14:00 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1013fb3e-012d-4ca2-8f51-3a65a77e7e93 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 43eae335-a4a0-40b2-8cd4-c7881cd397b1 from the live domain config. {{(pid=74840) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 12:14:00 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-1013fb3e-012d-4ca2-8f51-3a65a77e7e93 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 12:14:00 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:14:00 user nova-compute[74840]:   <source dev="/dev/sdb"/>
Nov 08 12:14:00 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:14:00 user nova-compute[74840]:   <serial>08a44583-de0d-44ca-a02a-fa9d906720c9</serial>
Nov 08 12:14:00 user nova-compute[74840]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 12:14:00 user nova-compute[74840]: </disk>
Nov 08 12:14:00 user nova-compute[74840]:  {{(pid=74840) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Starting finish_migration {{(pid=74840) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Instance directory exists: not creating {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 12:14:01 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Creating image(s)
Nov 08 12:14:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1013fb3e-012d-4ca2-8f51-3a65a77e7e93 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 43eae335-a4a0-40b2-8cd4-c7881cd397b1 {{(pid=74840) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 12:14:01 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Instance destroyed successfully.
Nov 08 12:14:01 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Instance destroyed successfully.
Nov 08 12:14:01 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:11:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1277810806',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-791461388',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHpDLhfsQbuoiOAJZjQdzHvpPhC/nzLrrMQESJ5Ldi9eYg8zkak82Rki/GHtRFnLyoKBsr3ji4PDu9fap5vsgpePAUrrP6MvAc2bSYV1GEi6T2SkCHIaBKds2SkXizZsQ==',key_name='tempest-keypair-1117122950',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:12:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0c961954c4a0440a93d9738ca5ab0026',ramdisk_id='',reservation_id='r-pbsbcfi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-874131883',owner_user_name='tempest-ServerActionsV293TestJSON-874131883-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:14:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cab11962ef3472a864f830d45396c4c',uuid=28ccd7b3-8bbe-42e7-aa00-612b3703ae79,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd22c195-e803-484d-811a-aeeb04326bd0", "address": "fa:16:3e:ee:6e:72", "network": {"id": "d0c950e1-4e6d-42f7-bbbb-7164603882bc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1883968250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c961954c4a0440a93d9738ca5ab0026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd22c195-e8", "ovs_interfaceid": "bd22c195-e803-484d-811a-aeeb04326bd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Converting VIF {"id": "bd22c195-e803-484d-811a-aeeb04326bd0", "address": "fa:16:3e:ee:6e:72", "network": {"id": "d0c950e1-4e6d-42f7-bbbb-7164603882bc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1883968250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c961954c4a0440a93d9738ca5ab0026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd22c195-e8", "ovs_interfaceid": "bd22c195-e803-484d-811a-aeeb04326bd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:6e:72,bridge_name='br-int',has_traffic_filtering=True,id=bd22c195-e803-484d-811a-aeeb04326bd0,network=Network(d0c950e1-4e6d-42f7-bbbb-7164603882bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd22c195-e8') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG os_vif [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:6e:72,bridge_name='br-int',has_traffic_filtering=True,id=bd22c195-e803-484d-811a-aeeb04326bd0,network=Network(d0c950e1-4e6d-42f7-bbbb-7164603882bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd22c195-e8') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd22c195-e8, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=71f68de1-2a0e-4c46-8b77-d4c0ed4c1c80) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:01 user nova-compute[74840]: INFO os_vif [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:6e:72,bridge_name='br-int',has_traffic_filtering=True,id=bd22c195-e803-484d-811a-aeeb04326bd0,network=Network(d0c950e1-4e6d-42f7-bbbb-7164603882bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd22c195-e8')
Nov 08 12:14:01 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BXnlZryS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:14:01 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 12:14:01 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b607479-54e2-461f-82ef-f49ca356ad9a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 12:14:01 user nova-compute[74840]: No targets found.
Nov 08 12:14:01 user nova-compute[74840]: iSNS:
Nov 08 12:14:01 user nova-compute[74840]: No targets found.
Nov 08 12:14:01 user nova-compute[74840]: STATIC:
Nov 08 12:14:01 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097
Nov 08 12:14:01 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:14:01 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:14:01 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc
Nov 08 12:14:01 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:14:01 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:14:01 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9
Nov 08 12:14:01 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:14:01 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:14:01 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60
Nov 08 12:14:01 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:14:01 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:14:01 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b
Nov 08 12:14:01 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:14:01 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:14:01 user nova-compute[74840]: FIRMWARE:
Nov 08 12:14:01 user nova-compute[74840]: No targets found.
Nov 08 12:14:01 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 12:14:01 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 12:14:01 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.242s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk. size=21474836480 {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c34d6b-5e9f-40ce-be6c-d778635e1948]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6754bbbe-d941-4e04-a5c0-4f2eedaef43a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)
Nov 08 12:14:01 user nova-compute[74840]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)
Nov 08 12:14:01 user nova-compute[74840]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc (non-flash)
Nov 08 12:14:01 user nova-compute[74840]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b (non-flash)
Nov 08 12:14:01 user nova-compute[74840]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60 (non-flash)
Nov 08 12:14:01 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)
Nov 08 12:14:01 user nova-compute[74840]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)
Nov 08 12:14:01 user nova-compute[74840]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc (non-flash)
Nov 08 12:14:01 user nova-compute[74840]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b (non-flash)
Nov 08 12:14:01 user nova-compute[74840]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60 (non-flash)
Nov 08 12:14:01 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7f42ab250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097'): ({'sdc'}, set())}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Removing single pathed devices sdc {{(pid=74840) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1cb7a3-3e32-4663-9891-2c7cb1d7b339]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21ca20c-01ac-4373-acee-f2f3dbd293e2]: (4, ('ok\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Flushing IO for device /dev/sdc {{(pid=74840) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc7ded1-ebd2-4662-9e0e-94184f88680b]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74840) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[703f5b22-4710-442e-8eb5-482577be0b11]: (4, ('1', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] SCSI volumes sdc have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097')] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ad1446-6390-48d2-99b1-82298ab5a1e7]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 -p 172.16.0.220:3260 --logout {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk 21474836480 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk 21474836480" returned: 0 in 0.276s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Did not create local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Ensure instance console log exists: /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Start _get_guest_xml network_info=[{"id": "b48b5298-045f-463d-9585-fbb5feb869bf", "address": "fa:16:3e:19:58:1f", "network": {"id": "9dec89b0-562f-482c-aec1-d024351d0bd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-237264167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-237264167-network", "vif_mac": "fa:16:3e:19:58:1f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a544910dc2c4b169c986fa74b5979d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48b5298-04", "ovs_interfaceid": "b48b5298-045f-463d-9585-fbb5feb869bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'image_id': '4fa17706-d304-4117-a420-dab994c703dc'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '2521eeb5-d50d-4ea3-828b-308f7686a473', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WnvQHzjl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '3b10fda0-9488-4089-8033-dd1c8e42af89', 'attached_at': '2023-11-08T12:14:01.000000', 'detached_at': '', 'volume_id': '3d161c9a-4d64-4a8b-9525-225154403d22', 'serial': '3d161c9a-4d64-4a8b-9525-225154403d22'}, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 -p 172.16.0.220:3260 --logout" returned: 0 in 0.313s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[072c2d56-31d7-4278-a16a-6dbb3d00cc87]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097, portal: 172.16.0.220,3260]
Nov 08 12:14:02 user nova-compute[74840]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097, portal: 172.16.0.220,3260] successful.
Nov 08 12:14:02 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 -p 172.16.0.220:3260 --op delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:02 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:14:02 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:14:02 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:05:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Calling os-brick to attach iSCSI Volume {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WnvQHzjl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:14:02 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:14:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[527fd00a-e3d9-483e-8d93-f9e8b6528f5c]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.663s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] <== disconnect_volume: return (666ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 12:14:02 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Deleting instance files /opt/stack/data/nova/instances/28ccd7b3-8bbe-42e7-aa00-612b3703ae79_del
Nov 08 12:14:02 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Deletion of /opt/stack/data/nova/instances/28ccd7b3-8bbe-42e7-aa00-612b3703ae79_del complete
Nov 08 12:14:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.015s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:14:02 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:14:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:14:02 user nova-compute[74840]: INFO os_brick.initiator.connectors.iscsi [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 12:14:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[be38d29e-5443-4e5d-b60f-6dfd99035c82]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 12:14:02 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --interface default --op new {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a6bc95-eb02-45b9-ab18-0aab7cec3bf5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22] added\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22] added
Nov 08 12:14:02 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5e1d4b-b3ec-4e40-8646-59cd339fbe89]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59ac8c0-cac8-41a5-90e8-d3d80c46298e]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WnvQHzjl {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WnvQHzjl" returned: 0 in 0.028s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2b58e5-5d99-4347-9c81-66cb38fb56d1]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WnvQHzjl'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[64af9c08-8cb2-4ee9-8014-3bf367398fae]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f015765e-0303-48b3-89d1-164fd8b8dc28]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)
Nov 08 12:14:02 user nova-compute[74840]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc (non-flash)
Nov 08 12:14:02 user nova-compute[74840]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b (non-flash)
Nov 08 12:14:02 user nova-compute[74840]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60 (non-flash)
Nov 08 12:14:02 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)
Nov 08 12:14:02 user nova-compute[74840]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc (non-flash)
Nov 08 12:14:02 user nova-compute[74840]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b (non-flash)
Nov 08 12:14:02 user nova-compute[74840]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60 (non-flash)
Nov 08 12:14:02 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --login {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:02 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 28ccd7b3-8bbe-42e7-aa00-612b3703ae79 could not be found.
Nov 08 12:14:02 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BXnlZryS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:14:02 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 12:14:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca741549-0a17-4191-968a-fe824939fb13]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22, portal: 172.16.0.220,3260]
Nov 08 12:14:02 user nova-compute[74840]: Login to [iface: default, target: iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22, portal: 172.16.0.220,3260] successful.
Nov 08 12:14:02 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[851742f9-82b5-4aa0-93e7-b4efc7b8b33a]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b017de09-007f-4caf-b616-d4ab6150775b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)
Nov 08 12:14:02 user nova-compute[74840]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)
Nov 08 12:14:02 user nova-compute[74840]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc (non-flash)
Nov 08 12:14:02 user nova-compute[74840]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b (non-flash)
Nov 08 12:14:02 user nova-compute[74840]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60 (non-flash)
Nov 08 12:14:02 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)
Nov 08 12:14:02 user nova-compute[74840]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)
Nov 08 12:14:02 user nova-compute[74840]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc (non-flash)
Nov 08 12:14:02 user nova-compute[74840]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b (non-flash)
Nov 08 12:14:02 user nova-compute[74840]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60 (non-flash)
Nov 08 12:14:02 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Connected to 172.16.0.220:3260 {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] HCTL ('34', '-', '-', 0) found on session 11 with lun 0 {{(pid=74840) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74840) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa9e8c0-663c-4651-8bc8-e774d07d3a53]: (4, ('- - 0', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Searching for a device in session 11 and hctl ['34', '*', '*', 0] yield: None {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG nova.compute.manager [req-953d2525-548f-4c1e-984c-c0a8c69ff50a req-7162d6c0-0989-4918-af32-d64644387c54 service nova] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Received event network-vif-plugged-bd22c195-e803-484d-811a-aeeb04326bd0 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-953d2525-548f-4c1e-984c-c0a8c69ff50a req-7162d6c0-0989-4918-af32-d64644387c54 service nova] Acquiring lock "28ccd7b3-8bbe-42e7-aa00-612b3703ae79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-953d2525-548f-4c1e-984c-c0a8c69ff50a req-7162d6c0-0989-4918-af32-d64644387c54 service nova] Lock "28ccd7b3-8bbe-42e7-aa00-612b3703ae79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-953d2525-548f-4c1e-984c-c0a8c69ff50a req-7162d6c0-0989-4918-af32-d64644387c54 service nova] Lock "28ccd7b3-8bbe-42e7-aa00-612b3703ae79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:14:02 user nova-compute[74840]: DEBUG nova.compute.manager [req-953d2525-548f-4c1e-984c-c0a8c69ff50a req-7162d6c0-0989-4918-af32-d64644387c54 service nova] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] No waiting events found dispatching network-vif-plugged-bd22c195-e803-484d-811a-aeeb04326bd0 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:14:02 user nova-compute[74840]: WARNING nova.compute.manager [req-953d2525-548f-4c1e-984c-c0a8c69ff50a req-7162d6c0-0989-4918-af32-d64644387c54 service nova] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Received unexpected event network-vif-plugged-bd22c195-e803-484d-811a-aeeb04326bd0 for instance with vm_state active and task_state rebuilding.
Nov 08 12:14:03 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Searching for a device in session 11 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:14:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WnvQHzjl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 12:14:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:14:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '26361373339653139', 'path': '/dev/sdc'} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:14:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361373339653139', 'path': '/dev/sdc'} {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 12:14:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.162s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:14:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:08:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-172158050',display_name='tempest-ServerActionsTestOtherB-server-172158050',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-172158050',id=3,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJKFMe0GKEBW9KmyXjqsjBsUl5GOfddH2uub399MmagL+sAbL8XpD7Zv97iB27MfsDGdoFheqqd0EDelgcb+/IZFf73OQgm/+DITCITQulDQXkqFfn6taEL9Zjc2Dr8/0g==',key_name='tempest-keypair-2038726199',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:09:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7a544910dc2c4b169c986fa74b5979d9',ramdisk_id='',reservation_id='r-o6735td4',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1148036573',owner_user_name='tempest-ServerActionsTestOtherB-1148036573-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:13:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47ef9bdd58a147518d0a09267731b67c',uuid=3b10fda0-9488-4089-8033-dd1c8e42af89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b48b5298-045f-463d-9585-fbb5feb869bf", "address": "fa:16:3e:19:58:1f", "network": {"id": "9dec89b0-562f-482c-aec1-d024351d0bd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-237264167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-237264167-network", "vif_mac": "fa:16:3e:19:58:1f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a544910dc2c4b169c986fa74b5979d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48b5298-04", "ovs_interfaceid": "b48b5298-045f-463d-9585-fbb5feb869bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:14:03 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Converting VIF {"id": "b48b5298-045f-463d-9585-fbb5feb869bf", "address": "fa:16:3e:19:58:1f", "network": {"id": "9dec89b0-562f-482c-aec1-d024351d0bd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-237264167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-237264167-network", "vif_mac": "fa:16:3e:19:58:1f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a544910dc2c4b169c986fa74b5979d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48b5298-04", "ovs_interfaceid": "b48b5298-045f-463d-9585-fbb5feb869bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:14:03 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:58:1f,bridge_name='br-int',has_traffic_filtering=True,id=b48b5298-045f-463d-9585-fbb5feb869bf,network=Network(9dec89b0-562f-482c-aec1-d024351d0bd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb48b5298-04') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:14:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:14:03 user nova-compute[74840]:   <uuid>3b10fda0-9488-4089-8033-dd1c8e42af89</uuid>
Nov 08 12:14:03 user nova-compute[74840]:   <name>instance-00000003</name>
Nov 08 12:14:03 user nova-compute[74840]:   <memory>2097152</memory>
Nov 08 12:14:03 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:14:03 user nova-compute[74840]:   <metadata>
Nov 08 12:14:03 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:14:03 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:14:03 user nova-compute[74840]:       <nova:name>tempest-ServerActionsTestOtherB-server-172158050</nova:name>
Nov 08 12:14:03 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:14:02</nova:creationTime>
Nov 08 12:14:03 user nova-compute[74840]:       <nova:flavor name="m1.small">
Nov 08 12:14:03 user nova-compute[74840]:         <nova:memory>2048</nova:memory>
Nov 08 12:14:03 user nova-compute[74840]:         <nova:disk>20</nova:disk>
Nov 08 12:14:03 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:14:03 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:14:03 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:14:03 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:14:03 user nova-compute[74840]:       <nova:owner>
Nov 08 12:14:03 user nova-compute[74840]:         <nova:user uuid="47ef9bdd58a147518d0a09267731b67c">tempest-ServerActionsTestOtherB-1148036573-project-member</nova:user>
Nov 08 12:14:03 user nova-compute[74840]:         <nova:project uuid="7a544910dc2c4b169c986fa74b5979d9">tempest-ServerActionsTestOtherB-1148036573</nova:project>
Nov 08 12:14:03 user nova-compute[74840]:       </nova:owner>
Nov 08 12:14:03 user nova-compute[74840]:       <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:14:03 user nova-compute[74840]:       <nova:ports>
Nov 08 12:14:03 user nova-compute[74840]:         <nova:port uuid="b48b5298-045f-463d-9585-fbb5feb869bf">
Nov 08 12:14:03 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 12:14:03 user nova-compute[74840]:         </nova:port>
Nov 08 12:14:03 user nova-compute[74840]:       </nova:ports>
Nov 08 12:14:03 user nova-compute[74840]:     </nova:instance>
Nov 08 12:14:03 user nova-compute[74840]:   </metadata>
Nov 08 12:14:03 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:14:03 user nova-compute[74840]:     <system>
Nov 08 12:14:03 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:14:03 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:14:03 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:14:03 user nova-compute[74840]:       <entry name="serial">3b10fda0-9488-4089-8033-dd1c8e42af89</entry>
Nov 08 12:14:03 user nova-compute[74840]:       <entry name="uuid">3b10fda0-9488-4089-8033-dd1c8e42af89</entry>
Nov 08 12:14:03 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:14:03 user nova-compute[74840]:     </system>
Nov 08 12:14:03 user nova-compute[74840]:   </sysinfo>
Nov 08 12:14:03 user nova-compute[74840]:   <os>
Nov 08 12:14:03 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:14:03 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:14:03 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:14:03 user nova-compute[74840]:   </os>
Nov 08 12:14:03 user nova-compute[74840]:   <features>
Nov 08 12:14:03 user nova-compute[74840]:     <acpi/>
Nov 08 12:14:03 user nova-compute[74840]:     <apic/>
Nov 08 12:14:03 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:14:03 user nova-compute[74840]:   </features>
Nov 08 12:14:03 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:14:03 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:14:03 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:14:03 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:14:03 user nova-compute[74840]:   </clock>
Nov 08 12:14:03 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:14:03 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:14:03 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:14:03 user nova-compute[74840]:   </cpu>
Nov 08 12:14:03 user nova-compute[74840]:   <devices>
Nov 08 12:14:03 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:14:03 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:14:03 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk"/>
Nov 08 12:14:03 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:14:03 user nova-compute[74840]:     </disk>
Nov 08 12:14:03 user nova-compute[74840]:     <disk type="block" device="disk">
Nov 08 12:14:03 user nova-compute[74840]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:14:03 user nova-compute[74840]:       <source dev="/dev/sdc"/>
Nov 08 12:14:03 user nova-compute[74840]:       <target dev="vdb" bus="virtio"/>
Nov 08 12:14:03 user nova-compute[74840]:       <serial>3d161c9a-4d64-4a8b-9525-225154403d22</serial>
Nov 08 12:14:03 user nova-compute[74840]:     </disk>
Nov 08 12:14:03 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:14:03 user nova-compute[74840]:       <mac address="fa:16:3e:19:58:1f"/>
Nov 08 12:14:03 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:14:03 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:14:03 user nova-compute[74840]:       <target dev="tapb48b5298-04"/>
Nov 08 12:14:03 user nova-compute[74840]:     </interface>
Nov 08 12:14:03 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:14:03 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/console.log" append="off"/>
Nov 08 12:14:03 user nova-compute[74840]:     </serial>
Nov 08 12:14:03 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:14:03 user nova-compute[74840]:     <video>
Nov 08 12:14:03 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:14:03 user nova-compute[74840]:     </video>
Nov 08 12:14:03 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:14:03 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:14:03 user nova-compute[74840]:     </rng>
Nov 08 12:14:03 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:14:03 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:14:03 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:14:03 user nova-compute[74840]:     </memballoon>
Nov 08 12:14:03 user nova-compute[74840]:   </devices>
Nov 08 12:14:03 user nova-compute[74840]: </domain>
Nov 08 12:14:03 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:14:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:08:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-172158050',display_name='tempest-ServerActionsTestOtherB-server-172158050',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-172158050',id=3,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJKFMe0GKEBW9KmyXjqsjBsUl5GOfddH2uub399MmagL+sAbL8XpD7Zv97iB27MfsDGdoFheqqd0EDelgcb+/IZFf73OQgm/+DITCITQulDQXkqFfn6taEL9Zjc2Dr8/0g==',key_name='tempest-keypair-2038726199',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:09:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7a544910dc2c4b169c986fa74b5979d9',ramdisk_id='',reservation_id='r-o6735td4',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1148036573',owner_user_name='tempest-ServerActionsTestOtherB-1148036573-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:13:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47ef9bdd58a147518d0a09267731b67c',uuid=3b10fda0-9488-4089-8033-dd1c8e42af89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b48b5298-045f-463d-9585-fbb5feb869bf", "address": "fa:16:3e:19:58:1f", "network": {"id": "9dec89b0-562f-482c-aec1-d024351d0bd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-237264167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-237264167-network", "vif_mac": "fa:16:3e:19:58:1f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a544910dc2c4b169c986fa74b5979d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48b5298-04", "ovs_interfaceid": "b48b5298-045f-463d-9585-fbb5feb869bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:14:03 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Converting VIF {"id": "b48b5298-045f-463d-9585-fbb5feb869bf", "address": "fa:16:3e:19:58:1f", "network": {"id": "9dec89b0-562f-482c-aec1-d024351d0bd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-237264167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-237264167-network", "vif_mac": "fa:16:3e:19:58:1f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a544910dc2c4b169c986fa74b5979d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48b5298-04", "ovs_interfaceid": "b48b5298-045f-463d-9585-fbb5feb869bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:14:03 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:58:1f,bridge_name='br-int',has_traffic_filtering=True,id=b48b5298-045f-463d-9585-fbb5feb869bf,network=Network(9dec89b0-562f-482c-aec1-d024351d0bd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb48b5298-04') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:14:03 user nova-compute[74840]: DEBUG os_vif [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:58:1f,bridge_name='br-int',has_traffic_filtering=True,id=b48b5298-045f-463d-9585-fbb5feb869bf,network=Network(9dec89b0-562f-482c-aec1-d024351d0bd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb48b5298-04') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:14:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:03 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca321821-840a-4968-bdf9-eea8889e6474]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:14:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:14:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 12:14:03 user nova-compute[74840]: No targets found.
Nov 08 12:14:03 user nova-compute[74840]: iSNS:
Nov 08 12:14:03 user nova-compute[74840]: No targets found.
Nov 08 12:14:03 user nova-compute[74840]: STATIC:
Nov 08 12:14:03 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22
Nov 08 12:14:03 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:14:03 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:14:03 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc
Nov 08 12:14:03 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:14:03 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:14:03 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9
Nov 08 12:14:03 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:14:03 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:14:03 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60
Nov 08 12:14:03 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:14:03 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:14:03 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b
Nov 08 12:14:03 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:14:03 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:14:03 user nova-compute[74840]: FIRMWARE:
Nov 08 12:14:03 user nova-compute[74840]: No targets found.
Nov 08 12:14:03 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:14:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 12:14:03 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 12:14:03 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 12:14:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 12:14:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '67178738-2a99-5b94-933c-dd46fce8bd89', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:14:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:14:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb48b5298-04, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:14:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb48b5298-04, col_values=(('qos', UUID('7f096bcb-ef49-4d3b-a176-ae4def517c9a')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:14:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb48b5298-04, col_values=(('external_ids', {'iface-id': 'b48b5298-045f-463d-9585-fbb5feb869bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:58:1f', 'vm-uuid': '3b10fda0-9488-4089-8033-dd1c8e42af89'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:14:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:14:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:03 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e845e48-bc88-4d48-9f6e-dc3764cdfd6d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:03 user nova-compute[74840]: INFO os_vif [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:58:1f,bridge_name='br-int',has_traffic_filtering=True,id=b48b5298-045f-463d-9585-fbb5feb869bf,network=Network(9dec89b0-562f-482c-aec1-d024351d0bd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb48b5298-04')
Nov 08 12:14:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:03 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2a4298-e664-4ebc-bcc1-e9160102ffd1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)
Nov 08 12:14:03 user nova-compute[74840]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)
Nov 08 12:14:03 user nova-compute[74840]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc (non-flash)
Nov 08 12:14:03 user nova-compute[74840]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b (non-flash)
Nov 08 12:14:03 user nova-compute[74840]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60 (non-flash)
Nov 08 12:14:03 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:14:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)
Nov 08 12:14:03 user nova-compute[74840]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)
Nov 08 12:14:03 user nova-compute[74840]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc (non-flash)
Nov 08 12:14:03 user nova-compute[74840]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b (non-flash)
Nov 08 12:14:03 user nova-compute[74840]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60 (non-flash)
Nov 08 12:14:03 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:14:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7d46744c0>, {}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 12:14:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Disconnecting from: [] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 12:14:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.136s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:14:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] <== disconnect_volume: return (1297ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:14:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 12:14:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:14:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:14:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] No VIF found with MAC fa:16:3e:19:58:1f, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:14:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:05 user nova-compute[74840]: DEBUG nova.compute.manager [req-d7b9295c-27d0-4e45-8ba1-6d7bfd777090 req-f20c9590-9bb1-4635-8ada-d12b5231e3e8 service nova] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Received event network-vif-plugged-b48b5298-045f-463d-9585-fbb5feb869bf {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:14:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-d7b9295c-27d0-4e45-8ba1-6d7bfd777090 req-f20c9590-9bb1-4635-8ada-d12b5231e3e8 service nova] Acquiring lock "3b10fda0-9488-4089-8033-dd1c8e42af89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:14:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-d7b9295c-27d0-4e45-8ba1-6d7bfd777090 req-f20c9590-9bb1-4635-8ada-d12b5231e3e8 service nova] Lock "3b10fda0-9488-4089-8033-dd1c8e42af89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:14:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-d7b9295c-27d0-4e45-8ba1-6d7bfd777090 req-f20c9590-9bb1-4635-8ada-d12b5231e3e8 service nova] Lock "3b10fda0-9488-4089-8033-dd1c8e42af89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:14:05 user nova-compute[74840]: DEBUG nova.compute.manager [req-d7b9295c-27d0-4e45-8ba1-6d7bfd777090 req-f20c9590-9bb1-4635-8ada-d12b5231e3e8 service nova] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] No waiting events found dispatching network-vif-plugged-b48b5298-045f-463d-9585-fbb5feb869bf {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:14:05 user nova-compute[74840]: WARNING nova.compute.manager [req-d7b9295c-27d0-4e45-8ba1-6d7bfd777090 req-f20c9590-9bb1-4635-8ada-d12b5231e3e8 service nova] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Received unexpected event network-vif-plugged-b48b5298-045f-463d-9585-fbb5feb869bf for instance with vm_state active and task_state resize_finish.
Nov 08 12:14:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:07 user nova-compute[74840]: DEBUG nova.compute.manager [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:14:07 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Instance running successfully.
Nov 08 12:14:07 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Failed to set time: agent not configured {{(pid=74840) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 08 12:14:07 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b7d566a3-0c86-42d0-b6c3-f5a8f0b3084b tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] finish_migration finished successfully. {{(pid=74840) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 08 12:14:07 user nova-compute[74840]: DEBUG nova.compute.manager [req-65b6e196-bd54-4dcd-be88-2c5bdd36cac1 req-cd89728b-b6e0-44f4-92fd-6ffb4e01de33 service nova] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Received event network-vif-plugged-b48b5298-045f-463d-9585-fbb5feb869bf {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:14:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-65b6e196-bd54-4dcd-be88-2c5bdd36cac1 req-cd89728b-b6e0-44f4-92fd-6ffb4e01de33 service nova] Acquiring lock "3b10fda0-9488-4089-8033-dd1c8e42af89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:14:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-65b6e196-bd54-4dcd-be88-2c5bdd36cac1 req-cd89728b-b6e0-44f4-92fd-6ffb4e01de33 service nova] Lock "3b10fda0-9488-4089-8033-dd1c8e42af89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:14:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-65b6e196-bd54-4dcd-be88-2c5bdd36cac1 req-cd89728b-b6e0-44f4-92fd-6ffb4e01de33 service nova] Lock "3b10fda0-9488-4089-8033-dd1c8e42af89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:14:07 user nova-compute[74840]: DEBUG nova.compute.manager [req-65b6e196-bd54-4dcd-be88-2c5bdd36cac1 req-cd89728b-b6e0-44f4-92fd-6ffb4e01de33 service nova] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] No waiting events found dispatching network-vif-plugged-b48b5298-045f-463d-9585-fbb5feb869bf {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:14:07 user nova-compute[74840]: WARNING nova.compute.manager [req-65b6e196-bd54-4dcd-be88-2c5bdd36cac1 req-cd89728b-b6e0-44f4-92fd-6ffb4e01de33 service nova] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Received unexpected event network-vif-plugged-b48b5298-045f-463d-9585-fbb5feb869bf for instance with vm_state active and task_state resize_finish.
Nov 08 12:14:08 user nova-compute[74840]: DEBUG nova.compute.manager [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Preparing to wait for external event volume-reimaged-2a571b42-9e1d-4406-b369-12722b22f097 {{(pid=74840) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 08 12:14:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Acquiring lock "28ccd7b3-8bbe-42e7-aa00-612b3703ae79-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:14:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Lock "28ccd7b3-8bbe-42e7-aa00-612b3703ae79-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:14:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Lock "28ccd7b3-8bbe-42e7-aa00-612b3703ae79-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:14:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:21 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-1013fb3e-012d-4ca2-8f51-3a65a77e7e93 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 43eae335-a4a0-40b2-8cd4-c7881cd397b1 is timed out.
Nov 08 12:14:21 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-1013fb3e-012d-4ca2-8f51-3a65a77e7e93 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Successfully detached device vdb from instance 43eae335-a4a0-40b2-8cd4-c7881cd397b1 from the live domain config.
Nov 08 12:14:21 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1013fb3e-012d-4ca2-8f51-3a65a77e7e93 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 12:14:21 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1013fb3e-012d-4ca2-8f51-3a65a77e7e93 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UcaVlIsJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:14:21 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-1013fb3e-012d-4ca2-8f51-3a65a77e7e93 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:14:21 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-1013fb3e-012d-4ca2-8f51-3a65a77e7e93 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:14:21 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-1013fb3e-012d-4ca2-8f51-3a65a77e7e93 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:14:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:21 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b5a9e4-3fa7-4e6a-af7c-0d69721a40e5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:21 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1013fb3e-012d-4ca2-8f51-3a65a77e7e93 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 12:14:21 user nova-compute[74840]: No targets found.
Nov 08 12:14:21 user nova-compute[74840]: iSNS:
Nov 08 12:14:21 user nova-compute[74840]: No targets found.
Nov 08 12:14:21 user nova-compute[74840]: STATIC:
Nov 08 12:14:21 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22
Nov 08 12:14:21 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:14:21 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:14:21 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc
Nov 08 12:14:21 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:14:21 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:14:21 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9
Nov 08 12:14:21 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:14:21 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:14:21 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60
Nov 08 12:14:21 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:14:21 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:14:21 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b
Nov 08 12:14:21 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:14:21 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:14:21 user nova-compute[74840]: FIRMWARE:
Nov 08 12:14:21 user nova-compute[74840]: No targets found.
Nov 08 12:14:21 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:14:21 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1013fb3e-012d-4ca2-8f51-3a65a77e7e93 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 12:14:21 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 12:14:21 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 12:14:21 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1013fb3e-012d-4ca2-8f51-3a65a77e7e93 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 12:14:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:21 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fb2ef1-2303-43c5-8785-8247e210f8bd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:21 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0eaa7a-7366-42b5-9dd0-fcb11c270fc9]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:21 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1013fb3e-012d-4ca2-8f51-3a65a77e7e93 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)
Nov 08 12:14:21 user nova-compute[74840]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)
Nov 08 12:14:21 user nova-compute[74840]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc (non-flash)
Nov 08 12:14:21 user nova-compute[74840]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b (non-flash)
Nov 08 12:14:21 user nova-compute[74840]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60 (non-flash)
Nov 08 12:14:21 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:14:21 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1013fb3e-012d-4ca2-8f51-3a65a77e7e93 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)
Nov 08 12:14:21 user nova-compute[74840]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 (non-flash)
Nov 08 12:14:21 user nova-compute[74840]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc (non-flash)
Nov 08 12:14:21 user nova-compute[74840]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b (non-flash)
Nov 08 12:14:21 user nova-compute[74840]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60 (non-flash)
Nov 08 12:14:21 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:14:21 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1013fb3e-012d-4ca2-8f51-3a65a77e7e93 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7f441f7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9'): ({'sdb'}, set())}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 12:14:21 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-1013fb3e-012d-4ca2-8f51-3a65a77e7e93 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Removing single pathed devices sdb {{(pid=74840) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 12:14:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:21 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[645a0f13-9fb2-4a68-a031-6732e5e935a6]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:21 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca76c860-d8c9-4eb6-8132-b4803d421906]: (4, ('ok\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:21 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-1013fb3e-012d-4ca2-8f51-3a65a77e7e93 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Flushing IO for device /dev/sdb {{(pid=74840) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 12:14:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:21 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[548151fc-93e7-4232-9b55-5c3f8fdd9d7e]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:21 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-1013fb3e-012d-4ca2-8f51-3a65a77e7e93 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74840) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 12:14:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:21 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ee7113-957a-4672-93ee-6ce07f53a5d0]: (4, ('1', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:21 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-1013fb3e-012d-4ca2-8f51-3a65a77e7e93 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 12:14:21 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-1013fb3e-012d-4ca2-8f51-3a65a77e7e93 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] SCSI volumes sdb have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 12:14:21 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1013fb3e-012d-4ca2-8f51-3a65a77e7e93 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9')] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 12:14:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:21 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2744e65-c1a2-430d-b085-805f9de005fc]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:21 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1013fb3e-012d-4ca2-8f51-3a65a77e7e93 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:14:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 -p 172.16.0.220:3260 --logout {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:21 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b05cd01-37f0-43be-aa13-9f4f194ba52e]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:21 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1013fb3e-012d-4ca2-8f51-3a65a77e7e93 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9, portal: 172.16.0.220,3260]
Nov 08 12:14:21 user nova-compute[74840]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9, portal: 172.16.0.220,3260] successful.
Nov 08 12:14:21 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:14:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 -p 172.16.0.220:3260 --op delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08a44583-de0d-44ca-a02a-fa9d906720c9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:21 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4d667f-a29f-4dba-9cb9-95698199253b]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:21 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1013fb3e-012d-4ca2-8f51-3a65a77e7e93 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:14:21 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-1013fb3e-012d-4ca2-8f51-3a65a77e7e93 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:14:21 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1013fb3e-012d-4ca2-8f51-3a65a77e7e93 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] <== disconnect_volume: return (370ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:14:21 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1013fb3e-012d-4ca2-8f51-3a65a77e7e93 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 12:14:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:14:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 12:14:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:14:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:14:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:28 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:29 user nova-compute[74840]: DEBUG nova.compute.manager [req-4a137fc6-5794-4133-8c32-d6ae671a57e2 req-49cc55a1-e144-462c-82cf-2a38e79cc603 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received event network-changed-38640df8-91ab-4bb6-89f1-ac84843d0e1c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:14:29 user nova-compute[74840]: DEBUG nova.compute.manager [req-4a137fc6-5794-4133-8c32-d6ae671a57e2 req-49cc55a1-e144-462c-82cf-2a38e79cc603 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Refreshing instance network info cache due to event network-changed-38640df8-91ab-4bb6-89f1-ac84843d0e1c. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:14:29 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4a137fc6-5794-4133-8c32-d6ae671a57e2 req-49cc55a1-e144-462c-82cf-2a38e79cc603 service nova] Acquiring lock "refresh_cache-d2dbd607-cf11-4d81-9639-c84e79d65fcd" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:14:29 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4a137fc6-5794-4133-8c32-d6ae671a57e2 req-49cc55a1-e144-462c-82cf-2a38e79cc603 service nova] Acquired lock "refresh_cache-d2dbd607-cf11-4d81-9639-c84e79d65fcd" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:14:29 user nova-compute[74840]: DEBUG nova.network.neutron [req-4a137fc6-5794-4133-8c32-d6ae671a57e2 req-49cc55a1-e144-462c-82cf-2a38e79cc603 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Refreshing network info cache for port 38640df8-91ab-4bb6-89f1-ac84843d0e1c {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:14:30 user nova-compute[74840]: DEBUG nova.network.neutron [req-4a137fc6-5794-4133-8c32-d6ae671a57e2 req-49cc55a1-e144-462c-82cf-2a38e79cc603 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Updated VIF entry in instance network info cache for port 38640df8-91ab-4bb6-89f1-ac84843d0e1c. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:14:30 user nova-compute[74840]: DEBUG nova.network.neutron [req-4a137fc6-5794-4133-8c32-d6ae671a57e2 req-49cc55a1-e144-462c-82cf-2a38e79cc603 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Updating instance_info_cache with network_info: [{"id": "38640df8-91ab-4bb6-89f1-ac84843d0e1c", "address": "fa:16:3e:7b:5b:86", "network": {"id": "ab262498-b88d-4054-a45b-cd8fe41731e6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1982652154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38640df8-91", "ovs_interfaceid": "38640df8-91ab-4bb6-89f1-ac84843d0e1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "65988447-7cce-4be7-87dd-4fd49e351040", "address": "fa:16:3e:92:b6:34", "network": {"id": "4998659b-781d-44e7-9601-d14cd5e39410", "bridge": "br-int", "label": "tempest-device-tagging-net1-756241958", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65988447-7c", "ovs_interfaceid": "65988447-7cce-4be7-87dd-4fd49e351040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3e6aa660-8be2-44d4-aece-59b38a00ff02", "address": "fa:16:3e:25:8f:ae", "network": {"id": "4998659b-781d-44e7-9601-d14cd5e39410", "bridge": "br-int", "label": "tempest-device-tagging-net1-756241958", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e6aa660-8b", "ovs_interfaceid": "3e6aa660-8be2-44d4-aece-59b38a00ff02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7a2393a4-2d55-49cc-b4af-189d3ab24c1e", "address": "fa:16:3e:64:5a:54", "network": {"id": "4998659b-781d-44e7-9601-d14cd5e39410", "bridge": "br-int", "label": "tempest-device-tagging-net1-756241958", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2393a4-2d", "ovs_interfaceid": "7a2393a4-2d55-49cc-b4af-189d3ab24c1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "77c96b94-7c85-4356-8da8-bb90854ead5e", "address": "fa:16:3e:21:2e:ad", "network": {"id": "4998659b-781d-44e7-9601-d14cd5e39410", "bridge": "br-int", "label": "tempest-device-tagging-net1-756241958", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c96b94-7c", "ovs_interfaceid": "77c96b94-7c85-4356-8da8-bb90854ead5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0f88f24e-b28a-4e36-bef3-1fa13084f370", "address": "fa:16:3e:c4:eb:48", "network": {"id": "2242fb46-3f42-4d3e-808c-ebdd55268fe5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388499652", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f88f24e-b2", "ovs_interfaceid": "0f88f24e-b28a-4e36-bef3-1fa13084f370", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b80b0e8d-2bc7-4e85-8843-c9d8c7931014", "address": "fa:16:3e:0b:f1:33", "network": {"id": "2242fb46-3f42-4d3e-808c-ebdd55268fe5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388499652", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb80b0e8d-2b", "ovs_interfaceid": "b80b0e8d-2bc7-4e85-8843-c9d8c7931014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:14:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4a137fc6-5794-4133-8c32-d6ae671a57e2 req-49cc55a1-e144-462c-82cf-2a38e79cc603 service nova] Releasing lock "refresh_cache-d2dbd607-cf11-4d81-9639-c84e79d65fcd" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:14:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Acquiring lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:14:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:14:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Acquiring lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:14:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:14:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:14:32 user nova-compute[74840]: INFO nova.compute.manager [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Terminating instance
Nov 08 12:14:32 user nova-compute[74840]: DEBUG nova.compute.manager [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Start destroying the instance on the hypervisor. {{(pid=74840) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 12:14:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:33 user nova-compute[74840]: DEBUG nova.compute.manager [req-88800275-13a8-49e2-ba35-33fbe3e9e7d4 req-084fe402-024a-4b0c-82e1-881aae99a050 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received event network-vif-unplugged-38640df8-91ab-4bb6-89f1-ac84843d0e1c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:14:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-88800275-13a8-49e2-ba35-33fbe3e9e7d4 req-084fe402-024a-4b0c-82e1-881aae99a050 service nova] Acquiring lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:14:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-88800275-13a8-49e2-ba35-33fbe3e9e7d4 req-084fe402-024a-4b0c-82e1-881aae99a050 service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:14:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-88800275-13a8-49e2-ba35-33fbe3e9e7d4 req-084fe402-024a-4b0c-82e1-881aae99a050 service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:14:33 user nova-compute[74840]: DEBUG nova.compute.manager [req-88800275-13a8-49e2-ba35-33fbe3e9e7d4 req-084fe402-024a-4b0c-82e1-881aae99a050 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] No waiting events found dispatching network-vif-unplugged-38640df8-91ab-4bb6-89f1-ac84843d0e1c {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:14:33 user nova-compute[74840]: DEBUG nova.compute.manager [req-88800275-13a8-49e2-ba35-33fbe3e9e7d4 req-084fe402-024a-4b0c-82e1-881aae99a050 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received event network-vif-unplugged-38640df8-91ab-4bb6-89f1-ac84843d0e1c for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:14:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:33 user nova-compute[74840]: DEBUG nova.compute.manager [req-3980a4be-b163-4219-a7e4-9a157d190855 req-3d3fc97f-4a3c-4f24-bd47-851f2fec3c78 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received event network-vif-unplugged-3e6aa660-8be2-44d4-aece-59b38a00ff02 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:14:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3980a4be-b163-4219-a7e4-9a157d190855 req-3d3fc97f-4a3c-4f24-bd47-851f2fec3c78 service nova] Acquiring lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:14:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3980a4be-b163-4219-a7e4-9a157d190855 req-3d3fc97f-4a3c-4f24-bd47-851f2fec3c78 service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:14:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3980a4be-b163-4219-a7e4-9a157d190855 req-3d3fc97f-4a3c-4f24-bd47-851f2fec3c78 service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:14:33 user nova-compute[74840]: DEBUG nova.compute.manager [req-3980a4be-b163-4219-a7e4-9a157d190855 req-3d3fc97f-4a3c-4f24-bd47-851f2fec3c78 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] No waiting events found dispatching network-vif-unplugged-3e6aa660-8be2-44d4-aece-59b38a00ff02 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:14:33 user nova-compute[74840]: DEBUG nova.compute.manager [req-3980a4be-b163-4219-a7e4-9a157d190855 req-3d3fc97f-4a3c-4f24-bd47-851f2fec3c78 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received event network-vif-unplugged-3e6aa660-8be2-44d4-aece-59b38a00ff02 for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:14:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:33 user nova-compute[74840]: DEBUG nova.compute.manager [req-56022b83-be55-4228-8237-5180727e695e req-ae469b38-7171-4614-8002-dde7da116bb8 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received event network-vif-unplugged-7a2393a4-2d55-49cc-b4af-189d3ab24c1e {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:14:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-56022b83-be55-4228-8237-5180727e695e req-ae469b38-7171-4614-8002-dde7da116bb8 service nova] Acquiring lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:14:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-56022b83-be55-4228-8237-5180727e695e req-ae469b38-7171-4614-8002-dde7da116bb8 service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:14:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-56022b83-be55-4228-8237-5180727e695e req-ae469b38-7171-4614-8002-dde7da116bb8 service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:14:33 user nova-compute[74840]: DEBUG nova.compute.manager [req-56022b83-be55-4228-8237-5180727e695e req-ae469b38-7171-4614-8002-dde7da116bb8 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] No waiting events found dispatching network-vif-unplugged-7a2393a4-2d55-49cc-b4af-189d3ab24c1e {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:14:33 user nova-compute[74840]: DEBUG nova.compute.manager [req-56022b83-be55-4228-8237-5180727e695e req-ae469b38-7171-4614-8002-dde7da116bb8 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received event network-vif-unplugged-7a2393a4-2d55-49cc-b4af-189d3ab24c1e for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:14:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:34 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Instance destroyed successfully.
Nov 08 12:14:34 user nova-compute[74840]: DEBUG nova.objects.instance [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Lazy-loading 'resources' on Instance uuid d2dbd607-cf11-4d81-9639-c84e79d65fcd {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:14:34 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-467103825',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-467103825',id=8,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZ5yB12feWvkkDrgRcMY7Hf4hO2W8Ls+no6Z45U+6vRbA1JCzU/OYbpBDI5J0S8zB8PP4ZuBH44tWe6fFVP49DWG3e3HxIQhdUjQvyeS1NhY7Ma9aKJ221mPUbEhRS7/Q==',key_name='tempest-keypair-1810663950',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:13:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71995e354fd546fd8d41823c548b1a22',ramdisk_id='',reservation_id='r-8aydahek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-403652028',owner_user_name='tempest-TaggedBootDevicesTest-403652028-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:13:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2856d02455a4163a74b4f5956719920',uuid=d2dbd607-cf11-4d81-9639-c84e79d65fcd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38640df8-91ab-4bb6-89f1-ac84843d0e1c", "address": "fa:16:3e:7b:5b:86", "network": {"id": "ab262498-b88d-4054-a45b-cd8fe41731e6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1982652154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38640df8-91", "ovs_interfaceid": "38640df8-91ab-4bb6-89f1-ac84843d0e1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:14:34 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Converting VIF {"id": "38640df8-91ab-4bb6-89f1-ac84843d0e1c", "address": "fa:16:3e:7b:5b:86", "network": {"id": "ab262498-b88d-4054-a45b-cd8fe41731e6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1982652154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38640df8-91", "ovs_interfaceid": "38640df8-91ab-4bb6-89f1-ac84843d0e1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:14:34 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:5b:86,bridge_name='br-int',has_traffic_filtering=True,id=38640df8-91ab-4bb6-89f1-ac84843d0e1c,network=Network(ab262498-b88d-4054-a45b-cd8fe41731e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38640df8-91') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:14:34 user nova-compute[74840]: DEBUG os_vif [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:5b:86,bridge_name='br-int',has_traffic_filtering=True,id=38640df8-91ab-4bb6-89f1-ac84843d0e1c,network=Network(ab262498-b88d-4054-a45b-cd8fe41731e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38640df8-91') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:14:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38640df8-91, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:14:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:14:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a09e0638-04c0-4c21-a7dc-58506f7d78f0) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:14:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:14:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:34 user nova-compute[74840]: INFO os_vif [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:5b:86,bridge_name='br-int',has_traffic_filtering=True,id=38640df8-91ab-4bb6-89f1-ac84843d0e1c,network=Network(ab262498-b88d-4054-a45b-cd8fe41731e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38640df8-91')
Nov 08 12:14:34 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-467103825',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-467103825',id=8,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZ5yB12feWvkkDrgRcMY7Hf4hO2W8Ls+no6Z45U+6vRbA1JCzU/OYbpBDI5J0S8zB8PP4ZuBH44tWe6fFVP49DWG3e3HxIQhdUjQvyeS1NhY7Ma9aKJ221mPUbEhRS7/Q==',key_name='tempest-keypair-1810663950',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:13:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71995e354fd546fd8d41823c548b1a22',ramdisk_id='',reservation_id='r-8aydahek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-403652028',owner_user_name='tempest-TaggedBootDevicesTest-403652028-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:13:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2856d02455a4163a74b4f5956719920',uuid=d2dbd607-cf11-4d81-9639-c84e79d65fcd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "65988447-7cce-4be7-87dd-4fd49e351040", "address": "fa:16:3e:92:b6:34", "network": {"id": "4998659b-781d-44e7-9601-d14cd5e39410", "bridge": "br-int", "label": "tempest-device-tagging-net1-756241958", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65988447-7c", "ovs_interfaceid": "65988447-7cce-4be7-87dd-4fd49e351040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:14:34 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Converting VIF {"id": "65988447-7cce-4be7-87dd-4fd49e351040", "address": "fa:16:3e:92:b6:34", "network": {"id": "4998659b-781d-44e7-9601-d14cd5e39410", "bridge": "br-int", "label": "tempest-device-tagging-net1-756241958", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65988447-7c", "ovs_interfaceid": "65988447-7cce-4be7-87dd-4fd49e351040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:14:34 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:b6:34,bridge_name='br-int',has_traffic_filtering=True,id=65988447-7cce-4be7-87dd-4fd49e351040,network=Network(4998659b-781d-44e7-9601-d14cd5e39410),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap65988447-7c') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:14:34 user nova-compute[74840]: DEBUG os_vif [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:b6:34,bridge_name='br-int',has_traffic_filtering=True,id=65988447-7cce-4be7-87dd-4fd49e351040,network=Network(4998659b-781d-44e7-9601-d14cd5e39410),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap65988447-7c') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:14:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap65988447-7c, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:14:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ac87804a-7695-4a1f-a88f-a97a6bdec20d) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:35 user nova-compute[74840]: INFO os_vif [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:b6:34,bridge_name='br-int',has_traffic_filtering=True,id=65988447-7cce-4be7-87dd-4fd49e351040,network=Network(4998659b-781d-44e7-9601-d14cd5e39410),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap65988447-7c')
Nov 08 12:14:35 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-467103825',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-467103825',id=8,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZ5yB12feWvkkDrgRcMY7Hf4hO2W8Ls+no6Z45U+6vRbA1JCzU/OYbpBDI5J0S8zB8PP4ZuBH44tWe6fFVP49DWG3e3HxIQhdUjQvyeS1NhY7Ma9aKJ221mPUbEhRS7/Q==',key_name='tempest-keypair-1810663950',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:13:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71995e354fd546fd8d41823c548b1a22',ramdisk_id='',reservation_id='r-8aydahek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-403652028',owner_user_name='tempest-TaggedBootDevicesTest-403652028-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:13:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2856d02455a4163a74b4f5956719920',uuid=d2dbd607-cf11-4d81-9639-c84e79d65fcd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e6aa660-8be2-44d4-aece-59b38a00ff02", "address": "fa:16:3e:25:8f:ae", "network": {"id": "4998659b-781d-44e7-9601-d14cd5e39410", "bridge": "br-int", "label": "tempest-device-tagging-net1-756241958", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e6aa660-8b", "ovs_interfaceid": "3e6aa660-8be2-44d4-aece-59b38a00ff02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Converting VIF {"id": "3e6aa660-8be2-44d4-aece-59b38a00ff02", "address": "fa:16:3e:25:8f:ae", "network": {"id": "4998659b-781d-44e7-9601-d14cd5e39410", "bridge": "br-int", "label": "tempest-device-tagging-net1-756241958", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e6aa660-8b", "ovs_interfaceid": "3e6aa660-8be2-44d4-aece-59b38a00ff02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:8f:ae,bridge_name='br-int',has_traffic_filtering=True,id=3e6aa660-8be2-44d4-aece-59b38a00ff02,network=Network(4998659b-781d-44e7-9601-d14cd5e39410),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3e6aa660-8b') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG os_vif [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:8f:ae,bridge_name='br-int',has_traffic_filtering=True,id=3e6aa660-8be2-44d4-aece-59b38a00ff02,network=Network(4998659b-781d-44e7-9601-d14cd5e39410),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3e6aa660-8b') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e6aa660-8b, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6d4501a2-18d9-40ba-8d52-55597668015e) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:35 user nova-compute[74840]: INFO os_vif [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:8f:ae,bridge_name='br-int',has_traffic_filtering=True,id=3e6aa660-8be2-44d4-aece-59b38a00ff02,network=Network(4998659b-781d-44e7-9601-d14cd5e39410),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3e6aa660-8b')
Nov 08 12:14:35 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-467103825',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-467103825',id=8,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZ5yB12feWvkkDrgRcMY7Hf4hO2W8Ls+no6Z45U+6vRbA1JCzU/OYbpBDI5J0S8zB8PP4ZuBH44tWe6fFVP49DWG3e3HxIQhdUjQvyeS1NhY7Ma9aKJ221mPUbEhRS7/Q==',key_name='tempest-keypair-1810663950',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:13:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71995e354fd546fd8d41823c548b1a22',ramdisk_id='',reservation_id='r-8aydahek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-403652028',owner_user_name='tempest-TaggedBootDevicesTest-403652028-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:13:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2856d02455a4163a74b4f5956719920',uuid=d2dbd607-cf11-4d81-9639-c84e79d65fcd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a2393a4-2d55-49cc-b4af-189d3ab24c1e", "address": "fa:16:3e:64:5a:54", "network": {"id": "4998659b-781d-44e7-9601-d14cd5e39410", "bridge": "br-int", "label": "tempest-device-tagging-net1-756241958", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2393a4-2d", "ovs_interfaceid": "7a2393a4-2d55-49cc-b4af-189d3ab24c1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Converting VIF {"id": "7a2393a4-2d55-49cc-b4af-189d3ab24c1e", "address": "fa:16:3e:64:5a:54", "network": {"id": "4998659b-781d-44e7-9601-d14cd5e39410", "bridge": "br-int", "label": "tempest-device-tagging-net1-756241958", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2393a4-2d", "ovs_interfaceid": "7a2393a4-2d55-49cc-b4af-189d3ab24c1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:5a:54,bridge_name='br-int',has_traffic_filtering=True,id=7a2393a4-2d55-49cc-b4af-189d3ab24c1e,network=Network(4998659b-781d-44e7-9601-d14cd5e39410),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a2393a4-2d') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG os_vif [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:5a:54,bridge_name='br-int',has_traffic_filtering=True,id=7a2393a4-2d55-49cc-b4af-189d3ab24c1e,network=Network(4998659b-781d-44e7-9601-d14cd5e39410),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a2393a4-2d') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a2393a4-2d, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ed442bdf-1cfa-4791-9d0d-c634daa6d8d1) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:35 user nova-compute[74840]: INFO os_vif [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:5a:54,bridge_name='br-int',has_traffic_filtering=True,id=7a2393a4-2d55-49cc-b4af-189d3ab24c1e,network=Network(4998659b-781d-44e7-9601-d14cd5e39410),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a2393a4-2d')
Nov 08 12:14:35 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-467103825',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-467103825',id=8,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZ5yB12feWvkkDrgRcMY7Hf4hO2W8Ls+no6Z45U+6vRbA1JCzU/OYbpBDI5J0S8zB8PP4ZuBH44tWe6fFVP49DWG3e3HxIQhdUjQvyeS1NhY7Ma9aKJ221mPUbEhRS7/Q==',key_name='tempest-keypair-1810663950',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:13:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71995e354fd546fd8d41823c548b1a22',ramdisk_id='',reservation_id='r-8aydahek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-403652028',owner_user_name='tempest-TaggedBootDevicesTest-403652028-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:13:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2856d02455a4163a74b4f5956719920',uuid=d2dbd607-cf11-4d81-9639-c84e79d65fcd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "77c96b94-7c85-4356-8da8-bb90854ead5e", "address": "fa:16:3e:21:2e:ad", "network": {"id": "4998659b-781d-44e7-9601-d14cd5e39410", "bridge": "br-int", "label": "tempest-device-tagging-net1-756241958", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c96b94-7c", "ovs_interfaceid": "77c96b94-7c85-4356-8da8-bb90854ead5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Converting VIF {"id": "77c96b94-7c85-4356-8da8-bb90854ead5e", "address": "fa:16:3e:21:2e:ad", "network": {"id": "4998659b-781d-44e7-9601-d14cd5e39410", "bridge": "br-int", "label": "tempest-device-tagging-net1-756241958", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c96b94-7c", "ovs_interfaceid": "77c96b94-7c85-4356-8da8-bb90854ead5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:2e:ad,bridge_name='br-int',has_traffic_filtering=True,id=77c96b94-7c85-4356-8da8-bb90854ead5e,network=Network(4998659b-781d-44e7-9601-d14cd5e39410),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77c96b94-7c') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG os_vif [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:2e:ad,bridge_name='br-int',has_traffic_filtering=True,id=77c96b94-7c85-4356-8da8-bb90854ead5e,network=Network(4998659b-781d-44e7-9601-d14cd5e39410),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77c96b94-7c') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap77c96b94-7c, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c8206a2a-c70b-43de-bafd-995062cce176) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:35 user nova-compute[74840]: INFO os_vif [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:2e:ad,bridge_name='br-int',has_traffic_filtering=True,id=77c96b94-7c85-4356-8da8-bb90854ead5e,network=Network(4998659b-781d-44e7-9601-d14cd5e39410),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77c96b94-7c')
Nov 08 12:14:35 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-467103825',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-467103825',id=8,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZ5yB12feWvkkDrgRcMY7Hf4hO2W8Ls+no6Z45U+6vRbA1JCzU/OYbpBDI5J0S8zB8PP4ZuBH44tWe6fFVP49DWG3e3HxIQhdUjQvyeS1NhY7Ma9aKJ221mPUbEhRS7/Q==',key_name='tempest-keypair-1810663950',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:13:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71995e354fd546fd8d41823c548b1a22',ramdisk_id='',reservation_id='r-8aydahek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-403652028',owner_user_name='tempest-TaggedBootDevicesTest-403652028-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:13:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2856d02455a4163a74b4f5956719920',uuid=d2dbd607-cf11-4d81-9639-c84e79d65fcd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f88f24e-b28a-4e36-bef3-1fa13084f370", "address": "fa:16:3e:c4:eb:48", "network": {"id": "2242fb46-3f42-4d3e-808c-ebdd55268fe5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388499652", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f88f24e-b2", "ovs_interfaceid": "0f88f24e-b28a-4e36-bef3-1fa13084f370", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Converting VIF {"id": "0f88f24e-b28a-4e36-bef3-1fa13084f370", "address": "fa:16:3e:c4:eb:48", "network": {"id": "2242fb46-3f42-4d3e-808c-ebdd55268fe5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388499652", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f88f24e-b2", "ovs_interfaceid": "0f88f24e-b28a-4e36-bef3-1fa13084f370", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:eb:48,bridge_name='br-int',has_traffic_filtering=True,id=0f88f24e-b28a-4e36-bef3-1fa13084f370,network=Network(2242fb46-3f42-4d3e-808c-ebdd55268fe5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f88f24e-b2') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG os_vif [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:eb:48,bridge_name='br-int',has_traffic_filtering=True,id=0f88f24e-b28a-4e36-bef3-1fa13084f370,network=Network(2242fb46-3f42-4d3e-808c-ebdd55268fe5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f88f24e-b2') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f88f24e-b2, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=03565e1e-027c-4295-b294-fd90c03510f7) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:35 user nova-compute[74840]: INFO os_vif [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:eb:48,bridge_name='br-int',has_traffic_filtering=True,id=0f88f24e-b28a-4e36-bef3-1fa13084f370,network=Network(2242fb46-3f42-4d3e-808c-ebdd55268fe5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f88f24e-b2')
Nov 08 12:14:35 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-467103825',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-467103825',id=8,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZ5yB12feWvkkDrgRcMY7Hf4hO2W8Ls+no6Z45U+6vRbA1JCzU/OYbpBDI5J0S8zB8PP4ZuBH44tWe6fFVP49DWG3e3HxIQhdUjQvyeS1NhY7Ma9aKJ221mPUbEhRS7/Q==',key_name='tempest-keypair-1810663950',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:13:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71995e354fd546fd8d41823c548b1a22',ramdisk_id='',reservation_id='r-8aydahek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-403652028',owner_user_name='tempest-TaggedBootDevicesTest-403652028-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:13:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2856d02455a4163a74b4f5956719920',uuid=d2dbd607-cf11-4d81-9639-c84e79d65fcd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b80b0e8d-2bc7-4e85-8843-c9d8c7931014", "address": "fa:16:3e:0b:f1:33", "network": {"id": "2242fb46-3f42-4d3e-808c-ebdd55268fe5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388499652", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb80b0e8d-2b", "ovs_interfaceid": "b80b0e8d-2bc7-4e85-8843-c9d8c7931014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Converting VIF {"id": "b80b0e8d-2bc7-4e85-8843-c9d8c7931014", "address": "fa:16:3e:0b:f1:33", "network": {"id": "2242fb46-3f42-4d3e-808c-ebdd55268fe5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388499652", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb80b0e8d-2b", "ovs_interfaceid": "b80b0e8d-2bc7-4e85-8843-c9d8c7931014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:f1:33,bridge_name='br-int',has_traffic_filtering=True,id=b80b0e8d-2bc7-4e85-8843-c9d8c7931014,network=Network(2242fb46-3f42-4d3e-808c-ebdd55268fe5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb80b0e8d-2b') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG os_vif [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:f1:33,bridge_name='br-int',has_traffic_filtering=True,id=b80b0e8d-2bc7-4e85-8843-c9d8c7931014,network=Network(2242fb46-3f42-4d3e-808c-ebdd55268fe5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb80b0e8d-2b') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb80b0e8d-2b, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=182665ff-28f1-41d1-8acf-da092f11a74d) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:14:35 user nova-compute[74840]: INFO os_vif [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:f1:33,bridge_name='br-int',has_traffic_filtering=True,id=b80b0e8d-2bc7-4e85-8843-c9d8c7931014,network=Network(2242fb46-3f42-4d3e-808c-ebdd55268fe5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb80b0e8d-2b')
Nov 08 12:14:35 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JPZiVOCl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:14:35 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:14:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[706bf441-f8de-4476-8bc1-2dd26ce62f89]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 12:14:35 user nova-compute[74840]: No targets found.
Nov 08 12:14:35 user nova-compute[74840]: iSNS:
Nov 08 12:14:35 user nova-compute[74840]: No targets found.
Nov 08 12:14:35 user nova-compute[74840]: STATIC:
Nov 08 12:14:35 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22
Nov 08 12:14:35 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:14:35 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:14:35 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc
Nov 08 12:14:35 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:14:35 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:14:35 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60
Nov 08 12:14:35 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:14:35 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:14:35 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b
Nov 08 12:14:35 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:14:35 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:14:35 user nova-compute[74840]: FIRMWARE:
Nov 08 12:14:35 user nova-compute[74840]: No targets found.
Nov 08 12:14:35 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 12:14:35 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 12:14:35 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0396c0-8958-41d8-a6cd-819e2f14f360]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e4122f-a8b4-4f0d-af4d-c256c0581b91]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)
Nov 08 12:14:35 user nova-compute[74840]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc (non-flash)
Nov 08 12:14:35 user nova-compute[74840]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b (non-flash)
Nov 08 12:14:35 user nova-compute[74840]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60 (non-flash)
Nov 08 12:14:35 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)
Nov 08 12:14:35 user nova-compute[74840]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc (non-flash)
Nov 08 12:14:35 user nova-compute[74840]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b (non-flash)
Nov 08 12:14:35 user nova-compute[74840]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60 (non-flash)
Nov 08 12:14:35 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7f4265d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60'): ({'sdf'}, set())}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Removing single pathed devices sdf {{(pid=74840) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG nova.compute.manager [req-8fe5398b-b251-4532-a510-ae31489145c4 req-b2781a9d-6e62-46ca-a838-baaf8d01071c service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received event network-vif-plugged-38640df8-91ab-4bb6-89f1-ac84843d0e1c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8fe5398b-b251-4532-a510-ae31489145c4 req-b2781a9d-6e62-46ca-a838-baaf8d01071c service nova] Acquiring lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8fe5398b-b251-4532-a510-ae31489145c4 req-b2781a9d-6e62-46ca-a838-baaf8d01071c service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8fe5398b-b251-4532-a510-ae31489145c4 req-b2781a9d-6e62-46ca-a838-baaf8d01071c service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG nova.compute.manager [req-8fe5398b-b251-4532-a510-ae31489145c4 req-b2781a9d-6e62-46ca-a838-baaf8d01071c service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] No waiting events found dispatching network-vif-plugged-38640df8-91ab-4bb6-89f1-ac84843d0e1c {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:14:35 user nova-compute[74840]: WARNING nova.compute.manager [req-8fe5398b-b251-4532-a510-ae31489145c4 req-b2781a9d-6e62-46ca-a838-baaf8d01071c service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received unexpected event network-vif-plugged-38640df8-91ab-4bb6-89f1-ac84843d0e1c for instance with vm_state active and task_state deleting.
Nov 08 12:14:35 user nova-compute[74840]: DEBUG nova.compute.manager [req-8fe5398b-b251-4532-a510-ae31489145c4 req-b2781a9d-6e62-46ca-a838-baaf8d01071c service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received event network-vif-unplugged-65988447-7cce-4be7-87dd-4fd49e351040 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8fe5398b-b251-4532-a510-ae31489145c4 req-b2781a9d-6e62-46ca-a838-baaf8d01071c service nova] Acquiring lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8fe5398b-b251-4532-a510-ae31489145c4 req-b2781a9d-6e62-46ca-a838-baaf8d01071c service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8fe5398b-b251-4532-a510-ae31489145c4 req-b2781a9d-6e62-46ca-a838-baaf8d01071c service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG nova.compute.manager [req-8fe5398b-b251-4532-a510-ae31489145c4 req-b2781a9d-6e62-46ca-a838-baaf8d01071c service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] No waiting events found dispatching network-vif-unplugged-65988447-7cce-4be7-87dd-4fd49e351040 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG nova.compute.manager [req-8fe5398b-b251-4532-a510-ae31489145c4 req-b2781a9d-6e62-46ca-a838-baaf8d01071c service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received event network-vif-unplugged-65988447-7cce-4be7-87dd-4fd49e351040 for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG nova.compute.manager [req-8fe5398b-b251-4532-a510-ae31489145c4 req-b2781a9d-6e62-46ca-a838-baaf8d01071c service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received event network-vif-plugged-65988447-7cce-4be7-87dd-4fd49e351040 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8fe5398b-b251-4532-a510-ae31489145c4 req-b2781a9d-6e62-46ca-a838-baaf8d01071c service nova] Acquiring lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8fe5398b-b251-4532-a510-ae31489145c4 req-b2781a9d-6e62-46ca-a838-baaf8d01071c service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8fe5398b-b251-4532-a510-ae31489145c4 req-b2781a9d-6e62-46ca-a838-baaf8d01071c service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG nova.compute.manager [req-8fe5398b-b251-4532-a510-ae31489145c4 req-b2781a9d-6e62-46ca-a838-baaf8d01071c service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] No waiting events found dispatching network-vif-plugged-65988447-7cce-4be7-87dd-4fd49e351040 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:14:35 user nova-compute[74840]: WARNING nova.compute.manager [req-8fe5398b-b251-4532-a510-ae31489145c4 req-b2781a9d-6e62-46ca-a838-baaf8d01071c service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received unexpected event network-vif-plugged-65988447-7cce-4be7-87dd-4fd49e351040 for instance with vm_state active and task_state deleting.
Nov 08 12:14:35 user nova-compute[74840]: DEBUG nova.compute.manager [req-8fe5398b-b251-4532-a510-ae31489145c4 req-b2781a9d-6e62-46ca-a838-baaf8d01071c service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received event network-vif-unplugged-77c96b94-7c85-4356-8da8-bb90854ead5e {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8fe5398b-b251-4532-a510-ae31489145c4 req-b2781a9d-6e62-46ca-a838-baaf8d01071c service nova] Acquiring lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8fe5398b-b251-4532-a510-ae31489145c4 req-b2781a9d-6e62-46ca-a838-baaf8d01071c service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8fe5398b-b251-4532-a510-ae31489145c4 req-b2781a9d-6e62-46ca-a838-baaf8d01071c service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG nova.compute.manager [req-8fe5398b-b251-4532-a510-ae31489145c4 req-b2781a9d-6e62-46ca-a838-baaf8d01071c service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] No waiting events found dispatching network-vif-unplugged-77c96b94-7c85-4356-8da8-bb90854ead5e {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG nova.compute.manager [req-8fe5398b-b251-4532-a510-ae31489145c4 req-b2781a9d-6e62-46ca-a838-baaf8d01071c service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received event network-vif-unplugged-77c96b94-7c85-4356-8da8-bb90854ead5e for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG nova.compute.manager [req-8fe5398b-b251-4532-a510-ae31489145c4 req-b2781a9d-6e62-46ca-a838-baaf8d01071c service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received event network-vif-plugged-77c96b94-7c85-4356-8da8-bb90854ead5e {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8fe5398b-b251-4532-a510-ae31489145c4 req-b2781a9d-6e62-46ca-a838-baaf8d01071c service nova] Acquiring lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8fe5398b-b251-4532-a510-ae31489145c4 req-b2781a9d-6e62-46ca-a838-baaf8d01071c service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8fe5398b-b251-4532-a510-ae31489145c4 req-b2781a9d-6e62-46ca-a838-baaf8d01071c service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG nova.compute.manager [req-8fe5398b-b251-4532-a510-ae31489145c4 req-b2781a9d-6e62-46ca-a838-baaf8d01071c service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] No waiting events found dispatching network-vif-plugged-77c96b94-7c85-4356-8da8-bb90854ead5e {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:14:35 user nova-compute[74840]: WARNING nova.compute.manager [req-8fe5398b-b251-4532-a510-ae31489145c4 req-b2781a9d-6e62-46ca-a838-baaf8d01071c service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received unexpected event network-vif-plugged-77c96b94-7c85-4356-8da8-bb90854ead5e for instance with vm_state active and task_state deleting.
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75e8489-4c03-49ef-b339-512f9fdd74ab]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d41fe9-9723-419e-a4b3-5d1cd6fbc611]: (4, ('ok\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Flushing IO for device /dev/sdf {{(pid=74840) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b220cc9-4237-4869-bce4-45ce430ac856]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74840) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[25802e7e-b093-4750-b698-dfbf3647137d]: (4, ('1', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] SCSI volumes sdf have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60')] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG nova.compute.manager [req-07074421-f37d-4b70-9abf-17992ff375af req-a5ba2fc5-eb19-4921-af12-a464cd57e0ef service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received event network-vif-plugged-3e6aa660-8be2-44d4-aece-59b38a00ff02 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-07074421-f37d-4b70-9abf-17992ff375af req-a5ba2fc5-eb19-4921-af12-a464cd57e0ef service nova] Acquiring lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-07074421-f37d-4b70-9abf-17992ff375af req-a5ba2fc5-eb19-4921-af12-a464cd57e0ef service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-07074421-f37d-4b70-9abf-17992ff375af req-a5ba2fc5-eb19-4921-af12-a464cd57e0ef service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG nova.compute.manager [req-07074421-f37d-4b70-9abf-17992ff375af req-a5ba2fc5-eb19-4921-af12-a464cd57e0ef service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] No waiting events found dispatching network-vif-plugged-3e6aa660-8be2-44d4-aece-59b38a00ff02 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:14:35 user nova-compute[74840]: WARNING nova.compute.manager [req-07074421-f37d-4b70-9abf-17992ff375af req-a5ba2fc5-eb19-4921-af12-a464cd57e0ef service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received unexpected event network-vif-plugged-3e6aa660-8be2-44d4-aece-59b38a00ff02 for instance with vm_state active and task_state deleting.
Nov 08 12:14:35 user nova-compute[74840]: DEBUG nova.compute.manager [req-07074421-f37d-4b70-9abf-17992ff375af req-a5ba2fc5-eb19-4921-af12-a464cd57e0ef service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received event network-vif-unplugged-0f88f24e-b28a-4e36-bef3-1fa13084f370 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-07074421-f37d-4b70-9abf-17992ff375af req-a5ba2fc5-eb19-4921-af12-a464cd57e0ef service nova] Acquiring lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-07074421-f37d-4b70-9abf-17992ff375af req-a5ba2fc5-eb19-4921-af12-a464cd57e0ef service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-07074421-f37d-4b70-9abf-17992ff375af req-a5ba2fc5-eb19-4921-af12-a464cd57e0ef service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG nova.compute.manager [req-07074421-f37d-4b70-9abf-17992ff375af req-a5ba2fc5-eb19-4921-af12-a464cd57e0ef service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] No waiting events found dispatching network-vif-unplugged-0f88f24e-b28a-4e36-bef3-1fa13084f370 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG nova.compute.manager [req-07074421-f37d-4b70-9abf-17992ff375af req-a5ba2fc5-eb19-4921-af12-a464cd57e0ef service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received event network-vif-unplugged-0f88f24e-b28a-4e36-bef3-1fa13084f370 for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG nova.compute.manager [req-07074421-f37d-4b70-9abf-17992ff375af req-a5ba2fc5-eb19-4921-af12-a464cd57e0ef service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received event network-vif-plugged-0f88f24e-b28a-4e36-bef3-1fa13084f370 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-07074421-f37d-4b70-9abf-17992ff375af req-a5ba2fc5-eb19-4921-af12-a464cd57e0ef service nova] Acquiring lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-07074421-f37d-4b70-9abf-17992ff375af req-a5ba2fc5-eb19-4921-af12-a464cd57e0ef service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-07074421-f37d-4b70-9abf-17992ff375af req-a5ba2fc5-eb19-4921-af12-a464cd57e0ef service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG nova.compute.manager [req-07074421-f37d-4b70-9abf-17992ff375af req-a5ba2fc5-eb19-4921-af12-a464cd57e0ef service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] No waiting events found dispatching network-vif-plugged-0f88f24e-b28a-4e36-bef3-1fa13084f370 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:14:35 user nova-compute[74840]: WARNING nova.compute.manager [req-07074421-f37d-4b70-9abf-17992ff375af req-a5ba2fc5-eb19-4921-af12-a464cd57e0ef service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received unexpected event network-vif-plugged-0f88f24e-b28a-4e36-bef3-1fa13084f370 for instance with vm_state active and task_state deleting.
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e119f09d-5f0d-4330-a101-29002120950d]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60 -p 172.16.0.220:3260 --logout {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63704fe-03a3-46d4-97ed-c0e93eff58a2]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60, portal: 172.16.0.220,3260]
Nov 08 12:14:35 user nova-compute[74840]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60, portal: 172.16.0.220,3260] successful.
Nov 08 12:14:35 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60 -p 172.16.0.220:3260 --op delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG nova.compute.manager [req-354538c5-a550-43e2-80ff-b3ef6970964b req-d4212873-5c15-488f-b867-2479a6fe2f90 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received event network-vif-plugged-7a2393a4-2d55-49cc-b4af-189d3ab24c1e {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-354538c5-a550-43e2-80ff-b3ef6970964b req-d4212873-5c15-488f-b867-2479a6fe2f90 service nova] Acquiring lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-354538c5-a550-43e2-80ff-b3ef6970964b req-d4212873-5c15-488f-b867-2479a6fe2f90 service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-354538c5-a550-43e2-80ff-b3ef6970964b req-d4212873-5c15-488f-b867-2479a6fe2f90 service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG nova.compute.manager [req-354538c5-a550-43e2-80ff-b3ef6970964b req-d4212873-5c15-488f-b867-2479a6fe2f90 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] No waiting events found dispatching network-vif-plugged-7a2393a4-2d55-49cc-b4af-189d3ab24c1e {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:14:35 user nova-compute[74840]: WARNING nova.compute.manager [req-354538c5-a550-43e2-80ff-b3ef6970964b req-d4212873-5c15-488f-b867-2479a6fe2f90 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received unexpected event network-vif-plugged-7a2393a4-2d55-49cc-b4af-189d3ab24c1e for instance with vm_state active and task_state deleting.
Nov 08 12:14:35 user nova-compute[74840]: DEBUG nova.compute.manager [req-354538c5-a550-43e2-80ff-b3ef6970964b req-d4212873-5c15-488f-b867-2479a6fe2f90 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received event network-vif-unplugged-b80b0e8d-2bc7-4e85-8843-c9d8c7931014 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-354538c5-a550-43e2-80ff-b3ef6970964b req-d4212873-5c15-488f-b867-2479a6fe2f90 service nova] Acquiring lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-354538c5-a550-43e2-80ff-b3ef6970964b req-d4212873-5c15-488f-b867-2479a6fe2f90 service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-354538c5-a550-43e2-80ff-b3ef6970964b req-d4212873-5c15-488f-b867-2479a6fe2f90 service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG nova.compute.manager [req-354538c5-a550-43e2-80ff-b3ef6970964b req-d4212873-5c15-488f-b867-2479a6fe2f90 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] No waiting events found dispatching network-vif-unplugged-b80b0e8d-2bc7-4e85-8843-c9d8c7931014 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG nova.compute.manager [req-354538c5-a550-43e2-80ff-b3ef6970964b req-d4212873-5c15-488f-b867-2479a6fe2f90 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received event network-vif-unplugged-b80b0e8d-2bc7-4e85-8843-c9d8c7931014 for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG nova.compute.manager [req-354538c5-a550-43e2-80ff-b3ef6970964b req-d4212873-5c15-488f-b867-2479a6fe2f90 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received event network-vif-plugged-b80b0e8d-2bc7-4e85-8843-c9d8c7931014 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-354538c5-a550-43e2-80ff-b3ef6970964b req-d4212873-5c15-488f-b867-2479a6fe2f90 service nova] Acquiring lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-354538c5-a550-43e2-80ff-b3ef6970964b req-d4212873-5c15-488f-b867-2479a6fe2f90 service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-354538c5-a550-43e2-80ff-b3ef6970964b req-d4212873-5c15-488f-b867-2479a6fe2f90 service nova] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG nova.compute.manager [req-354538c5-a550-43e2-80ff-b3ef6970964b req-d4212873-5c15-488f-b867-2479a6fe2f90 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] No waiting events found dispatching network-vif-plugged-b80b0e8d-2bc7-4e85-8843-c9d8c7931014 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:14:35 user nova-compute[74840]: WARNING nova.compute.manager [req-354538c5-a550-43e2-80ff-b3ef6970964b req-d4212873-5c15-488f-b867-2479a6fe2f90 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received unexpected event network-vif-plugged-b80b0e8d-2bc7-4e85-8843-c9d8c7931014 for instance with vm_state active and task_state deleting.
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:644305b8-0b29-4439-920c-b802be80bd60 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a92c47-518e-4fb6-9941-361e0e5b7645]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] <== disconnect_volume: return (336ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cQTWzeVq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:14:35 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:14:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8c8c49-e7b1-4f09-9089-a62273766879]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 12:14:35 user nova-compute[74840]: No targets found.
Nov 08 12:14:35 user nova-compute[74840]: iSNS:
Nov 08 12:14:35 user nova-compute[74840]: No targets found.
Nov 08 12:14:35 user nova-compute[74840]: STATIC:
Nov 08 12:14:35 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22
Nov 08 12:14:35 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:14:35 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:14:35 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc
Nov 08 12:14:35 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:14:35 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:14:35 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b
Nov 08 12:14:35 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:14:35 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:14:35 user nova-compute[74840]: FIRMWARE:
Nov 08 12:14:35 user nova-compute[74840]: No targets found.
Nov 08 12:14:35 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 12:14:35 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 12:14:35 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8267e2d-0d19-4588-8f87-3a2043f091d8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed068c79-dd8f-4992-badc-0ebfb8b928fd]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)
Nov 08 12:14:35 user nova-compute[74840]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc (non-flash)
Nov 08 12:14:35 user nova-compute[74840]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b (non-flash)
Nov 08 12:14:35 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)
Nov 08 12:14:35 user nova-compute[74840]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc (non-flash)
Nov 08 12:14:35 user nova-compute[74840]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b (non-flash)
Nov 08 12:14:35 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7f4105cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b'): ({'sde'}, set())}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Removing single pathed devices sde {{(pid=74840) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39edf79-29b5-448b-9d33-2cb3a47979d4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f97195-20c9-43f4-8ad8-b873a438448c]: (4, ('ok\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Flushing IO for device /dev/sde {{(pid=74840) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae060944-5a60-40e4-a6e1-0634c087d4b3]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74840) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5b17d7-0bc8-4fa6-ba93-ab499a166f5f]: (4, ('1', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] SCSI volumes sde have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b')] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2838514-0feb-4795-82c5-81f90d135230]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b -p 172.16.0.220:3260 --logout {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95d650d-b087-4f6f-a2eb-cb39630085e3]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b, portal: 172.16.0.220,3260]
Nov 08 12:14:35 user nova-compute[74840]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b, portal: 172.16.0.220,3260] successful.
Nov 08 12:14:35 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b -p 172.16.0.220:3260 --op delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae8e04aa-d9df-41b6-bbc3-146d58486e6b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ed8d27-65d0-4208-be79-b4152dcc0292]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] <== disconnect_volume: return (312ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 12:14:35 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uBlitSAY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:14:36 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:14:36 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71ce76a-3fac-425d-a5d2-d98599f03411]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 12:14:36 user nova-compute[74840]: No targets found.
Nov 08 12:14:36 user nova-compute[74840]: iSNS:
Nov 08 12:14:36 user nova-compute[74840]: No targets found.
Nov 08 12:14:36 user nova-compute[74840]: STATIC:
Nov 08 12:14:36 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22
Nov 08 12:14:36 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:14:36 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:14:36 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc
Nov 08 12:14:36 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:14:36 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:14:36 user nova-compute[74840]: FIRMWARE:
Nov 08 12:14:36 user nova-compute[74840]: No targets found.
Nov 08 12:14:36 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 12:14:36 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 12:14:36 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ca427b-f997-4b6b-8c2e-150eebb06a67]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ee7560-65b8-4720-90c2-fe05067903ed]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)
Nov 08 12:14:36 user nova-compute[74840]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc (non-flash)
Nov 08 12:14:36 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)
Nov 08 12:14:36 user nova-compute[74840]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc (non-flash)
Nov 08 12:14:36 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7f4105cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc'): ({'sdd'}, set())}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Removing single pathed devices sdd {{(pid=74840) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[2588d644-b83f-4c99-a106-dea51a150fdd]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f102dc2b-8986-409b-bfd8-1581a803db7e]: (4, ('ok\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Flushing IO for device /dev/sdd {{(pid=74840) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[efcc35a3-67ee-4246-8110-33967dc1227d]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74840) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00f126b-304b-4574-9033-2c2dd70c73b6]: (4, ('1', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] SCSI volumes sdd have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc')] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef41e6f6-0080-4261-bee2-215154fa7825]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc -p 172.16.0.220:3260 --logout {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3999fc4-9cf8-4564-824a-171832abd829]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc, portal: 172.16.0.220,3260]
Nov 08 12:14:36 user nova-compute[74840]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc, portal: 172.16.0.220,3260] successful.
Nov 08 12:14:36 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc -p 172.16.0.220:3260 --op delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbfcb038-a5cd-4d70-99e9-0666fcd0dbdc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[337b306c-d4c6-4613-9ae0-c09f3beb0747]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] <== disconnect_volume: return (336ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 12:14:36 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Deleting instance files /opt/stack/data/nova/instances/d2dbd607-cf11-4d81-9639-c84e79d65fcd_del
Nov 08 12:14:36 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Deletion of /opt/stack/data/nova/instances/d2dbd607-cf11-4d81-9639-c84e79d65fcd_del complete
Nov 08 12:14:36 user nova-compute[74840]: INFO nova.compute.manager [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Took 3.44 seconds to destroy the instance on the hypervisor.
Nov 08 12:14:36 user nova-compute[74840]: DEBUG oslo.service.loopingcall [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74840) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG nova.compute.manager [-] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Deallocating network for instance {{(pid=74840) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 12:14:36 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] deallocate_for_instance() {{(pid=74840) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 12:14:38 user nova-compute[74840]: DEBUG nova.compute.manager [req-6b8df6f2-a6ed-4e11-9052-47d4019bd9ca req-bf34513b-31e6-40cc-b52b-3df8f081cc02 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received event network-vif-deleted-7a2393a4-2d55-49cc-b4af-189d3ab24c1e {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:14:38 user nova-compute[74840]: INFO nova.compute.manager [req-6b8df6f2-a6ed-4e11-9052-47d4019bd9ca req-bf34513b-31e6-40cc-b52b-3df8f081cc02 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Neutron deleted interface 7a2393a4-2d55-49cc-b4af-189d3ab24c1e; detaching it from the instance and deleting it from the info cache
Nov 08 12:14:38 user nova-compute[74840]: DEBUG nova.network.neutron [req-6b8df6f2-a6ed-4e11-9052-47d4019bd9ca req-bf34513b-31e6-40cc-b52b-3df8f081cc02 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Updating instance_info_cache with network_info: [{"id": "38640df8-91ab-4bb6-89f1-ac84843d0e1c", "address": "fa:16:3e:7b:5b:86", "network": {"id": "ab262498-b88d-4054-a45b-cd8fe41731e6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1982652154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38640df8-91", "ovs_interfaceid": "38640df8-91ab-4bb6-89f1-ac84843d0e1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "65988447-7cce-4be7-87dd-4fd49e351040", "address": "fa:16:3e:92:b6:34", "network": {"id": "4998659b-781d-44e7-9601-d14cd5e39410", "bridge": "br-int", "label": "tempest-device-tagging-net1-756241958", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65988447-7c", "ovs_interfaceid": "65988447-7cce-4be7-87dd-4fd49e351040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3e6aa660-8be2-44d4-aece-59b38a00ff02", "address": "fa:16:3e:25:8f:ae", "network": {"id": "4998659b-781d-44e7-9601-d14cd5e39410", "bridge": "br-int", "label": "tempest-device-tagging-net1-756241958", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e6aa660-8b", "ovs_interfaceid": "3e6aa660-8be2-44d4-aece-59b38a00ff02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "77c96b94-7c85-4356-8da8-bb90854ead5e", "address": "fa:16:3e:21:2e:ad", "network": {"id": "4998659b-781d-44e7-9601-d14cd5e39410", "bridge": "br-int", "label": "tempest-device-tagging-net1-756241958", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c96b94-7c", "ovs_interfaceid": "77c96b94-7c85-4356-8da8-bb90854ead5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0f88f24e-b28a-4e36-bef3-1fa13084f370", "address": "fa:16:3e:c4:eb:48", "network": {"id": "2242fb46-3f42-4d3e-808c-ebdd55268fe5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388499652", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f88f24e-b2", "ovs_interfaceid": "0f88f24e-b28a-4e36-bef3-1fa13084f370", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b80b0e8d-2bc7-4e85-8843-c9d8c7931014", "address": "fa:16:3e:0b:f1:33", "network": {"id": "2242fb46-3f42-4d3e-808c-ebdd55268fe5", "bridge": "br-int", "label": "tempest-device-tagging-net2-1388499652", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71995e354fd546fd8d41823c548b1a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb80b0e8d-2b", "ovs_interfaceid": "b80b0e8d-2bc7-4e85-8843-c9d8c7931014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:14:38 user nova-compute[74840]: DEBUG nova.compute.manager [req-6b8df6f2-a6ed-4e11-9052-47d4019bd9ca req-bf34513b-31e6-40cc-b52b-3df8f081cc02 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Detach interface failed, port_id=7a2393a4-2d55-49cc-b4af-189d3ab24c1e, reason: Instance d2dbd607-cf11-4d81-9639-c84e79d65fcd could not be found. {{(pid=74840) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 12:14:40 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:14:40 user nova-compute[74840]: INFO nova.compute.manager [-] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Took 3.62 seconds to deallocate network for instance.
Nov 08 12:14:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:40 user nova-compute[74840]: DEBUG nova.compute.manager [req-48fb3309-ba8c-4ac2-ba78-5756f1fb86f3 req-29d94ef6-cc2e-48da-974a-e1ca77ebc209 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received event network-vif-deleted-0f88f24e-b28a-4e36-bef3-1fa13084f370 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:14:40 user nova-compute[74840]: DEBUG nova.compute.manager [req-48fb3309-ba8c-4ac2-ba78-5756f1fb86f3 req-29d94ef6-cc2e-48da-974a-e1ca77ebc209 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received event network-vif-deleted-b80b0e8d-2bc7-4e85-8843-c9d8c7931014 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:14:40 user nova-compute[74840]: DEBUG nova.compute.manager [req-48fb3309-ba8c-4ac2-ba78-5756f1fb86f3 req-29d94ef6-cc2e-48da-974a-e1ca77ebc209 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received event network-vif-deleted-77c96b94-7c85-4356-8da8-bb90854ead5e {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:14:40 user nova-compute[74840]: DEBUG nova.compute.manager [req-48fb3309-ba8c-4ac2-ba78-5756f1fb86f3 req-29d94ef6-cc2e-48da-974a-e1ca77ebc209 service nova] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Received event network-vif-deleted-38640df8-91ab-4bb6-89f1-ac84843d0e1c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:14:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:44 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:14:44 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74840) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 12:14:45 user nova-compute[74840]: DEBUG nova.objects.instance [None req-1013fb3e-012d-4ca2-8f51-3a65a77e7e93 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lazy-loading 'flavor' on Instance uuid 43eae335-a4a0-40b2-8cd4-c7881cd397b1 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:14:45 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1013fb3e-012d-4ca2-8f51-3a65a77e7e93 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "43eae335-a4a0-40b2-8cd4-c7881cd397b1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 44.542s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:14:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:45 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:14:45 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:14:45 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Rebuilding the list of instances to heal {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 12:14:45 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Skipping network cache update for instance because it is being deleted. {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 08 12:14:45 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "refresh_cache-43eae335-a4a0-40b2-8cd4-c7881cd397b1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:14:45 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquired lock "refresh_cache-43eae335-a4a0-40b2-8cd4-c7881cd397b1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:14:45 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Forcefully refreshing network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 12:14:45 user nova-compute[74840]: DEBUG nova.objects.instance [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lazy-loading 'info_cache' on Instance uuid 43eae335-a4a0-40b2-8cd4-c7881cd397b1 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:14:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:46 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Updating instance_info_cache with network_info: [{"id": "fb33b08e-aef7-4999-9121-3caf5d027586", "address": "fa:16:3e:8f:c3:d6", "network": {"id": "381cad9f-376a-4335-95a4-4824aa0d7fad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1035058856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ec082e08ddf4477a721e410fe944d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb33b08e-ae", "ovs_interfaceid": "fb33b08e-aef7-4999-9121-3caf5d027586", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:14:46 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Releasing lock "refresh_cache-43eae335-a4a0-40b2-8cd4-c7881cd397b1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:14:46 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Updated the network info_cache for instance {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 12:14:46 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:14:46 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:14:46 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:14:46 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:14:46 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:14:47 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:14:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:50 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:14:50 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:14:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:14:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:14:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:14:50 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:14:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0b7a0e1-d0d1-4682-9218-ef44d1e461f1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0b7a0e1-d0d1-4682-9218-ef44d1e461f1/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0b7a0e1-d0d1-4682-9218-ef44d1e461f1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:51 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bf6606da-75ab-4801-bdb8-283aada30429 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "43eae335-a4a0-40b2-8cd4-c7881cd397b1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:14:51 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bf6606da-75ab-4801-bdb8-283aada30429 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "43eae335-a4a0-40b2-8cd4-c7881cd397b1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:14:51 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bf6606da-75ab-4801-bdb8-283aada30429 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "43eae335-a4a0-40b2-8cd4-c7881cd397b1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:14:51 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bf6606da-75ab-4801-bdb8-283aada30429 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "43eae335-a4a0-40b2-8cd4-c7881cd397b1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:14:51 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bf6606da-75ab-4801-bdb8-283aada30429 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "43eae335-a4a0-40b2-8cd4-c7881cd397b1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:14:51 user nova-compute[74840]: INFO nova.compute.manager [None req-bf6606da-75ab-4801-bdb8-283aada30429 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Terminating instance
Nov 08 12:14:51 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bf6606da-75ab-4801-bdb8-283aada30429 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Start destroying the instance on the hypervisor. {{(pid=74840) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 12:14:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0b7a0e1-d0d1-4682-9218-ef44d1e461f1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:51 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:51 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:51 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:51 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43eae335-a4a0-40b2-8cd4-c7881cd397b1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43eae335-a4a0-40b2-8cd4-c7881cd397b1/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43eae335-a4a0-40b2-8cd4-c7881cd397b1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:52 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Instance destroyed successfully.
Nov 08 12:14:52 user nova-compute[74840]: DEBUG nova.objects.instance [None req-bf6606da-75ab-4801-bdb8-283aada30429 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lazy-loading 'resources' on Instance uuid 43eae335-a4a0-40b2-8cd4-c7881cd397b1 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:14:52 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-bf6606da-75ab-4801-bdb8-283aada30429 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:08:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1315362065',display_name='tempest-AttachVolumeNegativeTest-server-1315362065',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1315362065',id=1,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFreICnbAFizKKslyGfEnjFmW5UGlVQkC9XWYCjb5jOtF+PG6Az7MQ838BlFrTrlGesqyu/zhTSCVQmT+nxhs8fxB71Cnu/BA2xHDhU07/9nMYSkFkHKFetOeH7B2IbW7A==',key_name='tempest-keypair-1354977390',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:08:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ec082e08ddf4477a721e410fe944d10',ramdisk_id='',reservation_id='r-px3ivrur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1526881991',owner_user_name='tempest-AttachVolumeNegativeTest-1526881991-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:08:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e172625e7f334a2b896b2738bbf49aa8',uuid=43eae335-a4a0-40b2-8cd4-c7881cd397b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb33b08e-aef7-4999-9121-3caf5d027586", "address": "fa:16:3e:8f:c3:d6", "network": {"id": "381cad9f-376a-4335-95a4-4824aa0d7fad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1035058856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ec082e08ddf4477a721e410fe944d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb33b08e-ae", "ovs_interfaceid": "fb33b08e-aef7-4999-9121-3caf5d027586", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:14:52 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-bf6606da-75ab-4801-bdb8-283aada30429 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Converting VIF {"id": "fb33b08e-aef7-4999-9121-3caf5d027586", "address": "fa:16:3e:8f:c3:d6", "network": {"id": "381cad9f-376a-4335-95a4-4824aa0d7fad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1035058856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ec082e08ddf4477a721e410fe944d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb33b08e-ae", "ovs_interfaceid": "fb33b08e-aef7-4999-9121-3caf5d027586", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:14:52 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-bf6606da-75ab-4801-bdb8-283aada30429 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:c3:d6,bridge_name='br-int',has_traffic_filtering=True,id=fb33b08e-aef7-4999-9121-3caf5d027586,network=Network(381cad9f-376a-4335-95a4-4824aa0d7fad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb33b08e-ae') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:14:52 user nova-compute[74840]: DEBUG os_vif [None req-bf6606da-75ab-4801-bdb8-283aada30429 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:c3:d6,bridge_name='br-int',has_traffic_filtering=True,id=fb33b08e-aef7-4999-9121-3caf5d027586,network=Network(381cad9f-376a-4335-95a4-4824aa0d7fad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb33b08e-ae') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:14:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb33b08e-ae, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:14:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43eae335-a4a0-40b2-8cd4-c7881cd397b1/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:14:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=604f0d10-9ce0-4242-9fa7-3f89ade2dbc8) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:14:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:14:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2a38d-14cf-4199-bb04-179ab4605a9e/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:52 user nova-compute[74840]: INFO os_vif [None req-bf6606da-75ab-4801-bdb8-283aada30429 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:c3:d6,bridge_name='br-int',has_traffic_filtering=True,id=fb33b08e-aef7-4999-9121-3caf5d027586,network=Network(381cad9f-376a-4335-95a4-4824aa0d7fad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb33b08e-ae')
Nov 08 12:14:52 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-bf6606da-75ab-4801-bdb8-283aada30429 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Deleting instance files /opt/stack/data/nova/instances/43eae335-a4a0-40b2-8cd4-c7881cd397b1_del
Nov 08 12:14:52 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-bf6606da-75ab-4801-bdb8-283aada30429 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Deletion of /opt/stack/data/nova/instances/43eae335-a4a0-40b2-8cd4-c7881cd397b1_del complete
Nov 08 12:14:52 user nova-compute[74840]: DEBUG nova.compute.manager [req-29193e46-70ed-4d26-986c-520264a57588 req-72621960-9ccf-46be-8e74-fc8d2e2bdc8d service nova] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Received event network-vif-unplugged-fb33b08e-aef7-4999-9121-3caf5d027586 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:14:52 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-29193e46-70ed-4d26-986c-520264a57588 req-72621960-9ccf-46be-8e74-fc8d2e2bdc8d service nova] Acquiring lock "43eae335-a4a0-40b2-8cd4-c7881cd397b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:14:52 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-29193e46-70ed-4d26-986c-520264a57588 req-72621960-9ccf-46be-8e74-fc8d2e2bdc8d service nova] Lock "43eae335-a4a0-40b2-8cd4-c7881cd397b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:14:52 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-29193e46-70ed-4d26-986c-520264a57588 req-72621960-9ccf-46be-8e74-fc8d2e2bdc8d service nova] Lock "43eae335-a4a0-40b2-8cd4-c7881cd397b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:14:52 user nova-compute[74840]: DEBUG nova.compute.manager [req-29193e46-70ed-4d26-986c-520264a57588 req-72621960-9ccf-46be-8e74-fc8d2e2bdc8d service nova] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] No waiting events found dispatching network-vif-unplugged-fb33b08e-aef7-4999-9121-3caf5d027586 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:14:52 user nova-compute[74840]: DEBUG nova.compute.manager [req-29193e46-70ed-4d26-986c-520264a57588 req-72621960-9ccf-46be-8e74-fc8d2e2bdc8d service nova] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Received event network-vif-unplugged-fb33b08e-aef7-4999-9121-3caf5d027586 for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:14:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2a38d-14cf-4199-bb04-179ab4605a9e/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2a38d-14cf-4199-bb04-179ab4605a9e/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:52 user nova-compute[74840]: INFO nova.compute.manager [None req-bf6606da-75ab-4801-bdb8-283aada30429 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 08 12:14:52 user nova-compute[74840]: DEBUG oslo.service.loopingcall [None req-bf6606da-75ab-4801-bdb8-283aada30429 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74840) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 12:14:52 user nova-compute[74840]: DEBUG nova.compute.manager [-] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Deallocating network for instance {{(pid=74840) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 12:14:52 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] deallocate_for_instance() {{(pid=74840) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 12:14:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f2a38d-14cf-4199-bb04-179ab4605a9e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:52 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:14:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/684b8be2-7f8f-499f-8885-c9d1c86eef2f/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/684b8be2-7f8f-499f-8885-c9d1c86eef2f/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/684b8be2-7f8f-499f-8885-c9d1c86eef2f/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/684b8be2-7f8f-499f-8885-c9d1c86eef2f/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:54 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:14:54 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:14:54 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=8012MB free_disk=25.391902923583984GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:14:54 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:14:54 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:14:54 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Applying migration context for instance 3b10fda0-9488-4089-8033-dd1c8e42af89 as it has an incoming, in-progress migration 71afe97b-bd77-44bf-a107-3616642fe417. Migration status is finished {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 08 12:14:54 user nova-compute[74840]: INFO nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Updating resource usage from migration 71afe97b-bd77-44bf-a107-3616642fe417
Nov 08 12:14:54 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 43eae335-a4a0-40b2-8cd4-c7881cd397b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:14:54 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 684b8be2-7f8f-499f-8885-c9d1c86eef2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:14:54 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 58f2a38d-14cf-4199-bb04-179ab4605a9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:14:54 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance d2dbd607-cf11-4d81-9639-c84e79d65fcd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:14:54 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 28ccd7b3-8bbe-42e7-aa00-612b3703ae79 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:14:54 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance a0b7a0e1-d0d1-4682-9218-ef44d1e461f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:14:54 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Migration 71afe97b-bd77-44bf-a107-3616642fe417 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 08 12:14:54 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 3b10fda0-9488-4089-8033-dd1c8e42af89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:14:54 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:14:54 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=25GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:14:54 user nova-compute[74840]: DEBUG nova.compute.manager [req-d91485bb-cd7d-43d1-b14e-be7c223161e8 req-d62db567-86a1-4438-bf4e-c4e4e2d5405d service nova] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Received event network-vif-plugged-fb33b08e-aef7-4999-9121-3caf5d027586 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:14:54 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-d91485bb-cd7d-43d1-b14e-be7c223161e8 req-d62db567-86a1-4438-bf4e-c4e4e2d5405d service nova] Acquiring lock "43eae335-a4a0-40b2-8cd4-c7881cd397b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:14:54 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-d91485bb-cd7d-43d1-b14e-be7c223161e8 req-d62db567-86a1-4438-bf4e-c4e4e2d5405d service nova] Lock "43eae335-a4a0-40b2-8cd4-c7881cd397b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:14:54 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-d91485bb-cd7d-43d1-b14e-be7c223161e8 req-d62db567-86a1-4438-bf4e-c4e4e2d5405d service nova] Lock "43eae335-a4a0-40b2-8cd4-c7881cd397b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:14:54 user nova-compute[74840]: DEBUG nova.compute.manager [req-d91485bb-cd7d-43d1-b14e-be7c223161e8 req-d62db567-86a1-4438-bf4e-c4e4e2d5405d service nova] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] No waiting events found dispatching network-vif-plugged-fb33b08e-aef7-4999-9121-3caf5d027586 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:14:54 user nova-compute[74840]: WARNING nova.compute.manager [req-d91485bb-cd7d-43d1-b14e-be7c223161e8 req-d62db567-86a1-4438-bf4e-c4e4e2d5405d service nova] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Received unexpected event network-vif-plugged-fb33b08e-aef7-4999-9121-3caf5d027586 for instance with vm_state active and task_state deleting.
Nov 08 12:14:54 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:14:54 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:14:54 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:14:54 user nova-compute[74840]: INFO nova.compute.manager [-] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Took 2.19 seconds to deallocate network for instance.
Nov 08 12:14:54 user nova-compute[74840]: DEBUG nova.compute.manager [req-4cedc455-89e4-436d-9301-4bd48fdbb92e req-cb9a2f08-7d24-43cf-9bd3-3f5dcd992c43 service nova] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Received event network-vif-deleted-fb33b08e-aef7-4999-9121-3caf5d027586 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:14:54 user nova-compute[74840]: INFO nova.compute.manager [req-4cedc455-89e4-436d-9301-4bd48fdbb92e req-cb9a2f08-7d24-43cf-9bd3-3f5dcd992c43 service nova] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Neutron deleted interface fb33b08e-aef7-4999-9121-3caf5d027586; detaching it from the instance and deleting it from the info cache
Nov 08 12:14:54 user nova-compute[74840]: DEBUG nova.network.neutron [req-4cedc455-89e4-436d-9301-4bd48fdbb92e req-cb9a2f08-7d24-43cf-9bd3-3f5dcd992c43 service nova] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:14:54 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:14:54 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.631s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:14:54 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:14:54 user nova-compute[74840]: DEBUG nova.compute.manager [req-4cedc455-89e4-436d-9301-4bd48fdbb92e req-cb9a2f08-7d24-43cf-9bd3-3f5dcd992c43 service nova] [instance: 43eae335-a4a0-40b2-8cd4-c7881cd397b1] Detach interface failed, port_id=fb33b08e-aef7-4999-9121-3caf5d027586, reason: Instance 43eae335-a4a0-40b2-8cd4-c7881cd397b1 could not be found. {{(pid=74840) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 12:14:54 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:14:54 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:14:54 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:14:54 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Cleaning up deleted instances {{(pid=74840) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 12:14:54 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] There are 0 instances to clean {{(pid=74840) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 12:14:54 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bf6606da-75ab-4801-bdb8-283aada30429 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:14:54 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bf6606da-75ab-4801-bdb8-283aada30429 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:14:55 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bf6606da-75ab-4801-bdb8-283aada30429 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:14:55 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bf6606da-75ab-4801-bdb8-283aada30429 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:14:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bf6606da-75ab-4801-bdb8-283aada30429 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.432s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:14:55 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-bf6606da-75ab-4801-bdb8-283aada30429 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Deleted allocations for instance 43eae335-a4a0-40b2-8cd4-c7881cd397b1
Nov 08 12:14:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bf6606da-75ab-4801-bdb8-283aada30429 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "43eae335-a4a0-40b2-8cd4-c7881cd397b1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.089s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:14:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:14:59 user nova-compute[74840]: DEBUG nova.compute.manager [req-63b5a08a-c2fd-41c6-92cf-c75e79699303 req-93f2d4f3-33b5-45c8-bf0d-bab2db9109b7 service nova] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Received event volume-reimaged-2a571b42-9e1d-4406-b369-12722b22f097 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:14:59 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-63b5a08a-c2fd-41c6-92cf-c75e79699303 req-93f2d4f3-33b5-45c8-bf0d-bab2db9109b7 service nova] Acquiring lock "28ccd7b3-8bbe-42e7-aa00-612b3703ae79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:14:59 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-63b5a08a-c2fd-41c6-92cf-c75e79699303 req-93f2d4f3-33b5-45c8-bf0d-bab2db9109b7 service nova] Lock "28ccd7b3-8bbe-42e7-aa00-612b3703ae79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:14:59 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-63b5a08a-c2fd-41c6-92cf-c75e79699303 req-93f2d4f3-33b5-45c8-bf0d-bab2db9109b7 service nova] Lock "28ccd7b3-8bbe-42e7-aa00-612b3703ae79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:14:59 user nova-compute[74840]: DEBUG nova.compute.manager [req-63b5a08a-c2fd-41c6-92cf-c75e79699303 req-93f2d4f3-33b5-45c8-bf0d-bab2db9109b7 service nova] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Processing event volume-reimaged-2a571b42-9e1d-4406-b369-12722b22f097 {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 08 12:14:59 user nova-compute[74840]: DEBUG nova.compute.manager [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Instance event wait completed in 51 seconds for volume-reimaged {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:14:59 user nova-compute[74840]: INFO nova.virt.block_device [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Booting with volume 2a571b42-9e1d-4406-b369-12722b22f097 at /dev/vda
Nov 08 12:14:59 user nova-compute[74840]: DEBUG os_brick.utils [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:14:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:59 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa30a8ba-1837-4ec1-a208-dfe53fa4fb4b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c8228a11e03c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:59 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6439d5b-1164-4ba4-8179-f198ea875fd7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:14:59 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[04407152-0b87-4e86-831f-32f4a927aacc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:59 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[2102562d-828c-4c2d-a0d5-080cc69fa1b6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Running cmd (subprocess): nvme version {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] 'nvme version' failed. Not Retrying. {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:14:59 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.nvmeof [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] nvme not present on system {{(pid=74840) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 12:14:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:14:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:14:59 user nova-compute[74840]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 12:14:59 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c64890-c33c-4002-a6e8-e2856b946486]: (4, '') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:14:59 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74840) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 12:14:59 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 12:14:59 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] LIGHTOS: no hostnqn found. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 12:14:59 user nova-compute[74840]: DEBUG os_brick.utils [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c8228a11e03c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:14:59 user nova-compute[74840]: DEBUG nova.virt.block_device [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Updating existing volume attachment record: 148accf2-e32d-48ea-b4fb-d18ff481b5e4 {{(pid=74840) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 12:15:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-7f351076-21b3-4659-8152-200226e6c8f0 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Acquiring lock "58f2a38d-14cf-4199-bb04-179ab4605a9e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:15:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-7f351076-21b3-4659-8152-200226e6c8f0 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Lock "58f2a38d-14cf-4199-bb04-179ab4605a9e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:15:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-7f351076-21b3-4659-8152-200226e6c8f0 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Acquiring lock "58f2a38d-14cf-4199-bb04-179ab4605a9e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:15:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-7f351076-21b3-4659-8152-200226e6c8f0 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Lock "58f2a38d-14cf-4199-bb04-179ab4605a9e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:15:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-7f351076-21b3-4659-8152-200226e6c8f0 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Lock "58f2a38d-14cf-4199-bb04-179ab4605a9e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:15:00 user nova-compute[74840]: INFO nova.compute.manager [None req-7f351076-21b3-4659-8152-200226e6c8f0 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Terminating instance
Nov 08 12:15:00 user nova-compute[74840]: DEBUG nova.compute.manager [None req-7f351076-21b3-4659-8152-200226e6c8f0 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Start destroying the instance on the hypervisor. {{(pid=74840) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 12:15:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:01 user nova-compute[74840]: DEBUG nova.compute.manager [req-82f6179f-242c-492e-9979-b612276891d7 req-9ea4c1e9-346a-42d0-9e82-21ec24f0c01e service nova] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Received event network-vif-unplugged-62ca1e88-0819-443c-890f-05f6538b8f3e {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:15:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-82f6179f-242c-492e-9979-b612276891d7 req-9ea4c1e9-346a-42d0-9e82-21ec24f0c01e service nova] Acquiring lock "58f2a38d-14cf-4199-bb04-179ab4605a9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:15:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-82f6179f-242c-492e-9979-b612276891d7 req-9ea4c1e9-346a-42d0-9e82-21ec24f0c01e service nova] Lock "58f2a38d-14cf-4199-bb04-179ab4605a9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:15:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-82f6179f-242c-492e-9979-b612276891d7 req-9ea4c1e9-346a-42d0-9e82-21ec24f0c01e service nova] Lock "58f2a38d-14cf-4199-bb04-179ab4605a9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:15:01 user nova-compute[74840]: DEBUG nova.compute.manager [req-82f6179f-242c-492e-9979-b612276891d7 req-9ea4c1e9-346a-42d0-9e82-21ec24f0c01e service nova] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] No waiting events found dispatching network-vif-unplugged-62ca1e88-0819-443c-890f-05f6538b8f3e {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:15:01 user nova-compute[74840]: DEBUG nova.compute.manager [req-82f6179f-242c-492e-9979-b612276891d7 req-9ea4c1e9-346a-42d0-9e82-21ec24f0c01e service nova] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Received event network-vif-unplugged-62ca1e88-0819-443c-890f-05f6538b8f3e for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:15:01 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Instance destroyed successfully.
Nov 08 12:15:01 user nova-compute[74840]: DEBUG nova.objects.instance [None req-7f351076-21b3-4659-8152-200226e6c8f0 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Lazy-loading 'resources' on Instance uuid 58f2a38d-14cf-4199-bb04-179ab4605a9e {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:15:01 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-7f351076-21b3-4659-8152-200226e6c8f0 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:09:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1629452286',display_name='tempest-TestVolumeSwap-server-1629452286',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1629452286',id=6,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6exY8SfNI/CUUXXb92KxNWgYjX2NcNT6pHGUBlYjoEhsM9TUD+mJVBMTG/PBbjkv5xvH+P17cCXsP2gTNLFxi0sZC7+DwCBmePqadVL6pp0w09KHcOTjTo/BlUCjybAg==',key_name='tempest-keypair-600142584',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:09:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e0b4cf1a052c48c2a33f1f645c2b52a8',ramdisk_id='',reservation_id='r-bqu4wzxd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-2072360936',owner_user_name='tempest-TestVolumeSwap-2072360936-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:09:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d0c7a84ad7c46969004b4040c5cb3d7',uuid=58f2a38d-14cf-4199-bb04-179ab4605a9e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62ca1e88-0819-443c-890f-05f6538b8f3e", "address": "fa:16:3e:3b:d1:37", "network": {"id": "6462e35c-7722-46f1-afee-a088965b85e8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-713817565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b4cf1a052c48c2a33f1f645c2b52a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62ca1e88-08", "ovs_interfaceid": "62ca1e88-0819-443c-890f-05f6538b8f3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:15:01 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-7f351076-21b3-4659-8152-200226e6c8f0 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Converting VIF {"id": "62ca1e88-0819-443c-890f-05f6538b8f3e", "address": "fa:16:3e:3b:d1:37", "network": {"id": "6462e35c-7722-46f1-afee-a088965b85e8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-713817565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0b4cf1a052c48c2a33f1f645c2b52a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62ca1e88-08", "ovs_interfaceid": "62ca1e88-0819-443c-890f-05f6538b8f3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:15:01 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-7f351076-21b3-4659-8152-200226e6c8f0 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:d1:37,bridge_name='br-int',has_traffic_filtering=True,id=62ca1e88-0819-443c-890f-05f6538b8f3e,network=Network(6462e35c-7722-46f1-afee-a088965b85e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62ca1e88-08') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:15:01 user nova-compute[74840]: DEBUG os_vif [None req-7f351076-21b3-4659-8152-200226e6c8f0 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:d1:37,bridge_name='br-int',has_traffic_filtering=True,id=62ca1e88-0819-443c-890f-05f6538b8f3e,network=Network(6462e35c-7722-46f1-afee-a088965b85e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62ca1e88-08') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:15:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap62ca1e88-08, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:15:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:15:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c7ea2dc0-60ba-40ed-b7d2-d2f95ced3c87) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:15:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:15:01 user nova-compute[74840]: INFO os_vif [None req-7f351076-21b3-4659-8152-200226e6c8f0 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:d1:37,bridge_name='br-int',has_traffic_filtering=True,id=62ca1e88-0819-443c-890f-05f6538b8f3e,network=Network(6462e35c-7722-46f1-afee-a088965b85e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62ca1e88-08')
Nov 08 12:15:01 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-7f351076-21b3-4659-8152-200226e6c8f0 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Deleting instance files /opt/stack/data/nova/instances/58f2a38d-14cf-4199-bb04-179ab4605a9e_del
Nov 08 12:15:01 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-7f351076-21b3-4659-8152-200226e6c8f0 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Deletion of /opt/stack/data/nova/instances/58f2a38d-14cf-4199-bb04-179ab4605a9e_del complete
Nov 08 12:15:01 user nova-compute[74840]: INFO nova.compute.manager [None req-7f351076-21b3-4659-8152-200226e6c8f0 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 08 12:15:01 user nova-compute[74840]: DEBUG oslo.service.loopingcall [None req-7f351076-21b3-4659-8152-200226e6c8f0 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74840) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 12:15:01 user nova-compute[74840]: DEBUG nova.compute.manager [-] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Deallocating network for instance {{(pid=74840) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 12:15:01 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] deallocate_for_instance() {{(pid=74840) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 12:15:02 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Acquiring lock "eea27317-7454-4b5c-8d01-7976255a31bd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:15:02 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Lock "eea27317-7454-4b5c-8d01-7976255a31bd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:15:02 user nova-compute[74840]: DEBUG nova.compute.manager [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Starting instance... {{(pid=74840) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 12:15:02 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:15:02 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:15:02 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:15:02 user nova-compute[74840]: INFO nova.compute.claims [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Claim successful on node user
Nov 08 12:15:02 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Refreshing inventories for resource provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 12:15:02 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Updating ProviderTree inventory for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 12:15:02 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Updating inventory in ProviderTree for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 12:15:02 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:15:02 user nova-compute[74840]: INFO nova.compute.manager [-] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Took 1.13 seconds to deallocate network for instance.
Nov 08 12:15:02 user nova-compute[74840]: DEBUG nova.compute.manager [req-65362dcb-22be-4d88-aa93-a03e769b2afd req-f226d8f6-ee35-4fd5-8206-a12ae42f39ef service nova] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Received event network-vif-deleted-62ca1e88-0819-443c-890f-05f6538b8f3e {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:15:02 user nova-compute[74840]: INFO nova.compute.manager [req-65362dcb-22be-4d88-aa93-a03e769b2afd req-f226d8f6-ee35-4fd5-8206-a12ae42f39ef service nova] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Neutron deleted interface 62ca1e88-0819-443c-890f-05f6538b8f3e; detaching it from the instance and deleting it from the info cache
Nov 08 12:15:02 user nova-compute[74840]: DEBUG nova.network.neutron [req-65362dcb-22be-4d88-aa93-a03e769b2afd req-f226d8f6-ee35-4fd5-8206-a12ae42f39ef service nova] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:15:02 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Refreshing aggregate associations for resource provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e, aggregates: None {{(pid=74840) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 12:15:03 user nova-compute[74840]: DEBUG nova.compute.manager [req-65362dcb-22be-4d88-aa93-a03e769b2afd req-f226d8f6-ee35-4fd5-8206-a12ae42f39ef service nova] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Detach interface failed, port_id=62ca1e88-0819-443c-890f-05f6538b8f3e, reason: Instance 58f2a38d-14cf-4199-bb04-179ab4605a9e could not be found. {{(pid=74840) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 12:15:03 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Refreshing trait associations for resource provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=74840) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 12:15:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-7f351076-21b3-4659-8152-200226e6c8f0 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:15:03 user nova-compute[74840]: DEBUG nova.compute.manager [req-ccc4a62c-01d0-41be-8694-7d8cf03eac11 req-6d501ce3-bce2-4522-8be6-ae2ecd31845a service nova] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Received event network-vif-plugged-62ca1e88-0819-443c-890f-05f6538b8f3e {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:15:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-ccc4a62c-01d0-41be-8694-7d8cf03eac11 req-6d501ce3-bce2-4522-8be6-ae2ecd31845a service nova] Acquiring lock "58f2a38d-14cf-4199-bb04-179ab4605a9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:15:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-ccc4a62c-01d0-41be-8694-7d8cf03eac11 req-6d501ce3-bce2-4522-8be6-ae2ecd31845a service nova] Lock "58f2a38d-14cf-4199-bb04-179ab4605a9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:15:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-ccc4a62c-01d0-41be-8694-7d8cf03eac11 req-6d501ce3-bce2-4522-8be6-ae2ecd31845a service nova] Lock "58f2a38d-14cf-4199-bb04-179ab4605a9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:15:03 user nova-compute[74840]: DEBUG nova.compute.manager [req-ccc4a62c-01d0-41be-8694-7d8cf03eac11 req-6d501ce3-bce2-4522-8be6-ae2ecd31845a service nova] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] No waiting events found dispatching network-vif-plugged-62ca1e88-0819-443c-890f-05f6538b8f3e {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:15:03 user nova-compute[74840]: WARNING nova.compute.manager [req-ccc4a62c-01d0-41be-8694-7d8cf03eac11 req-6d501ce3-bce2-4522-8be6-ae2ecd31845a service nova] [instance: 58f2a38d-14cf-4199-bb04-179ab4605a9e] Received unexpected event network-vif-plugged-62ca1e88-0819-443c-890f-05f6538b8f3e for instance with vm_state deleted and task_state None.
Nov 08 12:15:03 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:15:03 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:15:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.692s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:15:03 user nova-compute[74840]: DEBUG nova.compute.manager [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Start building networks asynchronously for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 12:15:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-7f351076-21b3-4659-8152-200226e6c8f0 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.328s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:15:03 user nova-compute[74840]: DEBUG nova.compute.manager [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Allocating IP information in the background. {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 12:15:03 user nova-compute[74840]: DEBUG nova.network.neutron [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 12:15:03 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 12:15:03 user nova-compute[74840]: DEBUG nova.compute.manager [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Start building block device mappings for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 12:15:03 user nova-compute[74840]: DEBUG nova.policy [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '016aab95b2394f5f89283d1e62c5fd8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd51d983b3aa441dabb1543296f0bb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 12:15:03 user nova-compute[74840]: DEBUG nova.compute.manager [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Start spawning the instance on the hypervisor. {{(pid=74840) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 12:15:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:15:03 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Creating image(s)
Nov 08 12:15:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Acquiring lock "/opt/stack/data/nova/instances/eea27317-7454-4b5c-8d01-7976255a31bd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:15:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Lock "/opt/stack/data/nova/instances/eea27317-7454-4b5c-8d01-7976255a31bd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:15:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Lock "/opt/stack/data/nova/instances/eea27317-7454-4b5c-8d01-7976255a31bd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:15:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:03 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-7f351076-21b3-4659-8152-200226e6c8f0 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:15:03 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-7f351076-21b3-4659-8152-200226e6c8f0 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:15:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.235s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Acquiring lock "5d26578eba85497f494c575690c4248f381a0fe6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:15:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:15:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:04 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-7f351076-21b3-4659-8152-200226e6c8f0 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.653s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:15:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.173s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/eea27317-7454-4b5c-8d01-7976255a31bd/disk 1073741824 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/eea27317-7454-4b5c-8d01-7976255a31bd/disk 1073741824" returned: 0 in 0.071s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:04 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:15:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:04 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-7f351076-21b3-4659-8152-200226e6c8f0 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Deleted allocations for instance 58f2a38d-14cf-4199-bb04-179ab4605a9e
Nov 08 12:15:04 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-7f351076-21b3-4659-8152-200226e6c8f0 tempest-TestVolumeSwap-2072360936 tempest-TestVolumeSwap-2072360936-project-member] Lock "58f2a38d-14cf-4199-bb04-179ab4605a9e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.566s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:15:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.222s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:04 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eea27317-7454-4b5c-8d01-7976255a31bd/disk. size=1073741824 {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 12:15:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eea27317-7454-4b5c-8d01-7976255a31bd/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eea27317-7454-4b5c-8d01-7976255a31bd/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:04 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Cannot resize image /opt/stack/data/nova/instances/eea27317-7454-4b5c-8d01-7976255a31bd/disk to a smaller size. {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 12:15:04 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Created local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 12:15:04 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Ensure instance console log exists: /opt/stack/data/nova/instances/eea27317-7454-4b5c-8d01-7976255a31bd/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:15:04 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:15:04 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:15:04 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:15:04 user nova-compute[74840]: DEBUG nova.network.neutron [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Successfully created port: b714ef0b-8de1-45d6-ad22-922a3b727e0c {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:15:04 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:15:04 user nova-compute[74840]: WARNING nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] While synchronizing instance power states, found 6 instances in the database and 3 instances on the hypervisor.
Nov 08 12:15:04 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Triggering sync for uuid 3b10fda0-9488-4089-8033-dd1c8e42af89 {{(pid=74840) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 12:15:04 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Triggering sync for uuid 684b8be2-7f8f-499f-8885-c9d1c86eef2f {{(pid=74840) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 12:15:04 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Triggering sync for uuid d2dbd607-cf11-4d81-9639-c84e79d65fcd {{(pid=74840) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 12:15:04 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Triggering sync for uuid 28ccd7b3-8bbe-42e7-aa00-612b3703ae79 {{(pid=74840) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 12:15:04 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Triggering sync for uuid a0b7a0e1-d0d1-4682-9218-ef44d1e461f1 {{(pid=74840) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 12:15:04 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Triggering sync for uuid eea27317-7454-4b5c-8d01-7976255a31bd {{(pid=74840) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 12:15:04 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "3b10fda0-9488-4089-8033-dd1c8e42af89" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:15:04 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "3b10fda0-9488-4089-8033-dd1c8e42af89" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:15:04 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "684b8be2-7f8f-499f-8885-c9d1c86eef2f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:15:04 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "684b8be2-7f8f-499f-8885-c9d1c86eef2f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:15:04 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:15:04 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "28ccd7b3-8bbe-42e7-aa00-612b3703ae79" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:15:04 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "28ccd7b3-8bbe-42e7-aa00-612b3703ae79" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:15:04 user nova-compute[74840]: INFO nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] During sync_power_state the instance has a pending task (rebuild_block_device_mapping). Skip.
Nov 08 12:15:04 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "28ccd7b3-8bbe-42e7-aa00-612b3703ae79" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:15:04 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "a0b7a0e1-d0d1-4682-9218-ef44d1e461f1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:15:04 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "a0b7a0e1-d0d1-4682-9218-ef44d1e461f1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:15:04 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "eea27317-7454-4b5c-8d01-7976255a31bd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:15:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "3b10fda0-9488-4089-8033-dd1c8e42af89" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:15:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "684b8be2-7f8f-499f-8885-c9d1c86eef2f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:15:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "a0b7a0e1-d0d1-4682-9218-ef44d1e461f1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:15:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:05 user nova-compute[74840]: DEBUG nova.network.neutron [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Successfully updated port: b714ef0b-8de1-45d6-ad22-922a3b727e0c {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:15:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Acquiring lock "refresh_cache-eea27317-7454-4b5c-8d01-7976255a31bd" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:15:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Acquired lock "refresh_cache-eea27317-7454-4b5c-8d01-7976255a31bd" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:15:05 user nova-compute[74840]: DEBUG nova.network.neutron [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:15:05 user nova-compute[74840]: DEBUG nova.compute.manager [req-d0909a68-59cc-4d30-b660-6c4711c52b9c req-f30ce4ee-6e43-4d22-b95f-53c660623283 service nova] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Received event network-changed-b714ef0b-8de1-45d6-ad22-922a3b727e0c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:15:05 user nova-compute[74840]: DEBUG nova.compute.manager [req-d0909a68-59cc-4d30-b660-6c4711c52b9c req-f30ce4ee-6e43-4d22-b95f-53c660623283 service nova] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Refreshing instance network info cache due to event network-changed-b714ef0b-8de1-45d6-ad22-922a3b727e0c. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:15:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-d0909a68-59cc-4d30-b660-6c4711c52b9c req-f30ce4ee-6e43-4d22-b95f-53c660623283 service nova] Acquiring lock "refresh_cache-eea27317-7454-4b5c-8d01-7976255a31bd" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:15:06 user nova-compute[74840]: DEBUG nova.network.neutron [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:15:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:06 user nova-compute[74840]: DEBUG nova.network.neutron [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Updating instance_info_cache with network_info: [{"id": "b714ef0b-8de1-45d6-ad22-922a3b727e0c", "address": "fa:16:3e:db:66:9d", "network": {"id": "bfa1d7ef-3436-4676-a399-ead8194a958a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-3950314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd51d983b3aa441dabb1543296f0bb70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb714ef0b-8d", "ovs_interfaceid": "b714ef0b-8de1-45d6-ad22-922a3b727e0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:15:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Releasing lock "refresh_cache-eea27317-7454-4b5c-8d01-7976255a31bd" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:15:06 user nova-compute[74840]: DEBUG nova.compute.manager [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Instance network_info: |[{"id": "b714ef0b-8de1-45d6-ad22-922a3b727e0c", "address": "fa:16:3e:db:66:9d", "network": {"id": "bfa1d7ef-3436-4676-a399-ead8194a958a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-3950314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd51d983b3aa441dabb1543296f0bb70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb714ef0b-8d", "ovs_interfaceid": "b714ef0b-8de1-45d6-ad22-922a3b727e0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 12:15:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-d0909a68-59cc-4d30-b660-6c4711c52b9c req-f30ce4ee-6e43-4d22-b95f-53c660623283 service nova] Acquired lock "refresh_cache-eea27317-7454-4b5c-8d01-7976255a31bd" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:15:06 user nova-compute[74840]: DEBUG nova.network.neutron [req-d0909a68-59cc-4d30-b660-6c4711c52b9c req-f30ce4ee-6e43-4d22-b95f-53c660623283 service nova] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Refreshing network info cache for port b714ef0b-8de1-45d6-ad22-922a3b727e0c {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:15:06 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Start _get_guest_xml network_info=[{"id": "b714ef0b-8de1-45d6-ad22-922a3b727e0c", "address": "fa:16:3e:db:66:9d", "network": {"id": "bfa1d7ef-3436-4676-a399-ead8194a958a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-3950314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd51d983b3aa441dabb1543296f0bb70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb714ef0b-8d", "ovs_interfaceid": "b714ef0b-8de1-45d6-ad22-922a3b727e0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'image_id': '4fa17706-d304-4117-a420-dab994c703dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:15:06 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:15:06 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:15:06 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:15:06 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:15:06 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:15:06 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:15:06 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:15:06 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:15:06 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:15:06 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:15:06 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:15:06 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:15:06 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:15:06 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:15:06 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:15:06 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:15:06 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:15:06 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:15:06 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:15:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1592917518',display_name='tempest-VolumesAdminNegativeTest-server-1592917518',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1592917518',id=13,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd51d983b3aa441dabb1543296f0bb70',ramdisk_id='',reservation_id='r-sxahnvr0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1071383436',owner_user_name='tempest-VolumesAdminNegativeTest-1071383436-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:15:04Z,user_data=None,user_id='016aab95b2394f5f89283d1e62c5fd8d',uuid=eea27317-7454-4b5c-8d01-7976255a31bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b714ef0b-8de1-45d6-ad22-922a3b727e0c", "address": "fa:16:3e:db:66:9d", "network": {"id": "bfa1d7ef-3436-4676-a399-ead8194a958a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-3950314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd51d983b3aa441dabb1543296f0bb70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb714ef0b-8d", "ovs_interfaceid": "b714ef0b-8de1-45d6-ad22-922a3b727e0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:15:06 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Converting VIF {"id": "b714ef0b-8de1-45d6-ad22-922a3b727e0c", "address": "fa:16:3e:db:66:9d", "network": {"id": "bfa1d7ef-3436-4676-a399-ead8194a958a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-3950314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd51d983b3aa441dabb1543296f0bb70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb714ef0b-8d", "ovs_interfaceid": "b714ef0b-8de1-45d6-ad22-922a3b727e0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:15:06 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:66:9d,bridge_name='br-int',has_traffic_filtering=True,id=b714ef0b-8de1-45d6-ad22-922a3b727e0c,network=Network(bfa1d7ef-3436-4676-a399-ead8194a958a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb714ef0b-8d') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:15:06 user nova-compute[74840]: DEBUG nova.objects.instance [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Lazy-loading 'pci_devices' on Instance uuid eea27317-7454-4b5c-8d01-7976255a31bd {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:15:06 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:15:06 user nova-compute[74840]:   <uuid>eea27317-7454-4b5c-8d01-7976255a31bd</uuid>
Nov 08 12:15:06 user nova-compute[74840]:   <name>instance-0000000d</name>
Nov 08 12:15:06 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:15:06 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:15:06 user nova-compute[74840]:   <metadata>
Nov 08 12:15:06 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:15:06 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:15:06 user nova-compute[74840]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1592917518</nova:name>
Nov 08 12:15:06 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:15:06</nova:creationTime>
Nov 08 12:15:06 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:15:06 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:15:06 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:15:06 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:15:06 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:15:06 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:15:06 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:15:06 user nova-compute[74840]:       <nova:owner>
Nov 08 12:15:06 user nova-compute[74840]:         <nova:user uuid="016aab95b2394f5f89283d1e62c5fd8d">tempest-VolumesAdminNegativeTest-1071383436-project-member</nova:user>
Nov 08 12:15:06 user nova-compute[74840]:         <nova:project uuid="bd51d983b3aa441dabb1543296f0bb70">tempest-VolumesAdminNegativeTest-1071383436</nova:project>
Nov 08 12:15:06 user nova-compute[74840]:       </nova:owner>
Nov 08 12:15:06 user nova-compute[74840]:       <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:15:06 user nova-compute[74840]:       <nova:ports>
Nov 08 12:15:06 user nova-compute[74840]:         <nova:port uuid="b714ef0b-8de1-45d6-ad22-922a3b727e0c">
Nov 08 12:15:06 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 12:15:06 user nova-compute[74840]:         </nova:port>
Nov 08 12:15:06 user nova-compute[74840]:       </nova:ports>
Nov 08 12:15:06 user nova-compute[74840]:     </nova:instance>
Nov 08 12:15:06 user nova-compute[74840]:   </metadata>
Nov 08 12:15:06 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:15:06 user nova-compute[74840]:     <system>
Nov 08 12:15:06 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:15:06 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:15:06 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:15:06 user nova-compute[74840]:       <entry name="serial">eea27317-7454-4b5c-8d01-7976255a31bd</entry>
Nov 08 12:15:06 user nova-compute[74840]:       <entry name="uuid">eea27317-7454-4b5c-8d01-7976255a31bd</entry>
Nov 08 12:15:06 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:15:06 user nova-compute[74840]:     </system>
Nov 08 12:15:06 user nova-compute[74840]:   </sysinfo>
Nov 08 12:15:06 user nova-compute[74840]:   <os>
Nov 08 12:15:06 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:15:06 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:15:06 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:15:06 user nova-compute[74840]:   </os>
Nov 08 12:15:06 user nova-compute[74840]:   <features>
Nov 08 12:15:06 user nova-compute[74840]:     <acpi/>
Nov 08 12:15:06 user nova-compute[74840]:     <apic/>
Nov 08 12:15:06 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:15:06 user nova-compute[74840]:   </features>
Nov 08 12:15:06 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:15:06 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:15:06 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:15:06 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:15:06 user nova-compute[74840]:   </clock>
Nov 08 12:15:06 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:15:06 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:15:06 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:15:06 user nova-compute[74840]:   </cpu>
Nov 08 12:15:06 user nova-compute[74840]:   <devices>
Nov 08 12:15:06 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:15:06 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:15:06 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/eea27317-7454-4b5c-8d01-7976255a31bd/disk"/>
Nov 08 12:15:06 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:15:06 user nova-compute[74840]:     </disk>
Nov 08 12:15:06 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:15:06 user nova-compute[74840]:       <mac address="fa:16:3e:db:66:9d"/>
Nov 08 12:15:06 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:15:06 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:15:06 user nova-compute[74840]:       <target dev="tapb714ef0b-8d"/>
Nov 08 12:15:06 user nova-compute[74840]:     </interface>
Nov 08 12:15:06 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:15:06 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/eea27317-7454-4b5c-8d01-7976255a31bd/console.log" append="off"/>
Nov 08 12:15:06 user nova-compute[74840]:     </serial>
Nov 08 12:15:06 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:15:06 user nova-compute[74840]:     <video>
Nov 08 12:15:06 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:15:06 user nova-compute[74840]:     </video>
Nov 08 12:15:06 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:15:06 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:15:06 user nova-compute[74840]:     </rng>
Nov 08 12:15:06 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:15:06 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:15:06 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:15:06 user nova-compute[74840]:     </memballoon>
Nov 08 12:15:06 user nova-compute[74840]:   </devices>
Nov 08 12:15:06 user nova-compute[74840]: </domain>
Nov 08 12:15:06 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:15:06 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:15:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1592917518',display_name='tempest-VolumesAdminNegativeTest-server-1592917518',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1592917518',id=13,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd51d983b3aa441dabb1543296f0bb70',ramdisk_id='',reservation_id='r-sxahnvr0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1071383436',owner_user_name='tempest-VolumesAdminNegativeTest-1071383436-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:15:04Z,user_data=None,user_id='016aab95b2394f5f89283d1e62c5fd8d',uuid=eea27317-7454-4b5c-8d01-7976255a31bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b714ef0b-8de1-45d6-ad22-922a3b727e0c", "address": "fa:16:3e:db:66:9d", "network": {"id": "bfa1d7ef-3436-4676-a399-ead8194a958a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-3950314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd51d983b3aa441dabb1543296f0bb70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb714ef0b-8d", "ovs_interfaceid": "b714ef0b-8de1-45d6-ad22-922a3b727e0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:15:06 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Converting VIF {"id": "b714ef0b-8de1-45d6-ad22-922a3b727e0c", "address": "fa:16:3e:db:66:9d", "network": {"id": "bfa1d7ef-3436-4676-a399-ead8194a958a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-3950314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd51d983b3aa441dabb1543296f0bb70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb714ef0b-8d", "ovs_interfaceid": "b714ef0b-8de1-45d6-ad22-922a3b727e0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:15:06 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:66:9d,bridge_name='br-int',has_traffic_filtering=True,id=b714ef0b-8de1-45d6-ad22-922a3b727e0c,network=Network(bfa1d7ef-3436-4676-a399-ead8194a958a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb714ef0b-8d') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:15:06 user nova-compute[74840]: DEBUG os_vif [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:66:9d,bridge_name='br-int',has_traffic_filtering=True,id=b714ef0b-8de1-45d6-ad22-922a3b727e0c,network=Network(bfa1d7ef-3436-4676-a399-ead8194a958a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb714ef0b-8d') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:15:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:15:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:15:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '716d3e9c-d489-596c-a170-04bca570e171', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:15:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:15:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb714ef0b-8d, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:15:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb714ef0b-8d, col_values=(('qos', UUID('d3c1e29c-00e4-4a4b-9776-8e1054a006d2')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:15:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb714ef0b-8d, col_values=(('external_ids', {'iface-id': 'b714ef0b-8de1-45d6-ad22-922a3b727e0c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:66:9d', 'vm-uuid': 'eea27317-7454-4b5c-8d01-7976255a31bd'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:15:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:15:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:06 user nova-compute[74840]: INFO os_vif [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:66:9d,bridge_name='br-int',has_traffic_filtering=True,id=b714ef0b-8de1-45d6-ad22-922a3b727e0c,network=Network(bfa1d7ef-3436-4676-a399-ead8194a958a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb714ef0b-8d')
Nov 08 12:15:06 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:15:06 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] No VIF found with MAC fa:16:3e:db:66:9d, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:15:06 user nova-compute[74840]: DEBUG nova.network.neutron [req-d0909a68-59cc-4d30-b660-6c4711c52b9c req-f30ce4ee-6e43-4d22-b95f-53c660623283 service nova] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Updated VIF entry in instance network info cache for port b714ef0b-8de1-45d6-ad22-922a3b727e0c. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:15:06 user nova-compute[74840]: DEBUG nova.network.neutron [req-d0909a68-59cc-4d30-b660-6c4711c52b9c req-f30ce4ee-6e43-4d22-b95f-53c660623283 service nova] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Updating instance_info_cache with network_info: [{"id": "b714ef0b-8de1-45d6-ad22-922a3b727e0c", "address": "fa:16:3e:db:66:9d", "network": {"id": "bfa1d7ef-3436-4676-a399-ead8194a958a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-3950314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd51d983b3aa441dabb1543296f0bb70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb714ef0b-8d", "ovs_interfaceid": "b714ef0b-8de1-45d6-ad22-922a3b727e0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:15:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-d0909a68-59cc-4d30-b660-6c4711c52b9c req-f30ce4ee-6e43-4d22-b95f-53c660623283 service nova] Releasing lock "refresh_cache-eea27317-7454-4b5c-8d01-7976255a31bd" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:15:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:08 user nova-compute[74840]: DEBUG nova.compute.manager [req-a81eae1e-2ad8-4af5-a92b-2c77ef2ad4e4 req-98e826d6-632f-4a5f-bf1a-581231ef42bb service nova] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Received event network-vif-plugged-b714ef0b-8de1-45d6-ad22-922a3b727e0c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:15:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a81eae1e-2ad8-4af5-a92b-2c77ef2ad4e4 req-98e826d6-632f-4a5f-bf1a-581231ef42bb service nova] Acquiring lock "eea27317-7454-4b5c-8d01-7976255a31bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:15:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a81eae1e-2ad8-4af5-a92b-2c77ef2ad4e4 req-98e826d6-632f-4a5f-bf1a-581231ef42bb service nova] Lock "eea27317-7454-4b5c-8d01-7976255a31bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:15:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a81eae1e-2ad8-4af5-a92b-2c77ef2ad4e4 req-98e826d6-632f-4a5f-bf1a-581231ef42bb service nova] Lock "eea27317-7454-4b5c-8d01-7976255a31bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:15:08 user nova-compute[74840]: DEBUG nova.compute.manager [req-a81eae1e-2ad8-4af5-a92b-2c77ef2ad4e4 req-98e826d6-632f-4a5f-bf1a-581231ef42bb service nova] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] No waiting events found dispatching network-vif-plugged-b714ef0b-8de1-45d6-ad22-922a3b727e0c {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:15:08 user nova-compute[74840]: WARNING nova.compute.manager [req-a81eae1e-2ad8-4af5-a92b-2c77ef2ad4e4 req-98e826d6-632f-4a5f-bf1a-581231ef42bb service nova] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Received unexpected event network-vif-plugged-b714ef0b-8de1-45d6-ad22-922a3b727e0c for instance with vm_state building and task_state spawning.
Nov 08 12:15:10 user nova-compute[74840]: DEBUG nova.compute.manager [req-97d7ea8d-cadf-4b8b-9264-674b460e6fcd req-8c8994af-3718-441a-9391-198d860abc4a service nova] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Received event network-vif-plugged-b714ef0b-8de1-45d6-ad22-922a3b727e0c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:15:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-97d7ea8d-cadf-4b8b-9264-674b460e6fcd req-8c8994af-3718-441a-9391-198d860abc4a service nova] Acquiring lock "eea27317-7454-4b5c-8d01-7976255a31bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:15:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-97d7ea8d-cadf-4b8b-9264-674b460e6fcd req-8c8994af-3718-441a-9391-198d860abc4a service nova] Lock "eea27317-7454-4b5c-8d01-7976255a31bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:15:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-97d7ea8d-cadf-4b8b-9264-674b460e6fcd req-8c8994af-3718-441a-9391-198d860abc4a service nova] Lock "eea27317-7454-4b5c-8d01-7976255a31bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:15:10 user nova-compute[74840]: DEBUG nova.compute.manager [req-97d7ea8d-cadf-4b8b-9264-674b460e6fcd req-8c8994af-3718-441a-9391-198d860abc4a service nova] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] No waiting events found dispatching network-vif-plugged-b714ef0b-8de1-45d6-ad22-922a3b727e0c {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:15:10 user nova-compute[74840]: WARNING nova.compute.manager [req-97d7ea8d-cadf-4b8b-9264-674b460e6fcd req-8c8994af-3718-441a-9391-198d860abc4a service nova] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Received unexpected event network-vif-plugged-b714ef0b-8de1-45d6-ad22-922a3b727e0c for instance with vm_state building and task_state spawning.
Nov 08 12:15:10 user nova-compute[74840]: DEBUG nova.compute.manager [req-97d7ea8d-cadf-4b8b-9264-674b460e6fcd req-8c8994af-3718-441a-9391-198d860abc4a service nova] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Received event network-changed-259ddaf9-a353-4528-a451-96ff20064ff1 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:15:10 user nova-compute[74840]: DEBUG nova.compute.manager [req-97d7ea8d-cadf-4b8b-9264-674b460e6fcd req-8c8994af-3718-441a-9391-198d860abc4a service nova] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Refreshing instance network info cache due to event network-changed-259ddaf9-a353-4528-a451-96ff20064ff1. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:15:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-97d7ea8d-cadf-4b8b-9264-674b460e6fcd req-8c8994af-3718-441a-9391-198d860abc4a service nova] Acquiring lock "refresh_cache-a0b7a0e1-d0d1-4682-9218-ef44d1e461f1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:15:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-97d7ea8d-cadf-4b8b-9264-674b460e6fcd req-8c8994af-3718-441a-9391-198d860abc4a service nova] Acquired lock "refresh_cache-a0b7a0e1-d0d1-4682-9218-ef44d1e461f1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:15:10 user nova-compute[74840]: DEBUG nova.network.neutron [req-97d7ea8d-cadf-4b8b-9264-674b460e6fcd req-8c8994af-3718-441a-9391-198d860abc4a service nova] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Refreshing network info cache for port 259ddaf9-a353-4528-a451-96ff20064ff1 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:15:10 user nova-compute[74840]: DEBUG nova.compute.manager [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:15:10 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:15:10 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Instance spawned successfully.
Nov 08 12:15:10 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:15:10 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Found default for hw_cdrom_bus of ide {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:15:10 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Found default for hw_disk_bus of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:15:10 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:15:10 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:15:10 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Found default for hw_video_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:15:10 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Found default for hw_vif_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:15:11 user nova-compute[74840]: DEBUG nova.network.neutron [req-97d7ea8d-cadf-4b8b-9264-674b460e6fcd req-8c8994af-3718-441a-9391-198d860abc4a service nova] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Updated VIF entry in instance network info cache for port 259ddaf9-a353-4528-a451-96ff20064ff1. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:15:11 user nova-compute[74840]: DEBUG nova.network.neutron [req-97d7ea8d-cadf-4b8b-9264-674b460e6fcd req-8c8994af-3718-441a-9391-198d860abc4a service nova] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Updating instance_info_cache with network_info: [{"id": "259ddaf9-a353-4528-a451-96ff20064ff1", "address": "fa:16:3e:8b:2d:b3", "network": {"id": "b976e3d8-8d34-4f01-942d-c751f6a68780", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-154778043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65971596fc0642f3912bad70dc3e4e07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259ddaf9-a3", "ovs_interfaceid": "259ddaf9-a353-4528-a451-96ff20064ff1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:15:11 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-97d7ea8d-cadf-4b8b-9264-674b460e6fcd req-8c8994af-3718-441a-9391-198d860abc4a service nova] Releasing lock "refresh_cache-a0b7a0e1-d0d1-4682-9218-ef44d1e461f1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:15:11 user nova-compute[74840]: INFO nova.compute.manager [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Took 7.44 seconds to spawn the instance on the hypervisor.
Nov 08 12:15:11 user nova-compute[74840]: DEBUG nova.compute.manager [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:15:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:11 user nova-compute[74840]: INFO nova.compute.manager [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Took 8.58 seconds to build instance.
Nov 08 12:15:11 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-32262c2a-05c4-49c7-85e9-524ccd79aafb tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Lock "eea27317-7454-4b5c-8d01-7976255a31bd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.685s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:15:11 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "eea27317-7454-4b5c-8d01-7976255a31bd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 6.273s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:15:11 user nova-compute[74840]: INFO nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] During sync_power_state the instance has a pending task (spawning). Skip.
Nov 08 12:15:11 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "eea27317-7454-4b5c-8d01-7976255a31bd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:15:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:14 user nova-compute[74840]: DEBUG nova.network.neutron [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Port b48b5298-045f-463d-9585-fbb5feb869bf binding to destination host user is already ACTIVE {{(pid=74840) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 08 12:15:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Acquiring lock "refresh_cache-3b10fda0-9488-4089-8033-dd1c8e42af89" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:15:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Acquired lock "refresh_cache-3b10fda0-9488-4089-8033-dd1c8e42af89" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:15:14 user nova-compute[74840]: DEBUG nova.network.neutron [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:15:15 user nova-compute[74840]: DEBUG nova.network.neutron [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Updating instance_info_cache with network_info: [{"id": "b48b5298-045f-463d-9585-fbb5feb869bf", "address": "fa:16:3e:19:58:1f", "network": {"id": "9dec89b0-562f-482c-aec1-d024351d0bd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-237264167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a544910dc2c4b169c986fa74b5979d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48b5298-04", "ovs_interfaceid": "b48b5298-045f-463d-9585-fbb5feb869bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:15:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Releasing lock "refresh_cache-3b10fda0-9488-4089-8033-dd1c8e42af89" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:15:15 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Creating tmpfile /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/tmpku3kkgt2 to verify with other compute node that the instance is on the same shared storage. {{(pid=74840) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 08 12:15:15 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:15 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:15 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:15 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:15 user nova-compute[74840]: DEBUG nova.compute.manager [req-f47c4324-ae5b-48d9-9fc4-16dfc05dea46 req-5b0e5054-c09c-4905-b297-6fb85d495291 service nova] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Received event network-vif-unplugged-b48b5298-045f-463d-9585-fbb5feb869bf {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:15:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-f47c4324-ae5b-48d9-9fc4-16dfc05dea46 req-5b0e5054-c09c-4905-b297-6fb85d495291 service nova] Acquiring lock "3b10fda0-9488-4089-8033-dd1c8e42af89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:15:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-f47c4324-ae5b-48d9-9fc4-16dfc05dea46 req-5b0e5054-c09c-4905-b297-6fb85d495291 service nova] Lock "3b10fda0-9488-4089-8033-dd1c8e42af89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:15:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-f47c4324-ae5b-48d9-9fc4-16dfc05dea46 req-5b0e5054-c09c-4905-b297-6fb85d495291 service nova] Lock "3b10fda0-9488-4089-8033-dd1c8e42af89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:15:15 user nova-compute[74840]: DEBUG nova.compute.manager [req-f47c4324-ae5b-48d9-9fc4-16dfc05dea46 req-5b0e5054-c09c-4905-b297-6fb85d495291 service nova] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] No waiting events found dispatching network-vif-unplugged-b48b5298-045f-463d-9585-fbb5feb869bf {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:15:15 user nova-compute[74840]: WARNING nova.compute.manager [req-f47c4324-ae5b-48d9-9fc4-16dfc05dea46 req-5b0e5054-c09c-4905-b297-6fb85d495291 service nova] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Received unexpected event network-vif-unplugged-b48b5298-045f-463d-9585-fbb5feb869bf for instance with vm_state resized and task_state resize_reverting.
Nov 08 12:15:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:16 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Instance destroyed successfully.
Nov 08 12:15:16 user nova-compute[74840]: DEBUG nova.objects.instance [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lazy-loading 'resources' on Instance uuid 3b10fda0-9488-4089-8033-dd1c8e42af89 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:08:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-172158050',display_name='tempest-ServerActionsTestOtherB-server-172158050',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-172158050',id=3,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJKFMe0GKEBW9KmyXjqsjBsUl5GOfddH2uub399MmagL+sAbL8XpD7Zv97iB27MfsDGdoFheqqd0EDelgcb+/IZFf73OQgm/+DITCITQulDQXkqFfn6taEL9Zjc2Dr8/0g==',key_name='tempest-keypair-2038726199',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:14:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a544910dc2c4b169c986fa74b5979d9',ramdisk_id='',reservation_id='r-o6735td4',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1148036573',owner_user_name='tempest-ServerActionsTestOtherB-1148036573-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:14:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47ef9bdd58a147518d0a09267731b67c',uuid=3b10fda0-9488-4089-8033-dd1c8e42af89,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "b48b5298-045f-463d-9585-fbb5feb869bf", "address": "fa:16:3e:19:58:1f", "network": {"id": "9dec89b0-562f-482c-aec1-d024351d0bd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-237264167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a544910dc2c4b169c986fa74b5979d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48b5298-04", "ovs_interfaceid": "b48b5298-045f-463d-9585-fbb5feb869bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Converting VIF {"id": "b48b5298-045f-463d-9585-fbb5feb869bf", "address": "fa:16:3e:19:58:1f", "network": {"id": "9dec89b0-562f-482c-aec1-d024351d0bd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-237264167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a544910dc2c4b169c986fa74b5979d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48b5298-04", "ovs_interfaceid": "b48b5298-045f-463d-9585-fbb5feb869bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:58:1f,bridge_name='br-int',has_traffic_filtering=True,id=b48b5298-045f-463d-9585-fbb5feb869bf,network=Network(9dec89b0-562f-482c-aec1-d024351d0bd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb48b5298-04') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG os_vif [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:58:1f,bridge_name='br-int',has_traffic_filtering=True,id=b48b5298-045f-463d-9585-fbb5feb869bf,network=Network(9dec89b0-562f-482c-aec1-d024351d0bd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb48b5298-04') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb48b5298-04, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7f096bcb-ef49-4d3b-a176-ae4def517c9a) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:15:16 user nova-compute[74840]: INFO os_vif [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:58:1f,bridge_name='br-int',has_traffic_filtering=True,id=b48b5298-045f-463d-9585-fbb5feb869bf,network=Network(9dec89b0-562f-482c-aec1-d024351d0bd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb48b5298-04')
Nov 08 12:15:16 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WnvQHzjl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:15:16 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:15:16 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f68f5dc-e85f-469f-b39c-2f30d21383ce]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 12:15:16 user nova-compute[74840]: No targets found.
Nov 08 12:15:16 user nova-compute[74840]: iSNS:
Nov 08 12:15:16 user nova-compute[74840]: No targets found.
Nov 08 12:15:16 user nova-compute[74840]: STATIC:
Nov 08 12:15:16 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22
Nov 08 12:15:16 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:15:16 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:15:16 user nova-compute[74840]: FIRMWARE:
Nov 08 12:15:16 user nova-compute[74840]: No targets found.
Nov 08 12:15:16 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 12:15:16 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 12:15:16 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b9908e-2920-445f-9440-4d9de712b029]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb9dfa1-e318-4f9d-8a14-5687a2d2b5b9]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)
Nov 08 12:15:16 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)
Nov 08 12:15:16 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7f4129ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22'): ({'sdc'}, set())}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Removing single pathed devices sdc {{(pid=74840) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e12eca-a399-45b4-9bf0-67c2afb5c84a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b13afa-c06e-4d77-8dcc-658e36027cd3]: (4, ('ok\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Flushing IO for device /dev/sdc {{(pid=74840) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3aaae95-f480-45b4-83f0-1280e579b7bb]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74840) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a85049-1380-4ab4-8289-135b2768e244]: (4, ('1', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] SCSI volumes sdc have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22')] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d919ba-1dc7-4a82-9195-1a861e2c5c45]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --logout {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0eefc4-d049-432a-9774-5ffe27335278]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22, portal: 172.16.0.220,3260]
Nov 08 12:15:16 user nova-compute[74840]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22, portal: 172.16.0.220,3260] successful.
Nov 08 12:15:16 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --op delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[87380c2b-8d1f-47d9-bf11-c3e4da7e5911]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] <== disconnect_volume: return (356ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:15:16 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 12:15:18 user nova-compute[74840]: DEBUG nova.compute.manager [req-a4970c5e-c9fb-49e4-9359-bb4558629c2a req-3cc40279-8816-4015-b50d-17cf94add5f7 service nova] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Received event network-vif-plugged-b48b5298-045f-463d-9585-fbb5feb869bf {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:15:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a4970c5e-c9fb-49e4-9359-bb4558629c2a req-3cc40279-8816-4015-b50d-17cf94add5f7 service nova] Acquiring lock "3b10fda0-9488-4089-8033-dd1c8e42af89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:15:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a4970c5e-c9fb-49e4-9359-bb4558629c2a req-3cc40279-8816-4015-b50d-17cf94add5f7 service nova] Lock "3b10fda0-9488-4089-8033-dd1c8e42af89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:15:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a4970c5e-c9fb-49e4-9359-bb4558629c2a req-3cc40279-8816-4015-b50d-17cf94add5f7 service nova] Lock "3b10fda0-9488-4089-8033-dd1c8e42af89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:15:18 user nova-compute[74840]: DEBUG nova.compute.manager [req-a4970c5e-c9fb-49e4-9359-bb4558629c2a req-3cc40279-8816-4015-b50d-17cf94add5f7 service nova] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] No waiting events found dispatching network-vif-plugged-b48b5298-045f-463d-9585-fbb5feb869bf {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:15:18 user nova-compute[74840]: WARNING nova.compute.manager [req-a4970c5e-c9fb-49e4-9359-bb4558629c2a req-3cc40279-8816-4015-b50d-17cf94add5f7 service nova] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Received unexpected event network-vif-plugged-b48b5298-045f-463d-9585-fbb5feb869bf for instance with vm_state resized and task_state resize_reverting.
Nov 08 12:15:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:15:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:15:18 user nova-compute[74840]: DEBUG nova.objects.instance [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lazy-loading 'migration_context' on Instance uuid 3b10fda0-9488-4089-8033-dd1c8e42af89 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:15:18 user nova-compute[74840]: DEBUG nova.objects.base [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Object Instance<3b10fda0-9488-4089-8033-dd1c8e42af89> lazy-loaded attributes: resources,migration_context {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:15:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ebf95ce5-2dc9-4f26-a17c-dce9edeaaae2 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Acquiring lock "a0b7a0e1-d0d1-4682-9218-ef44d1e461f1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:15:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ebf95ce5-2dc9-4f26-a17c-dce9edeaaae2 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Lock "a0b7a0e1-d0d1-4682-9218-ef44d1e461f1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:15:18 user nova-compute[74840]: DEBUG nova.objects.instance [None req-ebf95ce5-2dc9-4f26-a17c-dce9edeaaae2 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Lazy-loading 'flavor' on Instance uuid a0b7a0e1-d0d1-4682-9218-ef44d1e461f1 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:15:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ebf95ce5-2dc9-4f26-a17c-dce9edeaaae2 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Lock "a0b7a0e1-d0d1-4682-9218-ef44d1e461f1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:15:19 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:15:19 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:15:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ebf95ce5-2dc9-4f26-a17c-dce9edeaaae2 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Acquiring lock "a0b7a0e1-d0d1-4682-9218-ef44d1e461f1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:15:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ebf95ce5-2dc9-4f26-a17c-dce9edeaaae2 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Lock "a0b7a0e1-d0d1-4682-9218-ef44d1e461f1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:15:19 user nova-compute[74840]: INFO nova.compute.manager [None req-ebf95ce5-2dc9-4f26-a17c-dce9edeaaae2 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Attaching volume 6f6a3706-32bc-46bb-a7be-f1e436435a6f to /dev/vdb
Nov 08 12:15:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.527s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:15:19 user nova-compute[74840]: INFO nova.compute.manager [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Swapping old allocation on dict_keys(['74d527b3-4704-47dd-ab76-ffd69ef9a25e']) held by migration 71afe97b-bd77-44bf-a107-3616642fe417 for instance
Nov 08 12:15:19 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Overwriting current allocation {'allocations': {'74d527b3-4704-47dd-ab76-ffd69ef9a25e': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 17}}, 'project_id': '7a544910dc2c4b169c986fa74b5979d9', 'user_id': '47ef9bdd58a147518d0a09267731b67c', 'consumer_generation': 1} on consumer 3b10fda0-9488-4089-8033-dd1c8e42af89 {{(pid=74840) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 08 12:15:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Acquiring lock "refresh_cache-3b10fda0-9488-4089-8033-dd1c8e42af89" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:15:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Acquired lock "refresh_cache-3b10fda0-9488-4089-8033-dd1c8e42af89" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:15:19 user nova-compute[74840]: DEBUG nova.network.neutron [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:15:20 user nova-compute[74840]: DEBUG os_brick.utils [None req-ebf95ce5-2dc9-4f26-a17c-dce9edeaaae2 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:15:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.056s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:20 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[975ed300-d624-4475-8c1a-48debd71ae2f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c8228a11e03c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:15:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:20 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8330c8-3f14-46c1-8c11-a7e4113cfd60]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:15:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:20 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f539fdbe-3641-441c-8a5d-e4fd7ebbd9b7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:15:20 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a31cbe-e5b4-4a3a-818c-7d616334868f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:15:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-ebf95ce5-2dc9-4f26-a17c-dce9edeaaae2 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Running cmd (subprocess): nvme version {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-ebf95ce5-2dc9-4f26-a17c-dce9edeaaae2 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] 'nvme version' failed. Not Retrying. {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:15:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ebf95ce5-2dc9-4f26-a17c-dce9edeaaae2 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] nvme not present on system {{(pid=74840) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 12:15:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:15:20 user nova-compute[74840]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 12:15:20 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[31955cd9-2406-4e9c-8ca4-0e40415867d0]: (4, '') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:15:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-ebf95ce5-2dc9-4f26-a17c-dce9edeaaae2 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74840) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 12:15:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-ebf95ce5-2dc9-4f26-a17c-dce9edeaaae2 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 12:15:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-ebf95ce5-2dc9-4f26-a17c-dce9edeaaae2 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] LIGHTOS: no hostnqn found. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 12:15:20 user nova-compute[74840]: DEBUG os_brick.utils [None req-ebf95ce5-2dc9-4f26-a17c-dce9edeaaae2 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] <== get_connector_properties: return (370ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c8228a11e03c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:15:20 user nova-compute[74840]: DEBUG nova.virt.block_device [None req-ebf95ce5-2dc9-4f26-a17c-dce9edeaaae2 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Updating existing volume attachment record: e276fd12-bbd8-41fe-88e5-fb04c4ba7ea1 {{(pid=74840) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 12:15:20 user nova-compute[74840]: DEBUG nova.network.neutron [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Updating instance_info_cache with network_info: [{"id": "b48b5298-045f-463d-9585-fbb5feb869bf", "address": "fa:16:3e:19:58:1f", "network": {"id": "9dec89b0-562f-482c-aec1-d024351d0bd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-237264167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a544910dc2c4b169c986fa74b5979d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48b5298-04", "ovs_interfaceid": "b48b5298-045f-463d-9585-fbb5feb869bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:15:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Releasing lock "refresh_cache-3b10fda0-9488-4089-8033-dd1c8e42af89" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:15:20 user nova-compute[74840]: DEBUG os_brick.utils [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:15:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.034s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:20 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c483be33-f817-4631-8055-d51f1094ec38]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c8228a11e03c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:15:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:20 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3d06e1-2a51-4e55-bfa8-7c7536dc4080]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:15:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:20 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[04495ea8-ca7d-4563-8dd4-61640322e8ad]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:15:20 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[862ee0ea-a26c-471d-afdb-42a56deae634]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:15:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Running cmd (subprocess): nvme version {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] 'nvme version' failed. Not Retrying. {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:15:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] nvme not present on system {{(pid=74840) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 12:15:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:15:20 user nova-compute[74840]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 12:15:20 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[427256dd-cf34-4b33-b3ae-99dd89556ead]: (4, '') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:15:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74840) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 12:15:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 12:15:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] LIGHTOS: no hostnqn found. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 12:15:20 user nova-compute[74840]: DEBUG os_brick.utils [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c8228a11e03c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:15:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Acquiring lock "e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:15:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Lock "e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:15:21 user nova-compute[74840]: DEBUG nova.compute.manager [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Starting instance... {{(pid=74840) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 12:15:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:15:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:15:21 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:15:21 user nova-compute[74840]: INFO nova.compute.claims [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Claim successful on node user
Nov 08 12:15:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:21 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:15:21 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:15:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.406s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:15:21 user nova-compute[74840]: DEBUG nova.compute.manager [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Start building networks asynchronously for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 12:15:21 user nova-compute[74840]: DEBUG nova.compute.manager [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Allocating IP information in the background. {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 12:15:21 user nova-compute[74840]: DEBUG nova.network.neutron [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 12:15:21 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 12:15:21 user nova-compute[74840]: DEBUG nova.compute.manager [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Start building block device mappings for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 12:15:21 user nova-compute[74840]: DEBUG nova.policy [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '676dcf6c3bb441b48da69412ced1c019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24eea35667934f72bef26febd10192b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 12:15:21 user nova-compute[74840]: DEBUG nova.compute.manager [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Start spawning the instance on the hypervisor. {{(pid=74840) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 12:15:21 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:15:21 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Creating image(s)
Nov 08 12:15:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Acquiring lock "/opt/stack/data/nova/instances/e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:15:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Lock "/opt/stack/data/nova/instances/e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:15:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Lock "/opt/stack/data/nova/instances/e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:15:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:22 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.203s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Acquiring lock "5d26578eba85497f494c575690c4248f381a0fe6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:15:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:15:22 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:22 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.194s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:22 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf/disk 1073741824 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:22 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf/disk 1073741824" returned: 0 in 0.058s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:15:22 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:22 user nova-compute[74840]: DEBUG nova.network.neutron [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Successfully created port: 3d85fb08-7cf4-4f26-a8d0-9de9095f874c {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:15:22 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.193s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:22 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf/disk. size=1073741824 {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 12:15:22 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:22 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:22 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Cannot resize image /opt/stack/data/nova/instances/e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf/disk to a smaller size. {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 12:15:22 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Created local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 12:15:22 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Ensure instance console log exists: /opt/stack/data/nova/instances/e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:15:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:15:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:15:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:15:23 user nova-compute[74840]: DEBUG nova.network.neutron [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Successfully updated port: 3d85fb08-7cf4-4f26-a8d0-9de9095f874c {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:15:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Acquiring lock "refresh_cache-e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:15:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Acquired lock "refresh_cache-e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:15:23 user nova-compute[74840]: DEBUG nova.network.neutron [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:15:23 user nova-compute[74840]: DEBUG nova.compute.manager [req-eb9a4786-a696-4edc-a4ef-64943d28a54a req-71ea95e6-3fd3-40a8-a893-5952e9233a10 service nova] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Received event network-changed-3d85fb08-7cf4-4f26-a8d0-9de9095f874c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:15:23 user nova-compute[74840]: DEBUG nova.compute.manager [req-eb9a4786-a696-4edc-a4ef-64943d28a54a req-71ea95e6-3fd3-40a8-a893-5952e9233a10 service nova] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Refreshing instance network info cache due to event network-changed-3d85fb08-7cf4-4f26-a8d0-9de9095f874c. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:15:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-eb9a4786-a696-4edc-a4ef-64943d28a54a req-71ea95e6-3fd3-40a8-a893-5952e9233a10 service nova] Acquiring lock "refresh_cache-e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:15:23 user nova-compute[74840]: DEBUG nova.network.neutron [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:15:23 user nova-compute[74840]: DEBUG nova.network.neutron [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Updating instance_info_cache with network_info: [{"id": "3d85fb08-7cf4-4f26-a8d0-9de9095f874c", "address": "fa:16:3e:6e:13:a8", "network": {"id": "a6dec0d8-d21a-41d6-9d3a-effe04e7f845", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-780900048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24eea35667934f72bef26febd10192b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d85fb08-7c", "ovs_interfaceid": "3d85fb08-7cf4-4f26-a8d0-9de9095f874c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:15:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Releasing lock "refresh_cache-e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:15:23 user nova-compute[74840]: DEBUG nova.compute.manager [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Instance network_info: |[{"id": "3d85fb08-7cf4-4f26-a8d0-9de9095f874c", "address": "fa:16:3e:6e:13:a8", "network": {"id": "a6dec0d8-d21a-41d6-9d3a-effe04e7f845", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-780900048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24eea35667934f72bef26febd10192b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d85fb08-7c", "ovs_interfaceid": "3d85fb08-7cf4-4f26-a8d0-9de9095f874c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 12:15:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-eb9a4786-a696-4edc-a4ef-64943d28a54a req-71ea95e6-3fd3-40a8-a893-5952e9233a10 service nova] Acquired lock "refresh_cache-e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:15:23 user nova-compute[74840]: DEBUG nova.network.neutron [req-eb9a4786-a696-4edc-a4ef-64943d28a54a req-71ea95e6-3fd3-40a8-a893-5952e9233a10 service nova] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Refreshing network info cache for port 3d85fb08-7cf4-4f26-a8d0-9de9095f874c {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:15:23 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Start _get_guest_xml network_info=[{"id": "3d85fb08-7cf4-4f26-a8d0-9de9095f874c", "address": "fa:16:3e:6e:13:a8", "network": {"id": "a6dec0d8-d21a-41d6-9d3a-effe04e7f845", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-780900048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24eea35667934f72bef26febd10192b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d85fb08-7c", "ovs_interfaceid": "3d85fb08-7cf4-4f26-a8d0-9de9095f874c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'image_id': '4fa17706-d304-4117-a420-dab994c703dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:15:23 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:15:23 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:15:23 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:15:23 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:15:23 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:15:23 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:15:23 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:15:23 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:15:23 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:15:23 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:15:23 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:15:23 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:15:23 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:15:23 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:15:23 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:15:23 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:15:23 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:15:23 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:15:23 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:15:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-539454341',display_name='tempest-TestServerVolumeAttachmentScenario-server-539454341',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-539454341',id=14,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPIUCivH5dqp+8G+VDAaB9quGsl40+835InkBq91B7snyaqGexenRT97XM03D/07Q3Ndqly9DDY98ZaKE/wpDZRLx2V2mkhsIyrvIdpLhsxGYB3NQnaw7DdUqJK2uZvrmg==',key_name='tempest-keypair-1872878997',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24eea35667934f72bef26febd10192b3',ramdisk_id='',reservation_id='r-um0chbdc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-447500273',owner_user_name='tempest-TestServerVolumeAttachmentScenario-447500273-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:15:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='676dcf6c3bb441b48da69412ced1c019',uuid=e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d85fb08-7cf4-4f26-a8d0-9de9095f874c", "address": "fa:16:3e:6e:13:a8", "network": {"id": "a6dec0d8-d21a-41d6-9d3a-effe04e7f845", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-780900048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24eea35667934f72bef26febd10192b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d85fb08-7c", "ovs_interfaceid": "3d85fb08-7cf4-4f26-a8d0-9de9095f874c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:15:23 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Converting VIF {"id": "3d85fb08-7cf4-4f26-a8d0-9de9095f874c", "address": "fa:16:3e:6e:13:a8", "network": {"id": "a6dec0d8-d21a-41d6-9d3a-effe04e7f845", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-780900048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24eea35667934f72bef26febd10192b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d85fb08-7c", "ovs_interfaceid": "3d85fb08-7cf4-4f26-a8d0-9de9095f874c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:15:23 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:13:a8,bridge_name='br-int',has_traffic_filtering=True,id=3d85fb08-7cf4-4f26-a8d0-9de9095f874c,network=Network(a6dec0d8-d21a-41d6-9d3a-effe04e7f845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d85fb08-7c') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:15:23 user nova-compute[74840]: DEBUG nova.objects.instance [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Lazy-loading 'pci_devices' on Instance uuid e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:15:24 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:15:24 user nova-compute[74840]:   <uuid>e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf</uuid>
Nov 08 12:15:24 user nova-compute[74840]:   <name>instance-0000000e</name>
Nov 08 12:15:24 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:15:24 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:15:24 user nova-compute[74840]:   <metadata>
Nov 08 12:15:24 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:15:24 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:15:24 user nova-compute[74840]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-539454341</nova:name>
Nov 08 12:15:24 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:15:23</nova:creationTime>
Nov 08 12:15:24 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:15:24 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:15:24 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:15:24 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:15:24 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:15:24 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:15:24 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:15:24 user nova-compute[74840]:       <nova:owner>
Nov 08 12:15:24 user nova-compute[74840]:         <nova:user uuid="676dcf6c3bb441b48da69412ced1c019">tempest-TestServerVolumeAttachmentScenario-447500273-project-member</nova:user>
Nov 08 12:15:24 user nova-compute[74840]:         <nova:project uuid="24eea35667934f72bef26febd10192b3">tempest-TestServerVolumeAttachmentScenario-447500273</nova:project>
Nov 08 12:15:24 user nova-compute[74840]:       </nova:owner>
Nov 08 12:15:24 user nova-compute[74840]:       <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:15:24 user nova-compute[74840]:       <nova:ports>
Nov 08 12:15:24 user nova-compute[74840]:         <nova:port uuid="3d85fb08-7cf4-4f26-a8d0-9de9095f874c">
Nov 08 12:15:24 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 08 12:15:24 user nova-compute[74840]:         </nova:port>
Nov 08 12:15:24 user nova-compute[74840]:       </nova:ports>
Nov 08 12:15:24 user nova-compute[74840]:     </nova:instance>
Nov 08 12:15:24 user nova-compute[74840]:   </metadata>
Nov 08 12:15:24 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:15:24 user nova-compute[74840]:     <system>
Nov 08 12:15:24 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:15:24 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:15:24 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:15:24 user nova-compute[74840]:       <entry name="serial">e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf</entry>
Nov 08 12:15:24 user nova-compute[74840]:       <entry name="uuid">e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf</entry>
Nov 08 12:15:24 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:15:24 user nova-compute[74840]:     </system>
Nov 08 12:15:24 user nova-compute[74840]:   </sysinfo>
Nov 08 12:15:24 user nova-compute[74840]:   <os>
Nov 08 12:15:24 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:15:24 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:15:24 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:15:24 user nova-compute[74840]:   </os>
Nov 08 12:15:24 user nova-compute[74840]:   <features>
Nov 08 12:15:24 user nova-compute[74840]:     <acpi/>
Nov 08 12:15:24 user nova-compute[74840]:     <apic/>
Nov 08 12:15:24 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:15:24 user nova-compute[74840]:   </features>
Nov 08 12:15:24 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:15:24 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:15:24 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:15:24 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:15:24 user nova-compute[74840]:   </clock>
Nov 08 12:15:24 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:15:24 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:15:24 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:15:24 user nova-compute[74840]:   </cpu>
Nov 08 12:15:24 user nova-compute[74840]:   <devices>
Nov 08 12:15:24 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:15:24 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:15:24 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf/disk"/>
Nov 08 12:15:24 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:15:24 user nova-compute[74840]:     </disk>
Nov 08 12:15:24 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:15:24 user nova-compute[74840]:       <mac address="fa:16:3e:6e:13:a8"/>
Nov 08 12:15:24 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:15:24 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:15:24 user nova-compute[74840]:       <target dev="tap3d85fb08-7c"/>
Nov 08 12:15:24 user nova-compute[74840]:     </interface>
Nov 08 12:15:24 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:15:24 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf/console.log" append="off"/>
Nov 08 12:15:24 user nova-compute[74840]:     </serial>
Nov 08 12:15:24 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:15:24 user nova-compute[74840]:     <video>
Nov 08 12:15:24 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:15:24 user nova-compute[74840]:     </video>
Nov 08 12:15:24 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:15:24 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:15:24 user nova-compute[74840]:     </rng>
Nov 08 12:15:24 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:15:24 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:15:24 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:15:24 user nova-compute[74840]:     </memballoon>
Nov 08 12:15:24 user nova-compute[74840]:   </devices>
Nov 08 12:15:24 user nova-compute[74840]: </domain>
Nov 08 12:15:24 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:15:24 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:15:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-539454341',display_name='tempest-TestServerVolumeAttachmentScenario-server-539454341',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-539454341',id=14,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPIUCivH5dqp+8G+VDAaB9quGsl40+835InkBq91B7snyaqGexenRT97XM03D/07Q3Ndqly9DDY98ZaKE/wpDZRLx2V2mkhsIyrvIdpLhsxGYB3NQnaw7DdUqJK2uZvrmg==',key_name='tempest-keypair-1872878997',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24eea35667934f72bef26febd10192b3',ramdisk_id='',reservation_id='r-um0chbdc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-447500273',owner_user_name='tempest-TestServerVolumeAttachmentScenario-447500273-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:15:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='676dcf6c3bb441b48da69412ced1c019',uuid=e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d85fb08-7cf4-4f26-a8d0-9de9095f874c", "address": "fa:16:3e:6e:13:a8", "network": {"id": "a6dec0d8-d21a-41d6-9d3a-effe04e7f845", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-780900048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24eea35667934f72bef26febd10192b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d85fb08-7c", "ovs_interfaceid": "3d85fb08-7cf4-4f26-a8d0-9de9095f874c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:15:24 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Converting VIF {"id": "3d85fb08-7cf4-4f26-a8d0-9de9095f874c", "address": "fa:16:3e:6e:13:a8", "network": {"id": "a6dec0d8-d21a-41d6-9d3a-effe04e7f845", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-780900048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24eea35667934f72bef26febd10192b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d85fb08-7c", "ovs_interfaceid": "3d85fb08-7cf4-4f26-a8d0-9de9095f874c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:15:24 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:13:a8,bridge_name='br-int',has_traffic_filtering=True,id=3d85fb08-7cf4-4f26-a8d0-9de9095f874c,network=Network(a6dec0d8-d21a-41d6-9d3a-effe04e7f845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d85fb08-7c') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:15:24 user nova-compute[74840]: DEBUG os_vif [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:13:a8,bridge_name='br-int',has_traffic_filtering=True,id=3d85fb08-7cf4-4f26-a8d0-9de9095f874c,network=Network(a6dec0d8-d21a-41d6-9d3a-effe04e7f845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d85fb08-7c') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:15:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:15:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:15:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd486fbb5-f518-558e-bfff-b1afddf8202f', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:15:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d85fb08-7c, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:15:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3d85fb08-7c, col_values=(('qos', UUID('5d911517-193c-48e0-b76c-d12d085ee5d5')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:15:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3d85fb08-7c, col_values=(('external_ids', {'iface-id': '3d85fb08-7cf4-4f26-a8d0-9de9095f874c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:13:a8', 'vm-uuid': 'e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:15:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:15:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:24 user nova-compute[74840]: INFO os_vif [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:13:a8,bridge_name='br-int',has_traffic_filtering=True,id=3d85fb08-7cf4-4f26-a8d0-9de9095f874c,network=Network(a6dec0d8-d21a-41d6-9d3a-effe04e7f845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d85fb08-7c')
Nov 08 12:15:24 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:15:24 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] No VIF found with MAC fa:16:3e:6e:13:a8, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:15:24 user nova-compute[74840]: DEBUG nova.network.neutron [req-eb9a4786-a696-4edc-a4ef-64943d28a54a req-71ea95e6-3fd3-40a8-a893-5952e9233a10 service nova] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Updated VIF entry in instance network info cache for port 3d85fb08-7cf4-4f26-a8d0-9de9095f874c. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:15:24 user nova-compute[74840]: DEBUG nova.network.neutron [req-eb9a4786-a696-4edc-a4ef-64943d28a54a req-71ea95e6-3fd3-40a8-a893-5952e9233a10 service nova] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Updating instance_info_cache with network_info: [{"id": "3d85fb08-7cf4-4f26-a8d0-9de9095f874c", "address": "fa:16:3e:6e:13:a8", "network": {"id": "a6dec0d8-d21a-41d6-9d3a-effe04e7f845", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-780900048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24eea35667934f72bef26febd10192b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d85fb08-7c", "ovs_interfaceid": "3d85fb08-7cf4-4f26-a8d0-9de9095f874c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:15:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-eb9a4786-a696-4edc-a4ef-64943d28a54a req-71ea95e6-3fd3-40a8-a893-5952e9233a10 service nova] Releasing lock "refresh_cache-e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:15:25 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:25 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:25 user nova-compute[74840]: DEBUG nova.compute.manager [req-2fee60c2-66ac-47de-9d72-0f4565554c53 req-0a695ea9-0d70-40c0-8966-4a1ad85cc011 service nova] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Received event network-vif-plugged-3d85fb08-7cf4-4f26-a8d0-9de9095f874c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:15:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2fee60c2-66ac-47de-9d72-0f4565554c53 req-0a695ea9-0d70-40c0-8966-4a1ad85cc011 service nova] Acquiring lock "e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:15:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2fee60c2-66ac-47de-9d72-0f4565554c53 req-0a695ea9-0d70-40c0-8966-4a1ad85cc011 service nova] Lock "e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:15:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2fee60c2-66ac-47de-9d72-0f4565554c53 req-0a695ea9-0d70-40c0-8966-4a1ad85cc011 service nova] Lock "e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:15:25 user nova-compute[74840]: DEBUG nova.compute.manager [req-2fee60c2-66ac-47de-9d72-0f4565554c53 req-0a695ea9-0d70-40c0-8966-4a1ad85cc011 service nova] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] No waiting events found dispatching network-vif-plugged-3d85fb08-7cf4-4f26-a8d0-9de9095f874c {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:15:25 user nova-compute[74840]: WARNING nova.compute.manager [req-2fee60c2-66ac-47de-9d72-0f4565554c53 req-0a695ea9-0d70-40c0-8966-4a1ad85cc011 service nova] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Received unexpected event network-vif-plugged-3d85fb08-7cf4-4f26-a8d0-9de9095f874c for instance with vm_state building and task_state spawning.
Nov 08 12:15:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:27 user nova-compute[74840]: DEBUG nova.compute.manager [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:15:27 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:15:27 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Instance spawned successfully.
Nov 08 12:15:27 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:15:27 user nova-compute[74840]: DEBUG nova.compute.manager [req-27dca438-5060-4afc-9a38-a26f88fc9db0 req-cd69ec94-0db5-4a28-bd55-d44d85561bb8 service nova] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Received event network-vif-plugged-3d85fb08-7cf4-4f26-a8d0-9de9095f874c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:15:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-27dca438-5060-4afc-9a38-a26f88fc9db0 req-cd69ec94-0db5-4a28-bd55-d44d85561bb8 service nova] Acquiring lock "e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:15:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-27dca438-5060-4afc-9a38-a26f88fc9db0 req-cd69ec94-0db5-4a28-bd55-d44d85561bb8 service nova] Lock "e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:15:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-27dca438-5060-4afc-9a38-a26f88fc9db0 req-cd69ec94-0db5-4a28-bd55-d44d85561bb8 service nova] Lock "e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:15:27 user nova-compute[74840]: DEBUG nova.compute.manager [req-27dca438-5060-4afc-9a38-a26f88fc9db0 req-cd69ec94-0db5-4a28-bd55-d44d85561bb8 service nova] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] No waiting events found dispatching network-vif-plugged-3d85fb08-7cf4-4f26-a8d0-9de9095f874c {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:15:27 user nova-compute[74840]: WARNING nova.compute.manager [req-27dca438-5060-4afc-9a38-a26f88fc9db0 req-cd69ec94-0db5-4a28-bd55-d44d85561bb8 service nova] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Received unexpected event network-vif-plugged-3d85fb08-7cf4-4f26-a8d0-9de9095f874c for instance with vm_state building and task_state spawning.
Nov 08 12:15:27 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Found default for hw_cdrom_bus of ide {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:15:27 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Found default for hw_disk_bus of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:15:27 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:15:27 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:15:27 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Found default for hw_video_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:15:27 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Found default for hw_vif_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:15:28 user nova-compute[74840]: INFO nova.compute.manager [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Took 6.08 seconds to spawn the instance on the hypervisor.
Nov 08 12:15:28 user nova-compute[74840]: DEBUG nova.compute.manager [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:15:28 user nova-compute[74840]: INFO nova.compute.manager [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Took 6.87 seconds to build instance.
Nov 08 12:15:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d37c5327-cafe-44da-951d-325d0b09766d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Lock "e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.973s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:15:29 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:34 user nova-compute[74840]: INFO nova.compute.manager [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] Took 54.26 seconds to detach 3 volumes for instance.
Nov 08 12:15:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:15:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:15:34 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:15:34 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:15:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.279s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:15:34 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Deleted allocations for instance d2dbd607-cf11-4d81-9639-c84e79d65fcd
Nov 08 12:15:34 user nova-compute[74840]: ERROR nova.volume.cinder [None req-ebf95ce5-2dc9-4f26-a17c-dce9edeaaae2 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Update attachment failed for attachment e276fd12-bbd8-41fe-88e5-fb04c4ba7ea1. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-1a884a24-c733-4022-a7a6-e44492b00993) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-1a884a24-c733-4022-a7a6-e44492b00993)
Nov 08 12:15:35 user nova-compute[74840]: ERROR nova.compute.manager [None req-ebf95ce5-2dc9-4f26-a17c-dce9edeaaae2 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Failed to attach 6f6a3706-32bc-46bb-a7be-f1e436435a6f at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-1a884a24-c733-4022-a7a6-e44492b00993)
Nov 08 12:15:35 user nova-compute[74840]: ERROR nova.compute.manager [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Traceback (most recent call last):
Nov 08 12:15:35 user nova-compute[74840]: ERROR nova.compute.manager [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 08 12:15:35 user nova-compute[74840]: ERROR nova.compute.manager [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 08 12:15:35 user nova-compute[74840]: ERROR nova.compute.manager [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 08 12:15:35 user nova-compute[74840]: ERROR nova.compute.manager [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1]     ret_val = method(obj, context, *args, **kwargs)
Nov 08 12:15:35 user nova-compute[74840]: ERROR nova.compute.manager [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 08 12:15:35 user nova-compute[74840]: ERROR nova.compute.manager [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1]     self._do_attach(context, instance, volume, volume_api,
Nov 08 12:15:35 user nova-compute[74840]: ERROR nova.compute.manager [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 08 12:15:35 user nova-compute[74840]: ERROR nova.compute.manager [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1]     self._volume_attach(context, volume, connector, instance,
Nov 08 12:15:35 user nova-compute[74840]: ERROR nova.compute.manager [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 08 12:15:35 user nova-compute[74840]: ERROR nova.compute.manager [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1]     connection_info = volume_api.attachment_update(
Nov 08 12:15:35 user nova-compute[74840]: ERROR nova.compute.manager [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 12:15:35 user nova-compute[74840]: ERROR nova.compute.manager [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1]     res = method(self, ctx, *args, **kwargs)
Nov 08 12:15:35 user nova-compute[74840]: ERROR nova.compute.manager [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 08 12:15:35 user nova-compute[74840]: ERROR nova.compute.manager [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 08 12:15:35 user nova-compute[74840]: ERROR nova.compute.manager [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 08 12:15:35 user nova-compute[74840]: ERROR nova.compute.manager [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1]     with excutils.save_and_reraise_exception():
Nov 08 12:15:35 user nova-compute[74840]: ERROR nova.compute.manager [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 12:15:35 user nova-compute[74840]: ERROR nova.compute.manager [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1]     self.force_reraise()
Nov 08 12:15:35 user nova-compute[74840]: ERROR nova.compute.manager [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 12:15:35 user nova-compute[74840]: ERROR nova.compute.manager [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1]     raise self.value
Nov 08 12:15:35 user nova-compute[74840]: ERROR nova.compute.manager [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 08 12:15:35 user nova-compute[74840]: ERROR nova.compute.manager [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1]     context, '3.44', skip_version_check=True).attachments.update(
Nov 08 12:15:35 user nova-compute[74840]: ERROR nova.compute.manager [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 08 12:15:35 user nova-compute[74840]: ERROR nova.compute.manager [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1]     return method.func(obj, *args, **kwargs)
Nov 08 12:15:35 user nova-compute[74840]: ERROR nova.compute.manager [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 08 12:15:35 user nova-compute[74840]: ERROR nova.compute.manager [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1]     resp = self._update('/attachments/%s' % id, body)
Nov 08 12:15:35 user nova-compute[74840]: ERROR nova.compute.manager [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 08 12:15:35 user nova-compute[74840]: ERROR nova.compute.manager [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 08 12:15:35 user nova-compute[74840]: ERROR nova.compute.manager [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 08 12:15:35 user nova-compute[74840]: ERROR nova.compute.manager [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1]     return self._cs_request(url, 'PUT', **kwargs)
Nov 08 12:15:35 user nova-compute[74840]: ERROR nova.compute.manager [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 12:15:35 user nova-compute[74840]: ERROR nova.compute.manager [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1]     return self.request(url, method, **kwargs)
Nov 08 12:15:35 user nova-compute[74840]: ERROR nova.compute.manager [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 12:15:35 user nova-compute[74840]: ERROR nova.compute.manager [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1]     raise exceptions.from_response(resp, body)
Nov 08 12:15:35 user nova-compute[74840]: ERROR nova.compute.manager [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-1a884a24-c733-4022-a7a6-e44492b00993)
Nov 08 12:15:35 user nova-compute[74840]: ERROR nova.compute.manager [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] 
Nov 08 12:15:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-51c8c4c4-67ca-4e23-83bd-f78acab35652 tempest-TaggedBootDevicesTest-403652028 tempest-TaggedBootDevicesTest-403652028-project-member] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 62.036s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:15:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 30.056s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:15:35 user nova-compute[74840]: INFO nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: d2dbd607-cf11-4d81-9639-c84e79d65fcd] During sync_power_state the instance has a pending task (deleting). Skip.
Nov 08 12:15:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "d2dbd607-cf11-4d81-9639-c84e79d65fcd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:15:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ebf95ce5-2dc9-4f26-a17c-dce9edeaaae2 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Lock "a0b7a0e1-d0d1-4682-9218-ef44d1e461f1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.999s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server [None req-ebf95ce5-2dc9-4f26-a17c-dce9edeaaae2 tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-1a884a24-c733-4022-a7a6-e44492b00993)
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-1a884a24-c733-4022-a7a6-e44492b00993)
Nov 08 12:15:35 user nova-compute[74840]: ERROR oslo_messaging.rpc.server 
Nov 08 12:15:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:15:43 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Creating image(s)
Nov 08 12:15:43 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Did not create local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Ensure instance console log exists: /opt/stack/data/nova/instances/28ccd7b3-8bbe-42e7-aa00-612b3703ae79/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Start _get_guest_xml network_info=[{"id": "bd22c195-e803-484d-811a-aeeb04326bd0", "address": "fa:16:3e:ee:6e:72", "network": {"id": "d0c950e1-4e6d-42f7-bbbb-7164603882bc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1883968250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c961954c4a0440a93d9738ca5ab0026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd22c195-e8", "ovs_interfaceid": "bd22c195-e803-484d-811a-aeeb04326bd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '148accf2-e32d-48ea-b4fb-d18ff481b5e4', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BXnlZryS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '28ccd7b3-8bbe-42e7-aa00-612b3703ae79', 'attached_at': '', 'detached_at': '', 'volume_id': '2a571b42-9e1d-4406-b369-12722b22f097', 'serial': '2a571b42-9e1d-4406-b369-12722b22f097'}, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:15:43 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 08 12:15:43 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 08 12:15:43 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG nova.objects.instance [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Lazy-loading 'vcpu_model' on Instance uuid 28ccd7b3-8bbe-42e7-aa00-612b3703ae79 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Calling os-brick to attach iSCSI Volume {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BXnlZryS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:15:43 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 12:15:43 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:15:43 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 12:15:43 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:15:43 user nova-compute[74840]: INFO os_brick.initiator.connectors.iscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 12:15:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 -p 172.16.0.220:3260 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9106a7-55d1-4e67-a19f-ec1d72f57e10]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 12:15:43 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 -p 172.16.0.220:3260 --interface default --op new {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9586349b-48e8-49f4-be21-feff24898288]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097] added\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097] added
Nov 08 12:15:43 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5170fa-789f-4918-980b-eaf868bf457b]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[97706590-3fbb-4139-98f4-27b54f148875]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BXnlZryS {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BXnlZryS" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[0250db9e-c995-49c5-9bee-2f9b3ae96528]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BXnlZryS'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb6022c-bb69-466e-b0f4-e4198a428be7]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd0756d-ce07-45e3-841f-a546bc8107b8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 12:15:43 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 12:15:43 user nova-compute[74840]:  {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:15:43 user nova-compute[74840]: WARNING os_brick.initiator.connectors.iscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 12:15:43 user nova-compute[74840]: : NotImplementedError
Nov 08 12:15:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 -p 172.16.0.220:3260 --login {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d19c2a-a8fc-423b-a6ca-11e8ebf1eeff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097, portal: 172.16.0.220,3260]
Nov 08 12:15:43 user nova-compute[74840]: Login to [iface: default, target: iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097, portal: 172.16.0.220,3260] successful.
Nov 08 12:15:43 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[49184518-c658-4470-953f-5857e02f0d79]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8810be4-879d-4c12-a703-05e16cc2f418]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)
Nov 08 12:15:43 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)
Nov 08 12:15:43 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Connected to 172.16.0.220:3260 {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=74840) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74840) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c6ef74-b88f-4f41-9096-02835f46817e]: (4, ('- - 0', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:15:43 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BXnlZryS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 12:15:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:44 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:15:44 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23965633037613630', 'path': '/dev/sdb'} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:15:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965633037613630', 'path': '/dev/sdb'} {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 12:15:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T12:11:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1277810806',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-791461388',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHpDLhfsQbuoiOAJZjQdzHvpPhC/nzLrrMQESJ5Ldi9eYg8zkak82Rki/GHtRFnLyoKBsr3ji4PDu9fap5vsgpePAUrrP6MvAc2bSYV1GEi6T2SkCHIaBKds2SkXizZsQ==',key_name='tempest-keypair-1117122950',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:12:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0c961954c4a0440a93d9738ca5ab0026',ramdisk_id='',reservation_id='r-pbsbcfi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-874131883',owner_user_name='tempest-ServerActionsV293TestJSON-874131883-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:15:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cab11962ef3472a864f830d45396c4c',uuid=28ccd7b3-8bbe-42e7-aa00-612b3703ae79,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd22c195-e803-484d-811a-aeeb04326bd0", "address": "fa:16:3e:ee:6e:72", "network": {"id": "d0c950e1-4e6d-42f7-bbbb-7164603882bc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1883968250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c961954c4a0440a93d9738ca5ab0026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd22c195-e8", "ovs_interfaceid": "bd22c195-e803-484d-811a-aeeb04326bd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:15:44 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Converting VIF {"id": "bd22c195-e803-484d-811a-aeeb04326bd0", "address": "fa:16:3e:ee:6e:72", "network": {"id": "d0c950e1-4e6d-42f7-bbbb-7164603882bc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1883968250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c961954c4a0440a93d9738ca5ab0026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd22c195-e8", "ovs_interfaceid": "bd22c195-e803-484d-811a-aeeb04326bd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:15:44 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:6e:72,bridge_name='br-int',has_traffic_filtering=True,id=bd22c195-e803-484d-811a-aeeb04326bd0,network=Network(d0c950e1-4e6d-42f7-bbbb-7164603882bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd22c195-e8') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:15:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:15:44 user nova-compute[74840]:   <uuid>28ccd7b3-8bbe-42e7-aa00-612b3703ae79</uuid>
Nov 08 12:15:44 user nova-compute[74840]:   <name>instance-0000000a</name>
Nov 08 12:15:44 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:15:44 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:15:44 user nova-compute[74840]:   <metadata>
Nov 08 12:15:44 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:15:44 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:15:44 user nova-compute[74840]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1277810806</nova:name>
Nov 08 12:15:44 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:15:43</nova:creationTime>
Nov 08 12:15:44 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:15:44 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:15:44 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:15:44 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:15:44 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:15:44 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:15:44 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:15:44 user nova-compute[74840]:       <nova:owner>
Nov 08 12:15:44 user nova-compute[74840]:         <nova:user uuid="0cab11962ef3472a864f830d45396c4c">tempest-ServerActionsV293TestJSON-874131883-project-member</nova:user>
Nov 08 12:15:44 user nova-compute[74840]:         <nova:project uuid="0c961954c4a0440a93d9738ca5ab0026">tempest-ServerActionsV293TestJSON-874131883</nova:project>
Nov 08 12:15:44 user nova-compute[74840]:       </nova:owner>
Nov 08 12:15:44 user nova-compute[74840]:       <nova:ports>
Nov 08 12:15:44 user nova-compute[74840]:         <nova:port uuid="bd22c195-e803-484d-811a-aeeb04326bd0">
Nov 08 12:15:44 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 12:15:44 user nova-compute[74840]:         </nova:port>
Nov 08 12:15:44 user nova-compute[74840]:       </nova:ports>
Nov 08 12:15:44 user nova-compute[74840]:     </nova:instance>
Nov 08 12:15:44 user nova-compute[74840]:   </metadata>
Nov 08 12:15:44 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:15:44 user nova-compute[74840]:     <system>
Nov 08 12:15:44 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:15:44 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:15:44 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:15:44 user nova-compute[74840]:       <entry name="serial">28ccd7b3-8bbe-42e7-aa00-612b3703ae79</entry>
Nov 08 12:15:44 user nova-compute[74840]:       <entry name="uuid">28ccd7b3-8bbe-42e7-aa00-612b3703ae79</entry>
Nov 08 12:15:44 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:15:44 user nova-compute[74840]:     </system>
Nov 08 12:15:44 user nova-compute[74840]:   </sysinfo>
Nov 08 12:15:44 user nova-compute[74840]:   <os>
Nov 08 12:15:44 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:15:44 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:15:44 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:15:44 user nova-compute[74840]:   </os>
Nov 08 12:15:44 user nova-compute[74840]:   <features>
Nov 08 12:15:44 user nova-compute[74840]:     <acpi/>
Nov 08 12:15:44 user nova-compute[74840]:     <apic/>
Nov 08 12:15:44 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:15:44 user nova-compute[74840]:   </features>
Nov 08 12:15:44 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:15:44 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:15:44 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:15:44 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:15:44 user nova-compute[74840]:   </clock>
Nov 08 12:15:44 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:15:44 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:15:44 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:15:44 user nova-compute[74840]:   </cpu>
Nov 08 12:15:44 user nova-compute[74840]:   <devices>
Nov 08 12:15:44 user nova-compute[74840]:     <disk type="block" device="disk">
Nov 08 12:15:44 user nova-compute[74840]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:15:44 user nova-compute[74840]:       <source dev="/dev/sdb"/>
Nov 08 12:15:44 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:15:44 user nova-compute[74840]:       <serial>2a571b42-9e1d-4406-b369-12722b22f097</serial>
Nov 08 12:15:44 user nova-compute[74840]:     </disk>
Nov 08 12:15:44 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:15:44 user nova-compute[74840]:       <mac address="fa:16:3e:ee:6e:72"/>
Nov 08 12:15:44 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:15:44 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:15:44 user nova-compute[74840]:       <target dev="tapbd22c195-e8"/>
Nov 08 12:15:44 user nova-compute[74840]:     </interface>
Nov 08 12:15:44 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:15:44 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/28ccd7b3-8bbe-42e7-aa00-612b3703ae79/console.log" append="off"/>
Nov 08 12:15:44 user nova-compute[74840]:     </serial>
Nov 08 12:15:44 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:15:44 user nova-compute[74840]:     <video>
Nov 08 12:15:44 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:15:44 user nova-compute[74840]:     </video>
Nov 08 12:15:44 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:15:44 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:15:44 user nova-compute[74840]:     </rng>
Nov 08 12:15:44 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:15:44 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:15:44 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:15:44 user nova-compute[74840]:     </memballoon>
Nov 08 12:15:44 user nova-compute[74840]:   </devices>
Nov 08 12:15:44 user nova-compute[74840]: </domain>
Nov 08 12:15:44 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:15:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T12:11:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1277810806',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-791461388',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHpDLhfsQbuoiOAJZjQdzHvpPhC/nzLrrMQESJ5Ldi9eYg8zkak82Rki/GHtRFnLyoKBsr3ji4PDu9fap5vsgpePAUrrP6MvAc2bSYV1GEi6T2SkCHIaBKds2SkXizZsQ==',key_name='tempest-keypair-1117122950',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:12:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0c961954c4a0440a93d9738ca5ab0026',ramdisk_id='',reservation_id='r-pbsbcfi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-874131883',owner_user_name='tempest-ServerActionsV293TestJSON-874131883-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:15:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cab11962ef3472a864f830d45396c4c',uuid=28ccd7b3-8bbe-42e7-aa00-612b3703ae79,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd22c195-e803-484d-811a-aeeb04326bd0", "address": "fa:16:3e:ee:6e:72", "network": {"id": "d0c950e1-4e6d-42f7-bbbb-7164603882bc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1883968250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c961954c4a0440a93d9738ca5ab0026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd22c195-e8", "ovs_interfaceid": "bd22c195-e803-484d-811a-aeeb04326bd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:15:44 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Converting VIF {"id": "bd22c195-e803-484d-811a-aeeb04326bd0", "address": "fa:16:3e:ee:6e:72", "network": {"id": "d0c950e1-4e6d-42f7-bbbb-7164603882bc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1883968250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c961954c4a0440a93d9738ca5ab0026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd22c195-e8", "ovs_interfaceid": "bd22c195-e803-484d-811a-aeeb04326bd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:15:44 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:6e:72,bridge_name='br-int',has_traffic_filtering=True,id=bd22c195-e803-484d-811a-aeeb04326bd0,network=Network(d0c950e1-4e6d-42f7-bbbb-7164603882bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd22c195-e8') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:15:44 user nova-compute[74840]: DEBUG os_vif [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:6e:72,bridge_name='br-int',has_traffic_filtering=True,id=bd22c195-e803-484d-811a-aeeb04326bd0,network=Network(d0c950e1-4e6d-42f7-bbbb-7164603882bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd22c195-e8') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:15:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:15:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:15:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c831015d-30f5-5e52-92d1-aa678e757cf7', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:15:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:15:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd22c195-e8, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:15:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbd22c195-e8, col_values=(('qos', UUID('119d6dfb-acb2-4366-9e04-2e15dc86397b')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:15:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbd22c195-e8, col_values=(('external_ids', {'iface-id': 'bd22c195-e803-484d-811a-aeeb04326bd0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:6e:72', 'vm-uuid': '28ccd7b3-8bbe-42e7-aa00-612b3703ae79'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:15:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:15:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:44 user nova-compute[74840]: INFO os_vif [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:6e:72,bridge_name='br-int',has_traffic_filtering=True,id=bd22c195-e803-484d-811a-aeeb04326bd0,network=Network(d0c950e1-4e6d-42f7-bbbb-7164603882bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd22c195-e8')
Nov 08 12:15:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:15:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] No VIF found with MAC fa:16:3e:ee:6e:72, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:15:45 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:15:45 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:15:45 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "refresh_cache-3b10fda0-9488-4089-8033-dd1c8e42af89" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:15:45 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquired lock "refresh_cache-3b10fda0-9488-4089-8033-dd1c8e42af89" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:15:45 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Forcefully refreshing network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 12:15:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:46 user nova-compute[74840]: DEBUG nova.compute.manager [req-e2bc2995-4319-480b-b17a-ffe9b351bf0b req-5c4629f3-6084-47e9-a25b-6df2b97c9c56 service nova] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Received event network-vif-plugged-bd22c195-e803-484d-811a-aeeb04326bd0 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:15:46 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e2bc2995-4319-480b-b17a-ffe9b351bf0b req-5c4629f3-6084-47e9-a25b-6df2b97c9c56 service nova] Acquiring lock "28ccd7b3-8bbe-42e7-aa00-612b3703ae79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:15:46 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e2bc2995-4319-480b-b17a-ffe9b351bf0b req-5c4629f3-6084-47e9-a25b-6df2b97c9c56 service nova] Lock "28ccd7b3-8bbe-42e7-aa00-612b3703ae79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:15:46 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e2bc2995-4319-480b-b17a-ffe9b351bf0b req-5c4629f3-6084-47e9-a25b-6df2b97c9c56 service nova] Lock "28ccd7b3-8bbe-42e7-aa00-612b3703ae79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:15:46 user nova-compute[74840]: DEBUG nova.compute.manager [req-e2bc2995-4319-480b-b17a-ffe9b351bf0b req-5c4629f3-6084-47e9-a25b-6df2b97c9c56 service nova] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] No waiting events found dispatching network-vif-plugged-bd22c195-e803-484d-811a-aeeb04326bd0 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:15:46 user nova-compute[74840]: WARNING nova.compute.manager [req-e2bc2995-4319-480b-b17a-ffe9b351bf0b req-5c4629f3-6084-47e9-a25b-6df2b97c9c56 service nova] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Received unexpected event network-vif-plugged-bd22c195-e803-484d-811a-aeeb04326bd0 for instance with vm_state active and task_state rebuild_spawning.
Nov 08 12:15:46 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Updating instance_info_cache with network_info: [{"id": "b48b5298-045f-463d-9585-fbb5feb869bf", "address": "fa:16:3e:19:58:1f", "network": {"id": "9dec89b0-562f-482c-aec1-d024351d0bd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-237264167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a544910dc2c4b169c986fa74b5979d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48b5298-04", "ovs_interfaceid": "b48b5298-045f-463d-9585-fbb5feb869bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:15:46 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Releasing lock "refresh_cache-3b10fda0-9488-4089-8033-dd1c8e42af89" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:15:46 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Updated the network info_cache for instance {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 12:15:46 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:15:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:47 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "74a51b1b-103e-49b2-b7a0-ec4625a9445b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:15:47 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "74a51b1b-103e-49b2-b7a0-ec4625a9445b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:15:47 user nova-compute[74840]: DEBUG nova.compute.manager [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Starting instance... {{(pid=74840) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 12:15:47 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:15:47 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:15:47 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:15:47 user nova-compute[74840]: INFO nova.compute.claims [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Claim successful on node user
Nov 08 12:15:47 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:15:47 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:15:47 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:15:47 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:15:47 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:15:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.427s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:15:48 user nova-compute[74840]: DEBUG nova.compute.manager [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Start building networks asynchronously for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 12:15:48 user nova-compute[74840]: DEBUG nova.compute.manager [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Allocating IP information in the background. {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 12:15:48 user nova-compute[74840]: DEBUG nova.network.neutron [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 12:15:48 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 12:15:48 user nova-compute[74840]: DEBUG nova.compute.manager [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Start building block device mappings for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 12:15:48 user nova-compute[74840]: DEBUG nova.policy [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e172625e7f334a2b896b2738bbf49aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec082e08ddf4477a721e410fe944d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 12:15:48 user nova-compute[74840]: DEBUG nova.compute.manager [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Start spawning the instance on the hypervisor. {{(pid=74840) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 12:15:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:15:48 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Creating image(s)
Nov 08 12:15:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "/opt/stack/data/nova/instances/74a51b1b-103e-49b2-b7a0-ec4625a9445b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:15:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "/opt/stack/data/nova/instances/74a51b1b-103e-49b2-b7a0-ec4625a9445b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:15:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "/opt/stack/data/nova/instances/74a51b1b-103e-49b2-b7a0-ec4625a9445b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:15:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:48 user nova-compute[74840]: DEBUG nova.compute.manager [req-044a2a39-1a19-4d39-a05b-1d21fc87f9c3 req-2b1d9697-7ad8-4d47-acdb-2bcdcc41e5d0 service nova] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Received event network-vif-plugged-bd22c195-e803-484d-811a-aeeb04326bd0 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:15:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-044a2a39-1a19-4d39-a05b-1d21fc87f9c3 req-2b1d9697-7ad8-4d47-acdb-2bcdcc41e5d0 service nova] Acquiring lock "28ccd7b3-8bbe-42e7-aa00-612b3703ae79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:15:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-044a2a39-1a19-4d39-a05b-1d21fc87f9c3 req-2b1d9697-7ad8-4d47-acdb-2bcdcc41e5d0 service nova] Lock "28ccd7b3-8bbe-42e7-aa00-612b3703ae79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:15:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-044a2a39-1a19-4d39-a05b-1d21fc87f9c3 req-2b1d9697-7ad8-4d47-acdb-2bcdcc41e5d0 service nova] Lock "28ccd7b3-8bbe-42e7-aa00-612b3703ae79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:15:48 user nova-compute[74840]: DEBUG nova.compute.manager [req-044a2a39-1a19-4d39-a05b-1d21fc87f9c3 req-2b1d9697-7ad8-4d47-acdb-2bcdcc41e5d0 service nova] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] No waiting events found dispatching network-vif-plugged-bd22c195-e803-484d-811a-aeeb04326bd0 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:15:48 user nova-compute[74840]: WARNING nova.compute.manager [req-044a2a39-1a19-4d39-a05b-1d21fc87f9c3 req-2b1d9697-7ad8-4d47-acdb-2bcdcc41e5d0 service nova] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Received unexpected event network-vif-plugged-bd22c195-e803-484d-811a-aeeb04326bd0 for instance with vm_state active and task_state rebuild_spawning.
Nov 08 12:15:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.206s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "5d26578eba85497f494c575690c4248f381a0fe6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:15:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:15:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:48 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:15:48 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:15:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.213s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/74a51b1b-103e-49b2-b7a0-ec4625a9445b/disk 1073741824 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/74a51b1b-103e-49b2-b7a0-ec4625a9445b/disk 1073741824" returned: 0 in 0.050s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:15:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:48 user nova-compute[74840]: DEBUG nova.compute.manager [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:15:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:15:48 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Instance spawned successfully.
Nov 08 12:15:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:15:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Found default for hw_cdrom_bus of ide {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:15:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Found default for hw_disk_bus of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:15:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:15:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:15:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Found default for hw_video_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:15:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Found default for hw_vif_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:15:48 user nova-compute[74840]: DEBUG nova.network.neutron [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Successfully created port: b3920dbd-57a3-4469-a524-a98d45a157e1 {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:15:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.190s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:48 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Checking if we can resize image /opt/stack/data/nova/instances/74a51b1b-103e-49b2-b7a0-ec4625a9445b/disk. size=1073741824 {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 12:15:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74a51b1b-103e-49b2-b7a0-ec4625a9445b/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:49 user nova-compute[74840]: DEBUG nova.compute.manager [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:15:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:15:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:15:49 user nova-compute[74840]: DEBUG nova.objects.instance [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74840) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 08 12:15:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74a51b1b-103e-49b2-b7a0-ec4625a9445b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:49 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Cannot resize image /opt/stack/data/nova/instances/74a51b1b-103e-49b2-b7a0-ec4625a9445b/disk to a smaller size. {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 12:15:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Created local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 12:15:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Ensure instance console log exists: /opt/stack/data/nova/instances/74a51b1b-103e-49b2-b7a0-ec4625a9445b/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:15:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:15:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:15:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:15:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-63b5a08a-c2fd-41c6-92cf-c75e79699303 tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.114s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:15:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:49 user nova-compute[74840]: DEBUG nova.network.neutron [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Successfully updated port: b3920dbd-57a3-4469-a524-a98d45a157e1 {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:15:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "refresh_cache-74a51b1b-103e-49b2-b7a0-ec4625a9445b" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:15:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquired lock "refresh_cache-74a51b1b-103e-49b2-b7a0-ec4625a9445b" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:15:49 user nova-compute[74840]: DEBUG nova.network.neutron [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:15:49 user nova-compute[74840]: DEBUG nova.compute.manager [req-4713d93a-f3c8-4bd6-ba3b-170381e25f39 req-674a8072-ab49-4b75-a64b-e0a4aeee0abc service nova] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Received event network-changed-b3920dbd-57a3-4469-a524-a98d45a157e1 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:15:49 user nova-compute[74840]: DEBUG nova.compute.manager [req-4713d93a-f3c8-4bd6-ba3b-170381e25f39 req-674a8072-ab49-4b75-a64b-e0a4aeee0abc service nova] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Refreshing instance network info cache due to event network-changed-b3920dbd-57a3-4469-a524-a98d45a157e1. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:15:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4713d93a-f3c8-4bd6-ba3b-170381e25f39 req-674a8072-ab49-4b75-a64b-e0a4aeee0abc service nova] Acquiring lock "refresh_cache-74a51b1b-103e-49b2-b7a0-ec4625a9445b" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:15:49 user nova-compute[74840]: DEBUG nova.network.neutron [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:15:50 user nova-compute[74840]: DEBUG nova.network.neutron [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Updating instance_info_cache with network_info: [{"id": "b3920dbd-57a3-4469-a524-a98d45a157e1", "address": "fa:16:3e:c3:be:3a", "network": {"id": "381cad9f-376a-4335-95a4-4824aa0d7fad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1035058856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ec082e08ddf4477a721e410fe944d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3920dbd-57", "ovs_interfaceid": "b3920dbd-57a3-4469-a524-a98d45a157e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:15:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Releasing lock "refresh_cache-74a51b1b-103e-49b2-b7a0-ec4625a9445b" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:15:50 user nova-compute[74840]: DEBUG nova.compute.manager [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Instance network_info: |[{"id": "b3920dbd-57a3-4469-a524-a98d45a157e1", "address": "fa:16:3e:c3:be:3a", "network": {"id": "381cad9f-376a-4335-95a4-4824aa0d7fad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1035058856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ec082e08ddf4477a721e410fe944d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3920dbd-57", "ovs_interfaceid": "b3920dbd-57a3-4469-a524-a98d45a157e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 12:15:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4713d93a-f3c8-4bd6-ba3b-170381e25f39 req-674a8072-ab49-4b75-a64b-e0a4aeee0abc service nova] Acquired lock "refresh_cache-74a51b1b-103e-49b2-b7a0-ec4625a9445b" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:15:50 user nova-compute[74840]: DEBUG nova.network.neutron [req-4713d93a-f3c8-4bd6-ba3b-170381e25f39 req-674a8072-ab49-4b75-a64b-e0a4aeee0abc service nova] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Refreshing network info cache for port b3920dbd-57a3-4469-a524-a98d45a157e1 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:15:50 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Start _get_guest_xml network_info=[{"id": "b3920dbd-57a3-4469-a524-a98d45a157e1", "address": "fa:16:3e:c3:be:3a", "network": {"id": "381cad9f-376a-4335-95a4-4824aa0d7fad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1035058856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ec082e08ddf4477a721e410fe944d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3920dbd-57", "ovs_interfaceid": "b3920dbd-57a3-4469-a524-a98d45a157e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'image_id': '4fa17706-d304-4117-a420-dab994c703dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:15:50 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:15:50 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:15:50 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:15:50 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:15:50 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:15:50 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:15:50 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:15:50 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:15:50 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:15:50 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:15:50 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:15:50 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:15:50 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:15:50 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:15:50 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:15:50 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:15:50 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:15:50 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:15:50 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:15:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-997811358',display_name='tempest-AttachVolumeNegativeTest-server-997811358',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-997811358',id=15,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0EpesumeT5ZVSmj+pF7J8qaag6op2GaiMIIDfcaK76hF2pL8eLRNH6XNHeubEdLP+BiKMNcHj4kp4VPTKIg1DSwR8jLgaqIRzzEMvLlt1p+MMSyASF5VcHXZCF6MwB+w==',key_name='tempest-keypair-1355330745',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ec082e08ddf4477a721e410fe944d10',ramdisk_id='',reservation_id='r-fgxiq2gu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1526881991',owner_user_name='tempest-AttachVolumeNegativeTest-1526881991-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:15:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e172625e7f334a2b896b2738bbf49aa8',uuid=74a51b1b-103e-49b2-b7a0-ec4625a9445b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3920dbd-57a3-4469-a524-a98d45a157e1", "address": "fa:16:3e:c3:be:3a", "network": {"id": "381cad9f-376a-4335-95a4-4824aa0d7fad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1035058856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ec082e08ddf4477a721e410fe944d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3920dbd-57", "ovs_interfaceid": "b3920dbd-57a3-4469-a524-a98d45a157e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:15:50 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Converting VIF {"id": "b3920dbd-57a3-4469-a524-a98d45a157e1", "address": "fa:16:3e:c3:be:3a", "network": {"id": "381cad9f-376a-4335-95a4-4824aa0d7fad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1035058856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ec082e08ddf4477a721e410fe944d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3920dbd-57", "ovs_interfaceid": "b3920dbd-57a3-4469-a524-a98d45a157e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:15:50 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:be:3a,bridge_name='br-int',has_traffic_filtering=True,id=b3920dbd-57a3-4469-a524-a98d45a157e1,network=Network(381cad9f-376a-4335-95a4-4824aa0d7fad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3920dbd-57') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:15:50 user nova-compute[74840]: DEBUG nova.objects.instance [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lazy-loading 'pci_devices' on Instance uuid 74a51b1b-103e-49b2-b7a0-ec4625a9445b {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:15:50 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:15:50 user nova-compute[74840]:   <uuid>74a51b1b-103e-49b2-b7a0-ec4625a9445b</uuid>
Nov 08 12:15:50 user nova-compute[74840]:   <name>instance-0000000f</name>
Nov 08 12:15:50 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:15:50 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:15:50 user nova-compute[74840]:   <metadata>
Nov 08 12:15:50 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:15:50 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:15:50 user nova-compute[74840]:       <nova:name>tempest-AttachVolumeNegativeTest-server-997811358</nova:name>
Nov 08 12:15:50 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:15:50</nova:creationTime>
Nov 08 12:15:50 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:15:50 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:15:50 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:15:50 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:15:50 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:15:50 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:15:50 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:15:50 user nova-compute[74840]:       <nova:owner>
Nov 08 12:15:50 user nova-compute[74840]:         <nova:user uuid="e172625e7f334a2b896b2738bbf49aa8">tempest-AttachVolumeNegativeTest-1526881991-project-member</nova:user>
Nov 08 12:15:50 user nova-compute[74840]:         <nova:project uuid="3ec082e08ddf4477a721e410fe944d10">tempest-AttachVolumeNegativeTest-1526881991</nova:project>
Nov 08 12:15:50 user nova-compute[74840]:       </nova:owner>
Nov 08 12:15:50 user nova-compute[74840]:       <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:15:50 user nova-compute[74840]:       <nova:ports>
Nov 08 12:15:50 user nova-compute[74840]:         <nova:port uuid="b3920dbd-57a3-4469-a524-a98d45a157e1">
Nov 08 12:15:50 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 12:15:50 user nova-compute[74840]:         </nova:port>
Nov 08 12:15:50 user nova-compute[74840]:       </nova:ports>
Nov 08 12:15:50 user nova-compute[74840]:     </nova:instance>
Nov 08 12:15:50 user nova-compute[74840]:   </metadata>
Nov 08 12:15:50 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:15:50 user nova-compute[74840]:     <system>
Nov 08 12:15:50 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:15:50 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:15:50 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:15:50 user nova-compute[74840]:       <entry name="serial">74a51b1b-103e-49b2-b7a0-ec4625a9445b</entry>
Nov 08 12:15:50 user nova-compute[74840]:       <entry name="uuid">74a51b1b-103e-49b2-b7a0-ec4625a9445b</entry>
Nov 08 12:15:50 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:15:50 user nova-compute[74840]:     </system>
Nov 08 12:15:50 user nova-compute[74840]:   </sysinfo>
Nov 08 12:15:50 user nova-compute[74840]:   <os>
Nov 08 12:15:50 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:15:50 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:15:50 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:15:50 user nova-compute[74840]:   </os>
Nov 08 12:15:50 user nova-compute[74840]:   <features>
Nov 08 12:15:50 user nova-compute[74840]:     <acpi/>
Nov 08 12:15:50 user nova-compute[74840]:     <apic/>
Nov 08 12:15:50 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:15:50 user nova-compute[74840]:   </features>
Nov 08 12:15:50 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:15:50 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:15:50 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:15:50 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:15:50 user nova-compute[74840]:   </clock>
Nov 08 12:15:50 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:15:50 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:15:50 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:15:50 user nova-compute[74840]:   </cpu>
Nov 08 12:15:50 user nova-compute[74840]:   <devices>
Nov 08 12:15:50 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:15:50 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:15:50 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/74a51b1b-103e-49b2-b7a0-ec4625a9445b/disk"/>
Nov 08 12:15:50 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:15:50 user nova-compute[74840]:     </disk>
Nov 08 12:15:50 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:15:50 user nova-compute[74840]:       <mac address="fa:16:3e:c3:be:3a"/>
Nov 08 12:15:50 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:15:50 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:15:50 user nova-compute[74840]:       <target dev="tapb3920dbd-57"/>
Nov 08 12:15:50 user nova-compute[74840]:     </interface>
Nov 08 12:15:50 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:15:50 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/74a51b1b-103e-49b2-b7a0-ec4625a9445b/console.log" append="off"/>
Nov 08 12:15:50 user nova-compute[74840]:     </serial>
Nov 08 12:15:50 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:15:50 user nova-compute[74840]:     <video>
Nov 08 12:15:50 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:15:50 user nova-compute[74840]:     </video>
Nov 08 12:15:50 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:15:50 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:15:50 user nova-compute[74840]:     </rng>
Nov 08 12:15:50 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:15:50 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:15:50 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:15:50 user nova-compute[74840]:     </memballoon>
Nov 08 12:15:50 user nova-compute[74840]:   </devices>
Nov 08 12:15:50 user nova-compute[74840]: </domain>
Nov 08 12:15:50 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:15:50 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:15:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-997811358',display_name='tempest-AttachVolumeNegativeTest-server-997811358',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-997811358',id=15,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0EpesumeT5ZVSmj+pF7J8qaag6op2GaiMIIDfcaK76hF2pL8eLRNH6XNHeubEdLP+BiKMNcHj4kp4VPTKIg1DSwR8jLgaqIRzzEMvLlt1p+MMSyASF5VcHXZCF6MwB+w==',key_name='tempest-keypair-1355330745',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ec082e08ddf4477a721e410fe944d10',ramdisk_id='',reservation_id='r-fgxiq2gu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1526881991',owner_user_name='tempest-AttachVolumeNegativeTest-1526881991-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:15:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e172625e7f334a2b896b2738bbf49aa8',uuid=74a51b1b-103e-49b2-b7a0-ec4625a9445b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3920dbd-57a3-4469-a524-a98d45a157e1", "address": "fa:16:3e:c3:be:3a", "network": {"id": "381cad9f-376a-4335-95a4-4824aa0d7fad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1035058856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ec082e08ddf4477a721e410fe944d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3920dbd-57", "ovs_interfaceid": "b3920dbd-57a3-4469-a524-a98d45a157e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:15:50 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Converting VIF {"id": "b3920dbd-57a3-4469-a524-a98d45a157e1", "address": "fa:16:3e:c3:be:3a", "network": {"id": "381cad9f-376a-4335-95a4-4824aa0d7fad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1035058856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ec082e08ddf4477a721e410fe944d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3920dbd-57", "ovs_interfaceid": "b3920dbd-57a3-4469-a524-a98d45a157e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:15:50 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:be:3a,bridge_name='br-int',has_traffic_filtering=True,id=b3920dbd-57a3-4469-a524-a98d45a157e1,network=Network(381cad9f-376a-4335-95a4-4824aa0d7fad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3920dbd-57') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:15:50 user nova-compute[74840]: DEBUG os_vif [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:be:3a,bridge_name='br-int',has_traffic_filtering=True,id=b3920dbd-57a3-4469-a524-a98d45a157e1,network=Network(381cad9f-376a-4335-95a4-4824aa0d7fad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3920dbd-57') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:15:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:15:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:15:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2d9f2859-4081-5229-9f73-fc94e8e9adc1', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:15:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:15:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3920dbd-57, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:15:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb3920dbd-57, col_values=(('qos', UUID('1f6fa3fc-d526-4826-9061-1abbc456940a')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:15:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb3920dbd-57, col_values=(('external_ids', {'iface-id': 'b3920dbd-57a3-4469-a524-a98d45a157e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:be:3a', 'vm-uuid': '74a51b1b-103e-49b2-b7a0-ec4625a9445b'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:15:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:15:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:50 user nova-compute[74840]: INFO os_vif [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:be:3a,bridge_name='br-int',has_traffic_filtering=True,id=b3920dbd-57a3-4469-a524-a98d45a157e1,network=Network(381cad9f-376a-4335-95a4-4824aa0d7fad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3920dbd-57')
Nov 08 12:15:50 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:15:50 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] No VIF found with MAC fa:16:3e:c3:be:3a, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:15:50 user nova-compute[74840]: DEBUG nova.network.neutron [req-4713d93a-f3c8-4bd6-ba3b-170381e25f39 req-674a8072-ab49-4b75-a64b-e0a4aeee0abc service nova] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Updated VIF entry in instance network info cache for port b3920dbd-57a3-4469-a524-a98d45a157e1. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:15:50 user nova-compute[74840]: DEBUG nova.network.neutron [req-4713d93a-f3c8-4bd6-ba3b-170381e25f39 req-674a8072-ab49-4b75-a64b-e0a4aeee0abc service nova] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Updating instance_info_cache with network_info: [{"id": "b3920dbd-57a3-4469-a524-a98d45a157e1", "address": "fa:16:3e:c3:be:3a", "network": {"id": "381cad9f-376a-4335-95a4-4824aa0d7fad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1035058856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ec082e08ddf4477a721e410fe944d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3920dbd-57", "ovs_interfaceid": "b3920dbd-57a3-4469-a524-a98d45a157e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:15:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4713d93a-f3c8-4bd6-ba3b-170381e25f39 req-674a8072-ab49-4b75-a64b-e0a4aeee0abc service nova] Releasing lock "refresh_cache-74a51b1b-103e-49b2-b7a0-ec4625a9445b" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:15:50 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:15:50 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:15:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:15:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:15:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:15:50 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:15:51 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:51 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:51 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:51 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:51 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:52 user nova-compute[74840]: DEBUG nova.compute.manager [req-47f04ba6-02ad-4f20-b93d-f1fd2981c3fa req-83171a6c-6fc1-4794-ac09-38f14d5015ee service nova] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Received event network-vif-plugged-b3920dbd-57a3-4469-a524-a98d45a157e1 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:15:52 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-47f04ba6-02ad-4f20-b93d-f1fd2981c3fa req-83171a6c-6fc1-4794-ac09-38f14d5015ee service nova] Acquiring lock "74a51b1b-103e-49b2-b7a0-ec4625a9445b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:15:52 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-47f04ba6-02ad-4f20-b93d-f1fd2981c3fa req-83171a6c-6fc1-4794-ac09-38f14d5015ee service nova] Lock "74a51b1b-103e-49b2-b7a0-ec4625a9445b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:15:52 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-47f04ba6-02ad-4f20-b93d-f1fd2981c3fa req-83171a6c-6fc1-4794-ac09-38f14d5015ee service nova] Lock "74a51b1b-103e-49b2-b7a0-ec4625a9445b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:15:52 user nova-compute[74840]: DEBUG nova.compute.manager [req-47f04ba6-02ad-4f20-b93d-f1fd2981c3fa req-83171a6c-6fc1-4794-ac09-38f14d5015ee service nova] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] No waiting events found dispatching network-vif-plugged-b3920dbd-57a3-4469-a524-a98d45a157e1 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:15:52 user nova-compute[74840]: WARNING nova.compute.manager [req-47f04ba6-02ad-4f20-b93d-f1fd2981c3fa req-83171a6c-6fc1-4794-ac09-38f14d5015ee service nova] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Received unexpected event network-vif-plugged-b3920dbd-57a3-4469-a524-a98d45a157e1 for instance with vm_state building and task_state spawning.
Nov 08 12:15:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf/disk --force-share --output=json" returned: 0 in 0.305s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:53 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:15:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0b7a0e1-d0d1-4682-9218-ef44d1e461f1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0b7a0e1-d0d1-4682-9218-ef44d1e461f1/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0b7a0e1-d0d1-4682-9218-ef44d1e461f1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0b7a0e1-d0d1-4682-9218-ef44d1e461f1/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74a51b1b-103e-49b2-b7a0-ec4625a9445b/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74a51b1b-103e-49b2-b7a0-ec4625a9445b/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74a51b1b-103e-49b2-b7a0-ec4625a9445b/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:54 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74a51b1b-103e-49b2-b7a0-ec4625a9445b/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:54 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/684b8be2-7f8f-499f-8885-c9d1c86eef2f/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:54 user nova-compute[74840]: DEBUG nova.compute.manager [req-5f53a69c-25f6-4eb1-a419-aec1d0fe02f7 req-60ec4f53-a209-48bb-a9f0-77cfd42e8bc5 service nova] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Received event network-vif-plugged-b3920dbd-57a3-4469-a524-a98d45a157e1 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:15:54 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-5f53a69c-25f6-4eb1-a419-aec1d0fe02f7 req-60ec4f53-a209-48bb-a9f0-77cfd42e8bc5 service nova] Acquiring lock "74a51b1b-103e-49b2-b7a0-ec4625a9445b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:15:54 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-5f53a69c-25f6-4eb1-a419-aec1d0fe02f7 req-60ec4f53-a209-48bb-a9f0-77cfd42e8bc5 service nova] Lock "74a51b1b-103e-49b2-b7a0-ec4625a9445b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:15:54 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-5f53a69c-25f6-4eb1-a419-aec1d0fe02f7 req-60ec4f53-a209-48bb-a9f0-77cfd42e8bc5 service nova] Lock "74a51b1b-103e-49b2-b7a0-ec4625a9445b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:15:54 user nova-compute[74840]: DEBUG nova.compute.manager [req-5f53a69c-25f6-4eb1-a419-aec1d0fe02f7 req-60ec4f53-a209-48bb-a9f0-77cfd42e8bc5 service nova] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] No waiting events found dispatching network-vif-plugged-b3920dbd-57a3-4469-a524-a98d45a157e1 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:15:54 user nova-compute[74840]: WARNING nova.compute.manager [req-5f53a69c-25f6-4eb1-a419-aec1d0fe02f7 req-60ec4f53-a209-48bb-a9f0-77cfd42e8bc5 service nova] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Received unexpected event network-vif-plugged-b3920dbd-57a3-4469-a524-a98d45a157e1 for instance with vm_state building and task_state spawning.
Nov 08 12:15:54 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/684b8be2-7f8f-499f-8885-c9d1c86eef2f/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:54 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/684b8be2-7f8f-499f-8885-c9d1c86eef2f/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:54 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/684b8be2-7f8f-499f-8885-c9d1c86eef2f/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:54 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eea27317-7454-4b5c-8d01-7976255a31bd/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:54 user nova-compute[74840]: DEBUG nova.compute.manager [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:15:54 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:15:54 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Instance spawned successfully.
Nov 08 12:15:54 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:15:54 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Found default for hw_cdrom_bus of ide {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:15:54 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Found default for hw_disk_bus of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:15:54 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:15:54 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:15:54 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Found default for hw_video_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:15:54 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Found default for hw_vif_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:15:54 user nova-compute[74840]: INFO nova.compute.manager [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Took 6.68 seconds to spawn the instance on the hypervisor.
Nov 08 12:15:54 user nova-compute[74840]: DEBUG nova.compute.manager [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:15:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eea27317-7454-4b5c-8d01-7976255a31bd/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eea27317-7454-4b5c-8d01-7976255a31bd/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:55 user nova-compute[74840]: INFO nova.compute.manager [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Took 7.60 seconds to build instance.
Nov 08 12:15:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-a0dd57f0-288c-4913-9110-dec9a030a0ae tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "74a51b1b-103e-49b2-b7a0-ec4625a9445b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.772s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:15:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eea27317-7454-4b5c-8d01-7976255a31bd/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:55 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:15:55 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:15:55 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=8079MB free_disk=25.394084930419922GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:15:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:15:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:15:55 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 684b8be2-7f8f-499f-8885-c9d1c86eef2f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:15:55 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 28ccd7b3-8bbe-42e7-aa00-612b3703ae79 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:15:55 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance a0b7a0e1-d0d1-4682-9218-ef44d1e461f1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:15:55 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 3b10fda0-9488-4089-8033-dd1c8e42af89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:15:55 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance eea27317-7454-4b5c-8d01-7976255a31bd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:15:55 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:15:55 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 74a51b1b-103e-49b2-b7a0-ec4625a9445b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:15:55 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:15:55 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:15:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:15:56 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:15:56 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:15:56 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:15:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.591s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:15:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Acquiring lock "4c7b5726-907f-4ae3-aba0-b58351106717" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:15:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Lock "4c7b5726-907f-4ae3-aba0-b58351106717" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:15:58 user nova-compute[74840]: DEBUG nova.compute.manager [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Starting instance... {{(pid=74840) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 12:15:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:15:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:15:58 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:15:58 user nova-compute[74840]: INFO nova.compute.claims [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Claim successful on node user
Nov 08 12:15:59 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:15:59 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:15:59 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:15:59 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.570s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:15:59 user nova-compute[74840]: DEBUG nova.compute.manager [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Start building networks asynchronously for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 12:15:59 user nova-compute[74840]: DEBUG nova.compute.manager [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Allocating IP information in the background. {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 12:15:59 user nova-compute[74840]: DEBUG nova.network.neutron [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 12:15:59 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 12:15:59 user nova-compute[74840]: DEBUG nova.compute.manager [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Start building block device mappings for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 12:15:59 user nova-compute[74840]: DEBUG nova.policy [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '82d4449a578d4eb99cb9159a9cb35bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee170af16c94cb0ac38095060bcb498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 12:15:59 user nova-compute[74840]: DEBUG nova.compute.manager [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Start spawning the instance on the hypervisor. {{(pid=74840) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 12:15:59 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:15:59 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Creating image(s)
Nov 08 12:15:59 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Acquiring lock "/opt/stack/data/nova/instances/4c7b5726-907f-4ae3-aba0-b58351106717/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:15:59 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Lock "/opt/stack/data/nova/instances/4c7b5726-907f-4ae3-aba0-b58351106717/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:15:59 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Lock "/opt/stack/data/nova/instances/4c7b5726-907f-4ae3-aba0-b58351106717/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:15:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:15:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.187s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:15:59 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Acquiring lock "5d26578eba85497f494c575690c4248f381a0fe6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:15:59 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:15:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:16:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.187s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:16:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/4c7b5726-907f-4ae3-aba0-b58351106717/disk 1073741824 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:16:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/4c7b5726-907f-4ae3-aba0-b58351106717/disk 1073741824" returned: 0 in 0.052s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:16:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:16:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:16:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.204s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:16:00 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4c7b5726-907f-4ae3-aba0-b58351106717/disk. size=1073741824 {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 12:16:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c7b5726-907f-4ae3-aba0-b58351106717/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:16:00 user nova-compute[74840]: DEBUG nova.network.neutron [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Successfully created port: 4faa22f9-4e0d-45de-bb90-8348b96c1268 {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:16:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c7b5726-907f-4ae3-aba0-b58351106717/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:16:00 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Cannot resize image /opt/stack/data/nova/instances/4c7b5726-907f-4ae3-aba0-b58351106717/disk to a smaller size. {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 12:16:00 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Created local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 12:16:00 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Ensure instance console log exists: /opt/stack/data/nova/instances/4c7b5726-907f-4ae3-aba0-b58351106717/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:16:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:16:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:16:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG nova.network.neutron [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Successfully updated port: 4faa22f9-4e0d-45de-bb90-8348b96c1268 {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Acquiring lock "refresh_cache-4c7b5726-907f-4ae3-aba0-b58351106717" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Acquired lock "refresh_cache-4c7b5726-907f-4ae3-aba0-b58351106717" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG nova.network.neutron [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG nova.compute.manager [req-1687a461-ae1d-4cd5-8810-7e4c429fa3e0 req-2db5d0e4-7a9d-49fb-bbcd-f7775d245342 service nova] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Received event network-changed-4faa22f9-4e0d-45de-bb90-8348b96c1268 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG nova.compute.manager [req-1687a461-ae1d-4cd5-8810-7e4c429fa3e0 req-2db5d0e4-7a9d-49fb-bbcd-f7775d245342 service nova] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Refreshing instance network info cache due to event network-changed-4faa22f9-4e0d-45de-bb90-8348b96c1268. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-1687a461-ae1d-4cd5-8810-7e4c429fa3e0 req-2db5d0e4-7a9d-49fb-bbcd-f7775d245342 service nova] Acquiring lock "refresh_cache-4c7b5726-907f-4ae3-aba0-b58351106717" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG nova.network.neutron [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG nova.network.neutron [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Updating instance_info_cache with network_info: [{"id": "4faa22f9-4e0d-45de-bb90-8348b96c1268", "address": "fa:16:3e:72:b1:f7", "network": {"id": "fcca035f-b03c-407d-99c5-4e1a46ef8354", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1402418482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aee170af16c94cb0ac38095060bcb498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4faa22f9-4e", "ovs_interfaceid": "4faa22f9-4e0d-45de-bb90-8348b96c1268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Releasing lock "refresh_cache-4c7b5726-907f-4ae3-aba0-b58351106717" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG nova.compute.manager [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Instance network_info: |[{"id": "4faa22f9-4e0d-45de-bb90-8348b96c1268", "address": "fa:16:3e:72:b1:f7", "network": {"id": "fcca035f-b03c-407d-99c5-4e1a46ef8354", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1402418482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aee170af16c94cb0ac38095060bcb498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4faa22f9-4e", "ovs_interfaceid": "4faa22f9-4e0d-45de-bb90-8348b96c1268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-1687a461-ae1d-4cd5-8810-7e4c429fa3e0 req-2db5d0e4-7a9d-49fb-bbcd-f7775d245342 service nova] Acquired lock "refresh_cache-4c7b5726-907f-4ae3-aba0-b58351106717" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG nova.network.neutron [req-1687a461-ae1d-4cd5-8810-7e4c429fa3e0 req-2db5d0e4-7a9d-49fb-bbcd-f7775d245342 service nova] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Refreshing network info cache for port 4faa22f9-4e0d-45de-bb90-8348b96c1268 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Start _get_guest_xml network_info=[{"id": "4faa22f9-4e0d-45de-bb90-8348b96c1268", "address": "fa:16:3e:72:b1:f7", "network": {"id": "fcca035f-b03c-407d-99c5-4e1a46ef8354", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1402418482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aee170af16c94cb0ac38095060bcb498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4faa22f9-4e", "ovs_interfaceid": "4faa22f9-4e0d-45de-bb90-8348b96c1268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'image_id': '4fa17706-d304-4117-a420-dab994c703dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:16:01 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:16:01 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:16:01 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:15:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1414983349',display_name='tempest-VolumesActionsTest-instance-1414983349',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1414983349',id=16,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aee170af16c94cb0ac38095060bcb498',ramdisk_id='',reservation_id='r-zlm0ojpd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-549796604',owner_user_name='tempest-VolumesActionsTest-549796604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:16:00Z,user_data=None,user_id='82d4449a578d4eb99cb9159a9cb35bf1',uuid=4c7b5726-907f-4ae3-aba0-b58351106717,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4faa22f9-4e0d-45de-bb90-8348b96c1268", "address": "fa:16:3e:72:b1:f7", "network": {"id": "fcca035f-b03c-407d-99c5-4e1a46ef8354", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1402418482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aee170af16c94cb0ac38095060bcb498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4faa22f9-4e", "ovs_interfaceid": "4faa22f9-4e0d-45de-bb90-8348b96c1268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Converting VIF {"id": "4faa22f9-4e0d-45de-bb90-8348b96c1268", "address": "fa:16:3e:72:b1:f7", "network": {"id": "fcca035f-b03c-407d-99c5-4e1a46ef8354", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1402418482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aee170af16c94cb0ac38095060bcb498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4faa22f9-4e", "ovs_interfaceid": "4faa22f9-4e0d-45de-bb90-8348b96c1268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:b1:f7,bridge_name='br-int',has_traffic_filtering=True,id=4faa22f9-4e0d-45de-bb90-8348b96c1268,network=Network(fcca035f-b03c-407d-99c5-4e1a46ef8354),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4faa22f9-4e') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG nova.objects.instance [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Lazy-loading 'pci_devices' on Instance uuid 4c7b5726-907f-4ae3-aba0-b58351106717 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:16:01 user nova-compute[74840]:   <uuid>4c7b5726-907f-4ae3-aba0-b58351106717</uuid>
Nov 08 12:16:01 user nova-compute[74840]:   <name>instance-00000010</name>
Nov 08 12:16:01 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:16:01 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:16:01 user nova-compute[74840]:   <metadata>
Nov 08 12:16:01 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:16:01 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:16:01 user nova-compute[74840]:       <nova:name>tempest-VolumesActionsTest-instance-1414983349</nova:name>
Nov 08 12:16:01 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:16:01</nova:creationTime>
Nov 08 12:16:01 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:16:01 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:16:01 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:16:01 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:16:01 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:16:01 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:16:01 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:16:01 user nova-compute[74840]:       <nova:owner>
Nov 08 12:16:01 user nova-compute[74840]:         <nova:user uuid="82d4449a578d4eb99cb9159a9cb35bf1">tempest-VolumesActionsTest-549796604-project-member</nova:user>
Nov 08 12:16:01 user nova-compute[74840]:         <nova:project uuid="aee170af16c94cb0ac38095060bcb498">tempest-VolumesActionsTest-549796604</nova:project>
Nov 08 12:16:01 user nova-compute[74840]:       </nova:owner>
Nov 08 12:16:01 user nova-compute[74840]:       <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:16:01 user nova-compute[74840]:       <nova:ports>
Nov 08 12:16:01 user nova-compute[74840]:         <nova:port uuid="4faa22f9-4e0d-45de-bb90-8348b96c1268">
Nov 08 12:16:01 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 08 12:16:01 user nova-compute[74840]:         </nova:port>
Nov 08 12:16:01 user nova-compute[74840]:       </nova:ports>
Nov 08 12:16:01 user nova-compute[74840]:     </nova:instance>
Nov 08 12:16:01 user nova-compute[74840]:   </metadata>
Nov 08 12:16:01 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:16:01 user nova-compute[74840]:     <system>
Nov 08 12:16:01 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:16:01 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:16:01 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:16:01 user nova-compute[74840]:       <entry name="serial">4c7b5726-907f-4ae3-aba0-b58351106717</entry>
Nov 08 12:16:01 user nova-compute[74840]:       <entry name="uuid">4c7b5726-907f-4ae3-aba0-b58351106717</entry>
Nov 08 12:16:01 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:16:01 user nova-compute[74840]:     </system>
Nov 08 12:16:01 user nova-compute[74840]:   </sysinfo>
Nov 08 12:16:01 user nova-compute[74840]:   <os>
Nov 08 12:16:01 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:16:01 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:16:01 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:16:01 user nova-compute[74840]:   </os>
Nov 08 12:16:01 user nova-compute[74840]:   <features>
Nov 08 12:16:01 user nova-compute[74840]:     <acpi/>
Nov 08 12:16:01 user nova-compute[74840]:     <apic/>
Nov 08 12:16:01 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:16:01 user nova-compute[74840]:   </features>
Nov 08 12:16:01 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:16:01 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:16:01 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:16:01 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:16:01 user nova-compute[74840]:   </clock>
Nov 08 12:16:01 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:16:01 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:16:01 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:16:01 user nova-compute[74840]:   </cpu>
Nov 08 12:16:01 user nova-compute[74840]:   <devices>
Nov 08 12:16:01 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:16:01 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:16:01 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/4c7b5726-907f-4ae3-aba0-b58351106717/disk"/>
Nov 08 12:16:01 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:16:01 user nova-compute[74840]:     </disk>
Nov 08 12:16:01 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:16:01 user nova-compute[74840]:       <mac address="fa:16:3e:72:b1:f7"/>
Nov 08 12:16:01 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:16:01 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:16:01 user nova-compute[74840]:       <target dev="tap4faa22f9-4e"/>
Nov 08 12:16:01 user nova-compute[74840]:     </interface>
Nov 08 12:16:01 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:16:01 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/4c7b5726-907f-4ae3-aba0-b58351106717/console.log" append="off"/>
Nov 08 12:16:01 user nova-compute[74840]:     </serial>
Nov 08 12:16:01 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:16:01 user nova-compute[74840]:     <video>
Nov 08 12:16:01 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:16:01 user nova-compute[74840]:     </video>
Nov 08 12:16:01 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:16:01 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:16:01 user nova-compute[74840]:     </rng>
Nov 08 12:16:01 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:16:01 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:16:01 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:16:01 user nova-compute[74840]:     </memballoon>
Nov 08 12:16:01 user nova-compute[74840]:   </devices>
Nov 08 12:16:01 user nova-compute[74840]: </domain>
Nov 08 12:16:01 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:15:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1414983349',display_name='tempest-VolumesActionsTest-instance-1414983349',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1414983349',id=16,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aee170af16c94cb0ac38095060bcb498',ramdisk_id='',reservation_id='r-zlm0ojpd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-549796604',owner_user_name='tempest-VolumesActionsTest-549796604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:16:00Z,user_data=None,user_id='82d4449a578d4eb99cb9159a9cb35bf1',uuid=4c7b5726-907f-4ae3-aba0-b58351106717,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4faa22f9-4e0d-45de-bb90-8348b96c1268", "address": "fa:16:3e:72:b1:f7", "network": {"id": "fcca035f-b03c-407d-99c5-4e1a46ef8354", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1402418482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aee170af16c94cb0ac38095060bcb498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4faa22f9-4e", "ovs_interfaceid": "4faa22f9-4e0d-45de-bb90-8348b96c1268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Converting VIF {"id": "4faa22f9-4e0d-45de-bb90-8348b96c1268", "address": "fa:16:3e:72:b1:f7", "network": {"id": "fcca035f-b03c-407d-99c5-4e1a46ef8354", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1402418482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aee170af16c94cb0ac38095060bcb498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4faa22f9-4e", "ovs_interfaceid": "4faa22f9-4e0d-45de-bb90-8348b96c1268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:b1:f7,bridge_name='br-int',has_traffic_filtering=True,id=4faa22f9-4e0d-45de-bb90-8348b96c1268,network=Network(fcca035f-b03c-407d-99c5-4e1a46ef8354),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4faa22f9-4e') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG os_vif [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:b1:f7,bridge_name='br-int',has_traffic_filtering=True,id=4faa22f9-4e0d-45de-bb90-8348b96c1268,network=Network(fcca035f-b03c-407d-99c5-4e1a46ef8354),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4faa22f9-4e') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '999eae59-0759-5fe5-b5db-45189715902a', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4faa22f9-4e, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4faa22f9-4e, col_values=(('qos', UUID('94dff163-7d93-424e-a3fb-7f48c0d4980c')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4faa22f9-4e, col_values=(('external_ids', {'iface-id': '4faa22f9-4e0d-45de-bb90-8348b96c1268', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:b1:f7', 'vm-uuid': '4c7b5726-907f-4ae3-aba0-b58351106717'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:01 user nova-compute[74840]: INFO os_vif [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:b1:f7,bridge_name='br-int',has_traffic_filtering=True,id=4faa22f9-4e0d-45de-bb90-8348b96c1268,network=Network(fcca035f-b03c-407d-99c5-4e1a46ef8354),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4faa22f9-4e')
Nov 08 12:16:01 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:16:01 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] No VIF found with MAC fa:16:3e:72:b1:f7, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:16:02 user nova-compute[74840]: DEBUG nova.network.neutron [req-1687a461-ae1d-4cd5-8810-7e4c429fa3e0 req-2db5d0e4-7a9d-49fb-bbcd-f7775d245342 service nova] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Updated VIF entry in instance network info cache for port 4faa22f9-4e0d-45de-bb90-8348b96c1268. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:16:02 user nova-compute[74840]: DEBUG nova.network.neutron [req-1687a461-ae1d-4cd5-8810-7e4c429fa3e0 req-2db5d0e4-7a9d-49fb-bbcd-f7775d245342 service nova] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Updating instance_info_cache with network_info: [{"id": "4faa22f9-4e0d-45de-bb90-8348b96c1268", "address": "fa:16:3e:72:b1:f7", "network": {"id": "fcca035f-b03c-407d-99c5-4e1a46ef8354", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1402418482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aee170af16c94cb0ac38095060bcb498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4faa22f9-4e", "ovs_interfaceid": "4faa22f9-4e0d-45de-bb90-8348b96c1268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:16:02 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-1687a461-ae1d-4cd5-8810-7e4c429fa3e0 req-2db5d0e4-7a9d-49fb-bbcd-f7775d245342 service nova] Releasing lock "refresh_cache-4c7b5726-907f-4ae3-aba0-b58351106717" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:16:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:03 user nova-compute[74840]: DEBUG nova.compute.manager [req-d25fc1e3-413c-4441-903a-fbf7ed663264 req-bde20cf8-5f5c-4b91-8f89-0db4450c6698 service nova] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Received event network-vif-plugged-4faa22f9-4e0d-45de-bb90-8348b96c1268 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:16:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-d25fc1e3-413c-4441-903a-fbf7ed663264 req-bde20cf8-5f5c-4b91-8f89-0db4450c6698 service nova] Acquiring lock "4c7b5726-907f-4ae3-aba0-b58351106717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:16:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-d25fc1e3-413c-4441-903a-fbf7ed663264 req-bde20cf8-5f5c-4b91-8f89-0db4450c6698 service nova] Lock "4c7b5726-907f-4ae3-aba0-b58351106717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:16:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-d25fc1e3-413c-4441-903a-fbf7ed663264 req-bde20cf8-5f5c-4b91-8f89-0db4450c6698 service nova] Lock "4c7b5726-907f-4ae3-aba0-b58351106717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:16:03 user nova-compute[74840]: DEBUG nova.compute.manager [req-d25fc1e3-413c-4441-903a-fbf7ed663264 req-bde20cf8-5f5c-4b91-8f89-0db4450c6698 service nova] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] No waiting events found dispatching network-vif-plugged-4faa22f9-4e0d-45de-bb90-8348b96c1268 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:16:03 user nova-compute[74840]: WARNING nova.compute.manager [req-d25fc1e3-413c-4441-903a-fbf7ed663264 req-bde20cf8-5f5c-4b91-8f89-0db4450c6698 service nova] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Received unexpected event network-vif-plugged-4faa22f9-4e0d-45de-bb90-8348b96c1268 for instance with vm_state building and task_state spawning.
Nov 08 12:16:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:05 user nova-compute[74840]: DEBUG nova.compute.manager [req-a96efa89-1b64-478f-a441-f65073bbded3 req-345b8061-4e48-4664-99cc-a94eefee30cb service nova] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Received event network-vif-plugged-4faa22f9-4e0d-45de-bb90-8348b96c1268 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:16:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a96efa89-1b64-478f-a441-f65073bbded3 req-345b8061-4e48-4664-99cc-a94eefee30cb service nova] Acquiring lock "4c7b5726-907f-4ae3-aba0-b58351106717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:16:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a96efa89-1b64-478f-a441-f65073bbded3 req-345b8061-4e48-4664-99cc-a94eefee30cb service nova] Lock "4c7b5726-907f-4ae3-aba0-b58351106717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:16:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a96efa89-1b64-478f-a441-f65073bbded3 req-345b8061-4e48-4664-99cc-a94eefee30cb service nova] Lock "4c7b5726-907f-4ae3-aba0-b58351106717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:16:05 user nova-compute[74840]: DEBUG nova.compute.manager [req-a96efa89-1b64-478f-a441-f65073bbded3 req-345b8061-4e48-4664-99cc-a94eefee30cb service nova] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] No waiting events found dispatching network-vif-plugged-4faa22f9-4e0d-45de-bb90-8348b96c1268 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:16:05 user nova-compute[74840]: WARNING nova.compute.manager [req-a96efa89-1b64-478f-a441-f65073bbded3 req-345b8061-4e48-4664-99cc-a94eefee30cb service nova] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Received unexpected event network-vif-plugged-4faa22f9-4e0d-45de-bb90-8348b96c1268 for instance with vm_state building and task_state spawning.
Nov 08 12:16:06 user nova-compute[74840]: DEBUG nova.compute.manager [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:16:06 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:16:06 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Instance spawned successfully.
Nov 08 12:16:06 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:16:06 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Found default for hw_cdrom_bus of ide {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:16:06 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Found default for hw_disk_bus of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:16:06 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:16:06 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:16:06 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Found default for hw_video_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:16:06 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Found default for hw_vif_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:16:06 user nova-compute[74840]: INFO nova.compute.manager [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Took 6.45 seconds to spawn the instance on the hypervisor.
Nov 08 12:16:06 user nova-compute[74840]: DEBUG nova.compute.manager [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:16:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:06 user nova-compute[74840]: INFO nova.compute.manager [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Took 7.45 seconds to build instance.
Nov 08 12:16:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-79c4e4f9-3dae-4a9b-8041-bef7735ffaf8 tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Lock "4c7b5726-907f-4ae3-aba0-b58351106717" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.576s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:16:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:25 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:25 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Starting finish_revert_migration {{(pid=74840) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 08 12:16:25 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Start _get_guest_xml network_info=[{"id": "b48b5298-045f-463d-9585-fbb5feb869bf", "address": "fa:16:3e:19:58:1f", "network": {"id": "9dec89b0-562f-482c-aec1-d024351d0bd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-237264167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a544910dc2c4b169c986fa74b5979d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48b5298-04", "ovs_interfaceid": "b48b5298-045f-463d-9585-fbb5feb869bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'image_id': '4fa17706-d304-4117-a420-dab994c703dc'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'c3bf2188-b9de-41f5-9ded-ca29f2a470a3', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WnvQHzjl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '3b10fda0-9488-4089-8033-dd1c8e42af89', 'attached_at': '2023-11-08T12:16:26.000000', 'detached_at': '', 'volume_id': '3d161c9a-4d64-4a8b-9525-225154403d22', 'serial': '3d161c9a-4d64-4a8b-9525-225154403d22'}, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:16:25 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:16:25 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:16:25 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:16:25 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:16:25 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:16:25 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:16:25 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:16:25 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:16:25 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:16:25 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:16:25 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:16:25 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:16:25 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:16:25 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:16:25 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:16:25 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:16:25 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:16:25 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:16:25 user nova-compute[74840]: DEBUG nova.objects.instance [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3b10fda0-9488-4089-8033-dd1c8e42af89 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:16:25 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Calling os-brick to attach iSCSI Volume {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 12:16:25 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WnvQHzjl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:16:25 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:16:25 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:16:25 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:16:25 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:16:25 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:16:25 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:16:25 user nova-compute[74840]: INFO os_brick.initiator.connectors.iscsi [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 12:16:25 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:16:25 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:16:25 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[08edbad4-88b5-4894-bbd7-b3d6d782acd2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:16:25 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 12:16:25 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:16:25 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --interface default --op new {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:16:25 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:16:25 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9253e47b-7d45-489a-a2f1-c8a39ae2410e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22] added\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:16:25 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22] added
Nov 08 12:16:25 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:16:25 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:16:25 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:16:25 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f05276d-803d-45ad-a9dd-cd49dd56e6da]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:16:25 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:16:25 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:16:25 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.045s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:16:25 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f64acc-a28c-43fa-bae9-068b55f74b14]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:16:25 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:16:25 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WnvQHzjl {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:16:25 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WnvQHzjl" returned: 0 in 0.031s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:16:25 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd2ee89-7566-4bdb-9f5c-dc927d71e2e6]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:16:25 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WnvQHzjl'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:16:25 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:16:26 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:16:26 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ebe5d6-5ef0-44c8-9bf6-664a897c9c84]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:16:26 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:16:26 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:16:26 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:16:26 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07081f2-86de-4f68-9b9d-e350c74ac3af]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:16:26 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)
Nov 08 12:16:26 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:16:26 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)
Nov 08 12:16:26 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:16:26 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --login {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:16:26 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:16:26 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4a18cc-3555-4d1d-bb9f-3d139ed7af6d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:16:26 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22, portal: 172.16.0.220,3260]
Nov 08 12:16:26 user nova-compute[74840]: Login to [iface: default, target: iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22, portal: 172.16.0.220,3260] successful.
Nov 08 12:16:26 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:16:26 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:16:26 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:16:26 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[43df5e0f-d74f-45b5-b595-eb6e034888a1]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:16:26 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:16:26 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:16:26 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:16:26 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce5dc06-4714-42ba-8fe1-1205d5f1f5b7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:16:26 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)
Nov 08 12:16:26 user nova-compute[74840]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)
Nov 08 12:16:26 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:16:26 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)
Nov 08 12:16:26 user nova-compute[74840]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)
Nov 08 12:16:26 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:16:26 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:16:26 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Connected to 172.16.0.220:3260 {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 12:16:26 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=74840) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 12:16:26 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74840) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 12:16:26 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:16:26 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:16:26 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6064269e-726f-4b04-8a1b-a32562630278]: (4, ('- - 0', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:16:26 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: None {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:16:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:27 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:16:27 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WnvQHzjl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 12:16:27 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.393s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:16:27 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] <== connect_volume: return (1394ms) {'type': 'block', 'scsi_wwn': '26361373339653139', 'path': '/dev/sdc'} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:16:27 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361373339653139', 'path': '/dev/sdc'} {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 12:16:27 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:08:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-172158050',display_name='tempest-ServerActionsTestOtherB-server-172158050',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-172158050',id=3,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJKFMe0GKEBW9KmyXjqsjBsUl5GOfddH2uub399MmagL+sAbL8XpD7Zv97iB27MfsDGdoFheqqd0EDelgcb+/IZFf73OQgm/+DITCITQulDQXkqFfn6taEL9Zjc2Dr8/0g==',key_name='tempest-keypair-2038726199',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:14:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7a544910dc2c4b169c986fa74b5979d9',ramdisk_id='',reservation_id='r-o6735td4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1148036573',owner_user_name='tempest-ServerActionsTestOtherB-1148036573-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:15:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47ef9bdd58a147518d0a09267731b67c',uuid=3b10fda0-9488-4089-8033-dd1c8e42af89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "b48b5298-045f-463d-9585-fbb5feb869bf", "address": "fa:16:3e:19:58:1f", "network": {"id": "9dec89b0-562f-482c-aec1-d024351d0bd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-237264167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a544910dc2c4b169c986fa74b5979d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48b5298-04", "ovs_interfaceid": "b48b5298-045f-463d-9585-fbb5feb869bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:16:27 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Converting VIF {"id": "b48b5298-045f-463d-9585-fbb5feb869bf", "address": "fa:16:3e:19:58:1f", "network": {"id": "9dec89b0-562f-482c-aec1-d024351d0bd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-237264167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a544910dc2c4b169c986fa74b5979d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48b5298-04", "ovs_interfaceid": "b48b5298-045f-463d-9585-fbb5feb869bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:16:27 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:58:1f,bridge_name='br-int',has_traffic_filtering=True,id=b48b5298-045f-463d-9585-fbb5feb869bf,network=Network(9dec89b0-562f-482c-aec1-d024351d0bd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb48b5298-04') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:16:27 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:16:27 user nova-compute[74840]:   <uuid>3b10fda0-9488-4089-8033-dd1c8e42af89</uuid>
Nov 08 12:16:27 user nova-compute[74840]:   <name>instance-00000003</name>
Nov 08 12:16:27 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:16:27 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:16:27 user nova-compute[74840]:   <metadata>
Nov 08 12:16:27 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:16:27 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:16:27 user nova-compute[74840]:       <nova:name>tempest-ServerActionsTestOtherB-server-172158050</nova:name>
Nov 08 12:16:27 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:16:25</nova:creationTime>
Nov 08 12:16:27 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:16:27 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:16:27 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:16:27 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:16:27 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:16:27 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:16:27 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:16:27 user nova-compute[74840]:       <nova:owner>
Nov 08 12:16:27 user nova-compute[74840]:         <nova:user uuid="47ef9bdd58a147518d0a09267731b67c">tempest-ServerActionsTestOtherB-1148036573-project-member</nova:user>
Nov 08 12:16:27 user nova-compute[74840]:         <nova:project uuid="7a544910dc2c4b169c986fa74b5979d9">tempest-ServerActionsTestOtherB-1148036573</nova:project>
Nov 08 12:16:27 user nova-compute[74840]:       </nova:owner>
Nov 08 12:16:27 user nova-compute[74840]:       <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:16:27 user nova-compute[74840]:       <nova:ports>
Nov 08 12:16:27 user nova-compute[74840]:         <nova:port uuid="b48b5298-045f-463d-9585-fbb5feb869bf">
Nov 08 12:16:27 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 12:16:27 user nova-compute[74840]:         </nova:port>
Nov 08 12:16:27 user nova-compute[74840]:       </nova:ports>
Nov 08 12:16:27 user nova-compute[74840]:     </nova:instance>
Nov 08 12:16:27 user nova-compute[74840]:   </metadata>
Nov 08 12:16:27 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:16:27 user nova-compute[74840]:     <system>
Nov 08 12:16:27 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:16:27 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:16:27 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:16:27 user nova-compute[74840]:       <entry name="serial">3b10fda0-9488-4089-8033-dd1c8e42af89</entry>
Nov 08 12:16:27 user nova-compute[74840]:       <entry name="uuid">3b10fda0-9488-4089-8033-dd1c8e42af89</entry>
Nov 08 12:16:27 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:16:27 user nova-compute[74840]:     </system>
Nov 08 12:16:27 user nova-compute[74840]:   </sysinfo>
Nov 08 12:16:27 user nova-compute[74840]:   <os>
Nov 08 12:16:27 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:16:27 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:16:27 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:16:27 user nova-compute[74840]:   </os>
Nov 08 12:16:27 user nova-compute[74840]:   <features>
Nov 08 12:16:27 user nova-compute[74840]:     <acpi/>
Nov 08 12:16:27 user nova-compute[74840]:     <apic/>
Nov 08 12:16:27 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:16:27 user nova-compute[74840]:   </features>
Nov 08 12:16:27 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:16:27 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:16:27 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:16:27 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:16:27 user nova-compute[74840]:   </clock>
Nov 08 12:16:27 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:16:27 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:16:27 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:16:27 user nova-compute[74840]:   </cpu>
Nov 08 12:16:27 user nova-compute[74840]:   <devices>
Nov 08 12:16:27 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:16:27 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:16:27 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk"/>
Nov 08 12:16:27 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:16:27 user nova-compute[74840]:     </disk>
Nov 08 12:16:27 user nova-compute[74840]:     <disk type="block" device="disk">
Nov 08 12:16:27 user nova-compute[74840]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:16:27 user nova-compute[74840]:       <source dev="/dev/sdc"/>
Nov 08 12:16:27 user nova-compute[74840]:       <target dev="vdb" bus="virtio"/>
Nov 08 12:16:27 user nova-compute[74840]:       <serial>3d161c9a-4d64-4a8b-9525-225154403d22</serial>
Nov 08 12:16:27 user nova-compute[74840]:     </disk>
Nov 08 12:16:27 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:16:27 user nova-compute[74840]:       <mac address="fa:16:3e:19:58:1f"/>
Nov 08 12:16:27 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:16:27 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:16:27 user nova-compute[74840]:       <target dev="tapb48b5298-04"/>
Nov 08 12:16:27 user nova-compute[74840]:     </interface>
Nov 08 12:16:27 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:16:27 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/console.log" append="off"/>
Nov 08 12:16:27 user nova-compute[74840]:     </serial>
Nov 08 12:16:27 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:16:27 user nova-compute[74840]:     <video>
Nov 08 12:16:27 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:16:27 user nova-compute[74840]:     </video>
Nov 08 12:16:27 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:16:27 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:16:27 user nova-compute[74840]:     </rng>
Nov 08 12:16:27 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:16:27 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:16:27 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:16:27 user nova-compute[74840]:     </memballoon>
Nov 08 12:16:27 user nova-compute[74840]:   </devices>
Nov 08 12:16:27 user nova-compute[74840]: </domain>
Nov 08 12:16:27 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:16:27 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:08:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-172158050',display_name='tempest-ServerActionsTestOtherB-server-172158050',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-172158050',id=3,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJKFMe0GKEBW9KmyXjqsjBsUl5GOfddH2uub399MmagL+sAbL8XpD7Zv97iB27MfsDGdoFheqqd0EDelgcb+/IZFf73OQgm/+DITCITQulDQXkqFfn6taEL9Zjc2Dr8/0g==',key_name='tempest-keypair-2038726199',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:14:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7a544910dc2c4b169c986fa74b5979d9',ramdisk_id='',reservation_id='r-o6735td4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1148036573',owner_user_name='tempest-ServerActionsTestOtherB-1148036573-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:15:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47ef9bdd58a147518d0a09267731b67c',uuid=3b10fda0-9488-4089-8033-dd1c8e42af89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "b48b5298-045f-463d-9585-fbb5feb869bf", "address": "fa:16:3e:19:58:1f", "network": {"id": "9dec89b0-562f-482c-aec1-d024351d0bd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-237264167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a544910dc2c4b169c986fa74b5979d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48b5298-04", "ovs_interfaceid": "b48b5298-045f-463d-9585-fbb5feb869bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:16:27 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Converting VIF {"id": "b48b5298-045f-463d-9585-fbb5feb869bf", "address": "fa:16:3e:19:58:1f", "network": {"id": "9dec89b0-562f-482c-aec1-d024351d0bd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-237264167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a544910dc2c4b169c986fa74b5979d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48b5298-04", "ovs_interfaceid": "b48b5298-045f-463d-9585-fbb5feb869bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:16:27 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:58:1f,bridge_name='br-int',has_traffic_filtering=True,id=b48b5298-045f-463d-9585-fbb5feb869bf,network=Network(9dec89b0-562f-482c-aec1-d024351d0bd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb48b5298-04') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:16:27 user nova-compute[74840]: DEBUG os_vif [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:58:1f,bridge_name='br-int',has_traffic_filtering=True,id=b48b5298-045f-463d-9585-fbb5feb869bf,network=Network(9dec89b0-562f-482c-aec1-d024351d0bd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb48b5298-04') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:16:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:16:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:16:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '67178738-2a99-5b94-933c-dd46fce8bd89', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:16:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb48b5298-04, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:16:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb48b5298-04, col_values=(('qos', UUID('f085fc08-8510-4ce0-a833-169973c73af1')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:16:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb48b5298-04, col_values=(('external_ids', {'iface-id': 'b48b5298-045f-463d-9585-fbb5feb869bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:58:1f', 'vm-uuid': '3b10fda0-9488-4089-8033-dd1c8e42af89'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:16:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:16:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:27 user nova-compute[74840]: INFO os_vif [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:58:1f,bridge_name='br-int',has_traffic_filtering=True,id=b48b5298-045f-463d-9585-fbb5feb869bf,network=Network(9dec89b0-562f-482c-aec1-d024351d0bd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb48b5298-04')
Nov 08 12:16:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:28 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:28 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:29 user nova-compute[74840]: DEBUG nova.compute.manager [req-5e55ab09-0d0f-4d67-9668-b3ff6d4c71bd req-c6ef616c-6da0-4cb0-adb1-a5901ade7bb8 service nova] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Received event network-vif-plugged-b48b5298-045f-463d-9585-fbb5feb869bf {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:16:29 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-5e55ab09-0d0f-4d67-9668-b3ff6d4c71bd req-c6ef616c-6da0-4cb0-adb1-a5901ade7bb8 service nova] Acquiring lock "3b10fda0-9488-4089-8033-dd1c8e42af89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:16:29 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-5e55ab09-0d0f-4d67-9668-b3ff6d4c71bd req-c6ef616c-6da0-4cb0-adb1-a5901ade7bb8 service nova] Lock "3b10fda0-9488-4089-8033-dd1c8e42af89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:16:29 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-5e55ab09-0d0f-4d67-9668-b3ff6d4c71bd req-c6ef616c-6da0-4cb0-adb1-a5901ade7bb8 service nova] Lock "3b10fda0-9488-4089-8033-dd1c8e42af89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:16:29 user nova-compute[74840]: DEBUG nova.compute.manager [req-5e55ab09-0d0f-4d67-9668-b3ff6d4c71bd req-c6ef616c-6da0-4cb0-adb1-a5901ade7bb8 service nova] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] No waiting events found dispatching network-vif-plugged-b48b5298-045f-463d-9585-fbb5feb869bf {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:16:29 user nova-compute[74840]: WARNING nova.compute.manager [req-5e55ab09-0d0f-4d67-9668-b3ff6d4c71bd req-c6ef616c-6da0-4cb0-adb1-a5901ade7bb8 service nova] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Received unexpected event network-vif-plugged-b48b5298-045f-463d-9585-fbb5feb869bf for instance with vm_state resized and task_state resize_reverting.
Nov 08 12:16:29 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:29 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:31 user nova-compute[74840]: DEBUG nova.compute.manager [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:16:31 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Instance running successfully.
Nov 08 12:16:31 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] finish_revert_migration finished successfully. {{(pid=74840) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 08 12:16:31 user nova-compute[74840]: DEBUG nova.compute.manager [req-8e530198-5ff7-4153-8ec2-eb6464e87b27 req-a1569b60-5287-4ad5-aef5-f406cd8c5235 service nova] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Received event network-vif-plugged-b48b5298-045f-463d-9585-fbb5feb869bf {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:16:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8e530198-5ff7-4153-8ec2-eb6464e87b27 req-a1569b60-5287-4ad5-aef5-f406cd8c5235 service nova] Acquiring lock "3b10fda0-9488-4089-8033-dd1c8e42af89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:16:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8e530198-5ff7-4153-8ec2-eb6464e87b27 req-a1569b60-5287-4ad5-aef5-f406cd8c5235 service nova] Lock "3b10fda0-9488-4089-8033-dd1c8e42af89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:16:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8e530198-5ff7-4153-8ec2-eb6464e87b27 req-a1569b60-5287-4ad5-aef5-f406cd8c5235 service nova] Lock "3b10fda0-9488-4089-8033-dd1c8e42af89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:16:31 user nova-compute[74840]: DEBUG nova.compute.manager [req-8e530198-5ff7-4153-8ec2-eb6464e87b27 req-a1569b60-5287-4ad5-aef5-f406cd8c5235 service nova] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] No waiting events found dispatching network-vif-plugged-b48b5298-045f-463d-9585-fbb5feb869bf {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:16:31 user nova-compute[74840]: WARNING nova.compute.manager [req-8e530198-5ff7-4153-8ec2-eb6464e87b27 req-a1569b60-5287-4ad5-aef5-f406cd8c5235 service nova] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Received unexpected event network-vif-plugged-b48b5298-045f-463d-9585-fbb5feb869bf for instance with vm_state resized and task_state resize_reverting.
Nov 08 12:16:31 user nova-compute[74840]: INFO nova.compute.manager [None req-eb6b43bc-5e69-4c3c-92d7-370dd1636b41 tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Updating instance to original state: 'active'
Nov 08 12:16:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquiring lock "d3e8efc6-7146-46ef-8433-380d7e69120c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:16:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "d3e8efc6-7146-46ef-8433-380d7e69120c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:16:37 user nova-compute[74840]: DEBUG nova.compute.manager [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Starting instance... {{(pid=74840) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 12:16:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:16:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:16:37 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:16:37 user nova-compute[74840]: INFO nova.compute.claims [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Claim successful on node user
Nov 08 12:16:37 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:16:37 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:16:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.523s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:16:38 user nova-compute[74840]: DEBUG nova.compute.manager [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Start building networks asynchronously for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 12:16:38 user nova-compute[74840]: DEBUG nova.compute.manager [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Allocating IP information in the background. {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 12:16:38 user nova-compute[74840]: DEBUG nova.network.neutron [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 12:16:38 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 12:16:38 user nova-compute[74840]: DEBUG nova.compute.manager [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Start building block device mappings for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 12:16:38 user nova-compute[74840]: DEBUG nova.policy [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '275e3d340c9d4d9e90b579e4bc0bfe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c97c47ab144ef3a8d5e9ee1ecc059e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 12:16:38 user nova-compute[74840]: DEBUG nova.compute.manager [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Start spawning the instance on the hypervisor. {{(pid=74840) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 12:16:38 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:16:38 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Creating image(s)
Nov 08 12:16:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquiring lock "/opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:16:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "/opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:16:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "/opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:16:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:16:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.221s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:16:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquiring lock "5d26578eba85497f494c575690c4248f381a0fe6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:16:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:16:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:16:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.212s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:16:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk 1073741824 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:16:38 user nova-compute[74840]: DEBUG nova.network.neutron [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Successfully created port: 5c942bb3-846b-4319-961f-42aed0e55bdf {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:16:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk 1073741824" returned: 0 in 0.072s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:16:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:16:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:16:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.242s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:16:39 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk. size=1073741824 {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 12:16:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:16:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:16:39 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Cannot resize image /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk to a smaller size. {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 12:16:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Created local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 12:16:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Ensure instance console log exists: /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:16:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:16:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:16:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:16:39 user nova-compute[74840]: DEBUG nova.network.neutron [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Successfully updated port: 5c942bb3-846b-4319-961f-42aed0e55bdf {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:16:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquiring lock "refresh_cache-d3e8efc6-7146-46ef-8433-380d7e69120c" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:16:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquired lock "refresh_cache-d3e8efc6-7146-46ef-8433-380d7e69120c" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:16:39 user nova-compute[74840]: DEBUG nova.network.neutron [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:16:39 user nova-compute[74840]: DEBUG nova.compute.manager [req-3d2aca7c-426b-4f64-9507-31f80b8ae399 req-90f7732e-b202-4173-a243-9dc474ea546d service nova] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Received event network-changed-5c942bb3-846b-4319-961f-42aed0e55bdf {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:16:39 user nova-compute[74840]: DEBUG nova.compute.manager [req-3d2aca7c-426b-4f64-9507-31f80b8ae399 req-90f7732e-b202-4173-a243-9dc474ea546d service nova] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Refreshing instance network info cache due to event network-changed-5c942bb3-846b-4319-961f-42aed0e55bdf. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:16:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3d2aca7c-426b-4f64-9507-31f80b8ae399 req-90f7732e-b202-4173-a243-9dc474ea546d service nova] Acquiring lock "refresh_cache-d3e8efc6-7146-46ef-8433-380d7e69120c" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:16:39 user nova-compute[74840]: DEBUG nova.network.neutron [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:16:40 user nova-compute[74840]: DEBUG nova.network.neutron [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Updating instance_info_cache with network_info: [{"id": "5c942bb3-846b-4319-961f-42aed0e55bdf", "address": "fa:16:3e:29:6a:cd", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c942bb3-84", "ovs_interfaceid": "5c942bb3-846b-4319-961f-42aed0e55bdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:16:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Releasing lock "refresh_cache-d3e8efc6-7146-46ef-8433-380d7e69120c" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:16:40 user nova-compute[74840]: DEBUG nova.compute.manager [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Instance network_info: |[{"id": "5c942bb3-846b-4319-961f-42aed0e55bdf", "address": "fa:16:3e:29:6a:cd", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c942bb3-84", "ovs_interfaceid": "5c942bb3-846b-4319-961f-42aed0e55bdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 12:16:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3d2aca7c-426b-4f64-9507-31f80b8ae399 req-90f7732e-b202-4173-a243-9dc474ea546d service nova] Acquired lock "refresh_cache-d3e8efc6-7146-46ef-8433-380d7e69120c" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:16:40 user nova-compute[74840]: DEBUG nova.network.neutron [req-3d2aca7c-426b-4f64-9507-31f80b8ae399 req-90f7732e-b202-4173-a243-9dc474ea546d service nova] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Refreshing network info cache for port 5c942bb3-846b-4319-961f-42aed0e55bdf {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:16:40 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Start _get_guest_xml network_info=[{"id": "5c942bb3-846b-4319-961f-42aed0e55bdf", "address": "fa:16:3e:29:6a:cd", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c942bb3-84", "ovs_interfaceid": "5c942bb3-846b-4319-961f-42aed0e55bdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'image_id': '4fa17706-d304-4117-a420-dab994c703dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:16:40 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:16:40 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:16:40 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:16:40 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:16:40 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:16:40 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:16:40 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:16:40 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:16:40 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:16:40 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:16:40 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:16:40 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:16:40 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:16:40 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:16:40 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:16:40 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:16:40 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:16:40 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:16:40 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:16:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1144019394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1144019394',id=17,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72c97c47ab144ef3a8d5e9ee1ecc059e',ramdisk_id='',reservation_id='r-kgiexb9c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-297593405',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:16:38Z,user_data=None,user_id='275e3d340c9d4d9e90b579e4bc0bfe0b',uuid=d3e8efc6-7146-46ef-8433-380d7e69120c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c942bb3-846b-4319-961f-42aed0e55bdf", "address": "fa:16:3e:29:6a:cd", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c942bb3-84", "ovs_interfaceid": "5c942bb3-846b-4319-961f-42aed0e55bdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:16:40 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Converting VIF {"id": "5c942bb3-846b-4319-961f-42aed0e55bdf", "address": "fa:16:3e:29:6a:cd", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c942bb3-84", "ovs_interfaceid": "5c942bb3-846b-4319-961f-42aed0e55bdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:16:40 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:6a:cd,bridge_name='br-int',has_traffic_filtering=True,id=5c942bb3-846b-4319-961f-42aed0e55bdf,network=Network(8388eafb-b115-49c7-82cd-0d85d0ee12e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c942bb3-84') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:16:40 user nova-compute[74840]: DEBUG nova.objects.instance [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lazy-loading 'pci_devices' on Instance uuid d3e8efc6-7146-46ef-8433-380d7e69120c {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:16:40 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:16:40 user nova-compute[74840]:   <uuid>d3e8efc6-7146-46ef-8433-380d7e69120c</uuid>
Nov 08 12:16:40 user nova-compute[74840]:   <name>instance-00000011</name>
Nov 08 12:16:40 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:16:40 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:16:40 user nova-compute[74840]:   <metadata>
Nov 08 12:16:40 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:16:40 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:16:40 user nova-compute[74840]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1144019394</nova:name>
Nov 08 12:16:40 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:16:40</nova:creationTime>
Nov 08 12:16:40 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:16:40 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:16:40 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:16:40 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:16:40 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:16:40 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:16:40 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:16:40 user nova-compute[74840]:       <nova:owner>
Nov 08 12:16:40 user nova-compute[74840]:         <nova:user uuid="275e3d340c9d4d9e90b579e4bc0bfe0b">tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member</nova:user>
Nov 08 12:16:40 user nova-compute[74840]:         <nova:project uuid="72c97c47ab144ef3a8d5e9ee1ecc059e">tempest-ServerBootFromVolumeStableRescueTest-297593405</nova:project>
Nov 08 12:16:40 user nova-compute[74840]:       </nova:owner>
Nov 08 12:16:40 user nova-compute[74840]:       <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:16:40 user nova-compute[74840]:       <nova:ports>
Nov 08 12:16:40 user nova-compute[74840]:         <nova:port uuid="5c942bb3-846b-4319-961f-42aed0e55bdf">
Nov 08 12:16:40 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 12:16:40 user nova-compute[74840]:         </nova:port>
Nov 08 12:16:40 user nova-compute[74840]:       </nova:ports>
Nov 08 12:16:40 user nova-compute[74840]:     </nova:instance>
Nov 08 12:16:40 user nova-compute[74840]:   </metadata>
Nov 08 12:16:40 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:16:40 user nova-compute[74840]:     <system>
Nov 08 12:16:40 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:16:40 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:16:40 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:16:40 user nova-compute[74840]:       <entry name="serial">d3e8efc6-7146-46ef-8433-380d7e69120c</entry>
Nov 08 12:16:40 user nova-compute[74840]:       <entry name="uuid">d3e8efc6-7146-46ef-8433-380d7e69120c</entry>
Nov 08 12:16:40 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:16:40 user nova-compute[74840]:     </system>
Nov 08 12:16:40 user nova-compute[74840]:   </sysinfo>
Nov 08 12:16:40 user nova-compute[74840]:   <os>
Nov 08 12:16:40 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:16:40 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:16:40 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:16:40 user nova-compute[74840]:   </os>
Nov 08 12:16:40 user nova-compute[74840]:   <features>
Nov 08 12:16:40 user nova-compute[74840]:     <acpi/>
Nov 08 12:16:40 user nova-compute[74840]:     <apic/>
Nov 08 12:16:40 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:16:40 user nova-compute[74840]:   </features>
Nov 08 12:16:40 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:16:40 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:16:40 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:16:40 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:16:40 user nova-compute[74840]:   </clock>
Nov 08 12:16:40 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:16:40 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:16:40 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:16:40 user nova-compute[74840]:   </cpu>
Nov 08 12:16:40 user nova-compute[74840]:   <devices>
Nov 08 12:16:40 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:16:40 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:16:40 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk"/>
Nov 08 12:16:40 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:16:40 user nova-compute[74840]:     </disk>
Nov 08 12:16:40 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:16:40 user nova-compute[74840]:       <mac address="fa:16:3e:29:6a:cd"/>
Nov 08 12:16:40 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:16:40 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:16:40 user nova-compute[74840]:       <target dev="tap5c942bb3-84"/>
Nov 08 12:16:40 user nova-compute[74840]:     </interface>
Nov 08 12:16:40 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:16:40 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/console.log" append="off"/>
Nov 08 12:16:40 user nova-compute[74840]:     </serial>
Nov 08 12:16:40 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:16:40 user nova-compute[74840]:     <video>
Nov 08 12:16:40 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:16:40 user nova-compute[74840]:     </video>
Nov 08 12:16:40 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:16:40 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:16:40 user nova-compute[74840]:     </rng>
Nov 08 12:16:40 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:16:40 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:16:40 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:16:40 user nova-compute[74840]:     </memballoon>
Nov 08 12:16:40 user nova-compute[74840]:   </devices>
Nov 08 12:16:40 user nova-compute[74840]: </domain>
Nov 08 12:16:40 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:16:40 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:16:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1144019394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1144019394',id=17,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72c97c47ab144ef3a8d5e9ee1ecc059e',ramdisk_id='',reservation_id='r-kgiexb9c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-297593405',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:16:38Z,user_data=None,user_id='275e3d340c9d4d9e90b579e4bc0bfe0b',uuid=d3e8efc6-7146-46ef-8433-380d7e69120c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c942bb3-846b-4319-961f-42aed0e55bdf", "address": "fa:16:3e:29:6a:cd", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c942bb3-84", "ovs_interfaceid": "5c942bb3-846b-4319-961f-42aed0e55bdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:16:40 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Converting VIF {"id": "5c942bb3-846b-4319-961f-42aed0e55bdf", "address": "fa:16:3e:29:6a:cd", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c942bb3-84", "ovs_interfaceid": "5c942bb3-846b-4319-961f-42aed0e55bdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:16:40 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:6a:cd,bridge_name='br-int',has_traffic_filtering=True,id=5c942bb3-846b-4319-961f-42aed0e55bdf,network=Network(8388eafb-b115-49c7-82cd-0d85d0ee12e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c942bb3-84') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:16:40 user nova-compute[74840]: DEBUG os_vif [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:6a:cd,bridge_name='br-int',has_traffic_filtering=True,id=5c942bb3-846b-4319-961f-42aed0e55bdf,network=Network(8388eafb-b115-49c7-82cd-0d85d0ee12e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c942bb3-84') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:16:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:16:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:16:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '015c8381-e28e-5c52-a0af-7bd6d73eb44a', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:16:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:16:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c942bb3-84, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:16:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5c942bb3-84, col_values=(('qos', UUID('8dc48b2d-3504-431c-ad25-3c85cc1fe947')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:16:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5c942bb3-84, col_values=(('external_ids', {'iface-id': '5c942bb3-846b-4319-961f-42aed0e55bdf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:6a:cd', 'vm-uuid': 'd3e8efc6-7146-46ef-8433-380d7e69120c'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:16:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:16:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:40 user nova-compute[74840]: INFO os_vif [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:6a:cd,bridge_name='br-int',has_traffic_filtering=True,id=5c942bb3-846b-4319-961f-42aed0e55bdf,network=Network(8388eafb-b115-49c7-82cd-0d85d0ee12e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c942bb3-84')
Nov 08 12:16:40 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:16:40 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] No VIF found with MAC fa:16:3e:29:6a:cd, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:16:40 user nova-compute[74840]: DEBUG nova.network.neutron [req-3d2aca7c-426b-4f64-9507-31f80b8ae399 req-90f7732e-b202-4173-a243-9dc474ea546d service nova] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Updated VIF entry in instance network info cache for port 5c942bb3-846b-4319-961f-42aed0e55bdf. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:16:40 user nova-compute[74840]: DEBUG nova.network.neutron [req-3d2aca7c-426b-4f64-9507-31f80b8ae399 req-90f7732e-b202-4173-a243-9dc474ea546d service nova] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Updating instance_info_cache with network_info: [{"id": "5c942bb3-846b-4319-961f-42aed0e55bdf", "address": "fa:16:3e:29:6a:cd", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c942bb3-84", "ovs_interfaceid": "5c942bb3-846b-4319-961f-42aed0e55bdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:16:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3d2aca7c-426b-4f64-9507-31f80b8ae399 req-90f7732e-b202-4173-a243-9dc474ea546d service nova] Releasing lock "refresh_cache-d3e8efc6-7146-46ef-8433-380d7e69120c" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:16:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:41 user nova-compute[74840]: DEBUG nova.compute.manager [req-a2dcb152-3a27-4015-9b77-f94a023c391d req-18a2caa3-e9d5-49cf-bf73-0d6938790ad7 service nova] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Received event network-vif-plugged-5c942bb3-846b-4319-961f-42aed0e55bdf {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:16:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a2dcb152-3a27-4015-9b77-f94a023c391d req-18a2caa3-e9d5-49cf-bf73-0d6938790ad7 service nova] Acquiring lock "d3e8efc6-7146-46ef-8433-380d7e69120c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:16:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a2dcb152-3a27-4015-9b77-f94a023c391d req-18a2caa3-e9d5-49cf-bf73-0d6938790ad7 service nova] Lock "d3e8efc6-7146-46ef-8433-380d7e69120c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:16:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a2dcb152-3a27-4015-9b77-f94a023c391d req-18a2caa3-e9d5-49cf-bf73-0d6938790ad7 service nova] Lock "d3e8efc6-7146-46ef-8433-380d7e69120c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:16:41 user nova-compute[74840]: DEBUG nova.compute.manager [req-a2dcb152-3a27-4015-9b77-f94a023c391d req-18a2caa3-e9d5-49cf-bf73-0d6938790ad7 service nova] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] No waiting events found dispatching network-vif-plugged-5c942bb3-846b-4319-961f-42aed0e55bdf {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:16:41 user nova-compute[74840]: WARNING nova.compute.manager [req-a2dcb152-3a27-4015-9b77-f94a023c391d req-18a2caa3-e9d5-49cf-bf73-0d6938790ad7 service nova] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Received unexpected event network-vif-plugged-5c942bb3-846b-4319-961f-42aed0e55bdf for instance with vm_state building and task_state spawning.
Nov 08 12:16:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:44 user nova-compute[74840]: DEBUG nova.compute.manager [req-98c4398c-9487-4a06-a455-26f95ae08350 req-5e919b9d-0708-4bab-96ff-8f9ec0942eea service nova] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Received event network-vif-plugged-5c942bb3-846b-4319-961f-42aed0e55bdf {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:16:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-98c4398c-9487-4a06-a455-26f95ae08350 req-5e919b9d-0708-4bab-96ff-8f9ec0942eea service nova] Acquiring lock "d3e8efc6-7146-46ef-8433-380d7e69120c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:16:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-98c4398c-9487-4a06-a455-26f95ae08350 req-5e919b9d-0708-4bab-96ff-8f9ec0942eea service nova] Lock "d3e8efc6-7146-46ef-8433-380d7e69120c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:16:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-98c4398c-9487-4a06-a455-26f95ae08350 req-5e919b9d-0708-4bab-96ff-8f9ec0942eea service nova] Lock "d3e8efc6-7146-46ef-8433-380d7e69120c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:16:44 user nova-compute[74840]: DEBUG nova.compute.manager [req-98c4398c-9487-4a06-a455-26f95ae08350 req-5e919b9d-0708-4bab-96ff-8f9ec0942eea service nova] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] No waiting events found dispatching network-vif-plugged-5c942bb3-846b-4319-961f-42aed0e55bdf {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:16:44 user nova-compute[74840]: WARNING nova.compute.manager [req-98c4398c-9487-4a06-a455-26f95ae08350 req-5e919b9d-0708-4bab-96ff-8f9ec0942eea service nova] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Received unexpected event network-vif-plugged-5c942bb3-846b-4319-961f-42aed0e55bdf for instance with vm_state building and task_state spawning.
Nov 08 12:16:44 user nova-compute[74840]: DEBUG nova.compute.manager [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:16:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:16:44 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Instance spawned successfully.
Nov 08 12:16:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:16:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Found default for hw_cdrom_bus of ide {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:16:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Found default for hw_disk_bus of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:16:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:16:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:16:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Found default for hw_video_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:16:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Found default for hw_vif_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:16:44 user nova-compute[74840]: INFO nova.compute.manager [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Took 5.82 seconds to spawn the instance on the hypervisor.
Nov 08 12:16:44 user nova-compute[74840]: DEBUG nova.compute.manager [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:16:44 user nova-compute[74840]: INFO nova.compute.manager [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Took 6.74 seconds to build instance.
Nov 08 12:16:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-701b491a-f676-492d-a1e0-d8b31a7c288f tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "d3e8efc6-7146-46ef-8433-380d7e69120c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.849s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:16:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:46 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:16:46 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:16:46 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "refresh_cache-684b8be2-7f8f-499f-8885-c9d1c86eef2f" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:16:46 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquired lock "refresh_cache-684b8be2-7f8f-499f-8885-c9d1c86eef2f" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:16:46 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Forcefully refreshing network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 12:16:47 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Updating instance_info_cache with network_info: [{"id": "b910fb2a-440c-426f-a000-064149073835", "address": "fa:16:3e:fd:8e:63", "network": {"id": "bfa1d7ef-3436-4676-a399-ead8194a958a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-3950314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd51d983b3aa441dabb1543296f0bb70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb910fb2a-44", "ovs_interfaceid": "b910fb2a-440c-426f-a000-064149073835", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:16:47 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Releasing lock "refresh_cache-684b8be2-7f8f-499f-8885-c9d1c86eef2f" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:16:47 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Updated the network info_cache for instance {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 12:16:47 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:16:47 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:16:47 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:16:48 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:16:49 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:16:49 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:16:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:51 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:51 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:16:51 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:16:51 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:16:51 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:16:51 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:16:51 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:16:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0b7a0e1-d0d1-4682-9218-ef44d1e461f1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:16:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0b7a0e1-d0d1-4682-9218-ef44d1e461f1/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:16:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0b7a0e1-d0d1-4682-9218-ef44d1e461f1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:16:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0b7a0e1-d0d1-4682-9218-ef44d1e461f1/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:16:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c7b5726-907f-4ae3-aba0-b58351106717/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:16:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c7b5726-907f-4ae3-aba0-b58351106717/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:16:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c7b5726-907f-4ae3-aba0-b58351106717/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:16:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c7b5726-907f-4ae3-aba0-b58351106717/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:16:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:16:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:16:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:16:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:16:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eea27317-7454-4b5c-8d01-7976255a31bd/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:16:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eea27317-7454-4b5c-8d01-7976255a31bd/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:16:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eea27317-7454-4b5c-8d01-7976255a31bd/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:16:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eea27317-7454-4b5c-8d01-7976255a31bd/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:16:53 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:16:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:16:54 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:16:54 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:16:54 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:16:54 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:16:54 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:16:54 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:16:54 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:16:54 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:16:54 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74a51b1b-103e-49b2-b7a0-ec4625a9445b/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:16:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74a51b1b-103e-49b2-b7a0-ec4625a9445b/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:16:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74a51b1b-103e-49b2-b7a0-ec4625a9445b/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:16:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74a51b1b-103e-49b2-b7a0-ec4625a9445b/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:16:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/684b8be2-7f8f-499f-8885-c9d1c86eef2f/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:16:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/684b8be2-7f8f-499f-8885-c9d1c86eef2f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:16:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/684b8be2-7f8f-499f-8885-c9d1c86eef2f/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:16:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/684b8be2-7f8f-499f-8885-c9d1c86eef2f/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:16:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:16:56 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:16:56 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:16:56 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=7387MB free_disk=25.33252716064453GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:16:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:16:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:16:56 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 684b8be2-7f8f-499f-8885-c9d1c86eef2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:16:56 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 28ccd7b3-8bbe-42e7-aa00-612b3703ae79 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:16:56 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance a0b7a0e1-d0d1-4682-9218-ef44d1e461f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:16:56 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 3b10fda0-9488-4089-8033-dd1c8e42af89 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:16:56 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance eea27317-7454-4b5c-8d01-7976255a31bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:16:56 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:16:56 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 74a51b1b-103e-49b2-b7a0-ec4625a9445b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:16:56 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 4c7b5726-907f-4ae3-aba0-b58351106717 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:16:56 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance d3e8efc6-7146-46ef-8433-380d7e69120c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:16:56 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:16:56 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:16:56 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:16:56 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:16:56 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:16:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.505s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:17:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:17:00 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:17:00 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:17:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:17:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:17:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:17:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "9b90af19-7629-4d19-ba8f-fae652f62e3e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:17:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "9b90af19-7629-4d19-ba8f-fae652f62e3e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:17:08 user nova-compute[74840]: DEBUG nova.compute.manager [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Starting instance... {{(pid=74840) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 12:17:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:17:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:17:08 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:17:08 user nova-compute[74840]: INFO nova.compute.claims [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Claim successful on node user
Nov 08 12:17:09 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:17:09 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:17:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.573s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:17:09 user nova-compute[74840]: DEBUG nova.compute.manager [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Start building networks asynchronously for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 12:17:09 user nova-compute[74840]: DEBUG nova.compute.manager [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Allocating IP information in the background. {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 12:17:09 user nova-compute[74840]: DEBUG nova.network.neutron [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 12:17:09 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 12:17:09 user nova-compute[74840]: DEBUG nova.compute.manager [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Start building block device mappings for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 12:17:09 user nova-compute[74840]: INFO nova.virt.block_device [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Booting with volume snapshot 1e73c31f-e75d-47aa-a7e2-a6761f4582e8 at /dev/vda
Nov 08 12:17:09 user nova-compute[74840]: DEBUG nova.policy [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '794c0281e1bf48f79117efdc3907e661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1250106b55ae44b0b303849df7781ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 12:17:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:17:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:17:10 user nova-compute[74840]: DEBUG nova.network.neutron [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Successfully created port: 3b079dbf-c166-48cc-a7ad-1a971751ba88 {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:17:11 user nova-compute[74840]: DEBUG nova.network.neutron [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Successfully updated port: 3b079dbf-c166-48cc-a7ad-1a971751ba88 {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:17:11 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "refresh_cache-9b90af19-7629-4d19-ba8f-fae652f62e3e" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:17:11 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquired lock "refresh_cache-9b90af19-7629-4d19-ba8f-fae652f62e3e" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:17:11 user nova-compute[74840]: DEBUG nova.network.neutron [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:17:11 user nova-compute[74840]: DEBUG nova.compute.manager [req-635f28cf-01e1-469b-9a4d-73fb4a84c2bd req-663d81d9-1d63-4aa2-98da-77cfbec581b1 service nova] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Received event network-changed-3b079dbf-c166-48cc-a7ad-1a971751ba88 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:17:11 user nova-compute[74840]: DEBUG nova.compute.manager [req-635f28cf-01e1-469b-9a4d-73fb4a84c2bd req-663d81d9-1d63-4aa2-98da-77cfbec581b1 service nova] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Refreshing instance network info cache due to event network-changed-3b079dbf-c166-48cc-a7ad-1a971751ba88. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:17:11 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-635f28cf-01e1-469b-9a4d-73fb4a84c2bd req-663d81d9-1d63-4aa2-98da-77cfbec581b1 service nova] Acquiring lock "refresh_cache-9b90af19-7629-4d19-ba8f-fae652f62e3e" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:17:11 user nova-compute[74840]: DEBUG nova.network.neutron [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:17:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:17:11 user nova-compute[74840]: DEBUG nova.network.neutron [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Updating instance_info_cache with network_info: [{"id": "3b079dbf-c166-48cc-a7ad-1a971751ba88", "address": "fa:16:3e:b7:f7:ea", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b079dbf-c1", "ovs_interfaceid": "3b079dbf-c166-48cc-a7ad-1a971751ba88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:17:11 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Releasing lock "refresh_cache-9b90af19-7629-4d19-ba8f-fae652f62e3e" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:17:11 user nova-compute[74840]: DEBUG nova.compute.manager [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Instance network_info: |[{"id": "3b079dbf-c166-48cc-a7ad-1a971751ba88", "address": "fa:16:3e:b7:f7:ea", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b079dbf-c1", "ovs_interfaceid": "3b079dbf-c166-48cc-a7ad-1a971751ba88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 12:17:11 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-635f28cf-01e1-469b-9a4d-73fb4a84c2bd req-663d81d9-1d63-4aa2-98da-77cfbec581b1 service nova] Acquired lock "refresh_cache-9b90af19-7629-4d19-ba8f-fae652f62e3e" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:17:11 user nova-compute[74840]: DEBUG nova.network.neutron [req-635f28cf-01e1-469b-9a4d-73fb4a84c2bd req-663d81d9-1d63-4aa2-98da-77cfbec581b1 service nova] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Refreshing network info cache for port 3b079dbf-c166-48cc-a7ad-1a971751ba88 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:17:12 user nova-compute[74840]: DEBUG nova.network.neutron [req-635f28cf-01e1-469b-9a4d-73fb4a84c2bd req-663d81d9-1d63-4aa2-98da-77cfbec581b1 service nova] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Updated VIF entry in instance network info cache for port 3b079dbf-c166-48cc-a7ad-1a971751ba88. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:17:12 user nova-compute[74840]: DEBUG nova.network.neutron [req-635f28cf-01e1-469b-9a4d-73fb4a84c2bd req-663d81d9-1d63-4aa2-98da-77cfbec581b1 service nova] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Updating instance_info_cache with network_info: [{"id": "3b079dbf-c166-48cc-a7ad-1a971751ba88", "address": "fa:16:3e:b7:f7:ea", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b079dbf-c1", "ovs_interfaceid": "3b079dbf-c166-48cc-a7ad-1a971751ba88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:17:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-635f28cf-01e1-469b-9a4d-73fb4a84c2bd req-663d81d9-1d63-4aa2-98da-77cfbec581b1 service nova] Releasing lock "refresh_cache-9b90af19-7629-4d19-ba8f-fae652f62e3e" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:17:12 user nova-compute[74840]: DEBUG nova.compute.manager [req-b68d56af-c1ab-4c59-99b7-f1d1ed3aa3c0 req-d26b071d-e022-4637-8d50-88eaa687e6fc service nova] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Received event network-changed-3d85fb08-7cf4-4f26-a8d0-9de9095f874c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:17:12 user nova-compute[74840]: DEBUG nova.compute.manager [req-b68d56af-c1ab-4c59-99b7-f1d1ed3aa3c0 req-d26b071d-e022-4637-8d50-88eaa687e6fc service nova] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Refreshing instance network info cache due to event network-changed-3d85fb08-7cf4-4f26-a8d0-9de9095f874c. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:17:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-b68d56af-c1ab-4c59-99b7-f1d1ed3aa3c0 req-d26b071d-e022-4637-8d50-88eaa687e6fc service nova] Acquiring lock "refresh_cache-e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:17:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-b68d56af-c1ab-4c59-99b7-f1d1ed3aa3c0 req-d26b071d-e022-4637-8d50-88eaa687e6fc service nova] Acquired lock "refresh_cache-e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:17:12 user nova-compute[74840]: DEBUG nova.network.neutron [req-b68d56af-c1ab-4c59-99b7-f1d1ed3aa3c0 req-d26b071d-e022-4637-8d50-88eaa687e6fc service nova] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Refreshing network info cache for port 3d85fb08-7cf4-4f26-a8d0-9de9095f874c {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:17:12 user nova-compute[74840]: DEBUG nova.network.neutron [req-b68d56af-c1ab-4c59-99b7-f1d1ed3aa3c0 req-d26b071d-e022-4637-8d50-88eaa687e6fc service nova] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Updated VIF entry in instance network info cache for port 3d85fb08-7cf4-4f26-a8d0-9de9095f874c. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:17:12 user nova-compute[74840]: DEBUG nova.network.neutron [req-b68d56af-c1ab-4c59-99b7-f1d1ed3aa3c0 req-d26b071d-e022-4637-8d50-88eaa687e6fc service nova] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Updating instance_info_cache with network_info: [{"id": "3d85fb08-7cf4-4f26-a8d0-9de9095f874c", "address": "fa:16:3e:6e:13:a8", "network": {"id": "a6dec0d8-d21a-41d6-9d3a-effe04e7f845", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-780900048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24eea35667934f72bef26febd10192b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d85fb08-7c", "ovs_interfaceid": "3d85fb08-7cf4-4f26-a8d0-9de9095f874c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:17:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-b68d56af-c1ab-4c59-99b7-f1d1ed3aa3c0 req-d26b071d-e022-4637-8d50-88eaa687e6fc service nova] Releasing lock "refresh_cache-e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:17:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4bb4f16e-f742-49ec-9fcf-e2a2fcf4a063 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Acquiring lock "e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:17:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4bb4f16e-f742-49ec-9fcf-e2a2fcf4a063 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Lock "e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:17:13 user nova-compute[74840]: DEBUG nova.objects.instance [None req-4bb4f16e-f742-49ec-9fcf-e2a2fcf4a063 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Lazy-loading 'flavor' on Instance uuid e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:17:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4bb4f16e-f742-49ec-9fcf-e2a2fcf4a063 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Lock "e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:17:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4bb4f16e-f742-49ec-9fcf-e2a2fcf4a063 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Acquiring lock "e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:17:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4bb4f16e-f742-49ec-9fcf-e2a2fcf4a063 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Lock "e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:17:13 user nova-compute[74840]: INFO nova.compute.manager [None req-4bb4f16e-f742-49ec-9fcf-e2a2fcf4a063 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Attaching volume 47e08f73-fc30-4ecb-a62f-074aa12560a9 to /dev/vdb
Nov 08 12:17:13 user nova-compute[74840]: DEBUG os_brick.utils [None req-4bb4f16e-f742-49ec-9fcf-e2a2fcf4a063 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:17:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:17:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:17:13 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f51004b-4f57-4a72-9207-347c16f8d73b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c8228a11e03c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:17:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:17:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:17:13 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[da06203a-be7a-4ef0-b805-4856203c51cf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:17:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:17:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:17:13 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb4c912-018a-4ee4-ac5a-b6ee6b595d1f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:17:13 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc21e4d-38ad-4cad-903c-8977c5e26cde]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:17:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-4bb4f16e-f742-49ec-9fcf-e2a2fcf4a063 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Running cmd (subprocess): nvme version {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:17:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-4bb4f16e-f742-49ec-9fcf-e2a2fcf4a063 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] 'nvme version' failed. Not Retrying. {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:17:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4bb4f16e-f742-49ec-9fcf-e2a2fcf4a063 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] nvme not present on system {{(pid=74840) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 12:17:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:17:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:17:13 user nova-compute[74840]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 12:17:13 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e58d436-e380-4559-8361-cd0fd555a31d]: (4, '') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:17:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-4bb4f16e-f742-49ec-9fcf-e2a2fcf4a063 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74840) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 12:17:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-4bb4f16e-f742-49ec-9fcf-e2a2fcf4a063 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 12:17:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-4bb4f16e-f742-49ec-9fcf-e2a2fcf4a063 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] LIGHTOS: no hostnqn found. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 12:17:13 user nova-compute[74840]: DEBUG os_brick.utils [None req-4bb4f16e-f742-49ec-9fcf-e2a2fcf4a063 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c8228a11e03c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:17:13 user nova-compute[74840]: DEBUG nova.virt.block_device [None req-4bb4f16e-f742-49ec-9fcf-e2a2fcf4a063 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Updating existing volume attachment record: 442f59ba-e54d-44b3-b5c3-28683e6ad410 {{(pid=74840) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 12:17:15 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:17:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:17:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:17:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:17:20 user nova-compute[74840]: DEBUG os_brick.utils [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:17:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:17:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:17:20 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[81da1dad-35a3-4a8f-a88b-498bfef6f4e7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c8228a11e03c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:17:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:17:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:17:20 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d8c7e9-956f-4dea-8f58-efa82d3e462e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:17:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:17:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:17:20 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1af9cc-f429-4017-b4b9-5a0fd3e3954d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:17:20 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[154d9045-27ea-42d1-99f7-16aab582cca8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:17:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Running cmd (subprocess): nvme version {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:17:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] 'nvme version' failed. Not Retrying. {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:17:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] nvme not present on system {{(pid=74840) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 12:17:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:17:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:17:20 user nova-compute[74840]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 12:17:20 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ff86a6-be00-44f5-8138-d35e98b5d7db]: (4, '') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:17:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74840) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 12:17:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 12:17:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] LIGHTOS: no hostnqn found. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 12:17:20 user nova-compute[74840]: DEBUG os_brick.utils [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c8228a11e03c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:17:20 user nova-compute[74840]: DEBUG nova.virt.block_device [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Updating existing volume attachment record: 8b393fdb-d202-4268-a463-3b4cc74a0694 {{(pid=74840) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 12:17:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:17:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:17:25 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:17:26 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bc6e04fa-c3d6-4cfa-b0a3-76439a47cb4f tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Acquiring lock "eea27317-7454-4b5c-8d01-7976255a31bd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:17:26 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bc6e04fa-c3d6-4cfa-b0a3-76439a47cb4f tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Lock "eea27317-7454-4b5c-8d01-7976255a31bd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:17:26 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bc6e04fa-c3d6-4cfa-b0a3-76439a47cb4f tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Acquiring lock "eea27317-7454-4b5c-8d01-7976255a31bd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:17:26 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bc6e04fa-c3d6-4cfa-b0a3-76439a47cb4f tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Lock "eea27317-7454-4b5c-8d01-7976255a31bd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:17:26 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bc6e04fa-c3d6-4cfa-b0a3-76439a47cb4f tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Lock "eea27317-7454-4b5c-8d01-7976255a31bd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:17:26 user nova-compute[74840]: INFO nova.compute.manager [None req-bc6e04fa-c3d6-4cfa-b0a3-76439a47cb4f tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Terminating instance
Nov 08 12:17:26 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bc6e04fa-c3d6-4cfa-b0a3-76439a47cb4f tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Start destroying the instance on the hypervisor. {{(pid=74840) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 12:17:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:17:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:17:26 user nova-compute[74840]: DEBUG nova.compute.manager [req-d075a2cb-8161-4748-9c2a-e58cb2b544c6 req-4f385dff-72b8-428a-bbaa-179ebd4fbfe3 service nova] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Received event network-vif-unplugged-b714ef0b-8de1-45d6-ad22-922a3b727e0c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:17:26 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-d075a2cb-8161-4748-9c2a-e58cb2b544c6 req-4f385dff-72b8-428a-bbaa-179ebd4fbfe3 service nova] Acquiring lock "eea27317-7454-4b5c-8d01-7976255a31bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:17:26 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-d075a2cb-8161-4748-9c2a-e58cb2b544c6 req-4f385dff-72b8-428a-bbaa-179ebd4fbfe3 service nova] Lock "eea27317-7454-4b5c-8d01-7976255a31bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:17:26 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-d075a2cb-8161-4748-9c2a-e58cb2b544c6 req-4f385dff-72b8-428a-bbaa-179ebd4fbfe3 service nova] Lock "eea27317-7454-4b5c-8d01-7976255a31bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:17:26 user nova-compute[74840]: DEBUG nova.compute.manager [req-d075a2cb-8161-4748-9c2a-e58cb2b544c6 req-4f385dff-72b8-428a-bbaa-179ebd4fbfe3 service nova] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] No waiting events found dispatching network-vif-unplugged-b714ef0b-8de1-45d6-ad22-922a3b727e0c {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:17:26 user nova-compute[74840]: DEBUG nova.compute.manager [req-d075a2cb-8161-4748-9c2a-e58cb2b544c6 req-4f385dff-72b8-428a-bbaa-179ebd4fbfe3 service nova] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Received event network-vif-unplugged-b714ef0b-8de1-45d6-ad22-922a3b727e0c for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:17:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:17:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:17:27 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Instance destroyed successfully.
Nov 08 12:17:27 user nova-compute[74840]: DEBUG nova.objects.instance [None req-bc6e04fa-c3d6-4cfa-b0a3-76439a47cb4f tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Lazy-loading 'resources' on Instance uuid eea27317-7454-4b5c-8d01-7976255a31bd {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:17:27 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-bc6e04fa-c3d6-4cfa-b0a3-76439a47cb4f tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:15:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1592917518',display_name='tempest-VolumesAdminNegativeTest-server-1592917518',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1592917518',id=13,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:15:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bd51d983b3aa441dabb1543296f0bb70',ramdisk_id='',reservation_id='r-sxahnvr0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1071383436',owner_user_name='tempest-VolumesAdminNegativeTest-1071383436-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:15:11Z,user_data=None,user_id='016aab95b2394f5f89283d1e62c5fd8d',uuid=eea27317-7454-4b5c-8d01-7976255a31bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b714ef0b-8de1-45d6-ad22-922a3b727e0c", "address": "fa:16:3e:db:66:9d", "network": {"id": "bfa1d7ef-3436-4676-a399-ead8194a958a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-3950314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd51d983b3aa441dabb1543296f0bb70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb714ef0b-8d", "ovs_interfaceid": "b714ef0b-8de1-45d6-ad22-922a3b727e0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:17:27 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-bc6e04fa-c3d6-4cfa-b0a3-76439a47cb4f tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Converting VIF {"id": "b714ef0b-8de1-45d6-ad22-922a3b727e0c", "address": "fa:16:3e:db:66:9d", "network": {"id": "bfa1d7ef-3436-4676-a399-ead8194a958a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-3950314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd51d983b3aa441dabb1543296f0bb70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb714ef0b-8d", "ovs_interfaceid": "b714ef0b-8de1-45d6-ad22-922a3b727e0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:17:27 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-bc6e04fa-c3d6-4cfa-b0a3-76439a47cb4f tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:66:9d,bridge_name='br-int',has_traffic_filtering=True,id=b714ef0b-8de1-45d6-ad22-922a3b727e0c,network=Network(bfa1d7ef-3436-4676-a399-ead8194a958a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb714ef0b-8d') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:17:27 user nova-compute[74840]: DEBUG os_vif [None req-bc6e04fa-c3d6-4cfa-b0a3-76439a47cb4f tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:66:9d,bridge_name='br-int',has_traffic_filtering=True,id=b714ef0b-8de1-45d6-ad22-922a3b727e0c,network=Network(bfa1d7ef-3436-4676-a399-ead8194a958a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb714ef0b-8d') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:17:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:17:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb714ef0b-8d, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:17:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:17:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:17:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:17:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d3c1e29c-00e4-4a4b-9776-8e1054a006d2) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:17:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:17:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:17:27 user nova-compute[74840]: INFO os_vif [None req-bc6e04fa-c3d6-4cfa-b0a3-76439a47cb4f tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:66:9d,bridge_name='br-int',has_traffic_filtering=True,id=b714ef0b-8de1-45d6-ad22-922a3b727e0c,network=Network(bfa1d7ef-3436-4676-a399-ead8194a958a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb714ef0b-8d')
Nov 08 12:17:27 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-bc6e04fa-c3d6-4cfa-b0a3-76439a47cb4f tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Deleting instance files /opt/stack/data/nova/instances/eea27317-7454-4b5c-8d01-7976255a31bd_del
Nov 08 12:17:27 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-bc6e04fa-c3d6-4cfa-b0a3-76439a47cb4f tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Deletion of /opt/stack/data/nova/instances/eea27317-7454-4b5c-8d01-7976255a31bd_del complete
Nov 08 12:17:27 user nova-compute[74840]: INFO nova.compute.manager [None req-bc6e04fa-c3d6-4cfa-b0a3-76439a47cb4f tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 08 12:17:27 user nova-compute[74840]: DEBUG oslo.service.loopingcall [None req-bc6e04fa-c3d6-4cfa-b0a3-76439a47cb4f tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74840) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 12:17:27 user nova-compute[74840]: DEBUG nova.compute.manager [-] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Deallocating network for instance {{(pid=74840) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 12:17:27 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] deallocate_for_instance() {{(pid=74840) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 12:17:28 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:17:28 user nova-compute[74840]: INFO nova.compute.manager [-] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Took 0.73 seconds to deallocate network for instance.
Nov 08 12:17:28 user nova-compute[74840]: DEBUG nova.compute.manager [req-84c896ef-8f1f-4d00-bde5-ded5c00b7e6e req-2327f1b0-3589-4cb9-b1bf-5fab2869d940 service nova] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Received event network-vif-deleted-b714ef0b-8de1-45d6-ad22-922a3b727e0c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:17:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bc6e04fa-c3d6-4cfa-b0a3-76439a47cb4f tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:17:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bc6e04fa-c3d6-4cfa-b0a3-76439a47cb4f tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:17:28 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bc6e04fa-c3d6-4cfa-b0a3-76439a47cb4f tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:17:28 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bc6e04fa-c3d6-4cfa-b0a3-76439a47cb4f tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:17:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bc6e04fa-c3d6-4cfa-b0a3-76439a47cb4f tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.332s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:17:28 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-bc6e04fa-c3d6-4cfa-b0a3-76439a47cb4f tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Deleted allocations for instance eea27317-7454-4b5c-8d01-7976255a31bd
Nov 08 12:17:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bc6e04fa-c3d6-4cfa-b0a3-76439a47cb4f tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Lock "eea27317-7454-4b5c-8d01-7976255a31bd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.245s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:17:28 user nova-compute[74840]: DEBUG nova.compute.manager [req-48733d92-64c6-4212-aa66-02a1a6afd207 req-c8c1ff06-26eb-45a8-9bbf-c976b60df9db service nova] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Received event network-vif-plugged-b714ef0b-8de1-45d6-ad22-922a3b727e0c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:17:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-48733d92-64c6-4212-aa66-02a1a6afd207 req-c8c1ff06-26eb-45a8-9bbf-c976b60df9db service nova] Acquiring lock "eea27317-7454-4b5c-8d01-7976255a31bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:17:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-48733d92-64c6-4212-aa66-02a1a6afd207 req-c8c1ff06-26eb-45a8-9bbf-c976b60df9db service nova] Lock "eea27317-7454-4b5c-8d01-7976255a31bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:17:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-48733d92-64c6-4212-aa66-02a1a6afd207 req-c8c1ff06-26eb-45a8-9bbf-c976b60df9db service nova] Lock "eea27317-7454-4b5c-8d01-7976255a31bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:17:28 user nova-compute[74840]: DEBUG nova.compute.manager [req-48733d92-64c6-4212-aa66-02a1a6afd207 req-c8c1ff06-26eb-45a8-9bbf-c976b60df9db service nova] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] No waiting events found dispatching network-vif-plugged-b714ef0b-8de1-45d6-ad22-922a3b727e0c {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:17:28 user nova-compute[74840]: WARNING nova.compute.manager [req-48733d92-64c6-4212-aa66-02a1a6afd207 req-c8c1ff06-26eb-45a8-9bbf-c976b60df9db service nova] [instance: eea27317-7454-4b5c-8d01-7976255a31bd] Received unexpected event network-vif-plugged-b714ef0b-8de1-45d6-ad22-922a3b727e0c for instance with vm_state deleted and task_state None.
Nov 08 12:17:30 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:17:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:17:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:17:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:17:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-de6306cb-31e1-4696-be85-051dd265309c tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Acquiring lock "28ccd7b3-8bbe-42e7-aa00-612b3703ae79" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:17:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-de6306cb-31e1-4696-be85-051dd265309c tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Lock "28ccd7b3-8bbe-42e7-aa00-612b3703ae79" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:17:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-de6306cb-31e1-4696-be85-051dd265309c tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Acquiring lock "28ccd7b3-8bbe-42e7-aa00-612b3703ae79-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:17:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-de6306cb-31e1-4696-be85-051dd265309c tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Lock "28ccd7b3-8bbe-42e7-aa00-612b3703ae79-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:17:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-de6306cb-31e1-4696-be85-051dd265309c tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Lock "28ccd7b3-8bbe-42e7-aa00-612b3703ae79-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:17:33 user nova-compute[74840]: INFO nova.compute.manager [None req-de6306cb-31e1-4696-be85-051dd265309c tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Terminating instance
Nov 08 12:17:33 user nova-compute[74840]: DEBUG nova.compute.manager [None req-de6306cb-31e1-4696-be85-051dd265309c tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Start destroying the instance on the hypervisor. {{(pid=74840) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 12:17:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:17:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:17:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:17:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:17:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG nova.compute.manager [req-f7eb71a3-d8b1-41d7-a206-cebe690fd929 req-d9162284-80d1-42de-96fc-00f7535e5a02 service nova] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Received event network-vif-unplugged-bd22c195-e803-484d-811a-aeeb04326bd0 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-f7eb71a3-d8b1-41d7-a206-cebe690fd929 req-d9162284-80d1-42de-96fc-00f7535e5a02 service nova] Acquiring lock "28ccd7b3-8bbe-42e7-aa00-612b3703ae79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-f7eb71a3-d8b1-41d7-a206-cebe690fd929 req-d9162284-80d1-42de-96fc-00f7535e5a02 service nova] Lock "28ccd7b3-8bbe-42e7-aa00-612b3703ae79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-f7eb71a3-d8b1-41d7-a206-cebe690fd929 req-d9162284-80d1-42de-96fc-00f7535e5a02 service nova] Lock "28ccd7b3-8bbe-42e7-aa00-612b3703ae79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG nova.compute.manager [req-f7eb71a3-d8b1-41d7-a206-cebe690fd929 req-d9162284-80d1-42de-96fc-00f7535e5a02 service nova] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] No waiting events found dispatching network-vif-unplugged-bd22c195-e803-484d-811a-aeeb04326bd0 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG nova.compute.manager [req-f7eb71a3-d8b1-41d7-a206-cebe690fd929 req-d9162284-80d1-42de-96fc-00f7535e5a02 service nova] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Received event network-vif-unplugged-bd22c195-e803-484d-811a-aeeb04326bd0 for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:17:34 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Instance destroyed successfully.
Nov 08 12:17:34 user nova-compute[74840]: DEBUG nova.objects.instance [None req-de6306cb-31e1-4696-be85-051dd265309c tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Lazy-loading 'resources' on Instance uuid 28ccd7b3-8bbe-42e7-aa00-612b3703ae79 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-de6306cb-31e1-4696-be85-051dd265309c tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T12:11:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1277810806',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-791461388',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHpDLhfsQbuoiOAJZjQdzHvpPhC/nzLrrMQESJ5Ldi9eYg8zkak82Rki/GHtRFnLyoKBsr3ji4PDu9fap5vsgpePAUrrP6MvAc2bSYV1GEi6T2SkCHIaBKds2SkXizZsQ==',key_name='tempest-keypair-1117122950',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:15:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c961954c4a0440a93d9738ca5ab0026',ramdisk_id='',reservation_id='r-pbsbcfi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-874131883',owner_user_name='tempest-ServerActionsV293TestJSON-874131883-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:15:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cab11962ef3472a864f830d45396c4c',uuid=28ccd7b3-8bbe-42e7-aa00-612b3703ae79,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd22c195-e803-484d-811a-aeeb04326bd0", "address": "fa:16:3e:ee:6e:72", "network": {"id": "d0c950e1-4e6d-42f7-bbbb-7164603882bc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1883968250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c961954c4a0440a93d9738ca5ab0026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd22c195-e8", "ovs_interfaceid": "bd22c195-e803-484d-811a-aeeb04326bd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-de6306cb-31e1-4696-be85-051dd265309c tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Converting VIF {"id": "bd22c195-e803-484d-811a-aeeb04326bd0", "address": "fa:16:3e:ee:6e:72", "network": {"id": "d0c950e1-4e6d-42f7-bbbb-7164603882bc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1883968250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c961954c4a0440a93d9738ca5ab0026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd22c195-e8", "ovs_interfaceid": "bd22c195-e803-484d-811a-aeeb04326bd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-de6306cb-31e1-4696-be85-051dd265309c tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:6e:72,bridge_name='br-int',has_traffic_filtering=True,id=bd22c195-e803-484d-811a-aeeb04326bd0,network=Network(d0c950e1-4e6d-42f7-bbbb-7164603882bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd22c195-e8') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG os_vif [None req-de6306cb-31e1-4696-be85-051dd265309c tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:6e:72,bridge_name='br-int',has_traffic_filtering=True,id=bd22c195-e803-484d-811a-aeeb04326bd0,network=Network(d0c950e1-4e6d-42f7-bbbb-7164603882bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd22c195-e8') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd22c195-e8, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=119d6dfb-acb2-4366-9e04-2e15dc86397b) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:17:34 user nova-compute[74840]: INFO os_vif [None req-de6306cb-31e1-4696-be85-051dd265309c tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:6e:72,bridge_name='br-int',has_traffic_filtering=True,id=bd22c195-e803-484d-811a-aeeb04326bd0,network=Network(d0c950e1-4e6d-42f7-bbbb-7164603882bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd22c195-e8')
Nov 08 12:17:34 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de6306cb-31e1-4696-be85-051dd265309c tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6306cb-31e1-4696-be85-051dd265309c tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BXnlZryS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:17:34 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-de6306cb-31e1-4696-be85-051dd265309c tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:17:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-de6306cb-31e1-4696-be85-051dd265309c tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-de6306cb-31e1-4696-be85-051dd265309c tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9b6b8a-5d7f-482d-ab8a-db1f99ef8931]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6306cb-31e1-4696-be85-051dd265309c tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 12:17:34 user nova-compute[74840]: No targets found.
Nov 08 12:17:34 user nova-compute[74840]: iSNS:
Nov 08 12:17:34 user nova-compute[74840]: No targets found.
Nov 08 12:17:34 user nova-compute[74840]: STATIC:
Nov 08 12:17:34 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22
Nov 08 12:17:34 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:17:34 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:17:34 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097
Nov 08 12:17:34 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:17:34 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:17:34 user nova-compute[74840]: FIRMWARE:
Nov 08 12:17:34 user nova-compute[74840]: No targets found.
Nov 08 12:17:34 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6306cb-31e1-4696-be85-051dd265309c tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 12:17:34 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 12:17:34 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6306cb-31e1-4696-be85-051dd265309c tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7618061-e286-4c47-98e5-fff171949199]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81b5dfc-c11a-45ff-8732-6888cbfd83e8]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6306cb-31e1-4696-be85-051dd265309c tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)
Nov 08 12:17:34 user nova-compute[74840]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)
Nov 08 12:17:34 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6306cb-31e1-4696-be85-051dd265309c tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 (non-flash)
Nov 08 12:17:34 user nova-compute[74840]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)
Nov 08 12:17:34 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6306cb-31e1-4696-be85-051dd265309c tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7ec371750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097'): ({'sdb'}, set())}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-de6306cb-31e1-4696-be85-051dd265309c tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Removing single pathed devices sdb {{(pid=74840) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1d371d-7c7d-4bbe-a6c1-08b317bc30f2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac57be5-f181-48f1-8f47-58749dd9fb6f]: (4, ('ok\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-de6306cb-31e1-4696-be85-051dd265309c tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Flushing IO for device /dev/sdb {{(pid=74840) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9192a988-0a78-4a5a-9a54-5d1fbf5e1f7e]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-de6306cb-31e1-4696-be85-051dd265309c tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74840) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b625b7fc-2ce2-418d-a1df-f2ece0231ae7]: (4, ('1', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-de6306cb-31e1-4696-be85-051dd265309c tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-de6306cb-31e1-4696-be85-051dd265309c tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] SCSI volumes sdb have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_f2c38507', '/dev/disk/by-id/scsi-1SCST_BIOf2c38507-9ec07a6089bd8d21', '/dev/disk/by-id/scsi-23965633037613630') {{(pid=85688) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2fb47e-0768-415c-b0c3-9d5f01fa3acf]: (4, None) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6306cb-31e1-4696-be85-051dd265309c tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097')] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a555732-6274-4a90-8d7e-85ddbb78c89b]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6306cb-31e1-4696-be85-051dd265309c tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 -p 172.16.0.220:3260 --logout {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d9c49e-90ba-4266-9324-6f27d3b265d8]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6306cb-31e1-4696-be85-051dd265309c tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097, portal: 172.16.0.220,3260]
Nov 08 12:17:34 user nova-compute[74840]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097, portal: 172.16.0.220,3260] successful.
Nov 08 12:17:34 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 -p 172.16.0.220:3260 --op delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a571b42-9e1d-4406-b369-12722b22f097 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[2715dd35-3d56-4e64-8f09-830967b1be1d]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6306cb-31e1-4696-be85-051dd265309c tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-de6306cb-31e1-4696-be85-051dd265309c tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-de6306cb-31e1-4696-be85-051dd265309c tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] <== disconnect_volume: return (343ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:17:34 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de6306cb-31e1-4696-be85-051dd265309c tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 12:17:34 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-de6306cb-31e1-4696-be85-051dd265309c tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Deleting instance files /opt/stack/data/nova/instances/28ccd7b3-8bbe-42e7-aa00-612b3703ae79_del
Nov 08 12:17:34 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-de6306cb-31e1-4696-be85-051dd265309c tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Deletion of /opt/stack/data/nova/instances/28ccd7b3-8bbe-42e7-aa00-612b3703ae79_del complete
Nov 08 12:17:35 user nova-compute[74840]: INFO nova.compute.manager [None req-de6306cb-31e1-4696-be85-051dd265309c tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 08 12:17:35 user nova-compute[74840]: DEBUG oslo.service.loopingcall [None req-de6306cb-31e1-4696-be85-051dd265309c tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74840) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 12:17:35 user nova-compute[74840]: DEBUG nova.compute.manager [-] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Deallocating network for instance {{(pid=74840) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 12:17:35 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] deallocate_for_instance() {{(pid=74840) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 12:17:35 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:17:35 user nova-compute[74840]: INFO nova.compute.manager [-] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Took 0.77 seconds to deallocate network for instance.
Nov 08 12:17:35 user nova-compute[74840]: DEBUG nova.compute.manager [req-6fc7e585-be52-4e05-958f-3a86a79da25d req-b1d489af-44b0-4aee-82c3-7bc255db2549 service nova] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Received event network-vif-deleted-bd22c195-e803-484d-811a-aeeb04326bd0 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:17:36 user nova-compute[74840]: DEBUG nova.compute.manager [req-b2d867f5-719d-4697-bd5d-9ab9a73255f2 req-7609ea21-3608-4783-a923-212c06213145 service nova] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Received event network-vif-plugged-bd22c195-e803-484d-811a-aeeb04326bd0 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:17:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-b2d867f5-719d-4697-bd5d-9ab9a73255f2 req-7609ea21-3608-4783-a923-212c06213145 service nova] Acquiring lock "28ccd7b3-8bbe-42e7-aa00-612b3703ae79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:17:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-b2d867f5-719d-4697-bd5d-9ab9a73255f2 req-7609ea21-3608-4783-a923-212c06213145 service nova] Lock "28ccd7b3-8bbe-42e7-aa00-612b3703ae79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:17:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-b2d867f5-719d-4697-bd5d-9ab9a73255f2 req-7609ea21-3608-4783-a923-212c06213145 service nova] Lock "28ccd7b3-8bbe-42e7-aa00-612b3703ae79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:17:36 user nova-compute[74840]: DEBUG nova.compute.manager [req-b2d867f5-719d-4697-bd5d-9ab9a73255f2 req-7609ea21-3608-4783-a923-212c06213145 service nova] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] No waiting events found dispatching network-vif-plugged-bd22c195-e803-484d-811a-aeeb04326bd0 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:17:36 user nova-compute[74840]: WARNING nova.compute.manager [req-b2d867f5-719d-4697-bd5d-9ab9a73255f2 req-7609ea21-3608-4783-a923-212c06213145 service nova] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Received unexpected event network-vif-plugged-bd22c195-e803-484d-811a-aeeb04326bd0 for instance with vm_state active and task_state deleting.
Nov 08 12:17:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:17:36 user nova-compute[74840]: INFO nova.compute.manager [None req-de6306cb-31e1-4696-be85-051dd265309c tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Took 0.98 seconds to detach 1 volumes for instance.
Nov 08 12:17:36 user nova-compute[74840]: DEBUG nova.compute.manager [None req-de6306cb-31e1-4696-be85-051dd265309c tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] [instance: 28ccd7b3-8bbe-42e7-aa00-612b3703ae79] Deleting volume: 2a571b42-9e1d-4406-b369-12722b22f097 {{(pid=74840) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 12:17:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-de6306cb-31e1-4696-be85-051dd265309c tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:17:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-de6306cb-31e1-4696-be85-051dd265309c tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:17:37 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-de6306cb-31e1-4696-be85-051dd265309c tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:17:37 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-de6306cb-31e1-4696-be85-051dd265309c tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:17:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-de6306cb-31e1-4696-be85-051dd265309c tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.377s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:17:37 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-de6306cb-31e1-4696-be85-051dd265309c tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Deleted allocations for instance 28ccd7b3-8bbe-42e7-aa00-612b3703ae79
Nov 08 12:17:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-de6306cb-31e1-4696-be85-051dd265309c tempest-ServerActionsV293TestJSON-874131883 tempest-ServerActionsV293TestJSON-874131883-project-member] Lock "28ccd7b3-8bbe-42e7-aa00-612b3703ae79" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.867s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:17:37 user nova-compute[74840]: DEBUG nova.compute.manager [req-08a0b332-b744-4b85-975b-c87da8e5b4fe req-693dadc9-70d1-4a5c-b1d4-0b5410be7cc3 service nova] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Received event network-changed-b3920dbd-57a3-4469-a524-a98d45a157e1 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:17:37 user nova-compute[74840]: DEBUG nova.compute.manager [req-08a0b332-b744-4b85-975b-c87da8e5b4fe req-693dadc9-70d1-4a5c-b1d4-0b5410be7cc3 service nova] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Refreshing instance network info cache due to event network-changed-b3920dbd-57a3-4469-a524-a98d45a157e1. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:17:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-08a0b332-b744-4b85-975b-c87da8e5b4fe req-693dadc9-70d1-4a5c-b1d4-0b5410be7cc3 service nova] Acquiring lock "refresh_cache-74a51b1b-103e-49b2-b7a0-ec4625a9445b" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:17:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-08a0b332-b744-4b85-975b-c87da8e5b4fe req-693dadc9-70d1-4a5c-b1d4-0b5410be7cc3 service nova] Acquired lock "refresh_cache-74a51b1b-103e-49b2-b7a0-ec4625a9445b" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:17:37 user nova-compute[74840]: DEBUG nova.network.neutron [req-08a0b332-b744-4b85-975b-c87da8e5b4fe req-693dadc9-70d1-4a5c-b1d4-0b5410be7cc3 service nova] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Refreshing network info cache for port b3920dbd-57a3-4469-a524-a98d45a157e1 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:17:38 user nova-compute[74840]: DEBUG nova.network.neutron [req-08a0b332-b744-4b85-975b-c87da8e5b4fe req-693dadc9-70d1-4a5c-b1d4-0b5410be7cc3 service nova] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Updated VIF entry in instance network info cache for port b3920dbd-57a3-4469-a524-a98d45a157e1. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:17:38 user nova-compute[74840]: DEBUG nova.network.neutron [req-08a0b332-b744-4b85-975b-c87da8e5b4fe req-693dadc9-70d1-4a5c-b1d4-0b5410be7cc3 service nova] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Updating instance_info_cache with network_info: [{"id": "b3920dbd-57a3-4469-a524-a98d45a157e1", "address": "fa:16:3e:c3:be:3a", "network": {"id": "381cad9f-376a-4335-95a4-4824aa0d7fad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1035058856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ec082e08ddf4477a721e410fe944d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3920dbd-57", "ovs_interfaceid": "b3920dbd-57a3-4469-a524-a98d45a157e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:17:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-08a0b332-b744-4b85-975b-c87da8e5b4fe req-693dadc9-70d1-4a5c-b1d4-0b5410be7cc3 service nova] Releasing lock "refresh_cache-74a51b1b-103e-49b2-b7a0-ec4625a9445b" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:17:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:17:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:17:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d65d4e64-5460-412a-9aa4-6ac57c03a573 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "74a51b1b-103e-49b2-b7a0-ec4625a9445b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:17:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d65d4e64-5460-412a-9aa4-6ac57c03a573 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "74a51b1b-103e-49b2-b7a0-ec4625a9445b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:17:44 user nova-compute[74840]: DEBUG nova.objects.instance [None req-d65d4e64-5460-412a-9aa4-6ac57c03a573 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lazy-loading 'flavor' on Instance uuid 74a51b1b-103e-49b2-b7a0-ec4625a9445b {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:17:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d65d4e64-5460-412a-9aa4-6ac57c03a573 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "74a51b1b-103e-49b2-b7a0-ec4625a9445b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:17:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:17:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d65d4e64-5460-412a-9aa4-6ac57c03a573 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "74a51b1b-103e-49b2-b7a0-ec4625a9445b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:17:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d65d4e64-5460-412a-9aa4-6ac57c03a573 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "74a51b1b-103e-49b2-b7a0-ec4625a9445b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:17:44 user nova-compute[74840]: INFO nova.compute.manager [None req-d65d4e64-5460-412a-9aa4-6ac57c03a573 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Attaching volume 49a84c89-160c-4f06-aa6d-c87d01a362fa to /dev/vdb
Nov 08 12:17:44 user nova-compute[74840]: DEBUG os_brick.utils [None req-d65d4e64-5460-412a-9aa4-6ac57c03a573 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:17:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:17:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:17:44 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[29406ca1-322e-447c-8d1d-ef3b69ad8dc1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c8228a11e03c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:17:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:17:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:17:44 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[973f80a0-4222-4a9a-a74e-655b80eaa4ec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:17:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:17:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:17:44 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06a3281-6b91-4e86-aad7-67dc12f3f1e4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:17:44 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0619d63-bd0e-4a66-9800-edd181430b1f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:17:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-d65d4e64-5460-412a-9aa4-6ac57c03a573 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Running cmd (subprocess): nvme version {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:17:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-d65d4e64-5460-412a-9aa4-6ac57c03a573 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] 'nvme version' failed. Not Retrying. {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:17:44 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d65d4e64-5460-412a-9aa4-6ac57c03a573 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] nvme not present on system {{(pid=74840) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 12:17:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:17:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:17:44 user nova-compute[74840]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 12:17:44 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17ad19e-8b57-4549-9b62-059e58caef40]: (4, '') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:17:44 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-d65d4e64-5460-412a-9aa4-6ac57c03a573 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74840) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 12:17:44 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-d65d4e64-5460-412a-9aa4-6ac57c03a573 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 12:17:44 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-d65d4e64-5460-412a-9aa4-6ac57c03a573 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] LIGHTOS: no hostnqn found. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 12:17:44 user nova-compute[74840]: DEBUG os_brick.utils [None req-d65d4e64-5460-412a-9aa4-6ac57c03a573 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c8228a11e03c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:17:44 user nova-compute[74840]: DEBUG nova.virt.block_device [None req-d65d4e64-5460-412a-9aa4-6ac57c03a573 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Updating existing volume attachment record: b5115d29-dbe5-479f-969e-a9f5db2b9c93 {{(pid=74840) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 12:17:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:17:47 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:17:47 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:17:47 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:17:48 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:17:48 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:17:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "refresh_cache-a0b7a0e1-d0d1-4682-9218-ef44d1e461f1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:17:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquired lock "refresh_cache-a0b7a0e1-d0d1-4682-9218-ef44d1e461f1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:17:48 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Forcefully refreshing network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 12:17:49 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Updating instance_info_cache with network_info: [{"id": "259ddaf9-a353-4528-a451-96ff20064ff1", "address": "fa:16:3e:8b:2d:b3", "network": {"id": "b976e3d8-8d34-4f01-942d-c751f6a68780", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-154778043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65971596fc0642f3912bad70dc3e4e07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259ddaf9-a3", "ovs_interfaceid": "259ddaf9-a353-4528-a451-96ff20064ff1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:17:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Releasing lock "refresh_cache-a0b7a0e1-d0d1-4682-9218-ef44d1e461f1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:17:49 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Updated the network info_cache for instance {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 12:17:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:17:49 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:17:49 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:17:49 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:17:52 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:17:52 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:17:52 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:17:52 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:17:52 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:17:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0b7a0e1-d0d1-4682-9218-ef44d1e461f1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:17:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0b7a0e1-d0d1-4682-9218-ef44d1e461f1/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:17:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0b7a0e1-d0d1-4682-9218-ef44d1e461f1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:17:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0b7a0e1-d0d1-4682-9218-ef44d1e461f1/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:17:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c7b5726-907f-4ae3-aba0-b58351106717/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:17:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c7b5726-907f-4ae3-aba0-b58351106717/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:17:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c7b5726-907f-4ae3-aba0-b58351106717/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:17:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c7b5726-907f-4ae3-aba0-b58351106717/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:17:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:17:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:17:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:17:54 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:17:54 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:17:54 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:17:54 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:17:54 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:17:54 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:17:54 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:17:54 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:17:54 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:17:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:17:55 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:17:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74a51b1b-103e-49b2-b7a0-ec4625a9445b/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:17:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74a51b1b-103e-49b2-b7a0-ec4625a9445b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:17:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74a51b1b-103e-49b2-b7a0-ec4625a9445b/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:17:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74a51b1b-103e-49b2-b7a0-ec4625a9445b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:17:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/684b8be2-7f8f-499f-8885-c9d1c86eef2f/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:17:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/684b8be2-7f8f-499f-8885-c9d1c86eef2f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:17:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/684b8be2-7f8f-499f-8885-c9d1c86eef2f/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:17:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/684b8be2-7f8f-499f-8885-c9d1c86eef2f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:17:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:17:56 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:17:56 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:17:56 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=7805MB free_disk=25.319869995117188GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:17:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:17:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:17:56 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 684b8be2-7f8f-499f-8885-c9d1c86eef2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:17:56 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance a0b7a0e1-d0d1-4682-9218-ef44d1e461f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:17:56 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 3b10fda0-9488-4089-8033-dd1c8e42af89 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:17:56 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:17:56 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 74a51b1b-103e-49b2-b7a0-ec4625a9445b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:17:56 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 4c7b5726-907f-4ae3-aba0-b58351106717 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:17:56 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance d3e8efc6-7146-46ef-8433-380d7e69120c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:17:56 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 9b90af19-7629-4d19-ba8f-fae652f62e3e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:17:56 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:17:56 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:17:56 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:17:56 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:17:56 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:17:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.468s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:17:57 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:17:57 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:17:59 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bb4f16e-f742-49ec-9fcf-e2a2fcf4a063 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Calling os-brick to attach iSCSI Volume {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb4f16e-f742-49ec-9fcf-e2a2fcf4a063 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zBHKyiGW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:18:02 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-4bb4f16e-f742-49ec-9fcf-e2a2fcf4a063 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:18:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-4bb4f16e-f742-49ec-9fcf-e2a2fcf4a063 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-4bb4f16e-f742-49ec-9fcf-e2a2fcf4a063 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:18:02 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-4bb4f16e-f742-49ec-9fcf-e2a2fcf4a063 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:18:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-4bb4f16e-f742-49ec-9fcf-e2a2fcf4a063 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-4bb4f16e-f742-49ec-9fcf-e2a2fcf4a063 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:18:02 user nova-compute[74840]: INFO os_brick.initiator.connectors.iscsi [None req-4bb4f16e-f742-49ec-9fcf-e2a2fcf4a063 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 12:18:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 -p 172.16.0.220:3260 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83555a3-94b3-429d-8561-a5f8c87f6d1b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb4f16e-f742-49ec-9fcf-e2a2fcf4a063 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 12:18:02 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7284ab8b-85d0-45cf-85dd-dab5d7cb1175]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9] added\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb4f16e-f742-49ec-9fcf-e2a2fcf4a063 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9] added
Nov 08 12:18:02 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c548ee23-f75d-466f-8b5e-d6c0605f48e1]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb4f16e-f742-49ec-9fcf-e2a2fcf4a063 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aad3805-8741-4177-864a-74ec22e5f79e]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb4f16e-f742-49ec-9fcf-e2a2fcf4a063 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zBHKyiGW {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zBHKyiGW" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3831e4-c629-48e3-8cca-ff92ec145be4]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb4f16e-f742-49ec-9fcf-e2a2fcf4a063 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zBHKyiGW'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d1aea8-bc51-42b6-b5da-9f7261afb9e9]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb4f16e-f742-49ec-9fcf-e2a2fcf4a063 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9f7ed7-c4c1-4f10-b45e-d523f3fb62ad]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb4f16e-f742-49ec-9fcf-e2a2fcf4a063 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)
Nov 08 12:18:02 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb4f16e-f742-49ec-9fcf-e2a2fcf4a063 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)
Nov 08 12:18:02 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 -p 172.16.0.220:3260 --login {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d8806a-a9bf-43e6-8508-ddbc4b2f1c88]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb4f16e-f742-49ec-9fcf-e2a2fcf4a063 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9, portal: 172.16.0.220,3260]
Nov 08 12:18:02 user nova-compute[74840]: Login to [iface: default, target: iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9, portal: 172.16.0.220,3260] successful.
Nov 08 12:18:02 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e74aaa8-4f35-45ed-b059-928fb985aa12]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb4f16e-f742-49ec-9fcf-e2a2fcf4a063 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG nova.compute.manager [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Start spawning the instance on the hypervisor. {{(pid=74840) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:18:02 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Creating image(s)
Nov 08 12:18:02 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Did not create local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Ensure instance console log exists: /opt/stack/data/nova/instances/9b90af19-7629-4d19-ba8f-fae652f62e3e/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Start _get_guest_xml network_info=[{"id": "3b079dbf-c166-48cc-a7ad-1a971751ba88", "address": "fa:16:3e:b7:f7:ea", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b079dbf-c1", "ovs_interfaceid": "3b079dbf-c166-48cc-a7ad-1a971751ba88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '8b393fdb-d202-4268-a463-3b4cc74a0694', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XJAkVPia', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9b90af19-7629-4d19-ba8f-fae652f62e3e', 'attached_at': '', 'detached_at': '', 'volume_id': '76c4c09e-d3eb-4c13-b405-57ea4c9e3665', 'serial': '76c4c09e-d3eb-4c13-b405-57ea4c9e3665'}, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16d7754-1e78-4581-8e0f-e91dbafc40f0]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb4f16e-f742-49ec-9fcf-e2a2fcf4a063 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)
Nov 08 12:18:02 user nova-compute[74840]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 (non-flash)
Nov 08 12:18:02 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb4f16e-f742-49ec-9fcf-e2a2fcf4a063 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)
Nov 08 12:18:02 user nova-compute[74840]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 (non-flash)
Nov 08 12:18:02 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-4bb4f16e-f742-49ec-9fcf-e2a2fcf4a063 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb4f16e-f742-49ec-9fcf-e2a2fcf4a063 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Connected to 172.16.0.220:3260 {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-4bb4f16e-f742-49ec-9fcf-e2a2fcf4a063 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=74840) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-4bb4f16e-f742-49ec-9fcf-e2a2fcf4a063 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74840) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:02 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:18:02 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:18:02 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Calling os-brick to attach iSCSI Volume {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XJAkVPia', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:18:02 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:18:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b40f89e-d492-42e1-ab34-3ad646d12eae]: (4, ('- - 0', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-4bb4f16e-f742-49ec-9fcf-e2a2fcf4a063 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:18:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb4f16e-f742-49ec-9fcf-e2a2fcf4a063 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zBHKyiGW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 12:18:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-401d998e-6f35-4cc7-9876-28dfd7aa711b tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Acquiring lock "4c7b5726-907f-4ae3-aba0-b58351106717" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:18:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-401d998e-6f35-4cc7-9876-28dfd7aa711b tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Lock "4c7b5726-907f-4ae3-aba0-b58351106717" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:18:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-401d998e-6f35-4cc7-9876-28dfd7aa711b tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Acquiring lock "4c7b5726-907f-4ae3-aba0-b58351106717-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:18:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-401d998e-6f35-4cc7-9876-28dfd7aa711b tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Lock "4c7b5726-907f-4ae3-aba0-b58351106717-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:18:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-401d998e-6f35-4cc7-9876-28dfd7aa711b tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Lock "4c7b5726-907f-4ae3-aba0-b58351106717-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:18:03 user nova-compute[74840]: INFO nova.compute.manager [None req-401d998e-6f35-4cc7-9876-28dfd7aa711b tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Terminating instance
Nov 08 12:18:03 user nova-compute[74840]: DEBUG nova.compute.manager [None req-401d998e-6f35-4cc7-9876-28dfd7aa711b tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Start destroying the instance on the hypervisor. {{(pid=74840) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 12:18:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:03 user nova-compute[74840]: DEBUG nova.compute.manager [req-e81459c7-5956-47a5-804a-5d73f8f2772c req-fe02843c-c7bc-474a-a69f-f1af4e5e9d07 service nova] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Received event network-vif-unplugged-4faa22f9-4e0d-45de-bb90-8348b96c1268 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:18:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e81459c7-5956-47a5-804a-5d73f8f2772c req-fe02843c-c7bc-474a-a69f-f1af4e5e9d07 service nova] Acquiring lock "4c7b5726-907f-4ae3-aba0-b58351106717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:18:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e81459c7-5956-47a5-804a-5d73f8f2772c req-fe02843c-c7bc-474a-a69f-f1af4e5e9d07 service nova] Lock "4c7b5726-907f-4ae3-aba0-b58351106717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:18:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e81459c7-5956-47a5-804a-5d73f8f2772c req-fe02843c-c7bc-474a-a69f-f1af4e5e9d07 service nova] Lock "4c7b5726-907f-4ae3-aba0-b58351106717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:18:03 user nova-compute[74840]: DEBUG nova.compute.manager [req-e81459c7-5956-47a5-804a-5d73f8f2772c req-fe02843c-c7bc-474a-a69f-f1af4e5e9d07 service nova] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] No waiting events found dispatching network-vif-unplugged-4faa22f9-4e0d-45de-bb90-8348b96c1268 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:18:03 user nova-compute[74840]: DEBUG nova.compute.manager [req-e81459c7-5956-47a5-804a-5d73f8f2772c req-fe02843c-c7bc-474a-a69f-f1af4e5e9d07 service nova] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Received event network-vif-unplugged-4faa22f9-4e0d-45de-bb90-8348b96c1268 for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:18:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-4bb4f16e-f742-49ec-9fcf-e2a2fcf4a063 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.420s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:18:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb4f16e-f742-49ec-9fcf-e2a2fcf4a063 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] <== connect_volume: return (1421ms) {'type': 'block', 'scsi_wwn': '23064306439306266', 'path': '/dev/sdb'} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:18:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bb4f16e-f742-49ec-9fcf-e2a2fcf4a063 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064306439306266', 'path': '/dev/sdb'} {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 12:18:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.009s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:18:03 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:18:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:18:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:18:03 user nova-compute[74840]: INFO os_brick.initiator.connectors.iscsi [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 12:18:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665 -p 172.16.0.220:3260 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:03 user nova-compute[74840]: DEBUG nova.objects.instance [None req-4bb4f16e-f742-49ec-9fcf-e2a2fcf4a063 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Lazy-loading 'flavor' on Instance uuid e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:18:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:03 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a4faae-c721-4cd4-a2b7-b558372ef19d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 12:18:03 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:18:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665 -p 172.16.0.220:3260 --interface default --op new {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-4bb4f16e-f742-49ec-9fcf-e2a2fcf4a063 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 12:18:03 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:18:03 user nova-compute[74840]:   <source dev="/dev/sdb"/>
Nov 08 12:18:03 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:18:03 user nova-compute[74840]:   <serial>47e08f73-fc30-4ecb-a62f-074aa12560a9</serial>
Nov 08 12:18:03 user nova-compute[74840]: </disk>
Nov 08 12:18:03 user nova-compute[74840]:  {{(pid=74840) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 12:18:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:03 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[609cf4b8-cf96-4993-8bae-d10cbf28f6e9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665] added\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665] added
Nov 08 12:18:03 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:18:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:03 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[0168284c-aaed-4e10-9996-64a8887626a3]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:18:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:03 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[94358b12-d605-4330-a78d-12f549efedd3]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:18:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XJAkVPia {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XJAkVPia" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:03 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8bcde8-2959-43e0-8d81-24ea969c527a]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XJAkVPia'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:18:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:03 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[89152d9a-e824-4ffa-95dc-55e117f7c479]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:18:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:03 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[47fc4022-8a8a-41f7-b411-d1b959d0689b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)
Nov 08 12:18:03 user nova-compute[74840]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 (non-flash)
Nov 08 12:18:03 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:18:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)
Nov 08 12:18:03 user nova-compute[74840]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 (non-flash)
Nov 08 12:18:03 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:18:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665 -p 172.16.0.220:3260 --login {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:04 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Instance destroyed successfully.
Nov 08 12:18:04 user nova-compute[74840]: DEBUG nova.objects.instance [None req-401d998e-6f35-4cc7-9876-28dfd7aa711b tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Lazy-loading 'resources' on Instance uuid 4c7b5726-907f-4ae3-aba0-b58351106717 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:18:04 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-401d998e-6f35-4cc7-9876-28dfd7aa711b tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:15:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1414983349',display_name='tempest-VolumesActionsTest-instance-1414983349',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1414983349',id=16,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:16:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aee170af16c94cb0ac38095060bcb498',ramdisk_id='',reservation_id='r-zlm0ojpd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-549796604',owner_user_name='tempest-VolumesActionsTest-549796604-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:16:06Z,user_data=None,user_id='82d4449a578d4eb99cb9159a9cb35bf1',uuid=4c7b5726-907f-4ae3-aba0-b58351106717,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4faa22f9-4e0d-45de-bb90-8348b96c1268", "address": "fa:16:3e:72:b1:f7", "network": {"id": "fcca035f-b03c-407d-99c5-4e1a46ef8354", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1402418482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aee170af16c94cb0ac38095060bcb498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4faa22f9-4e", "ovs_interfaceid": "4faa22f9-4e0d-45de-bb90-8348b96c1268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:18:04 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-401d998e-6f35-4cc7-9876-28dfd7aa711b tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Converting VIF {"id": "4faa22f9-4e0d-45de-bb90-8348b96c1268", "address": "fa:16:3e:72:b1:f7", "network": {"id": "fcca035f-b03c-407d-99c5-4e1a46ef8354", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1402418482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aee170af16c94cb0ac38095060bcb498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4faa22f9-4e", "ovs_interfaceid": "4faa22f9-4e0d-45de-bb90-8348b96c1268", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:18:04 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-401d998e-6f35-4cc7-9876-28dfd7aa711b tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:b1:f7,bridge_name='br-int',has_traffic_filtering=True,id=4faa22f9-4e0d-45de-bb90-8348b96c1268,network=Network(fcca035f-b03c-407d-99c5-4e1a46ef8354),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4faa22f9-4e') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:18:04 user nova-compute[74840]: DEBUG os_vif [None req-401d998e-6f35-4cc7-9876-28dfd7aa711b tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:b1:f7,bridge_name='br-int',has_traffic_filtering=True,id=4faa22f9-4e0d-45de-bb90-8348b96c1268,network=Network(fcca035f-b03c-407d-99c5-4e1a46ef8354),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4faa22f9-4e') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:18:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4faa22f9-4e, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:18:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=94dff163-7d93-424e-a3fb-7f48c0d4980c) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:18:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:18:04 user nova-compute[74840]: INFO os_vif [None req-401d998e-6f35-4cc7-9876-28dfd7aa711b tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:b1:f7,bridge_name='br-int',has_traffic_filtering=True,id=4faa22f9-4e0d-45de-bb90-8348b96c1268,network=Network(fcca035f-b03c-407d-99c5-4e1a46ef8354),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4faa22f9-4e')
Nov 08 12:18:04 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-401d998e-6f35-4cc7-9876-28dfd7aa711b tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Deleting instance files /opt/stack/data/nova/instances/4c7b5726-907f-4ae3-aba0-b58351106717_del
Nov 08 12:18:04 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-401d998e-6f35-4cc7-9876-28dfd7aa711b tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Deletion of /opt/stack/data/nova/instances/4c7b5726-907f-4ae3-aba0-b58351106717_del complete
Nov 08 12:18:04 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4bb4f16e-f742-49ec-9fcf-e2a2fcf4a063 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:18:04 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4bb4f16e-f742-49ec-9fcf-e2a2fcf4a063 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:18:04 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4bb4f16e-f742-49ec-9fcf-e2a2fcf4a063 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] No VIF found with MAC fa:16:3e:6e:13:a8, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:18:04 user nova-compute[74840]: INFO nova.compute.manager [None req-401d998e-6f35-4cc7-9876-28dfd7aa711b tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Took 1.31 seconds to destroy the instance on the hypervisor.
Nov 08 12:18:04 user nova-compute[74840]: DEBUG oslo.service.loopingcall [None req-401d998e-6f35-4cc7-9876-28dfd7aa711b tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74840) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 12:18:04 user nova-compute[74840]: DEBUG nova.compute.manager [-] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Deallocating network for instance {{(pid=74840) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 12:18:04 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] deallocate_for_instance() {{(pid=74840) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 12:18:04 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4bb4f16e-f742-49ec-9fcf-e2a2fcf4a063 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Lock "e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 51.245s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:18:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665 -p 172.16.0.220:3260 --login" returned: 0 in 1.091s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:05 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[38bd8857-4104-419f-8680-515ab547d7e5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665, portal: 172.16.0.220,3260]
Nov 08 12:18:05 user nova-compute[74840]: Login to [iface: default, target: iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665, portal: 172.16.0.220,3260] successful.
Nov 08 12:18:05 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:18:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.051s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:05 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[03515cb3-d063-4d48-9b9b-b935049ab1fd]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:18:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:05 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[106d1c90-2668-487e-8c17-6810ec49da26]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)
Nov 08 12:18:05 user nova-compute[74840]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 (non-flash)
Nov 08 12:18:05 user nova-compute[74840]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665 (non-flash)
Nov 08 12:18:05 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:18:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)
Nov 08 12:18:05 user nova-compute[74840]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 (non-flash)
Nov 08 12:18:05 user nova-compute[74840]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665 (non-flash)
Nov 08 12:18:05 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:18:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.381s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:18:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Connected to 172.16.0.220:3260 {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 12:18:05 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] HCTL ('35', '-', '-', 0) found on session 16 with lun 0 {{(pid=74840) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 12:18:05 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74840) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 12:18:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:05 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97859ae-3792-49e4-bb5d-5555aa92fa92]: (4, ('- - 0', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:05 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: None {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:18:05 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:18:05 user nova-compute[74840]: INFO nova.compute.manager [-] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Took 0.71 seconds to deallocate network for instance.
Nov 08 12:18:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-401d998e-6f35-4cc7-9876-28dfd7aa711b tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:18:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-401d998e-6f35-4cc7-9876-28dfd7aa711b tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:18:05 user nova-compute[74840]: DEBUG nova.compute.manager [req-f5cbdba5-874d-449b-8de3-8e0bc168b525 req-5216f24b-001f-40e1-a486-d710fb59caa3 service nova] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Received event network-vif-plugged-4faa22f9-4e0d-45de-bb90-8348b96c1268 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:18:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-f5cbdba5-874d-449b-8de3-8e0bc168b525 req-5216f24b-001f-40e1-a486-d710fb59caa3 service nova] Acquiring lock "4c7b5726-907f-4ae3-aba0-b58351106717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:18:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-f5cbdba5-874d-449b-8de3-8e0bc168b525 req-5216f24b-001f-40e1-a486-d710fb59caa3 service nova] Lock "4c7b5726-907f-4ae3-aba0-b58351106717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:18:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-f5cbdba5-874d-449b-8de3-8e0bc168b525 req-5216f24b-001f-40e1-a486-d710fb59caa3 service nova] Lock "4c7b5726-907f-4ae3-aba0-b58351106717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:18:05 user nova-compute[74840]: DEBUG nova.compute.manager [req-f5cbdba5-874d-449b-8de3-8e0bc168b525 req-5216f24b-001f-40e1-a486-d710fb59caa3 service nova] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] No waiting events found dispatching network-vif-plugged-4faa22f9-4e0d-45de-bb90-8348b96c1268 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:18:05 user nova-compute[74840]: WARNING nova.compute.manager [req-f5cbdba5-874d-449b-8de3-8e0bc168b525 req-5216f24b-001f-40e1-a486-d710fb59caa3 service nova] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Received unexpected event network-vif-plugged-4faa22f9-4e0d-45de-bb90-8348b96c1268 for instance with vm_state deleted and task_state None.
Nov 08 12:18:05 user nova-compute[74840]: DEBUG nova.compute.manager [req-f5cbdba5-874d-449b-8de3-8e0bc168b525 req-5216f24b-001f-40e1-a486-d710fb59caa3 service nova] [instance: 4c7b5726-907f-4ae3-aba0-b58351106717] Received event network-vif-deleted-4faa22f9-4e0d-45de-bb90-8348b96c1268 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:18:05 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-401d998e-6f35-4cc7-9876-28dfd7aa711b tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:18:05 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-401d998e-6f35-4cc7-9876-28dfd7aa711b tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:18:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-401d998e-6f35-4cc7-9876-28dfd7aa711b tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.330s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:18:05 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-401d998e-6f35-4cc7-9876-28dfd7aa711b tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Deleted allocations for instance 4c7b5726-907f-4ae3-aba0-b58351106717
Nov 08 12:18:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-401d998e-6f35-4cc7-9876-28dfd7aa711b tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Lock "4c7b5726-907f-4ae3-aba0-b58351106717" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.611s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:18:06 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:18:06 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XJAkVPia', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 12:18:06 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.423s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:18:06 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] <== connect_volume: return (3432ms) {'type': 'block', 'scsi_wwn': '26138633331373234', 'path': '/dev/sdd'} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:18:06 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138633331373234', 'path': '/dev/sdd'} {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 12:18:06 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:17:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-548846971',display_name='tempest-TestVolumeBootPattern-server-548846971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-548846971',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1250106b55ae44b0b303849df7781ffb',ramdisk_id='',reservation_id='r-6e3k9w8u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-77780905',owner_user_name='tempest-TestVolumeBootPattern-77780905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:17:10Z,user_data=None,user_id='794c0281e1bf48f79117efdc3907e661',uuid=9b90af19-7629-4d19-ba8f-fae652f62e3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b079dbf-c166-48cc-a7ad-1a971751ba88", "address": "fa:16:3e:b7:f7:ea", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b079dbf-c1", "ovs_interfaceid": "3b079dbf-c166-48cc-a7ad-1a971751ba88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:18:06 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Converting VIF {"id": "3b079dbf-c166-48cc-a7ad-1a971751ba88", "address": "fa:16:3e:b7:f7:ea", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b079dbf-c1", "ovs_interfaceid": "3b079dbf-c166-48cc-a7ad-1a971751ba88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:18:06 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:f7:ea,bridge_name='br-int',has_traffic_filtering=True,id=3b079dbf-c166-48cc-a7ad-1a971751ba88,network=Network(174da5e9-78cc-426f-87fb-1d3b23b8b459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b079dbf-c1') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:18:06 user nova-compute[74840]: DEBUG nova.objects.instance [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lazy-loading 'pci_devices' on Instance uuid 9b90af19-7629-4d19-ba8f-fae652f62e3e {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:18:06 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:18:06 user nova-compute[74840]:   <uuid>9b90af19-7629-4d19-ba8f-fae652f62e3e</uuid>
Nov 08 12:18:06 user nova-compute[74840]:   <name>instance-00000012</name>
Nov 08 12:18:06 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:18:06 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:18:06 user nova-compute[74840]:   <metadata>
Nov 08 12:18:06 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:18:06 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:18:06 user nova-compute[74840]:       <nova:name>tempest-TestVolumeBootPattern-server-548846971</nova:name>
Nov 08 12:18:06 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:18:02</nova:creationTime>
Nov 08 12:18:06 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:18:06 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:18:06 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:18:06 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:18:06 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:18:06 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:18:06 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:18:06 user nova-compute[74840]:       <nova:owner>
Nov 08 12:18:06 user nova-compute[74840]:         <nova:user uuid="794c0281e1bf48f79117efdc3907e661">tempest-TestVolumeBootPattern-77780905-project-member</nova:user>
Nov 08 12:18:06 user nova-compute[74840]:         <nova:project uuid="1250106b55ae44b0b303849df7781ffb">tempest-TestVolumeBootPattern-77780905</nova:project>
Nov 08 12:18:06 user nova-compute[74840]:       </nova:owner>
Nov 08 12:18:06 user nova-compute[74840]:       <nova:ports>
Nov 08 12:18:06 user nova-compute[74840]:         <nova:port uuid="3b079dbf-c166-48cc-a7ad-1a971751ba88">
Nov 08 12:18:06 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 12:18:06 user nova-compute[74840]:         </nova:port>
Nov 08 12:18:06 user nova-compute[74840]:       </nova:ports>
Nov 08 12:18:06 user nova-compute[74840]:     </nova:instance>
Nov 08 12:18:06 user nova-compute[74840]:   </metadata>
Nov 08 12:18:06 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:18:06 user nova-compute[74840]:     <system>
Nov 08 12:18:06 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:18:06 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:18:06 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:18:06 user nova-compute[74840]:       <entry name="serial">9b90af19-7629-4d19-ba8f-fae652f62e3e</entry>
Nov 08 12:18:06 user nova-compute[74840]:       <entry name="uuid">9b90af19-7629-4d19-ba8f-fae652f62e3e</entry>
Nov 08 12:18:06 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:18:06 user nova-compute[74840]:     </system>
Nov 08 12:18:06 user nova-compute[74840]:   </sysinfo>
Nov 08 12:18:06 user nova-compute[74840]:   <os>
Nov 08 12:18:06 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:18:06 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:18:06 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:18:06 user nova-compute[74840]:   </os>
Nov 08 12:18:06 user nova-compute[74840]:   <features>
Nov 08 12:18:06 user nova-compute[74840]:     <acpi/>
Nov 08 12:18:06 user nova-compute[74840]:     <apic/>
Nov 08 12:18:06 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:18:06 user nova-compute[74840]:   </features>
Nov 08 12:18:06 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:18:06 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:18:06 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:18:06 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:18:06 user nova-compute[74840]:   </clock>
Nov 08 12:18:06 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:18:06 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:18:06 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:18:06 user nova-compute[74840]:   </cpu>
Nov 08 12:18:06 user nova-compute[74840]:   <devices>
Nov 08 12:18:06 user nova-compute[74840]:     <disk type="block" device="disk">
Nov 08 12:18:06 user nova-compute[74840]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:18:06 user nova-compute[74840]:       <source dev="/dev/sdd"/>
Nov 08 12:18:06 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:18:06 user nova-compute[74840]:       <serial>76c4c09e-d3eb-4c13-b405-57ea4c9e3665</serial>
Nov 08 12:18:06 user nova-compute[74840]:     </disk>
Nov 08 12:18:06 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:18:06 user nova-compute[74840]:       <mac address="fa:16:3e:b7:f7:ea"/>
Nov 08 12:18:06 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:18:06 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:18:06 user nova-compute[74840]:       <target dev="tap3b079dbf-c1"/>
Nov 08 12:18:06 user nova-compute[74840]:     </interface>
Nov 08 12:18:06 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:18:06 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/9b90af19-7629-4d19-ba8f-fae652f62e3e/console.log" append="off"/>
Nov 08 12:18:06 user nova-compute[74840]:     </serial>
Nov 08 12:18:06 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:18:06 user nova-compute[74840]:     <video>
Nov 08 12:18:06 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:18:06 user nova-compute[74840]:     </video>
Nov 08 12:18:06 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:18:06 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:18:06 user nova-compute[74840]:     </rng>
Nov 08 12:18:06 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:18:06 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:18:06 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:18:06 user nova-compute[74840]:     </memballoon>
Nov 08 12:18:06 user nova-compute[74840]:   </devices>
Nov 08 12:18:06 user nova-compute[74840]: </domain>
Nov 08 12:18:06 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:18:06 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:17:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-548846971',display_name='tempest-TestVolumeBootPattern-server-548846971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-548846971',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1250106b55ae44b0b303849df7781ffb',ramdisk_id='',reservation_id='r-6e3k9w8u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-77780905',owner_user_name='tempest-TestVolumeBootPattern-77780905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:17:10Z,user_data=None,user_id='794c0281e1bf48f79117efdc3907e661',uuid=9b90af19-7629-4d19-ba8f-fae652f62e3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b079dbf-c166-48cc-a7ad-1a971751ba88", "address": "fa:16:3e:b7:f7:ea", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b079dbf-c1", "ovs_interfaceid": "3b079dbf-c166-48cc-a7ad-1a971751ba88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:18:06 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Converting VIF {"id": "3b079dbf-c166-48cc-a7ad-1a971751ba88", "address": "fa:16:3e:b7:f7:ea", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b079dbf-c1", "ovs_interfaceid": "3b079dbf-c166-48cc-a7ad-1a971751ba88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:18:06 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:f7:ea,bridge_name='br-int',has_traffic_filtering=True,id=3b079dbf-c166-48cc-a7ad-1a971751ba88,network=Network(174da5e9-78cc-426f-87fb-1d3b23b8b459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b079dbf-c1') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:18:06 user nova-compute[74840]: DEBUG os_vif [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:f7:ea,bridge_name='br-int',has_traffic_filtering=True,id=3b079dbf-c166-48cc-a7ad-1a971751ba88,network=Network(174da5e9-78cc-426f-87fb-1d3b23b8b459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b079dbf-c1') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:18:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:18:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:18:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c80cceff-61e3-5a04-aa78-eaf4197a19a4', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:18:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:18:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b079dbf-c1, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:18:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3b079dbf-c1, col_values=(('qos', UUID('af6ca372-0833-4b1c-bd82-a463047caca9')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:18:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3b079dbf-c1, col_values=(('external_ids', {'iface-id': '3b079dbf-c166-48cc-a7ad-1a971751ba88', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:f7:ea', 'vm-uuid': '9b90af19-7629-4d19-ba8f-fae652f62e3e'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:18:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:18:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:06 user nova-compute[74840]: INFO os_vif [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:f7:ea,bridge_name='br-int',has_traffic_filtering=True,id=3b079dbf-c166-48cc-a7ad-1a971751ba88,network=Network(174da5e9-78cc-426f-87fb-1d3b23b8b459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b079dbf-c1')
Nov 08 12:18:06 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:18:06 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] No VIF found with MAC fa:16:3e:b7:f7:ea, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:18:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Acquiring lock "032e6584-9acf-469f-b661-faf6555659e1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:18:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "032e6584-9acf-469f-b661-faf6555659e1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:18:06 user nova-compute[74840]: DEBUG nova.compute.manager [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Starting instance... {{(pid=74840) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 12:18:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:18:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:18:06 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:18:06 user nova-compute[74840]: INFO nova.compute.claims [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Claim successful on node user
Nov 08 12:18:07 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:18:07 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:18:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.738s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:18:07 user nova-compute[74840]: DEBUG nova.compute.manager [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Start building networks asynchronously for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 12:18:07 user nova-compute[74840]: DEBUG nova.compute.manager [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Allocating IP information in the background. {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 12:18:07 user nova-compute[74840]: DEBUG nova.network.neutron [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: 032e6584-9acf-469f-b661-faf6555659e1] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 12:18:07 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 12:18:07 user nova-compute[74840]: DEBUG nova.compute.manager [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Start building block device mappings for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 12:18:07 user nova-compute[74840]: DEBUG nova.policy [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b5a96f2e0a304f278120312edb71d7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a082f8090094f009393593fb26b445b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 12:18:07 user nova-compute[74840]: DEBUG nova.compute.manager [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Start spawning the instance on the hypervisor. {{(pid=74840) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 12:18:07 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:18:07 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Creating image(s)
Nov 08 12:18:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Acquiring lock "/opt/stack/data/nova/instances/032e6584-9acf-469f-b661-faf6555659e1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:18:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "/opt/stack/data/nova/instances/032e6584-9acf-469f-b661-faf6555659e1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:18:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "/opt/stack/data/nova/instances/032e6584-9acf-469f-b661-faf6555659e1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:18:07 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:07 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.208s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Acquiring lock "5d26578eba85497f494c575690c4248f381a0fe6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:18:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:18:07 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.282s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/032e6584-9acf-469f-b661-faf6555659e1/disk 1073741824 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:08 user nova-compute[74840]: DEBUG nova.compute.manager [req-7e7148d3-1a83-454e-89bf-746a0ec82cbb req-997cb020-3e66-4756-a3c7-aa47c019246f service nova] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Received event network-vif-plugged-3b079dbf-c166-48cc-a7ad-1a971751ba88 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:18:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-7e7148d3-1a83-454e-89bf-746a0ec82cbb req-997cb020-3e66-4756-a3c7-aa47c019246f service nova] Acquiring lock "9b90af19-7629-4d19-ba8f-fae652f62e3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:18:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-7e7148d3-1a83-454e-89bf-746a0ec82cbb req-997cb020-3e66-4756-a3c7-aa47c019246f service nova] Lock "9b90af19-7629-4d19-ba8f-fae652f62e3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:18:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-7e7148d3-1a83-454e-89bf-746a0ec82cbb req-997cb020-3e66-4756-a3c7-aa47c019246f service nova] Lock "9b90af19-7629-4d19-ba8f-fae652f62e3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:18:08 user nova-compute[74840]: DEBUG nova.compute.manager [req-7e7148d3-1a83-454e-89bf-746a0ec82cbb req-997cb020-3e66-4756-a3c7-aa47c019246f service nova] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] No waiting events found dispatching network-vif-plugged-3b079dbf-c166-48cc-a7ad-1a971751ba88 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:18:08 user nova-compute[74840]: WARNING nova.compute.manager [req-7e7148d3-1a83-454e-89bf-746a0ec82cbb req-997cb020-3e66-4756-a3c7-aa47c019246f service nova] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Received unexpected event network-vif-plugged-3b079dbf-c166-48cc-a7ad-1a971751ba88 for instance with vm_state building and task_state spawning.
Nov 08 12:18:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/032e6584-9acf-469f-b661-faf6555659e1/disk 1073741824" returned: 0 in 0.080s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.368s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:18:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.211s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:08 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Checking if we can resize image /opt/stack/data/nova/instances/032e6584-9acf-469f-b661-faf6555659e1/disk. size=1073741824 {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 12:18:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032e6584-9acf-469f-b661-faf6555659e1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:08 user nova-compute[74840]: DEBUG nova.network.neutron [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Successfully created port: 4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:18:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032e6584-9acf-469f-b661-faf6555659e1/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:08 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Cannot resize image /opt/stack/data/nova/instances/032e6584-9acf-469f-b661-faf6555659e1/disk to a smaller size. {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 12:18:08 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Created local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 12:18:08 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Ensure instance console log exists: /opt/stack/data/nova/instances/032e6584-9acf-469f-b661-faf6555659e1/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:18:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:18:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:18:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:18:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Acquiring lock "e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:18:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Lock "e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:18:09 user nova-compute[74840]: DEBUG nova.objects.instance [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Lazy-loading 'flavor' on Instance uuid e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:18:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Lock "e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:18:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Acquiring lock "e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:18:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Lock "e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:18:09 user nova-compute[74840]: INFO nova.compute.manager [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Attaching volume d6163f42-ec0f-4b2f-a4d2-64a6c8880a35 to /dev/vdc
Nov 08 12:18:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:09 user nova-compute[74840]: DEBUG os_brick.utils [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:18:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:09 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6868ed76-910e-4c36-a2d2-1dcaef2dec82]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c8228a11e03c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:09 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b259414c-f586-478b-9d6e-1fcce817f75d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:09 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2eb28f-9ecd-41a3-bc58-de63b3ab5b03]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:09 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[11de6c5a-427e-455d-959d-aa3999898c0c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Running cmd (subprocess): nvme version {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] 'nvme version' failed. Not Retrying. {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:18:09 user nova-compute[74840]: DEBUG nova.network.neutron [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Successfully updated port: 4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:18:09 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.nvmeof [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] nvme not present on system {{(pid=74840) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 12:18:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:18:09 user nova-compute[74840]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 12:18:09 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[73025533-0a23-4ba6-b62b-4243aedf2cf6]: (4, '') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:09 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74840) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 12:18:09 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 12:18:09 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] LIGHTOS: no hostnqn found. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 12:18:09 user nova-compute[74840]: DEBUG os_brick.utils [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] <== get_connector_properties: return (309ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c8228a11e03c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:18:09 user nova-compute[74840]: DEBUG nova.virt.block_device [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Updating existing volume attachment record: f6cc79c1-792b-44de-a13a-afd2825caf9a {{(pid=74840) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 12:18:09 user nova-compute[74840]: DEBUG nova.compute.manager [req-646f0bdb-b1f4-49ce-bc75-f334bfa16dfa req-2906e8cb-1084-4652-991e-7067d426f140 service nova] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Received event network-changed-4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:18:09 user nova-compute[74840]: DEBUG nova.compute.manager [req-646f0bdb-b1f4-49ce-bc75-f334bfa16dfa req-2906e8cb-1084-4652-991e-7067d426f140 service nova] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Refreshing instance network info cache due to event network-changed-4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:18:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-646f0bdb-b1f4-49ce-bc75-f334bfa16dfa req-2906e8cb-1084-4652-991e-7067d426f140 service nova] Acquiring lock "refresh_cache-032e6584-9acf-469f-b661-faf6555659e1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:18:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-646f0bdb-b1f4-49ce-bc75-f334bfa16dfa req-2906e8cb-1084-4652-991e-7067d426f140 service nova] Acquired lock "refresh_cache-032e6584-9acf-469f-b661-faf6555659e1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:18:09 user nova-compute[74840]: DEBUG nova.network.neutron [req-646f0bdb-b1f4-49ce-bc75-f334bfa16dfa req-2906e8cb-1084-4652-991e-7067d426f140 service nova] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Refreshing network info cache for port 4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:18:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Acquiring lock "refresh_cache-032e6584-9acf-469f-b661-faf6555659e1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:18:09 user nova-compute[74840]: DEBUG nova.network.neutron [req-646f0bdb-b1f4-49ce-bc75-f334bfa16dfa req-2906e8cb-1084-4652-991e-7067d426f140 service nova] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG nova.network.neutron [req-646f0bdb-b1f4-49ce-bc75-f334bfa16dfa req-2906e8cb-1084-4652-991e-7067d426f140 service nova] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG nova.compute.manager [req-b9a1adc2-8619-4f31-ac48-a1e9a9d62a9d req-92929a03-337a-4bef-97d5-e7948101bfd4 service nova] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Received event network-vif-plugged-3b079dbf-c166-48cc-a7ad-1a971751ba88 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-b9a1adc2-8619-4f31-ac48-a1e9a9d62a9d req-92929a03-337a-4bef-97d5-e7948101bfd4 service nova] Acquiring lock "9b90af19-7629-4d19-ba8f-fae652f62e3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-b9a1adc2-8619-4f31-ac48-a1e9a9d62a9d req-92929a03-337a-4bef-97d5-e7948101bfd4 service nova] Lock "9b90af19-7629-4d19-ba8f-fae652f62e3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-b9a1adc2-8619-4f31-ac48-a1e9a9d62a9d req-92929a03-337a-4bef-97d5-e7948101bfd4 service nova] Lock "9b90af19-7629-4d19-ba8f-fae652f62e3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG nova.compute.manager [req-b9a1adc2-8619-4f31-ac48-a1e9a9d62a9d req-92929a03-337a-4bef-97d5-e7948101bfd4 service nova] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] No waiting events found dispatching network-vif-plugged-3b079dbf-c166-48cc-a7ad-1a971751ba88 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:18:10 user nova-compute[74840]: WARNING nova.compute.manager [req-b9a1adc2-8619-4f31-ac48-a1e9a9d62a9d req-92929a03-337a-4bef-97d5-e7948101bfd4 service nova] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Received unexpected event network-vif-plugged-3b079dbf-c166-48cc-a7ad-1a971751ba88 for instance with vm_state building and task_state spawning.
Nov 08 12:18:10 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d65d4e64-5460-412a-9aa4-6ac57c03a573 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Calling os-brick to attach iSCSI Volume {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d4e64-5460-412a-9aa4-6ac57c03a573 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:49a84c89-160c-4f06-aa6d-c87d01a362fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LfumDOzI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:18:10 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-d65d4e64-5460-412a-9aa4-6ac57c03a573 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:18:10 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-d65d4e64-5460-412a-9aa4-6ac57c03a573 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-d65d4e64-5460-412a-9aa4-6ac57c03a573 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:18:10 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-d65d4e64-5460-412a-9aa4-6ac57c03a573 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:18:10 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-d65d4e64-5460-412a-9aa4-6ac57c03a573 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49a84c89-160c-4f06-aa6d-c87d01a362fa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-d65d4e64-5460-412a-9aa4-6ac57c03a573 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49a84c89-160c-4f06-aa6d-c87d01a362fa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:18:10 user nova-compute[74840]: INFO os_brick.initiator.connectors.iscsi [None req-d65d4e64-5460-412a-9aa4-6ac57c03a573 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 12:18:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-646f0bdb-b1f4-49ce-bc75-f334bfa16dfa req-2906e8cb-1084-4652-991e-7067d426f140 service nova] Releasing lock "refresh_cache-032e6584-9acf-469f-b661-faf6555659e1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Acquired lock "refresh_cache-032e6584-9acf-469f-b661-faf6555659e1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG nova.network.neutron [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49a84c89-160c-4f06-aa6d-c87d01a362fa -p 172.16.0.220:3260 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG nova.compute.manager [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49a84c89-160c-4f06-aa6d-c87d01a362fa -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[abff931e-5505-4eb5-9ca2-4f05acfde551]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d4e64-5460-412a-9aa4-6ac57c03a573 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 12:18:10 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:18:10 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Instance spawned successfully.
Nov 08 12:18:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49a84c89-160c-4f06-aa6d-c87d01a362fa -p 172.16.0.220:3260 --interface default --op new {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49a84c89-160c-4f06-aa6d-c87d01a362fa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[107371c8-a453-4429-9ef7-217bc604c611]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49a84c89-160c-4f06-aa6d-c87d01a362fa] added\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d4e64-5460-412a-9aa4-6ac57c03a573 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49a84c89-160c-4f06-aa6d-c87d01a362fa] added
Nov 08 12:18:10 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49a84c89-160c-4f06-aa6d-c87d01a362fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Found default for hw_cdrom_bus of ide {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Found default for hw_disk_bus of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Found default for hw_video_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Found default for hw_vif_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG nova.network.neutron [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49a84c89-160c-4f06-aa6d-c87d01a362fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9393f83a-5e17-4013-9c3d-a45f7cd3b308]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d4e64-5460-412a-9aa4-6ac57c03a573 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49a84c89-160c-4f06-aa6d-c87d01a362fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49a84c89-160c-4f06-aa6d-c87d01a362fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[134e1aae-76c2-491b-9e95-a0a191903612]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d4e64-5460-412a-9aa4-6ac57c03a573 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49a84c89-160c-4f06-aa6d-c87d01a362fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LfumDOzI {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:10 user nova-compute[74840]: INFO nova.compute.manager [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Took 8.03 seconds to spawn the instance on the hypervisor.
Nov 08 12:18:10 user nova-compute[74840]: DEBUG nova.compute.manager [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49a84c89-160c-4f06-aa6d-c87d01a362fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LfumDOzI" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa078e09-fabe-476f-899a-e86de93257e4]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d4e64-5460-412a-9aa4-6ac57c03a573 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LfumDOzI'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49a84c89-160c-4f06-aa6d-c87d01a362fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49a84c89-160c-4f06-aa6d-c87d01a362fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[93637644-457f-46e6-bf59-e32531a4227c]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d4e64-5460-412a-9aa4-6ac57c03a573 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ee394d-ad2b-4521-82d8-067e7d1cac8b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d4e64-5460-412a-9aa4-6ac57c03a573 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)
Nov 08 12:18:10 user nova-compute[74840]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 (non-flash)
Nov 08 12:18:10 user nova-compute[74840]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665 (non-flash)
Nov 08 12:18:10 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d4e64-5460-412a-9aa4-6ac57c03a573 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)
Nov 08 12:18:10 user nova-compute[74840]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 (non-flash)
Nov 08 12:18:10 user nova-compute[74840]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665 (non-flash)
Nov 08 12:18:10 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49a84c89-160c-4f06-aa6d-c87d01a362fa -p 172.16.0.220:3260 --login {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:10 user nova-compute[74840]: INFO nova.compute.manager [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Took 61.91 seconds to build instance.
Nov 08 12:18:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4ec52c57-2c6f-4e57-8eca-593f3cc4b621 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "9b90af19-7629-4d19-ba8f-fae652f62e3e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 62.013s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49a84c89-160c-4f06-aa6d-c87d01a362fa -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[526ab154-56ca-46ae-be23-5c5a111fe6f1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:49a84c89-160c-4f06-aa6d-c87d01a362fa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:49a84c89-160c-4f06-aa6d-c87d01a362fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d4e64-5460-412a-9aa4-6ac57c03a573 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:49a84c89-160c-4f06-aa6d-c87d01a362fa, portal: 172.16.0.220,3260]
Nov 08 12:18:10 user nova-compute[74840]: Login to [iface: default, target: iqn.2010-10.org.openstack:49a84c89-160c-4f06-aa6d-c87d01a362fa, portal: 172.16.0.220,3260] successful.
Nov 08 12:18:10 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49a84c89-160c-4f06-aa6d-c87d01a362fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49a84c89-160c-4f06-aa6d-c87d01a362fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd92b0ec-6329-4574-bf4b-cc7f5d93fb30]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d4e64-5460-412a-9aa4-6ac57c03a573 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a26130f-61de-4e26-abf8-5f99295d1e8e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49a84c89-160c-4f06-aa6d-c87d01a362fa (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d4e64-5460-412a-9aa4-6ac57c03a573 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)
Nov 08 12:18:10 user nova-compute[74840]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 (non-flash)
Nov 08 12:18:10 user nova-compute[74840]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665 (non-flash)
Nov 08 12:18:10 user nova-compute[74840]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49a84c89-160c-4f06-aa6d-c87d01a362fa (non-flash)
Nov 08 12:18:10 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d4e64-5460-412a-9aa4-6ac57c03a573 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)
Nov 08 12:18:10 user nova-compute[74840]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 (non-flash)
Nov 08 12:18:10 user nova-compute[74840]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665 (non-flash)
Nov 08 12:18:10 user nova-compute[74840]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49a84c89-160c-4f06-aa6d-c87d01a362fa (non-flash)
Nov 08 12:18:10 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-d65d4e64-5460-412a-9aa4-6ac57c03a573 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49a84c89-160c-4f06-aa6d-c87d01a362fa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d4e64-5460-412a-9aa4-6ac57c03a573 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Connected to 172.16.0.220:3260 {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-d65d4e64-5460-412a-9aa4-6ac57c03a573 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] HCTL ('36', '-', '-', 0) found on session 17 with lun 0 {{(pid=74840) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-d65d4e64-5460-412a-9aa4-6ac57c03a573 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74840) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG nova.network.neutron [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Updating instance_info_cache with network_info: [{"id": "4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd", "address": "fa:16:3e:d3:22:7c", "network": {"id": "89a24eca-8c74-4e0e-b778-275f200927f0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1409559017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a082f8090094f009393593fb26b445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d59d0f9-05", "ovs_interfaceid": "4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[853c686d-1e84-4902-b5c9-b21659adac84]: (4, ('- - 0', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-d65d4e64-5460-412a-9aa4-6ac57c03a573 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Searching for a device in session 17 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d4e64-5460-412a-9aa4-6ac57c03a573 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:49a84c89-160c-4f06-aa6d-c87d01a362fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LfumDOzI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Releasing lock "refresh_cache-032e6584-9acf-469f-b661-faf6555659e1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG nova.compute.manager [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Instance network_info: |[{"id": "4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd", "address": "fa:16:3e:d3:22:7c", "network": {"id": "89a24eca-8c74-4e0e-b778-275f200927f0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1409559017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a082f8090094f009393593fb26b445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d59d0f9-05", "ovs_interfaceid": "4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Start _get_guest_xml network_info=[{"id": "4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd", "address": "fa:16:3e:d3:22:7c", "network": {"id": "89a24eca-8c74-4e0e-b778-275f200927f0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1409559017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a082f8090094f009393593fb26b445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d59d0f9-05", "ovs_interfaceid": "4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'image_id': '4fa17706-d304-4117-a420-dab994c703dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:18:10 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:18:10 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:18:10 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:18:10 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:18:11 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:18:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1321940893',display_name='tempest-VolumesSnapshotTestJSON-instance-1321940893',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1321940893',id=19,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdD2/O3Di67E6V+l5UJO4rtKB350T1sBCd0VKZ9Ym+COxks8E0hODzCW14hQCkCQx8YNCSbmMMFMAqHvrf+utZtpInDwIft4hu1HbOky8hwV+dUqvmmS31J+tw13c2hbA==',key_name='tempest-keypair-603358064',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a082f8090094f009393593fb26b445b',ramdisk_id='',reservation_id='r-h659hzxt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1995603553',owner_user_name='tempest-VolumesSnapshotTestJSON-1995603553-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:18:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5a96f2e0a304f278120312edb71d7ac',uuid=032e6584-9acf-469f-b661-faf6555659e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd", "address": "fa:16:3e:d3:22:7c", "network": {"id": "89a24eca-8c74-4e0e-b778-275f200927f0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1409559017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a082f8090094f009393593fb26b445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d59d0f9-05", "ovs_interfaceid": "4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:18:11 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Converting VIF {"id": "4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd", "address": "fa:16:3e:d3:22:7c", "network": {"id": "89a24eca-8c74-4e0e-b778-275f200927f0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1409559017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a082f8090094f009393593fb26b445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d59d0f9-05", "ovs_interfaceid": "4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:18:11 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:22:7c,bridge_name='br-int',has_traffic_filtering=True,id=4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd,network=Network(89a24eca-8c74-4e0e-b778-275f200927f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d59d0f9-05') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:18:11 user nova-compute[74840]: DEBUG nova.objects.instance [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lazy-loading 'pci_devices' on Instance uuid 032e6584-9acf-469f-b661-faf6555659e1 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:18:11 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: 032e6584-9acf-469f-b661-faf6555659e1] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:18:11 user nova-compute[74840]:   <uuid>032e6584-9acf-469f-b661-faf6555659e1</uuid>
Nov 08 12:18:11 user nova-compute[74840]:   <name>instance-00000013</name>
Nov 08 12:18:11 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:18:11 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:18:11 user nova-compute[74840]:   <metadata>
Nov 08 12:18:11 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:18:11 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:18:11 user nova-compute[74840]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1321940893</nova:name>
Nov 08 12:18:11 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:18:10</nova:creationTime>
Nov 08 12:18:11 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:18:11 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:18:11 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:18:11 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:18:11 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:18:11 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:18:11 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:18:11 user nova-compute[74840]:       <nova:owner>
Nov 08 12:18:11 user nova-compute[74840]:         <nova:user uuid="b5a96f2e0a304f278120312edb71d7ac">tempest-VolumesSnapshotTestJSON-1995603553-project-member</nova:user>
Nov 08 12:18:11 user nova-compute[74840]:         <nova:project uuid="9a082f8090094f009393593fb26b445b">tempest-VolumesSnapshotTestJSON-1995603553</nova:project>
Nov 08 12:18:11 user nova-compute[74840]:       </nova:owner>
Nov 08 12:18:11 user nova-compute[74840]:       <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:18:11 user nova-compute[74840]:       <nova:ports>
Nov 08 12:18:11 user nova-compute[74840]:         <nova:port uuid="4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd">
Nov 08 12:18:11 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 12:18:11 user nova-compute[74840]:         </nova:port>
Nov 08 12:18:11 user nova-compute[74840]:       </nova:ports>
Nov 08 12:18:11 user nova-compute[74840]:     </nova:instance>
Nov 08 12:18:11 user nova-compute[74840]:   </metadata>
Nov 08 12:18:11 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:18:11 user nova-compute[74840]:     <system>
Nov 08 12:18:11 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:18:11 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:18:11 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:18:11 user nova-compute[74840]:       <entry name="serial">032e6584-9acf-469f-b661-faf6555659e1</entry>
Nov 08 12:18:11 user nova-compute[74840]:       <entry name="uuid">032e6584-9acf-469f-b661-faf6555659e1</entry>
Nov 08 12:18:11 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:18:11 user nova-compute[74840]:     </system>
Nov 08 12:18:11 user nova-compute[74840]:   </sysinfo>
Nov 08 12:18:11 user nova-compute[74840]:   <os>
Nov 08 12:18:11 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:18:11 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:18:11 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:18:11 user nova-compute[74840]:   </os>
Nov 08 12:18:11 user nova-compute[74840]:   <features>
Nov 08 12:18:11 user nova-compute[74840]:     <acpi/>
Nov 08 12:18:11 user nova-compute[74840]:     <apic/>
Nov 08 12:18:11 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:18:11 user nova-compute[74840]:   </features>
Nov 08 12:18:11 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:18:11 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:18:11 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:18:11 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:18:11 user nova-compute[74840]:   </clock>
Nov 08 12:18:11 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:18:11 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:18:11 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:18:11 user nova-compute[74840]:   </cpu>
Nov 08 12:18:11 user nova-compute[74840]:   <devices>
Nov 08 12:18:11 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:18:11 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:18:11 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/032e6584-9acf-469f-b661-faf6555659e1/disk"/>
Nov 08 12:18:11 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:18:11 user nova-compute[74840]:     </disk>
Nov 08 12:18:11 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:18:11 user nova-compute[74840]:       <mac address="fa:16:3e:d3:22:7c"/>
Nov 08 12:18:11 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:18:11 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:18:11 user nova-compute[74840]:       <target dev="tap4d59d0f9-05"/>
Nov 08 12:18:11 user nova-compute[74840]:     </interface>
Nov 08 12:18:11 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:18:11 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/032e6584-9acf-469f-b661-faf6555659e1/console.log" append="off"/>
Nov 08 12:18:11 user nova-compute[74840]:     </serial>
Nov 08 12:18:11 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:18:11 user nova-compute[74840]:     <video>
Nov 08 12:18:11 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:18:11 user nova-compute[74840]:     </video>
Nov 08 12:18:11 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:18:11 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:18:11 user nova-compute[74840]:     </rng>
Nov 08 12:18:11 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:18:11 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:18:11 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:18:11 user nova-compute[74840]:     </memballoon>
Nov 08 12:18:11 user nova-compute[74840]:   </devices>
Nov 08 12:18:11 user nova-compute[74840]: </domain>
Nov 08 12:18:11 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:18:11 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:18:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1321940893',display_name='tempest-VolumesSnapshotTestJSON-instance-1321940893',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1321940893',id=19,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdD2/O3Di67E6V+l5UJO4rtKB350T1sBCd0VKZ9Ym+COxks8E0hODzCW14hQCkCQx8YNCSbmMMFMAqHvrf+utZtpInDwIft4hu1HbOky8hwV+dUqvmmS31J+tw13c2hbA==',key_name='tempest-keypair-603358064',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a082f8090094f009393593fb26b445b',ramdisk_id='',reservation_id='r-h659hzxt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1995603553',owner_user_name='tempest-VolumesSnapshotTestJSON-1995603553-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:18:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5a96f2e0a304f278120312edb71d7ac',uuid=032e6584-9acf-469f-b661-faf6555659e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd", "address": "fa:16:3e:d3:22:7c", "network": {"id": "89a24eca-8c74-4e0e-b778-275f200927f0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1409559017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a082f8090094f009393593fb26b445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d59d0f9-05", "ovs_interfaceid": "4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:18:11 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Converting VIF {"id": "4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd", "address": "fa:16:3e:d3:22:7c", "network": {"id": "89a24eca-8c74-4e0e-b778-275f200927f0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1409559017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a082f8090094f009393593fb26b445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d59d0f9-05", "ovs_interfaceid": "4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:18:11 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:22:7c,bridge_name='br-int',has_traffic_filtering=True,id=4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd,network=Network(89a24eca-8c74-4e0e-b778-275f200927f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d59d0f9-05') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:18:11 user nova-compute[74840]: DEBUG os_vif [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:22:7c,bridge_name='br-int',has_traffic_filtering=True,id=4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd,network=Network(89a24eca-8c74-4e0e-b778-275f200927f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d59d0f9-05') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:18:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:18:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:18:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd4d12152-a01c-58dc-b727-d8d98b5ddcf7', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:18:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:18:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d59d0f9-05, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:18:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4d59d0f9-05, col_values=(('qos', UUID('31c92fee-0251-4c0e-8b59-538c93134fdd')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:18:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4d59d0f9-05, col_values=(('external_ids', {'iface-id': '4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:22:7c', 'vm-uuid': '032e6584-9acf-469f-b661-faf6555659e1'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:18:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:18:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:11 user nova-compute[74840]: INFO os_vif [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:22:7c,bridge_name='br-int',has_traffic_filtering=True,id=4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd,network=Network(89a24eca-8c74-4e0e-b778-275f200927f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d59d0f9-05')
Nov 08 12:18:11 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:18:11 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] No VIF found with MAC fa:16:3e:d3:22:7c, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:18:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:11 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-d65d4e64-5460-412a-9aa4-6ac57c03a573 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:18:11 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d4e64-5460-412a-9aa4-6ac57c03a573 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '23933346530376239', 'path': '/dev/sde'} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:18:11 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d65d4e64-5460-412a-9aa4-6ac57c03a573 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933346530376239', 'path': '/dev/sde'} {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 12:18:11 user nova-compute[74840]: DEBUG nova.objects.instance [None req-d65d4e64-5460-412a-9aa4-6ac57c03a573 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lazy-loading 'flavor' on Instance uuid 74a51b1b-103e-49b2-b7a0-ec4625a9445b {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:18:11 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-d65d4e64-5460-412a-9aa4-6ac57c03a573 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 12:18:11 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:18:11 user nova-compute[74840]:   <source dev="/dev/sde"/>
Nov 08 12:18:11 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:18:11 user nova-compute[74840]:   <serial>49a84c89-160c-4f06-aa6d-c87d01a362fa</serial>
Nov 08 12:18:11 user nova-compute[74840]: </disk>
Nov 08 12:18:11 user nova-compute[74840]:  {{(pid=74840) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 12:18:12 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-d65d4e64-5460-412a-9aa4-6ac57c03a573 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:18:12 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-d65d4e64-5460-412a-9aa4-6ac57c03a573 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:18:12 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-d65d4e64-5460-412a-9aa4-6ac57c03a573 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] No VIF found with MAC fa:16:3e:c3:be:3a, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:18:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d65d4e64-5460-412a-9aa4-6ac57c03a573 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "74a51b1b-103e-49b2-b7a0-ec4625a9445b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.267s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:18:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:13 user nova-compute[74840]: DEBUG nova.compute.manager [req-d29c6e19-e67f-4dc3-9333-793b434965ce req-77556463-bff2-4b7c-928e-26a286c3b0dc service nova] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Received event network-vif-plugged-4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:18:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-d29c6e19-e67f-4dc3-9333-793b434965ce req-77556463-bff2-4b7c-928e-26a286c3b0dc service nova] Acquiring lock "032e6584-9acf-469f-b661-faf6555659e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:18:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-d29c6e19-e67f-4dc3-9333-793b434965ce req-77556463-bff2-4b7c-928e-26a286c3b0dc service nova] Lock "032e6584-9acf-469f-b661-faf6555659e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:18:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-d29c6e19-e67f-4dc3-9333-793b434965ce req-77556463-bff2-4b7c-928e-26a286c3b0dc service nova] Lock "032e6584-9acf-469f-b661-faf6555659e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:18:13 user nova-compute[74840]: DEBUG nova.compute.manager [req-d29c6e19-e67f-4dc3-9333-793b434965ce req-77556463-bff2-4b7c-928e-26a286c3b0dc service nova] [instance: 032e6584-9acf-469f-b661-faf6555659e1] No waiting events found dispatching network-vif-plugged-4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:18:13 user nova-compute[74840]: WARNING nova.compute.manager [req-d29c6e19-e67f-4dc3-9333-793b434965ce req-77556463-bff2-4b7c-928e-26a286c3b0dc service nova] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Received unexpected event network-vif-plugged-4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd for instance with vm_state building and task_state spawning.
Nov 08 12:18:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5031cd32-8261-4b59-a445-60692bfa72e7 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "74a51b1b-103e-49b2-b7a0-ec4625a9445b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:18:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5031cd32-8261-4b59-a445-60692bfa72e7 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "74a51b1b-103e-49b2-b7a0-ec4625a9445b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:18:14 user nova-compute[74840]: INFO nova.compute.manager [None req-5031cd32-8261-4b59-a445-60692bfa72e7 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Detaching volume 49a84c89-160c-4f06-aa6d-c87d01a362fa
Nov 08 12:18:14 user nova-compute[74840]: INFO nova.virt.block_device [None req-5031cd32-8261-4b59-a445-60692bfa72e7 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Attempting to driver detach volume 49a84c89-160c-4f06-aa6d-c87d01a362fa from mountpoint /dev/vdb
Nov 08 12:18:14 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-5031cd32-8261-4b59-a445-60692bfa72e7 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Attempting to detach device vdb from instance 74a51b1b-103e-49b2-b7a0-ec4625a9445b from the persistent domain config. {{(pid=74840) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 12:18:14 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-5031cd32-8261-4b59-a445-60692bfa72e7 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 12:18:14 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:18:14 user nova-compute[74840]:   <source dev="/dev/sde"/>
Nov 08 12:18:14 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:18:14 user nova-compute[74840]:   <serial>49a84c89-160c-4f06-aa6d-c87d01a362fa</serial>
Nov 08 12:18:14 user nova-compute[74840]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 12:18:14 user nova-compute[74840]: </disk>
Nov 08 12:18:14 user nova-compute[74840]:  {{(pid=74840) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 12:18:14 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-5031cd32-8261-4b59-a445-60692bfa72e7 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Successfully detached device vdb from instance 74a51b1b-103e-49b2-b7a0-ec4625a9445b from the persistent domain config.
Nov 08 12:18:14 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-5031cd32-8261-4b59-a445-60692bfa72e7 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 74a51b1b-103e-49b2-b7a0-ec4625a9445b from the live domain config. {{(pid=74840) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 12:18:14 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-5031cd32-8261-4b59-a445-60692bfa72e7 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 12:18:14 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:18:14 user nova-compute[74840]:   <source dev="/dev/sde"/>
Nov 08 12:18:14 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:18:14 user nova-compute[74840]:   <serial>49a84c89-160c-4f06-aa6d-c87d01a362fa</serial>
Nov 08 12:18:14 user nova-compute[74840]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 12:18:14 user nova-compute[74840]: </disk>
Nov 08 12:18:14 user nova-compute[74840]:  {{(pid=74840) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 12:18:14 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-5031cd32-8261-4b59-a445-60692bfa72e7 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 74a51b1b-103e-49b2-b7a0-ec4625a9445b {{(pid=74840) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 12:18:15 user nova-compute[74840]: DEBUG nova.compute.manager [req-b3e4869e-6889-41cc-8cd2-4a728effe720 req-23d1a67c-c8ae-4568-8fb6-e7144fae9448 service nova] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Received event network-vif-plugged-4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:18:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-b3e4869e-6889-41cc-8cd2-4a728effe720 req-23d1a67c-c8ae-4568-8fb6-e7144fae9448 service nova] Acquiring lock "032e6584-9acf-469f-b661-faf6555659e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:18:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-b3e4869e-6889-41cc-8cd2-4a728effe720 req-23d1a67c-c8ae-4568-8fb6-e7144fae9448 service nova] Lock "032e6584-9acf-469f-b661-faf6555659e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:18:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-b3e4869e-6889-41cc-8cd2-4a728effe720 req-23d1a67c-c8ae-4568-8fb6-e7144fae9448 service nova] Lock "032e6584-9acf-469f-b661-faf6555659e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:18:15 user nova-compute[74840]: DEBUG nova.compute.manager [req-b3e4869e-6889-41cc-8cd2-4a728effe720 req-23d1a67c-c8ae-4568-8fb6-e7144fae9448 service nova] [instance: 032e6584-9acf-469f-b661-faf6555659e1] No waiting events found dispatching network-vif-plugged-4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:18:15 user nova-compute[74840]: WARNING nova.compute.manager [req-b3e4869e-6889-41cc-8cd2-4a728effe720 req-23d1a67c-c8ae-4568-8fb6-e7144fae9448 service nova] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Received unexpected event network-vif-plugged-4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd for instance with vm_state building and task_state spawning.
Nov 08 12:18:15 user nova-compute[74840]: DEBUG nova.compute.manager [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:18:15 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:18:15 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Instance spawned successfully.
Nov 08 12:18:15 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:18:15 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Found default for hw_cdrom_bus of ide {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:18:15 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Found default for hw_disk_bus of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:18:15 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:18:15 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:18:15 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Found default for hw_video_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:18:15 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Found default for hw_vif_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:18:15 user nova-compute[74840]: INFO nova.compute.manager [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Took 8.07 seconds to spawn the instance on the hypervisor.
Nov 08 12:18:15 user nova-compute[74840]: DEBUG nova.compute.manager [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:18:15 user nova-compute[74840]: INFO nova.compute.manager [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Took 9.22 seconds to build instance.
Nov 08 12:18:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8e343d24-6cab-4144-b50b-3b98290bcabd tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "032e6584-9acf-469f-b661-faf6555659e1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.351s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:18:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:25 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:28 user nova-compute[74840]: DEBUG nova.compute.manager [None req-b937ab37-a287-4c39-9465-50fe9f4d32a3 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:18:28 user nova-compute[74840]: INFO nova.compute.manager [None req-b937ab37-a287-4c39-9465-50fe9f4d32a3 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] instance snapshotting
Nov 08 12:18:28 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-b937ab37-a287-4c39-9465-50fe9f4d32a3 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Beginning live snapshot process
Nov 08 12:18:29 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-b937ab37-a287-4c39-9465-50fe9f4d32a3 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json -f qcow2 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:29 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-b937ab37-a287-4c39-9465-50fe9f4d32a3 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json -f qcow2" returned: 0 in 0.211s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:29 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-b937ab37-a287-4c39-9465-50fe9f4d32a3 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json -f qcow2 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:29 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:29 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-b937ab37-a287-4c39-9465-50fe9f4d32a3 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json -f qcow2" returned: 0 in 0.283s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:29 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-b937ab37-a287-4c39-9465-50fe9f4d32a3 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:29 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-b937ab37-a287-4c39-9465-50fe9f4d32a3 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.216s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:29 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-b937ab37-a287-4c39-9465-50fe9f4d32a3 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpz5dhy6fq/8e317ff4130947db91064af9878bbff9.delta 1073741824 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:29 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-b937ab37-a287-4c39-9465-50fe9f4d32a3 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpz5dhy6fq/8e317ff4130947db91064af9878bbff9.delta 1073741824" returned: 0 in 0.075s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:29 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-b937ab37-a287-4c39-9465-50fe9f4d32a3 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 08 12:18:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-70822123-dd1b-4653-996e-cc1e6e4f7762 tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Acquiring lock "684b8be2-7f8f-499f-8885-c9d1c86eef2f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:18:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-70822123-dd1b-4653-996e-cc1e6e4f7762 tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Lock "684b8be2-7f8f-499f-8885-c9d1c86eef2f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:18:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-70822123-dd1b-4653-996e-cc1e6e4f7762 tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Acquiring lock "684b8be2-7f8f-499f-8885-c9d1c86eef2f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:18:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-70822123-dd1b-4653-996e-cc1e6e4f7762 tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Lock "684b8be2-7f8f-499f-8885-c9d1c86eef2f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:18:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-70822123-dd1b-4653-996e-cc1e6e4f7762 tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Lock "684b8be2-7f8f-499f-8885-c9d1c86eef2f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:18:30 user nova-compute[74840]: INFO nova.compute.manager [None req-70822123-dd1b-4653-996e-cc1e6e4f7762 tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Terminating instance
Nov 08 12:18:30 user nova-compute[74840]: DEBUG nova.compute.manager [None req-70822123-dd1b-4653-996e-cc1e6e4f7762 tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Start destroying the instance on the hypervisor. {{(pid=74840) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 12:18:30 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:30 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:30 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:30 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-b937ab37-a287-4c39-9465-50fe9f4d32a3 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74840) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 12:18:31 user nova-compute[74840]: DEBUG nova.compute.manager [req-e1f133d1-9d0d-4177-aa54-be73bbd4b6cf req-1efbf620-9af0-41c8-82a0-c92e6239ba26 service nova] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Received event network-vif-unplugged-b910fb2a-440c-426f-a000-064149073835 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:18:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e1f133d1-9d0d-4177-aa54-be73bbd4b6cf req-1efbf620-9af0-41c8-82a0-c92e6239ba26 service nova] Acquiring lock "684b8be2-7f8f-499f-8885-c9d1c86eef2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:18:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e1f133d1-9d0d-4177-aa54-be73bbd4b6cf req-1efbf620-9af0-41c8-82a0-c92e6239ba26 service nova] Lock "684b8be2-7f8f-499f-8885-c9d1c86eef2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:18:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e1f133d1-9d0d-4177-aa54-be73bbd4b6cf req-1efbf620-9af0-41c8-82a0-c92e6239ba26 service nova] Lock "684b8be2-7f8f-499f-8885-c9d1c86eef2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:18:31 user nova-compute[74840]: DEBUG nova.compute.manager [req-e1f133d1-9d0d-4177-aa54-be73bbd4b6cf req-1efbf620-9af0-41c8-82a0-c92e6239ba26 service nova] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] No waiting events found dispatching network-vif-unplugged-b910fb2a-440c-426f-a000-064149073835 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:18:31 user nova-compute[74840]: DEBUG nova.compute.manager [req-e1f133d1-9d0d-4177-aa54-be73bbd4b6cf req-1efbf620-9af0-41c8-82a0-c92e6239ba26 service nova] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Received event network-vif-unplugged-b910fb2a-440c-426f-a000-064149073835 for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:18:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:31 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-b937ab37-a287-4c39-9465-50fe9f4d32a3 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] COPY block job progress, current cursor: 15138816 final cursor: 75497472 {{(pid=74840) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 12:18:31 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Instance destroyed successfully.
Nov 08 12:18:31 user nova-compute[74840]: DEBUG nova.objects.instance [None req-70822123-dd1b-4653-996e-cc1e6e4f7762 tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Lazy-loading 'resources' on Instance uuid 684b8be2-7f8f-499f-8885-c9d1c86eef2f {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:18:31 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-70822123-dd1b-4653-996e-cc1e6e4f7762 tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:09:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-163515573',display_name='tempest-VolumesAdminNegativeTest-server-163515573',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-163515573',id=4,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIJZL0dMho7k4byp5eyjMmCBjS1q40Bmx1HHYC8I1rNDXrB0dJ6f16FDcTMWHIFSXefA1qgMxJqLXZpTH7tQfZ1Xwe4wPuWbLs5+64ZIoEqahsozVUkGt6SApZ3oM31Eg==',key_name='tempest-keypair-1000135048',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:09:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bd51d983b3aa441dabb1543296f0bb70',ramdisk_id='',reservation_id='r-70xdhzpj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1071383436',owner_user_name='tempest-VolumesAdminNegativeTest-1071383436-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:09:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='016aab95b2394f5f89283d1e62c5fd8d',uuid=684b8be2-7f8f-499f-8885-c9d1c86eef2f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b910fb2a-440c-426f-a000-064149073835", "address": "fa:16:3e:fd:8e:63", "network": {"id": "bfa1d7ef-3436-4676-a399-ead8194a958a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-3950314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd51d983b3aa441dabb1543296f0bb70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb910fb2a-44", "ovs_interfaceid": "b910fb2a-440c-426f-a000-064149073835", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:18:31 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-70822123-dd1b-4653-996e-cc1e6e4f7762 tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Converting VIF {"id": "b910fb2a-440c-426f-a000-064149073835", "address": "fa:16:3e:fd:8e:63", "network": {"id": "bfa1d7ef-3436-4676-a399-ead8194a958a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-3950314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd51d983b3aa441dabb1543296f0bb70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb910fb2a-44", "ovs_interfaceid": "b910fb2a-440c-426f-a000-064149073835", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:18:31 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-70822123-dd1b-4653-996e-cc1e6e4f7762 tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:8e:63,bridge_name='br-int',has_traffic_filtering=True,id=b910fb2a-440c-426f-a000-064149073835,network=Network(bfa1d7ef-3436-4676-a399-ead8194a958a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb910fb2a-44') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:18:31 user nova-compute[74840]: DEBUG os_vif [None req-70822123-dd1b-4653-996e-cc1e6e4f7762 tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:8e:63,bridge_name='br-int',has_traffic_filtering=True,id=b910fb2a-440c-426f-a000-064149073835,network=Network(bfa1d7ef-3436-4676-a399-ead8194a958a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb910fb2a-44') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:18:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb910fb2a-44, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:18:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:18:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c37d8548-4aca-4d35-98c4-63b55f641c90) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:18:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:31 user nova-compute[74840]: INFO os_vif [None req-70822123-dd1b-4653-996e-cc1e6e4f7762 tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:8e:63,bridge_name='br-int',has_traffic_filtering=True,id=b910fb2a-440c-426f-a000-064149073835,network=Network(bfa1d7ef-3436-4676-a399-ead8194a958a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb910fb2a-44')
Nov 08 12:18:31 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-70822123-dd1b-4653-996e-cc1e6e4f7762 tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Deleting instance files /opt/stack/data/nova/instances/684b8be2-7f8f-499f-8885-c9d1c86eef2f_del
Nov 08 12:18:31 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-70822123-dd1b-4653-996e-cc1e6e4f7762 tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Deletion of /opt/stack/data/nova/instances/684b8be2-7f8f-499f-8885-c9d1c86eef2f_del complete
Nov 08 12:18:31 user nova-compute[74840]: INFO nova.compute.manager [None req-70822123-dd1b-4653-996e-cc1e6e4f7762 tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Took 1.10 seconds to destroy the instance on the hypervisor.
Nov 08 12:18:31 user nova-compute[74840]: DEBUG oslo.service.loopingcall [None req-70822123-dd1b-4653-996e-cc1e6e4f7762 tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74840) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 12:18:31 user nova-compute[74840]: DEBUG nova.compute.manager [-] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Deallocating network for instance {{(pid=74840) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 12:18:31 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] deallocate_for_instance() {{(pid=74840) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 12:18:31 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-b937ab37-a287-4c39-9465-50fe9f4d32a3 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74840) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 12:18:31 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-b937ab37-a287-4c39-9465-50fe9f4d32a3 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 08 12:18:32 user nova-compute[74840]: DEBUG nova.privsep.utils [None req-b937ab37-a287-4c39-9465-50fe9f4d32a3 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74840) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 12:18:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-b937ab37-a287-4c39-9465-50fe9f4d32a3 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpz5dhy6fq/8e317ff4130947db91064af9878bbff9.delta /opt/stack/data/nova/instances/snapshots/tmpz5dhy6fq/8e317ff4130947db91064af9878bbff9 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:32 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:18:32 user nova-compute[74840]: INFO nova.compute.manager [-] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Took 1.16 seconds to deallocate network for instance.
Nov 08 12:18:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-b937ab37-a287-4c39-9465-50fe9f4d32a3 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpz5dhy6fq/8e317ff4130947db91064af9878bbff9.delta /opt/stack/data/nova/instances/snapshots/tmpz5dhy6fq/8e317ff4130947db91064af9878bbff9" returned: 0 in 0.657s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:32 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-b937ab37-a287-4c39-9465-50fe9f4d32a3 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Snapshot extracted, beginning image upload
Nov 08 12:18:32 user nova-compute[74840]: DEBUG nova.compute.manager [req-2003fb34-a23b-4544-84fa-678304ddd8aa req-b6ef600b-7038-4b6f-856f-7a62f5cd101a service nova] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Received event network-vif-deleted-b910fb2a-440c-426f-a000-064149073835 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:18:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-70822123-dd1b-4653-996e-cc1e6e4f7762 tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:18:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-70822123-dd1b-4653-996e-cc1e6e4f7762 tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:18:33 user nova-compute[74840]: DEBUG nova.compute.manager [req-4ad5c84c-26bb-48ef-92c5-5351057c0f36 req-348ae6b8-8a59-433b-ad3c-c1a3905138a5 service nova] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Received event network-vif-plugged-b910fb2a-440c-426f-a000-064149073835 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:18:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4ad5c84c-26bb-48ef-92c5-5351057c0f36 req-348ae6b8-8a59-433b-ad3c-c1a3905138a5 service nova] Acquiring lock "684b8be2-7f8f-499f-8885-c9d1c86eef2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:18:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4ad5c84c-26bb-48ef-92c5-5351057c0f36 req-348ae6b8-8a59-433b-ad3c-c1a3905138a5 service nova] Lock "684b8be2-7f8f-499f-8885-c9d1c86eef2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:18:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4ad5c84c-26bb-48ef-92c5-5351057c0f36 req-348ae6b8-8a59-433b-ad3c-c1a3905138a5 service nova] Lock "684b8be2-7f8f-499f-8885-c9d1c86eef2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:18:33 user nova-compute[74840]: DEBUG nova.compute.manager [req-4ad5c84c-26bb-48ef-92c5-5351057c0f36 req-348ae6b8-8a59-433b-ad3c-c1a3905138a5 service nova] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] No waiting events found dispatching network-vif-plugged-b910fb2a-440c-426f-a000-064149073835 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:18:33 user nova-compute[74840]: WARNING nova.compute.manager [req-4ad5c84c-26bb-48ef-92c5-5351057c0f36 req-348ae6b8-8a59-433b-ad3c-c1a3905138a5 service nova] [instance: 684b8be2-7f8f-499f-8885-c9d1c86eef2f] Received unexpected event network-vif-plugged-b910fb2a-440c-426f-a000-064149073835 for instance with vm_state deleted and task_state None.
Nov 08 12:18:33 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-70822123-dd1b-4653-996e-cc1e6e4f7762 tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:18:33 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-70822123-dd1b-4653-996e-cc1e6e4f7762 tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:18:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-70822123-dd1b-4653-996e-cc1e6e4f7762 tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.413s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:18:33 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-70822123-dd1b-4653-996e-cc1e6e4f7762 tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Deleted allocations for instance 684b8be2-7f8f-499f-8885-c9d1c86eef2f
Nov 08 12:18:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-70822123-dd1b-4653-996e-cc1e6e4f7762 tempest-VolumesAdminNegativeTest-1071383436 tempest-VolumesAdminNegativeTest-1071383436-project-member] Lock "684b8be2-7f8f-499f-8885-c9d1c86eef2f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.960s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:18:34 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-5031cd32-8261-4b59-a445-60692bfa72e7 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 74a51b1b-103e-49b2-b7a0-ec4625a9445b is timed out.
Nov 08 12:18:34 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-5031cd32-8261-4b59-a445-60692bfa72e7 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Successfully detached device vdb from instance 74a51b1b-103e-49b2-b7a0-ec4625a9445b from the live domain config.
Nov 08 12:18:34 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5031cd32-8261-4b59-a445-60692bfa72e7 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 12:18:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-5031cd32-8261-4b59-a445-60692bfa72e7 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:49a84c89-160c-4f06-aa6d-c87d01a362fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LfumDOzI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:18:34 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-5031cd32-8261-4b59-a445-60692bfa72e7 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:18:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-5031cd32-8261-4b59-a445-60692bfa72e7 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:18:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-5031cd32-8261-4b59-a445-60692bfa72e7 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:18:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:34 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[272bc4db-9991-44a2-8998-0d47607e8858]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49a84c89-160c-4f06-aa6d-c87d01a362fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-5031cd32-8261-4b59-a445-60692bfa72e7 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 12:18:34 user nova-compute[74840]: No targets found.
Nov 08 12:18:34 user nova-compute[74840]: iSNS:
Nov 08 12:18:34 user nova-compute[74840]: No targets found.
Nov 08 12:18:34 user nova-compute[74840]: STATIC:
Nov 08 12:18:34 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22
Nov 08 12:18:34 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:18:34 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:18:34 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9
Nov 08 12:18:34 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:18:34 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:18:34 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:49a84c89-160c-4f06-aa6d-c87d01a362fa
Nov 08 12:18:34 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:18:34 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:18:34 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665
Nov 08 12:18:34 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:18:34 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:18:34 user nova-compute[74840]: FIRMWARE:
Nov 08 12:18:34 user nova-compute[74840]: No targets found.
Nov 08 12:18:34 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:18:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-5031cd32-8261-4b59-a445-60692bfa72e7 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 12:18:34 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 12:18:34 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 12:18:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-5031cd32-8261-4b59-a445-60692bfa72e7 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49a84c89-160c-4f06-aa6d-c87d01a362fa', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 12:18:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:34 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfb94f9-760f-42ec-bb9a-965ba5e03dc6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49a84c89-160c-4f06-aa6d-c87d01a362fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:34 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[4123a05f-c6fb-40ae-94d2-2ebbf93cf0ec]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49a84c89-160c-4f06-aa6d-c87d01a362fa (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-5031cd32-8261-4b59-a445-60692bfa72e7 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)
Nov 08 12:18:34 user nova-compute[74840]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 (non-flash)
Nov 08 12:18:34 user nova-compute[74840]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665 (non-flash)
Nov 08 12:18:34 user nova-compute[74840]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49a84c89-160c-4f06-aa6d-c87d01a362fa (non-flash)
Nov 08 12:18:34 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:18:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-5031cd32-8261-4b59-a445-60692bfa72e7 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)
Nov 08 12:18:34 user nova-compute[74840]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 (non-flash)
Nov 08 12:18:34 user nova-compute[74840]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665 (non-flash)
Nov 08 12:18:34 user nova-compute[74840]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49a84c89-160c-4f06-aa6d-c87d01a362fa (non-flash)
Nov 08 12:18:34 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:18:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-5031cd32-8261-4b59-a445-60692bfa72e7 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7f458cf70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49a84c89-160c-4f06-aa6d-c87d01a362fa'): ({'sde'}, set())}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 12:18:34 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-5031cd32-8261-4b59-a445-60692bfa72e7 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Removing single pathed devices sde {{(pid=74840) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 12:18:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:34 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d963f5e-0aec-43d8-ae3e-47987e177eae]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:34 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab27861-36fb-4ae1-b723-3a62d052de4e]: (4, ('ok\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:34 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-5031cd32-8261-4b59-a445-60692bfa72e7 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Flushing IO for device /dev/sde {{(pid=74840) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 12:18:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:34 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe54d569-118d-435c-bc08-e9a1aad7964c]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:34 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-5031cd32-8261-4b59-a445-60692bfa72e7 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74840) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 12:18:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:34 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e06209-2453-41e5-b859-4b04572dcaea]: (4, ('1', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:34 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-5031cd32-8261-4b59-a445-60692bfa72e7 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 12:18:34 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-5031cd32-8261-4b59-a445-60692bfa72e7 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] SCSI volumes sde have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 12:18:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-5031cd32-8261-4b59-a445-60692bfa72e7 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49a84c89-160c-4f06-aa6d-c87d01a362fa')] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 12:18:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49a84c89-160c-4f06-aa6d-c87d01a362fa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49a84c89-160c-4f06-aa6d-c87d01a362fa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:35 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66d239e-4531-426c-b589-134e828ba213]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-5031cd32-8261-4b59-a445-60692bfa72e7 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:18:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49a84c89-160c-4f06-aa6d-c87d01a362fa -p 172.16.0.220:3260 --logout {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49a84c89-160c-4f06-aa6d-c87d01a362fa -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:35 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea4b01a-a22e-434b-a91f-113af409c5d8]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:49a84c89-160c-4f06-aa6d-c87d01a362fa, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:49a84c89-160c-4f06-aa6d-c87d01a362fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-5031cd32-8261-4b59-a445-60692bfa72e7 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:49a84c89-160c-4f06-aa6d-c87d01a362fa, portal: 172.16.0.220,3260]
Nov 08 12:18:35 user nova-compute[74840]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:49a84c89-160c-4f06-aa6d-c87d01a362fa, portal: 172.16.0.220,3260] successful.
Nov 08 12:18:35 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:18:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49a84c89-160c-4f06-aa6d-c87d01a362fa -p 172.16.0.220:3260 --op delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49a84c89-160c-4f06-aa6d-c87d01a362fa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:35 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a62b9a-987b-4f75-93c2-c0909d8b76e7]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-5031cd32-8261-4b59-a445-60692bfa72e7 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:18:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-5031cd32-8261-4b59-a445-60692bfa72e7 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.398s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:18:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-5031cd32-8261-4b59-a445-60692bfa72e7 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] <== disconnect_volume: return (400ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:18:35 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5031cd32-8261-4b59-a445-60692bfa72e7 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 12:18:36 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-b937ab37-a287-4c39-9465-50fe9f4d32a3 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Snapshot image upload complete
Nov 08 12:18:36 user nova-compute[74840]: INFO nova.compute.manager [None req-b937ab37-a287-4c39-9465-50fe9f4d32a3 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Took 7.40 seconds to snapshot the instance on the hypervisor.
Nov 08 12:18:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG nova.objects.instance [None req-5031cd32-8261-4b59-a445-60692bfa72e7 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lazy-loading 'flavor' on Instance uuid 74a51b1b-103e-49b2-b7a0-ec4625a9445b {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5031cd32-8261-4b59-a445-60692bfa72e7 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "74a51b1b-103e-49b2-b7a0-ec4625a9445b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 25.015s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Calling os-brick to attach iSCSI Volume {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'npisaORm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:18:39 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:18:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:18:39 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:18:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:18:39 user nova-compute[74840]: INFO os_brick.initiator.connectors.iscsi [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 12:18:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35 -p 172.16.0.220:3260 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c162c20-c207-47a7-8857-7cc68459e1da]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 12:18:39 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35 -p 172.16.0.220:3260 --interface default --op new {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d58330-735b-462f-a7f5-9d6298669282]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35] added\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35] added
Nov 08 12:18:39 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b384eed4-a0c5-4e27-9aec-3b82f6f4546d]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a727c878-42ab-422d-927f-25cb7bff508a]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v npisaORm {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v npisaORm" returned: 0 in 0.025s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f84758-df4d-4cbb-93a2-0b834e27cf29]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'npisaORm'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7152bc-d1e3-494b-924a-36b25a630e86]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[59497873-6b8d-4394-a9fc-732ebc751e88]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)
Nov 08 12:18:39 user nova-compute[74840]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 (non-flash)
Nov 08 12:18:39 user nova-compute[74840]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665 (non-flash)
Nov 08 12:18:39 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)
Nov 08 12:18:39 user nova-compute[74840]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 (non-flash)
Nov 08 12:18:39 user nova-compute[74840]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665 (non-flash)
Nov 08 12:18:39 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35 -p 172.16.0.220:3260 --login {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ab1fdc-df0a-4091-93d4-c0cd5ed75eb2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35, portal: 172.16.0.220,3260]
Nov 08 12:18:39 user nova-compute[74840]: Login to [iface: default, target: iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35, portal: 172.16.0.220,3260] successful.
Nov 08 12:18:39 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a02967-90ab-4fb2-901f-5660fbe37407]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[313aa19f-69d7-4a40-beef-c2b5d948b118]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)
Nov 08 12:18:39 user nova-compute[74840]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 (non-flash)
Nov 08 12:18:39 user nova-compute[74840]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665 (non-flash)
Nov 08 12:18:39 user nova-compute[74840]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35 (non-flash)
Nov 08 12:18:39 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)
Nov 08 12:18:39 user nova-compute[74840]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 (non-flash)
Nov 08 12:18:39 user nova-compute[74840]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665 (non-flash)
Nov 08 12:18:39 user nova-compute[74840]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35 (non-flash)
Nov 08 12:18:39 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Connected to 172.16.0.220:3260 {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] HCTL ('36', '-', '-', 0) found on session 18 with lun 0 {{(pid=74840) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74840) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[771f3a0d-3c2b-4a79-a4ce-c9777bea44c6]: (4, ('- - 0', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:39 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Searching for a device in session 18 and hctl ['36', '*', '*', 0] yield: None {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:18:40 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Searching for a device in session 18 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:18:40 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'npisaORm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 12:18:40 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:18:40 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '23831633637383562', 'path': '/dev/sde'} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:18:40 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831633637383562', 'path': '/dev/sde'} {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 12:18:40 user nova-compute[74840]: DEBUG nova.objects.instance [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Lazy-loading 'flavor' on Instance uuid e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:18:40 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 12:18:40 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:18:40 user nova-compute[74840]:   <source dev="/dev/sde"/>
Nov 08 12:18:40 user nova-compute[74840]:   <target dev="vdc" bus="virtio"/>
Nov 08 12:18:40 user nova-compute[74840]:   <serial>d6163f42-ec0f-4b2f-a4d2-64a6c8880a35</serial>
Nov 08 12:18:40 user nova-compute[74840]: </disk>
Nov 08 12:18:40 user nova-compute[74840]:  {{(pid=74840) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 12:18:41 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:18:41 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:18:41 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:18:41 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] No VIF found with MAC fa:16:3e:6e:13:a8, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:18:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-393afcad-14fd-45a7-9470-8e2ada675ec0 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Lock "e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.968s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:18:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1f3ebb49-95d2-4dc6-8087-2ec65b6a255d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Acquiring lock "e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:18:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1f3ebb49-95d2-4dc6-8087-2ec65b6a255d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Lock "e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:18:41 user nova-compute[74840]: INFO nova.compute.manager [None req-1f3ebb49-95d2-4dc6-8087-2ec65b6a255d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Detaching volume d6163f42-ec0f-4b2f-a4d2-64a6c8880a35
Nov 08 12:18:42 user nova-compute[74840]: INFO nova.virt.block_device [None req-1f3ebb49-95d2-4dc6-8087-2ec65b6a255d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Attempting to driver detach volume d6163f42-ec0f-4b2f-a4d2-64a6c8880a35 from mountpoint /dev/vdc
Nov 08 12:18:42 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1f3ebb49-95d2-4dc6-8087-2ec65b6a255d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Attempting to detach device vdc from instance e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf from the persistent domain config. {{(pid=74840) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 12:18:42 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-1f3ebb49-95d2-4dc6-8087-2ec65b6a255d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 12:18:42 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:18:42 user nova-compute[74840]:   <source dev="/dev/sde"/>
Nov 08 12:18:42 user nova-compute[74840]:   <target dev="vdc" bus="virtio"/>
Nov 08 12:18:42 user nova-compute[74840]:   <serial>d6163f42-ec0f-4b2f-a4d2-64a6c8880a35</serial>
Nov 08 12:18:42 user nova-compute[74840]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 08 12:18:42 user nova-compute[74840]: </disk>
Nov 08 12:18:42 user nova-compute[74840]:  {{(pid=74840) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 12:18:42 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-1f3ebb49-95d2-4dc6-8087-2ec65b6a255d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Successfully detached device vdc from instance e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf from the persistent domain config.
Nov 08 12:18:42 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1f3ebb49-95d2-4dc6-8087-2ec65b6a255d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf from the live domain config. {{(pid=74840) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 12:18:42 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-1f3ebb49-95d2-4dc6-8087-2ec65b6a255d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 12:18:42 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:18:42 user nova-compute[74840]:   <source dev="/dev/sde"/>
Nov 08 12:18:42 user nova-compute[74840]:   <target dev="vdc" bus="virtio"/>
Nov 08 12:18:42 user nova-compute[74840]:   <serial>d6163f42-ec0f-4b2f-a4d2-64a6c8880a35</serial>
Nov 08 12:18:42 user nova-compute[74840]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 08 12:18:42 user nova-compute[74840]: </disk>
Nov 08 12:18:42 user nova-compute[74840]:  {{(pid=74840) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 12:18:42 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1f3ebb49-95d2-4dc6-8087-2ec65b6a255d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf {{(pid=74840) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 12:18:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:47 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c5fc3250-1eee-4569-9377-fde8db9d118c tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Acquiring lock "a0b7a0e1-d0d1-4682-9218-ef44d1e461f1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:18:47 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c5fc3250-1eee-4569-9377-fde8db9d118c tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Lock "a0b7a0e1-d0d1-4682-9218-ef44d1e461f1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:18:47 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c5fc3250-1eee-4569-9377-fde8db9d118c tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Acquiring lock "a0b7a0e1-d0d1-4682-9218-ef44d1e461f1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:18:47 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c5fc3250-1eee-4569-9377-fde8db9d118c tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Lock "a0b7a0e1-d0d1-4682-9218-ef44d1e461f1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:18:47 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c5fc3250-1eee-4569-9377-fde8db9d118c tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Lock "a0b7a0e1-d0d1-4682-9218-ef44d1e461f1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:18:47 user nova-compute[74840]: INFO nova.compute.manager [None req-c5fc3250-1eee-4569-9377-fde8db9d118c tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Terminating instance
Nov 08 12:18:47 user nova-compute[74840]: DEBUG nova.compute.manager [None req-c5fc3250-1eee-4569-9377-fde8db9d118c tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Start destroying the instance on the hypervisor. {{(pid=74840) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 12:18:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:47 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:18:47 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:18:47 user nova-compute[74840]: DEBUG nova.compute.manager [req-6d17c0fb-b2cf-442e-b142-dff7e90c2344 req-f00e9472-381f-4f87-aa8e-75c0fb3ef713 service nova] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Received event network-vif-unplugged-259ddaf9-a353-4528-a451-96ff20064ff1 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:18:47 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-6d17c0fb-b2cf-442e-b142-dff7e90c2344 req-f00e9472-381f-4f87-aa8e-75c0fb3ef713 service nova] Acquiring lock "a0b7a0e1-d0d1-4682-9218-ef44d1e461f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:18:47 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-6d17c0fb-b2cf-442e-b142-dff7e90c2344 req-f00e9472-381f-4f87-aa8e-75c0fb3ef713 service nova] Lock "a0b7a0e1-d0d1-4682-9218-ef44d1e461f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:18:47 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-6d17c0fb-b2cf-442e-b142-dff7e90c2344 req-f00e9472-381f-4f87-aa8e-75c0fb3ef713 service nova] Lock "a0b7a0e1-d0d1-4682-9218-ef44d1e461f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:18:47 user nova-compute[74840]: DEBUG nova.compute.manager [req-6d17c0fb-b2cf-442e-b142-dff7e90c2344 req-f00e9472-381f-4f87-aa8e-75c0fb3ef713 service nova] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] No waiting events found dispatching network-vif-unplugged-259ddaf9-a353-4528-a451-96ff20064ff1 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:18:47 user nova-compute[74840]: DEBUG nova.compute.manager [req-6d17c0fb-b2cf-442e-b142-dff7e90c2344 req-f00e9472-381f-4f87-aa8e-75c0fb3ef713 service nova] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Received event network-vif-unplugged-259ddaf9-a353-4528-a451-96ff20064ff1 for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:18:48 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Instance destroyed successfully.
Nov 08 12:18:48 user nova-compute[74840]: DEBUG nova.objects.instance [None req-c5fc3250-1eee-4569-9377-fde8db9d118c tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Lazy-loading 'resources' on Instance uuid a0b7a0e1-d0d1-4682-9218-ef44d1e461f1 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:18:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-c5fc3250-1eee-4569-9377-fde8db9d118c tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:13:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1652328863',display_name='tempest-SnapshotDataIntegrityTests-server-1652328863',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1652328863',id=12,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHM/dg7SdKK5a9V4GEkbb3T2fQTNAH4Aw8YQ7uwF+Lkwv/PfkA+956TGTE2COo6c9c5IieNgxwFHUyb2et2Dq4VW5v/TKCQ6dadaXXelhZ7VklXHH2WSIvo0nbjYuAmtyg==',key_name='tempest-keypair-246279031',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:13:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='65971596fc0642f3912bad70dc3e4e07',ramdisk_id='',reservation_id='r-nvtfufvt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-11119301',owner_user_name='tempest-SnapshotDataIntegrityTests-11119301-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:13:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f26e5df3fa1c4715be2565af1dbb0a03',uuid=a0b7a0e1-d0d1-4682-9218-ef44d1e461f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "259ddaf9-a353-4528-a451-96ff20064ff1", "address": "fa:16:3e:8b:2d:b3", "network": {"id": "b976e3d8-8d34-4f01-942d-c751f6a68780", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-154778043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65971596fc0642f3912bad70dc3e4e07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259ddaf9-a3", "ovs_interfaceid": "259ddaf9-a353-4528-a451-96ff20064ff1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:18:48 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-c5fc3250-1eee-4569-9377-fde8db9d118c tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Converting VIF {"id": "259ddaf9-a353-4528-a451-96ff20064ff1", "address": "fa:16:3e:8b:2d:b3", "network": {"id": "b976e3d8-8d34-4f01-942d-c751f6a68780", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-154778043-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65971596fc0642f3912bad70dc3e4e07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259ddaf9-a3", "ovs_interfaceid": "259ddaf9-a353-4528-a451-96ff20064ff1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:18:48 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-c5fc3250-1eee-4569-9377-fde8db9d118c tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:2d:b3,bridge_name='br-int',has_traffic_filtering=True,id=259ddaf9-a353-4528-a451-96ff20064ff1,network=Network(b976e3d8-8d34-4f01-942d-c751f6a68780),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap259ddaf9-a3') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:18:48 user nova-compute[74840]: DEBUG os_vif [None req-c5fc3250-1eee-4569-9377-fde8db9d118c tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:2d:b3,bridge_name='br-int',has_traffic_filtering=True,id=259ddaf9-a353-4528-a451-96ff20064ff1,network=Network(b976e3d8-8d34-4f01-942d-c751f6a68780),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap259ddaf9-a3') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:18:48 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:48 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap259ddaf9-a3, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:18:48 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:48 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:18:48 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:48 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=553b3369-8ae4-4f77-b3dd-55c78d68a109) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:18:48 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:48 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:48 user nova-compute[74840]: INFO os_vif [None req-c5fc3250-1eee-4569-9377-fde8db9d118c tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:2d:b3,bridge_name='br-int',has_traffic_filtering=True,id=259ddaf9-a353-4528-a451-96ff20064ff1,network=Network(b976e3d8-8d34-4f01-942d-c751f6a68780),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap259ddaf9-a3')
Nov 08 12:18:48 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-c5fc3250-1eee-4569-9377-fde8db9d118c tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Deleting instance files /opt/stack/data/nova/instances/a0b7a0e1-d0d1-4682-9218-ef44d1e461f1_del
Nov 08 12:18:48 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-c5fc3250-1eee-4569-9377-fde8db9d118c tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Deletion of /opt/stack/data/nova/instances/a0b7a0e1-d0d1-4682-9218-ef44d1e461f1_del complete
Nov 08 12:18:48 user nova-compute[74840]: INFO nova.compute.manager [None req-c5fc3250-1eee-4569-9377-fde8db9d118c tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 08 12:18:48 user nova-compute[74840]: DEBUG oslo.service.loopingcall [None req-c5fc3250-1eee-4569-9377-fde8db9d118c tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74840) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 12:18:48 user nova-compute[74840]: DEBUG nova.compute.manager [-] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Deallocating network for instance {{(pid=74840) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 12:18:48 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] deallocate_for_instance() {{(pid=74840) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 12:18:48 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:18:48 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:18:48 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Rebuilding the list of instances to heal {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 12:18:48 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Skipping network cache update for instance because it is being deleted. {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 08 12:18:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "refresh_cache-3b10fda0-9488-4089-8033-dd1c8e42af89" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:18:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquired lock "refresh_cache-3b10fda0-9488-4089-8033-dd1c8e42af89" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:18:48 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Forcefully refreshing network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 12:18:48 user nova-compute[74840]: DEBUG nova.objects.instance [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lazy-loading 'info_cache' on Instance uuid 3b10fda0-9488-4089-8033-dd1c8e42af89 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:18:49 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Updating instance_info_cache with network_info: [{"id": "b48b5298-045f-463d-9585-fbb5feb869bf", "address": "fa:16:3e:19:58:1f", "network": {"id": "9dec89b0-562f-482c-aec1-d024351d0bd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-237264167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a544910dc2c4b169c986fa74b5979d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48b5298-04", "ovs_interfaceid": "b48b5298-045f-463d-9585-fbb5feb869bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:18:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Releasing lock "refresh_cache-3b10fda0-9488-4089-8033-dd1c8e42af89" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:18:49 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Updated the network info_cache for instance {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 12:18:49 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:18:49 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:18:49 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:18:49 user nova-compute[74840]: INFO nova.compute.manager [-] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Took 1.47 seconds to deallocate network for instance.
Nov 08 12:18:49 user nova-compute[74840]: DEBUG nova.compute.manager [req-087e723b-69de-47ab-b438-c108abbc1534 req-9d6eb931-72f3-43eb-bbf1-209a824a87b1 service nova] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Received event network-vif-deleted-259ddaf9-a353-4528-a451-96ff20064ff1 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:18:49 user nova-compute[74840]: INFO nova.compute.manager [req-087e723b-69de-47ab-b438-c108abbc1534 req-9d6eb931-72f3-43eb-bbf1-209a824a87b1 service nova] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Neutron deleted interface 259ddaf9-a353-4528-a451-96ff20064ff1; detaching it from the instance and deleting it from the info cache
Nov 08 12:18:49 user nova-compute[74840]: DEBUG nova.network.neutron [req-087e723b-69de-47ab-b438-c108abbc1534 req-9d6eb931-72f3-43eb-bbf1-209a824a87b1 service nova] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:18:49 user nova-compute[74840]: DEBUG nova.compute.manager [req-087e723b-69de-47ab-b438-c108abbc1534 req-9d6eb931-72f3-43eb-bbf1-209a824a87b1 service nova] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Detach interface failed, port_id=259ddaf9-a353-4528-a451-96ff20064ff1, reason: Instance a0b7a0e1-d0d1-4682-9218-ef44d1e461f1 could not be found. {{(pid=74840) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 12:18:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c5fc3250-1eee-4569-9377-fde8db9d118c tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:18:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c5fc3250-1eee-4569-9377-fde8db9d118c tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:18:49 user nova-compute[74840]: DEBUG nova.compute.manager [req-ea619d7a-322d-4884-8526-898292cc58db req-66853c06-b16f-4a84-84f4-a6174f6df3b1 service nova] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Received event network-vif-plugged-259ddaf9-a353-4528-a451-96ff20064ff1 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:18:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-ea619d7a-322d-4884-8526-898292cc58db req-66853c06-b16f-4a84-84f4-a6174f6df3b1 service nova] Acquiring lock "a0b7a0e1-d0d1-4682-9218-ef44d1e461f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:18:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-ea619d7a-322d-4884-8526-898292cc58db req-66853c06-b16f-4a84-84f4-a6174f6df3b1 service nova] Lock "a0b7a0e1-d0d1-4682-9218-ef44d1e461f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:18:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-ea619d7a-322d-4884-8526-898292cc58db req-66853c06-b16f-4a84-84f4-a6174f6df3b1 service nova] Lock "a0b7a0e1-d0d1-4682-9218-ef44d1e461f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:18:49 user nova-compute[74840]: DEBUG nova.compute.manager [req-ea619d7a-322d-4884-8526-898292cc58db req-66853c06-b16f-4a84-84f4-a6174f6df3b1 service nova] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] No waiting events found dispatching network-vif-plugged-259ddaf9-a353-4528-a451-96ff20064ff1 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:18:49 user nova-compute[74840]: WARNING nova.compute.manager [req-ea619d7a-322d-4884-8526-898292cc58db req-66853c06-b16f-4a84-84f4-a6174f6df3b1 service nova] [instance: a0b7a0e1-d0d1-4682-9218-ef44d1e461f1] Received unexpected event network-vif-plugged-259ddaf9-a353-4528-a451-96ff20064ff1 for instance with vm_state deleted and task_state None.
Nov 08 12:18:50 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-c5fc3250-1eee-4569-9377-fde8db9d118c tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:18:50 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-c5fc3250-1eee-4569-9377-fde8db9d118c tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:18:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c5fc3250-1eee-4569-9377-fde8db9d118c tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.289s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:18:50 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-c5fc3250-1eee-4569-9377-fde8db9d118c tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Deleted allocations for instance a0b7a0e1-d0d1-4682-9218-ef44d1e461f1
Nov 08 12:18:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c5fc3250-1eee-4569-9377-fde8db9d118c tempest-SnapshotDataIntegrityTests-11119301 tempest-SnapshotDataIntegrityTests-11119301-project-member] Lock "a0b7a0e1-d0d1-4682-9218-ef44d1e461f1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.856s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:18:51 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:51 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:18:51 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:18:52 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:18:52 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:18:52 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:18:52 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:18:52 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:18:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:53 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:53 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:18:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:53 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:18:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:54 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:54 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:54 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:54 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:18:54 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74a51b1b-103e-49b2-b7a0-ec4625a9445b/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:54 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74a51b1b-103e-49b2-b7a0-ec4625a9445b/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:54 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74a51b1b-103e-49b2-b7a0-ec4625a9445b/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:54 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74a51b1b-103e-49b2-b7a0-ec4625a9445b/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:54 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032e6584-9acf-469f-b661-faf6555659e1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032e6584-9acf-469f-b661-faf6555659e1/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032e6584-9acf-469f-b661-faf6555659e1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Acquiring lock "d00e1756-34cd-4847-b108-023ba273444a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:18:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Lock "d00e1756-34cd-4847-b108-023ba273444a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:18:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032e6584-9acf-469f-b661-faf6555659e1/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:55 user nova-compute[74840]: DEBUG nova.compute.manager [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: d00e1756-34cd-4847-b108-023ba273444a] Starting instance... {{(pid=74840) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 12:18:55 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:18:55 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:18:55 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=7807MB free_disk=25.311241149902344GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:18:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:18:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:18:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:18:55 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 3b10fda0-9488-4089-8033-dd1c8e42af89 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:18:55 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:18:55 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 74a51b1b-103e-49b2-b7a0-ec4625a9445b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:18:55 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance d3e8efc6-7146-46ef-8433-380d7e69120c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:18:55 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 9b90af19-7629-4d19-ba8f-fae652f62e3e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:18:55 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 032e6584-9acf-469f-b661-faf6555659e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:18:55 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance d00e1756-34cd-4847-b108-023ba273444a has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 08 12:18:55 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:18:55 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:18:56 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:18:56 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:18:56 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:18:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.468s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:18:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.453s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:18:56 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:18:56 user nova-compute[74840]: INFO nova.compute.claims [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: d00e1756-34cd-4847-b108-023ba273444a] Claim successful on node user
Nov 08 12:18:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:56 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:18:56 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:18:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.386s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:18:56 user nova-compute[74840]: DEBUG nova.compute.manager [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: d00e1756-34cd-4847-b108-023ba273444a] Start building networks asynchronously for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 12:18:56 user nova-compute[74840]: DEBUG nova.compute.manager [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: d00e1756-34cd-4847-b108-023ba273444a] Allocating IP information in the background. {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 12:18:56 user nova-compute[74840]: DEBUG nova.network.neutron [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: d00e1756-34cd-4847-b108-023ba273444a] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 12:18:56 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: d00e1756-34cd-4847-b108-023ba273444a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 12:18:56 user nova-compute[74840]: DEBUG nova.compute.manager [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: d00e1756-34cd-4847-b108-023ba273444a] Start building block device mappings for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 12:18:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-96faadb9-c91c-4231-a48a-65ca8385818a tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Acquiring lock "3b10fda0-9488-4089-8033-dd1c8e42af89" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:18:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-96faadb9-c91c-4231-a48a-65ca8385818a tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lock "3b10fda0-9488-4089-8033-dd1c8e42af89" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:18:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-96faadb9-c91c-4231-a48a-65ca8385818a tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Acquiring lock "3b10fda0-9488-4089-8033-dd1c8e42af89-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:18:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-96faadb9-c91c-4231-a48a-65ca8385818a tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lock "3b10fda0-9488-4089-8033-dd1c8e42af89-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:18:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-96faadb9-c91c-4231-a48a-65ca8385818a tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lock "3b10fda0-9488-4089-8033-dd1c8e42af89-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:18:56 user nova-compute[74840]: INFO nova.compute.manager [None req-96faadb9-c91c-4231-a48a-65ca8385818a tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Terminating instance
Nov 08 12:18:56 user nova-compute[74840]: DEBUG nova.compute.manager [None req-96faadb9-c91c-4231-a48a-65ca8385818a tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Start destroying the instance on the hypervisor. {{(pid=74840) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 12:18:56 user nova-compute[74840]: DEBUG nova.policy [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '82d4449a578d4eb99cb9159a9cb35bf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aee170af16c94cb0ac38095060bcb498', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 12:18:56 user nova-compute[74840]: DEBUG nova.compute.manager [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: d00e1756-34cd-4847-b108-023ba273444a] Start spawning the instance on the hypervisor. {{(pid=74840) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 12:18:56 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: d00e1756-34cd-4847-b108-023ba273444a] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:18:56 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: d00e1756-34cd-4847-b108-023ba273444a] Creating image(s)
Nov 08 12:18:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Acquiring lock "/opt/stack/data/nova/instances/d00e1756-34cd-4847-b108-023ba273444a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:18:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Lock "/opt/stack/data/nova/instances/d00e1756-34cd-4847-b108-023ba273444a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:18:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Lock "/opt/stack/data/nova/instances/d00e1756-34cd-4847-b108-023ba273444a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:18:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:56 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.206s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Acquiring lock "5d26578eba85497f494c575690c4248f381a0fe6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG nova.compute.manager [req-0fb55746-299c-475a-9717-0c158168cfb8 req-fef96c66-628d-4cda-b279-2130f195c733 service nova] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Received event network-vif-unplugged-b48b5298-045f-463d-9585-fbb5feb869bf {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0fb55746-299c-475a-9717-0c158168cfb8 req-fef96c66-628d-4cda-b279-2130f195c733 service nova] Acquiring lock "3b10fda0-9488-4089-8033-dd1c8e42af89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0fb55746-299c-475a-9717-0c158168cfb8 req-fef96c66-628d-4cda-b279-2130f195c733 service nova] Lock "3b10fda0-9488-4089-8033-dd1c8e42af89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0fb55746-299c-475a-9717-0c158168cfb8 req-fef96c66-628d-4cda-b279-2130f195c733 service nova] Lock "3b10fda0-9488-4089-8033-dd1c8e42af89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG nova.compute.manager [req-0fb55746-299c-475a-9717-0c158168cfb8 req-fef96c66-628d-4cda-b279-2130f195c733 service nova] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] No waiting events found dispatching network-vif-unplugged-b48b5298-045f-463d-9585-fbb5feb869bf {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG nova.compute.manager [req-0fb55746-299c-475a-9717-0c158168cfb8 req-fef96c66-628d-4cda-b279-2130f195c733 service nova] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Received event network-vif-unplugged-b48b5298-045f-463d-9585-fbb5feb869bf for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.206s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/d00e1756-34cd-4847-b108-023ba273444a/disk 1073741824 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/d00e1756-34cd-4847-b108-023ba273444a/disk 1073741824" returned: 0 in 0.056s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.180s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d00e1756-34cd-4847-b108-023ba273444a/disk. size=1073741824 {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d00e1756-34cd-4847-b108-023ba273444a/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:57 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Instance destroyed successfully.
Nov 08 12:18:57 user nova-compute[74840]: DEBUG nova.objects.instance [None req-96faadb9-c91c-4231-a48a-65ca8385818a tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lazy-loading 'resources' on Instance uuid 3b10fda0-9488-4089-8033-dd1c8e42af89 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-96faadb9-c91c-4231-a48a-65ca8385818a tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:08:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-172158050',display_name='tempest-ServerActionsTestOtherB-server-172158050',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-172158050',id=3,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJKFMe0GKEBW9KmyXjqsjBsUl5GOfddH2uub399MmagL+sAbL8XpD7Zv97iB27MfsDGdoFheqqd0EDelgcb+/IZFf73OQgm/+DITCITQulDQXkqFfn6taEL9Zjc2Dr8/0g==',key_name='tempest-keypair-2038726199',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:16:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a544910dc2c4b169c986fa74b5979d9',ramdisk_id='',reservation_id='r-o6735td4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1148036573',owner_user_name='tempest-ServerActionsTestOtherB-1148036573-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:16:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47ef9bdd58a147518d0a09267731b67c',uuid=3b10fda0-9488-4089-8033-dd1c8e42af89,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b48b5298-045f-463d-9585-fbb5feb869bf", "address": "fa:16:3e:19:58:1f", "network": {"id": "9dec89b0-562f-482c-aec1-d024351d0bd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-237264167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a544910dc2c4b169c986fa74b5979d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48b5298-04", "ovs_interfaceid": "b48b5298-045f-463d-9585-fbb5feb869bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-96faadb9-c91c-4231-a48a-65ca8385818a tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Converting VIF {"id": "b48b5298-045f-463d-9585-fbb5feb869bf", "address": "fa:16:3e:19:58:1f", "network": {"id": "9dec89b0-562f-482c-aec1-d024351d0bd9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-237264167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a544910dc2c4b169c986fa74b5979d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb48b5298-04", "ovs_interfaceid": "b48b5298-045f-463d-9585-fbb5feb869bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-96faadb9-c91c-4231-a48a-65ca8385818a tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:58:1f,bridge_name='br-int',has_traffic_filtering=True,id=b48b5298-045f-463d-9585-fbb5feb869bf,network=Network(9dec89b0-562f-482c-aec1-d024351d0bd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb48b5298-04') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG os_vif [None req-96faadb9-c91c-4231-a48a-65ca8385818a tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:58:1f,bridge_name='br-int',has_traffic_filtering=True,id=b48b5298-045f-463d-9585-fbb5feb869bf,network=Network(9dec89b0-562f-482c-aec1-d024351d0bd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb48b5298-04') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb48b5298-04, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f085fc08-8510-4ce0-a833-169973c73af1) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:57 user nova-compute[74840]: INFO os_vif [None req-96faadb9-c91c-4231-a48a-65ca8385818a tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:58:1f,bridge_name='br-int',has_traffic_filtering=True,id=b48b5298-045f-463d-9585-fbb5feb869bf,network=Network(9dec89b0-562f-482c-aec1-d024351d0bd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb48b5298-04')
Nov 08 12:18:57 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96faadb9-c91c-4231-a48a-65ca8385818a tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-96faadb9-c91c-4231-a48a-65ca8385818a tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WnvQHzjl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:18:57 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-96faadb9-c91c-4231-a48a-65ca8385818a tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:18:57 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-96faadb9-c91c-4231-a48a-65ca8385818a tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-96faadb9-c91c-4231-a48a-65ca8385818a tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[873885d6-8a75-4d92-92cd-00b07d5fa837]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-96faadb9-c91c-4231-a48a-65ca8385818a tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 12:18:57 user nova-compute[74840]: No targets found.
Nov 08 12:18:57 user nova-compute[74840]: iSNS:
Nov 08 12:18:57 user nova-compute[74840]: No targets found.
Nov 08 12:18:57 user nova-compute[74840]: STATIC:
Nov 08 12:18:57 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22
Nov 08 12:18:57 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:18:57 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:18:57 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9
Nov 08 12:18:57 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:18:57 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:18:57 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665
Nov 08 12:18:57 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:18:57 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:18:57 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35
Nov 08 12:18:57 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:18:57 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:18:57 user nova-compute[74840]: FIRMWARE:
Nov 08 12:18:57 user nova-compute[74840]: No targets found.
Nov 08 12:18:57 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-96faadb9-c91c-4231-a48a-65ca8385818a tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 12:18:57 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 12:18:57 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-96faadb9-c91c-4231-a48a-65ca8385818a tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[84313549-7a92-4859-83a3-c09bf93f0f19]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[51fed85e-fd78-469f-8daa-c2d5a5bc3e19]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-96faadb9-c91c-4231-a48a-65ca8385818a tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)
Nov 08 12:18:57 user nova-compute[74840]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 (non-flash)
Nov 08 12:18:57 user nova-compute[74840]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665 (non-flash)
Nov 08 12:18:57 user nova-compute[74840]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35 (non-flash)
Nov 08 12:18:57 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-96faadb9-c91c-4231-a48a-65ca8385818a tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 (non-flash)
Nov 08 12:18:57 user nova-compute[74840]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 (non-flash)
Nov 08 12:18:57 user nova-compute[74840]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665 (non-flash)
Nov 08 12:18:57 user nova-compute[74840]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35 (non-flash)
Nov 08 12:18:57 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-96faadb9-c91c-4231-a48a-65ca8385818a tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7f446a680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22'): ({'sdc'}, set())}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-96faadb9-c91c-4231-a48a-65ca8385818a tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Removing single pathed devices sdc {{(pid=74840) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d00e1756-34cd-4847-b108-023ba273444a/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Cannot resize image /opt/stack/data/nova/instances/d00e1756-34cd-4847-b108-023ba273444a/disk to a smaller size. {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: d00e1756-34cd-4847-b108-023ba273444a] Created local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: d00e1756-34cd-4847-b108-023ba273444a] Ensure instance console log exists: /opt/stack/data/nova/instances/d00e1756-34cd-4847-b108-023ba273444a/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[35dd67f0-b533-45e1-b5b0-f0af04e2b1a3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc04aaf-0ab0-4f08-9915-2fe9a1eb3c47]: (4, ('ok\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-96faadb9-c91c-4231-a48a-65ca8385818a tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Flushing IO for device /dev/sdc {{(pid=74840) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb4251a-83d1-402f-a982-27cf3c4ebe22]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-96faadb9-c91c-4231-a48a-65ca8385818a tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74840) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG nova.network.neutron [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: d00e1756-34cd-4847-b108-023ba273444a] Successfully created port: 0273291b-7186-488c-baf2-5f971efec444 {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.029s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3715dce-d92d-48e8-ad44-916d184f7bd4]: (4, ('1', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-96faadb9-c91c-4231-a48a-65ca8385818a tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-96faadb9-c91c-4231-a48a-65ca8385818a tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] SCSI volumes sdc have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-96faadb9-c91c-4231-a48a-65ca8385818a tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22')] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7f1e8c-4d45-47ef-83e5-87c3d516356d]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-96faadb9-c91c-4231-a48a-65ca8385818a tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --logout {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5262a137-ca6c-4cdf-b385-f1a691db6339]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-96faadb9-c91c-4231-a48a-65ca8385818a tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22, portal: 172.16.0.220,3260]
Nov 08 12:18:57 user nova-compute[74840]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22, portal: 172.16.0.220,3260] successful.
Nov 08 12:18:57 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:18:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --op delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:18:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d161c9a-4d64-4a8b-9525-225154403d22 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:18:58 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[609ddbbc-ac47-49a6-8f83-c092bc1c83ef]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:18:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-96faadb9-c91c-4231-a48a-65ca8385818a tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:18:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-96faadb9-c91c-4231-a48a-65ca8385818a tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:18:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-96faadb9-c91c-4231-a48a-65ca8385818a tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] <== disconnect_volume: return (322ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:18:58 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96faadb9-c91c-4231-a48a-65ca8385818a tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 12:18:58 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-96faadb9-c91c-4231-a48a-65ca8385818a tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Deleting instance files /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89_del
Nov 08 12:18:58 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-96faadb9-c91c-4231-a48a-65ca8385818a tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Deletion of /opt/stack/data/nova/instances/3b10fda0-9488-4089-8033-dd1c8e42af89_del complete
Nov 08 12:18:58 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:18:58 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:18:58 user nova-compute[74840]: INFO nova.compute.manager [None req-96faadb9-c91c-4231-a48a-65ca8385818a tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Took 1.61 seconds to destroy the instance on the hypervisor.
Nov 08 12:18:58 user nova-compute[74840]: DEBUG oslo.service.loopingcall [None req-96faadb9-c91c-4231-a48a-65ca8385818a tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74840) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 12:18:58 user nova-compute[74840]: DEBUG nova.compute.manager [-] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Deallocating network for instance {{(pid=74840) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 12:18:58 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] deallocate_for_instance() {{(pid=74840) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 12:18:58 user nova-compute[74840]: DEBUG nova.network.neutron [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: d00e1756-34cd-4847-b108-023ba273444a] Successfully updated port: 0273291b-7186-488c-baf2-5f971efec444 {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:18:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Acquiring lock "refresh_cache-d00e1756-34cd-4847-b108-023ba273444a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:18:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Acquired lock "refresh_cache-d00e1756-34cd-4847-b108-023ba273444a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:18:58 user nova-compute[74840]: DEBUG nova.network.neutron [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: d00e1756-34cd-4847-b108-023ba273444a] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:18:58 user nova-compute[74840]: DEBUG nova.compute.manager [req-44f6635e-48c2-4f71-a92c-5fa17009ebdf req-50afa670-5e00-4ef4-9f92-a8e7a7af29ef service nova] [instance: d00e1756-34cd-4847-b108-023ba273444a] Received event network-changed-0273291b-7186-488c-baf2-5f971efec444 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:18:58 user nova-compute[74840]: DEBUG nova.compute.manager [req-44f6635e-48c2-4f71-a92c-5fa17009ebdf req-50afa670-5e00-4ef4-9f92-a8e7a7af29ef service nova] [instance: d00e1756-34cd-4847-b108-023ba273444a] Refreshing instance network info cache due to event network-changed-0273291b-7186-488c-baf2-5f971efec444. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:18:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-44f6635e-48c2-4f71-a92c-5fa17009ebdf req-50afa670-5e00-4ef4-9f92-a8e7a7af29ef service nova] Acquiring lock "refresh_cache-d00e1756-34cd-4847-b108-023ba273444a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:18:58 user nova-compute[74840]: DEBUG nova.network.neutron [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: d00e1756-34cd-4847-b108-023ba273444a] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:18:59 user nova-compute[74840]: DEBUG nova.network.neutron [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: d00e1756-34cd-4847-b108-023ba273444a] Updating instance_info_cache with network_info: [{"id": "0273291b-7186-488c-baf2-5f971efec444", "address": "fa:16:3e:5d:d0:05", "network": {"id": "fcca035f-b03c-407d-99c5-4e1a46ef8354", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1402418482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aee170af16c94cb0ac38095060bcb498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0273291b-71", "ovs_interfaceid": "0273291b-7186-488c-baf2-5f971efec444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:18:59 user nova-compute[74840]: DEBUG nova.compute.manager [req-5c4e29a9-b008-4f74-b8f8-3bdc545b17dc req-00e34868-9a19-45b0-8775-078ddcc18173 service nova] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Received event network-vif-plugged-b48b5298-045f-463d-9585-fbb5feb869bf {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:18:59 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-5c4e29a9-b008-4f74-b8f8-3bdc545b17dc req-00e34868-9a19-45b0-8775-078ddcc18173 service nova] Acquiring lock "3b10fda0-9488-4089-8033-dd1c8e42af89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:18:59 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-5c4e29a9-b008-4f74-b8f8-3bdc545b17dc req-00e34868-9a19-45b0-8775-078ddcc18173 service nova] Lock "3b10fda0-9488-4089-8033-dd1c8e42af89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:18:59 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-5c4e29a9-b008-4f74-b8f8-3bdc545b17dc req-00e34868-9a19-45b0-8775-078ddcc18173 service nova] Lock "3b10fda0-9488-4089-8033-dd1c8e42af89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:18:59 user nova-compute[74840]: DEBUG nova.compute.manager [req-5c4e29a9-b008-4f74-b8f8-3bdc545b17dc req-00e34868-9a19-45b0-8775-078ddcc18173 service nova] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] No waiting events found dispatching network-vif-plugged-b48b5298-045f-463d-9585-fbb5feb869bf {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:18:59 user nova-compute[74840]: WARNING nova.compute.manager [req-5c4e29a9-b008-4f74-b8f8-3bdc545b17dc req-00e34868-9a19-45b0-8775-078ddcc18173 service nova] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Received unexpected event network-vif-plugged-b48b5298-045f-463d-9585-fbb5feb869bf for instance with vm_state active and task_state deleting.
Nov 08 12:18:59 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Releasing lock "refresh_cache-d00e1756-34cd-4847-b108-023ba273444a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:18:59 user nova-compute[74840]: DEBUG nova.compute.manager [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: d00e1756-34cd-4847-b108-023ba273444a] Instance network_info: |[{"id": "0273291b-7186-488c-baf2-5f971efec444", "address": "fa:16:3e:5d:d0:05", "network": {"id": "fcca035f-b03c-407d-99c5-4e1a46ef8354", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1402418482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aee170af16c94cb0ac38095060bcb498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0273291b-71", "ovs_interfaceid": "0273291b-7186-488c-baf2-5f971efec444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 12:18:59 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-44f6635e-48c2-4f71-a92c-5fa17009ebdf req-50afa670-5e00-4ef4-9f92-a8e7a7af29ef service nova] Acquired lock "refresh_cache-d00e1756-34cd-4847-b108-023ba273444a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:18:59 user nova-compute[74840]: DEBUG nova.network.neutron [req-44f6635e-48c2-4f71-a92c-5fa17009ebdf req-50afa670-5e00-4ef4-9f92-a8e7a7af29ef service nova] [instance: d00e1756-34cd-4847-b108-023ba273444a] Refreshing network info cache for port 0273291b-7186-488c-baf2-5f971efec444 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:18:59 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: d00e1756-34cd-4847-b108-023ba273444a] Start _get_guest_xml network_info=[{"id": "0273291b-7186-488c-baf2-5f971efec444", "address": "fa:16:3e:5d:d0:05", "network": {"id": "fcca035f-b03c-407d-99c5-4e1a46ef8354", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1402418482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aee170af16c94cb0ac38095060bcb498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0273291b-71", "ovs_interfaceid": "0273291b-7186-488c-baf2-5f971efec444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'image_id': '4fa17706-d304-4117-a420-dab994c703dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:18:59 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:18:59 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:18:59 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:18:59 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:18:59 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:18:59 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:18:59 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:18:59 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:18:59 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:18:59 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:18:59 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:18:59 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:18:59 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:18:59 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:18:59 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:18:59 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:18:59 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:18:59 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:18:59 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:18:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-379032465',display_name='tempest-VolumesActionsTest-instance-379032465',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-379032465',id=20,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aee170af16c94cb0ac38095060bcb498',ramdisk_id='',reservation_id='r-tu05uggp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-549796604',owner_user_name='tempest-VolumesActionsTest-549796604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:18:57Z,user_data=None,user_id='82d4449a578d4eb99cb9159a9cb35bf1',uuid=d00e1756-34cd-4847-b108-023ba273444a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0273291b-7186-488c-baf2-5f971efec444", "address": "fa:16:3e:5d:d0:05", "network": {"id": "fcca035f-b03c-407d-99c5-4e1a46ef8354", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1402418482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aee170af16c94cb0ac38095060bcb498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0273291b-71", "ovs_interfaceid": "0273291b-7186-488c-baf2-5f971efec444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:18:59 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Converting VIF {"id": "0273291b-7186-488c-baf2-5f971efec444", "address": "fa:16:3e:5d:d0:05", "network": {"id": "fcca035f-b03c-407d-99c5-4e1a46ef8354", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1402418482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aee170af16c94cb0ac38095060bcb498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0273291b-71", "ovs_interfaceid": "0273291b-7186-488c-baf2-5f971efec444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:18:59 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:d0:05,bridge_name='br-int',has_traffic_filtering=True,id=0273291b-7186-488c-baf2-5f971efec444,network=Network(fcca035f-b03c-407d-99c5-4e1a46ef8354),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0273291b-71') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:18:59 user nova-compute[74840]: DEBUG nova.objects.instance [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Lazy-loading 'pci_devices' on Instance uuid d00e1756-34cd-4847-b108-023ba273444a {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:18:59 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: d00e1756-34cd-4847-b108-023ba273444a] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:18:59 user nova-compute[74840]:   <uuid>d00e1756-34cd-4847-b108-023ba273444a</uuid>
Nov 08 12:18:59 user nova-compute[74840]:   <name>instance-00000014</name>
Nov 08 12:18:59 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:18:59 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:18:59 user nova-compute[74840]:   <metadata>
Nov 08 12:18:59 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:18:59 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:18:59 user nova-compute[74840]:       <nova:name>tempest-VolumesActionsTest-instance-379032465</nova:name>
Nov 08 12:18:59 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:18:59</nova:creationTime>
Nov 08 12:18:59 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:18:59 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:18:59 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:18:59 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:18:59 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:18:59 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:18:59 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:18:59 user nova-compute[74840]:       <nova:owner>
Nov 08 12:18:59 user nova-compute[74840]:         <nova:user uuid="82d4449a578d4eb99cb9159a9cb35bf1">tempest-VolumesActionsTest-549796604-project-member</nova:user>
Nov 08 12:18:59 user nova-compute[74840]:         <nova:project uuid="aee170af16c94cb0ac38095060bcb498">tempest-VolumesActionsTest-549796604</nova:project>
Nov 08 12:18:59 user nova-compute[74840]:       </nova:owner>
Nov 08 12:18:59 user nova-compute[74840]:       <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:18:59 user nova-compute[74840]:       <nova:ports>
Nov 08 12:18:59 user nova-compute[74840]:         <nova:port uuid="0273291b-7186-488c-baf2-5f971efec444">
Nov 08 12:18:59 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 12:18:59 user nova-compute[74840]:         </nova:port>
Nov 08 12:18:59 user nova-compute[74840]:       </nova:ports>
Nov 08 12:18:59 user nova-compute[74840]:     </nova:instance>
Nov 08 12:18:59 user nova-compute[74840]:   </metadata>
Nov 08 12:18:59 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:18:59 user nova-compute[74840]:     <system>
Nov 08 12:18:59 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:18:59 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:18:59 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:18:59 user nova-compute[74840]:       <entry name="serial">d00e1756-34cd-4847-b108-023ba273444a</entry>
Nov 08 12:18:59 user nova-compute[74840]:       <entry name="uuid">d00e1756-34cd-4847-b108-023ba273444a</entry>
Nov 08 12:18:59 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:18:59 user nova-compute[74840]:     </system>
Nov 08 12:18:59 user nova-compute[74840]:   </sysinfo>
Nov 08 12:18:59 user nova-compute[74840]:   <os>
Nov 08 12:18:59 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:18:59 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:18:59 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:18:59 user nova-compute[74840]:   </os>
Nov 08 12:18:59 user nova-compute[74840]:   <features>
Nov 08 12:18:59 user nova-compute[74840]:     <acpi/>
Nov 08 12:18:59 user nova-compute[74840]:     <apic/>
Nov 08 12:18:59 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:18:59 user nova-compute[74840]:   </features>
Nov 08 12:18:59 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:18:59 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:18:59 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:18:59 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:18:59 user nova-compute[74840]:   </clock>
Nov 08 12:18:59 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:18:59 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:18:59 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:18:59 user nova-compute[74840]:   </cpu>
Nov 08 12:18:59 user nova-compute[74840]:   <devices>
Nov 08 12:18:59 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:18:59 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:18:59 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/d00e1756-34cd-4847-b108-023ba273444a/disk"/>
Nov 08 12:18:59 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:18:59 user nova-compute[74840]:     </disk>
Nov 08 12:18:59 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:18:59 user nova-compute[74840]:       <mac address="fa:16:3e:5d:d0:05"/>
Nov 08 12:18:59 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:18:59 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:18:59 user nova-compute[74840]:       <target dev="tap0273291b-71"/>
Nov 08 12:18:59 user nova-compute[74840]:     </interface>
Nov 08 12:18:59 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:18:59 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/d00e1756-34cd-4847-b108-023ba273444a/console.log" append="off"/>
Nov 08 12:18:59 user nova-compute[74840]:     </serial>
Nov 08 12:18:59 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:18:59 user nova-compute[74840]:     <video>
Nov 08 12:18:59 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:18:59 user nova-compute[74840]:     </video>
Nov 08 12:18:59 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:18:59 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:18:59 user nova-compute[74840]:     </rng>
Nov 08 12:18:59 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:18:59 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:18:59 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:18:59 user nova-compute[74840]:     </memballoon>
Nov 08 12:18:59 user nova-compute[74840]:   </devices>
Nov 08 12:18:59 user nova-compute[74840]: </domain>
Nov 08 12:18:59 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:18:59 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:18:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-379032465',display_name='tempest-VolumesActionsTest-instance-379032465',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-379032465',id=20,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aee170af16c94cb0ac38095060bcb498',ramdisk_id='',reservation_id='r-tu05uggp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-549796604',owner_user_name='tempest-VolumesActionsTest-549796604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:18:57Z,user_data=None,user_id='82d4449a578d4eb99cb9159a9cb35bf1',uuid=d00e1756-34cd-4847-b108-023ba273444a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0273291b-7186-488c-baf2-5f971efec444", "address": "fa:16:3e:5d:d0:05", "network": {"id": "fcca035f-b03c-407d-99c5-4e1a46ef8354", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1402418482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aee170af16c94cb0ac38095060bcb498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0273291b-71", "ovs_interfaceid": "0273291b-7186-488c-baf2-5f971efec444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:18:59 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Converting VIF {"id": "0273291b-7186-488c-baf2-5f971efec444", "address": "fa:16:3e:5d:d0:05", "network": {"id": "fcca035f-b03c-407d-99c5-4e1a46ef8354", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1402418482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aee170af16c94cb0ac38095060bcb498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0273291b-71", "ovs_interfaceid": "0273291b-7186-488c-baf2-5f971efec444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:18:59 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:d0:05,bridge_name='br-int',has_traffic_filtering=True,id=0273291b-7186-488c-baf2-5f971efec444,network=Network(fcca035f-b03c-407d-99c5-4e1a46ef8354),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0273291b-71') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:18:59 user nova-compute[74840]: DEBUG os_vif [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:d0:05,bridge_name='br-int',has_traffic_filtering=True,id=0273291b-7186-488c-baf2-5f971efec444,network=Network(fcca035f-b03c-407d-99c5-4e1a46ef8354),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0273291b-71') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:18:59 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:59 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:18:59 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:18:59 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:59 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4c1d60d6-8c5d-5765-8a57-a942263f8b1c', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:18:59 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:18:59 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:59 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:18:59 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:59 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0273291b-71, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:18:59 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0273291b-71, col_values=(('qos', UUID('49bdc062-a965-447f-81fb-e777224ac6a4')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:18:59 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0273291b-71, col_values=(('external_ids', {'iface-id': '0273291b-7186-488c-baf2-5f971efec444', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:d0:05', 'vm-uuid': 'd00e1756-34cd-4847-b108-023ba273444a'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:18:59 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:59 user nova-compute[74840]: INFO nova.compute.manager [-] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Took 1.06 seconds to deallocate network for instance.
Nov 08 12:18:59 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:18:59 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:18:59 user nova-compute[74840]: INFO os_vif [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:d0:05,bridge_name='br-int',has_traffic_filtering=True,id=0273291b-7186-488c-baf2-5f971efec444,network=Network(fcca035f-b03c-407d-99c5-4e1a46ef8354),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0273291b-71')
Nov 08 12:18:59 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:18:59 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] No VIF found with MAC fa:16:3e:5d:d0:05, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:18:59 user nova-compute[74840]: DEBUG nova.network.neutron [req-44f6635e-48c2-4f71-a92c-5fa17009ebdf req-50afa670-5e00-4ef4-9f92-a8e7a7af29ef service nova] [instance: d00e1756-34cd-4847-b108-023ba273444a] Updated VIF entry in instance network info cache for port 0273291b-7186-488c-baf2-5f971efec444. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:18:59 user nova-compute[74840]: DEBUG nova.network.neutron [req-44f6635e-48c2-4f71-a92c-5fa17009ebdf req-50afa670-5e00-4ef4-9f92-a8e7a7af29ef service nova] [instance: d00e1756-34cd-4847-b108-023ba273444a] Updating instance_info_cache with network_info: [{"id": "0273291b-7186-488c-baf2-5f971efec444", "address": "fa:16:3e:5d:d0:05", "network": {"id": "fcca035f-b03c-407d-99c5-4e1a46ef8354", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1402418482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aee170af16c94cb0ac38095060bcb498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0273291b-71", "ovs_interfaceid": "0273291b-7186-488c-baf2-5f971efec444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:18:59 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-44f6635e-48c2-4f71-a92c-5fa17009ebdf req-50afa670-5e00-4ef4-9f92-a8e7a7af29ef service nova] Releasing lock "refresh_cache-d00e1756-34cd-4847-b108-023ba273444a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:19:00 user nova-compute[74840]: INFO nova.compute.manager [None req-96faadb9-c91c-4231-a48a-65ca8385818a tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Took 1.10 seconds to detach 1 volumes for instance.
Nov 08 12:19:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-96faadb9-c91c-4231-a48a-65ca8385818a tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:19:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-96faadb9-c91c-4231-a48a-65ca8385818a tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:19:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:00 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-96faadb9-c91c-4231-a48a-65ca8385818a tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:19:00 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-96faadb9-c91c-4231-a48a-65ca8385818a tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:19:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-96faadb9-c91c-4231-a48a-65ca8385818a tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.340s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:19:00 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-96faadb9-c91c-4231-a48a-65ca8385818a tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Deleted allocations for instance 3b10fda0-9488-4089-8033-dd1c8e42af89
Nov 08 12:19:01 user nova-compute[74840]: DEBUG nova.compute.manager [req-962deb43-64b2-4260-822b-980d59938699 req-d318b0e8-a37d-45a2-9417-887335014dea service nova] [instance: d00e1756-34cd-4847-b108-023ba273444a] Received event network-vif-plugged-0273291b-7186-488c-baf2-5f971efec444 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:19:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-962deb43-64b2-4260-822b-980d59938699 req-d318b0e8-a37d-45a2-9417-887335014dea service nova] Acquiring lock "d00e1756-34cd-4847-b108-023ba273444a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:19:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-962deb43-64b2-4260-822b-980d59938699 req-d318b0e8-a37d-45a2-9417-887335014dea service nova] Lock "d00e1756-34cd-4847-b108-023ba273444a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:19:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-962deb43-64b2-4260-822b-980d59938699 req-d318b0e8-a37d-45a2-9417-887335014dea service nova] Lock "d00e1756-34cd-4847-b108-023ba273444a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:19:01 user nova-compute[74840]: DEBUG nova.compute.manager [req-962deb43-64b2-4260-822b-980d59938699 req-d318b0e8-a37d-45a2-9417-887335014dea service nova] [instance: d00e1756-34cd-4847-b108-023ba273444a] No waiting events found dispatching network-vif-plugged-0273291b-7186-488c-baf2-5f971efec444 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:19:01 user nova-compute[74840]: WARNING nova.compute.manager [req-962deb43-64b2-4260-822b-980d59938699 req-d318b0e8-a37d-45a2-9417-887335014dea service nova] [instance: d00e1756-34cd-4847-b108-023ba273444a] Received unexpected event network-vif-plugged-0273291b-7186-488c-baf2-5f971efec444 for instance with vm_state building and task_state spawning.
Nov 08 12:19:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-96faadb9-c91c-4231-a48a-65ca8385818a tempest-ServerActionsTestOtherB-1148036573 tempest-ServerActionsTestOtherB-1148036573-project-member] Lock "3b10fda0-9488-4089-8033-dd1c8e42af89" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.365s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:19:01 user nova-compute[74840]: DEBUG nova.compute.manager [req-6c218d44-027c-4793-81ba-9b5adf8b69da req-c9e40866-23e0-43ff-b414-41ec0ddfed2a service nova] [instance: 3b10fda0-9488-4089-8033-dd1c8e42af89] Received event network-vif-deleted-b48b5298-045f-463d-9585-fbb5feb869bf {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:19:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:01 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:19:02 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-1f3ebb49-95d2-4dc6-8087-2ec65b6a255d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf is timed out.
Nov 08 12:19:02 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-1f3ebb49-95d2-4dc6-8087-2ec65b6a255d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Successfully detached device vdc from instance e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf from the live domain config.
Nov 08 12:19:02 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f3ebb49-95d2-4dc6-8087-2ec65b6a255d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 12:19:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3ebb49-95d2-4dc6-8087-2ec65b6a255d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'npisaORm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:19:02 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-1f3ebb49-95d2-4dc6-8087-2ec65b6a255d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:19:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-1f3ebb49-95d2-4dc6-8087-2ec65b6a255d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:19:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-1f3ebb49-95d2-4dc6-8087-2ec65b6a255d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:19:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:19:02 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aff5655-2a88-4167-b2ae-1acfa8413b0f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:19:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3ebb49-95d2-4dc6-8087-2ec65b6a255d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 12:19:02 user nova-compute[74840]: No targets found.
Nov 08 12:19:02 user nova-compute[74840]: iSNS:
Nov 08 12:19:02 user nova-compute[74840]: No targets found.
Nov 08 12:19:02 user nova-compute[74840]: STATIC:
Nov 08 12:19:02 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9
Nov 08 12:19:02 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:19:02 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:19:02 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665
Nov 08 12:19:02 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:19:02 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:19:02 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35
Nov 08 12:19:02 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:19:02 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:19:02 user nova-compute[74840]: FIRMWARE:
Nov 08 12:19:02 user nova-compute[74840]: No targets found.
Nov 08 12:19:02 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:19:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3ebb49-95d2-4dc6-8087-2ec65b6a255d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 12:19:02 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 12:19:02 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 12:19:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3ebb49-95d2-4dc6-8087-2ec65b6a255d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 12:19:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:19:02 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[64960127-d3e9-43ab-9be9-8cf63b9df3a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:19:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:19:02 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[44873b5f-c724-4c68-b293-2e0ad03d42af]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:19:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3ebb49-95d2-4dc6-8087-2ec65b6a255d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 (non-flash)
Nov 08 12:19:02 user nova-compute[74840]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665 (non-flash)
Nov 08 12:19:02 user nova-compute[74840]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35 (non-flash)
Nov 08 12:19:02 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:19:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3ebb49-95d2-4dc6-8087-2ec65b6a255d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 (non-flash)
Nov 08 12:19:02 user nova-compute[74840]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665 (non-flash)
Nov 08 12:19:02 user nova-compute[74840]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35 (non-flash)
Nov 08 12:19:02 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:19:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3ebb49-95d2-4dc6-8087-2ec65b6a255d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7f808c280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35'): ({'sde'}, set())}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 12:19:02 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-1f3ebb49-95d2-4dc6-8087-2ec65b6a255d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Removing single pathed devices sde {{(pid=74840) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 12:19:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:19:02 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb3b750-d3bc-46e6-880f-442fde024ab0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:19:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:19:02 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0296fc6-7df2-4829-a6d0-b687e07b2f64]: (4, ('ok\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:19:02 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-1f3ebb49-95d2-4dc6-8087-2ec65b6a255d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Flushing IO for device /dev/sde {{(pid=74840) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 12:19:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:19:02 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[198c0829-8806-480b-8fea-d0f156a344e4]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:19:02 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-1f3ebb49-95d2-4dc6-8087-2ec65b6a255d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74840) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 12:19:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:19:02 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[01754c83-0740-41a9-906f-aba65100eaa8]: (4, ('1', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:19:02 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-1f3ebb49-95d2-4dc6-8087-2ec65b6a255d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 12:19:02 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-1f3ebb49-95d2-4dc6-8087-2ec65b6a255d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] SCSI volumes sde have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 12:19:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3ebb49-95d2-4dc6-8087-2ec65b6a255d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35')] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 12:19:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:19:02 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e458c4-4857-414c-94f6-b54fa90c2573]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:19:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3ebb49-95d2-4dc6-8087-2ec65b6a255d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:19:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35 -p 172.16.0.220:3260 --logout {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:19:02 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40aa543-5a98-4337-ad32-26eeb602a70a]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:19:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3ebb49-95d2-4dc6-8087-2ec65b6a255d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35, portal: 172.16.0.220,3260]
Nov 08 12:19:02 user nova-compute[74840]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35, portal: 172.16.0.220,3260] successful.
Nov 08 12:19:02 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:19:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35 -p 172.16.0.220:3260 --op delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6163f42-ec0f-4b2f-a4d2-64a6c8880a35 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:19:02 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f383bd42-a7f0-4a47-a64a-fbf04c820a77]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:19:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3ebb49-95d2-4dc6-8087-2ec65b6a255d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:19:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-1f3ebb49-95d2-4dc6-8087-2ec65b6a255d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:19:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3ebb49-95d2-4dc6-8087-2ec65b6a255d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] <== disconnect_volume: return (328ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:19:02 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f3ebb49-95d2-4dc6-8087-2ec65b6a255d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 12:19:03 user nova-compute[74840]: DEBUG nova.compute.manager [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: d00e1756-34cd-4847-b108-023ba273444a] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:19:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: d00e1756-34cd-4847-b108-023ba273444a] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:19:03 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: d00e1756-34cd-4847-b108-023ba273444a] Instance spawned successfully.
Nov 08 12:19:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: d00e1756-34cd-4847-b108-023ba273444a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:19:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: d00e1756-34cd-4847-b108-023ba273444a] Found default for hw_cdrom_bus of ide {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:19:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: d00e1756-34cd-4847-b108-023ba273444a] Found default for hw_disk_bus of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:19:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: d00e1756-34cd-4847-b108-023ba273444a] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:19:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: d00e1756-34cd-4847-b108-023ba273444a] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:19:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: d00e1756-34cd-4847-b108-023ba273444a] Found default for hw_video_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:19:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: d00e1756-34cd-4847-b108-023ba273444a] Found default for hw_vif_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:19:03 user nova-compute[74840]: DEBUG nova.compute.manager [req-9e9a5579-3850-46ea-903d-67f140b3d5aa req-e0b13fe2-45bb-402c-a1ac-d6b3924ab0fd service nova] [instance: d00e1756-34cd-4847-b108-023ba273444a] Received event network-vif-plugged-0273291b-7186-488c-baf2-5f971efec444 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:19:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9e9a5579-3850-46ea-903d-67f140b3d5aa req-e0b13fe2-45bb-402c-a1ac-d6b3924ab0fd service nova] Acquiring lock "d00e1756-34cd-4847-b108-023ba273444a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:19:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9e9a5579-3850-46ea-903d-67f140b3d5aa req-e0b13fe2-45bb-402c-a1ac-d6b3924ab0fd service nova] Lock "d00e1756-34cd-4847-b108-023ba273444a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:19:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9e9a5579-3850-46ea-903d-67f140b3d5aa req-e0b13fe2-45bb-402c-a1ac-d6b3924ab0fd service nova] Lock "d00e1756-34cd-4847-b108-023ba273444a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:19:03 user nova-compute[74840]: DEBUG nova.compute.manager [req-9e9a5579-3850-46ea-903d-67f140b3d5aa req-e0b13fe2-45bb-402c-a1ac-d6b3924ab0fd service nova] [instance: d00e1756-34cd-4847-b108-023ba273444a] No waiting events found dispatching network-vif-plugged-0273291b-7186-488c-baf2-5f971efec444 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:19:03 user nova-compute[74840]: WARNING nova.compute.manager [req-9e9a5579-3850-46ea-903d-67f140b3d5aa req-e0b13fe2-45bb-402c-a1ac-d6b3924ab0fd service nova] [instance: d00e1756-34cd-4847-b108-023ba273444a] Received unexpected event network-vif-plugged-0273291b-7186-488c-baf2-5f971efec444 for instance with vm_state building and task_state spawning.
Nov 08 12:19:03 user nova-compute[74840]: INFO nova.compute.manager [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: d00e1756-34cd-4847-b108-023ba273444a] Took 6.42 seconds to spawn the instance on the hypervisor.
Nov 08 12:19:03 user nova-compute[74840]: DEBUG nova.compute.manager [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: d00e1756-34cd-4847-b108-023ba273444a] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:19:03 user nova-compute[74840]: INFO nova.compute.manager [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: d00e1756-34cd-4847-b108-023ba273444a] Took 7.66 seconds to build instance.
Nov 08 12:19:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8c83d5da-bc80-4a08-93a6-3ddd28e74e6e tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Lock "d00e1756-34cd-4847-b108-023ba273444a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.123s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:19:03 user nova-compute[74840]: DEBUG nova.objects.instance [None req-1f3ebb49-95d2-4dc6-8087-2ec65b6a255d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Lazy-loading 'flavor' on Instance uuid e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:19:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1f3ebb49-95d2-4dc6-8087-2ec65b6a255d tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Lock "e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.992s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:19:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:04 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-801a3eb2-9a62-4bc2-ab76-dc8ebf612fa5 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "74a51b1b-103e-49b2-b7a0-ec4625a9445b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:19:04 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-801a3eb2-9a62-4bc2-ab76-dc8ebf612fa5 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "74a51b1b-103e-49b2-b7a0-ec4625a9445b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:19:04 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-801a3eb2-9a62-4bc2-ab76-dc8ebf612fa5 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "74a51b1b-103e-49b2-b7a0-ec4625a9445b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:19:04 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-801a3eb2-9a62-4bc2-ab76-dc8ebf612fa5 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "74a51b1b-103e-49b2-b7a0-ec4625a9445b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:19:04 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-801a3eb2-9a62-4bc2-ab76-dc8ebf612fa5 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "74a51b1b-103e-49b2-b7a0-ec4625a9445b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:19:04 user nova-compute[74840]: INFO nova.compute.manager [None req-801a3eb2-9a62-4bc2-ab76-dc8ebf612fa5 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Terminating instance
Nov 08 12:19:04 user nova-compute[74840]: DEBUG nova.compute.manager [None req-801a3eb2-9a62-4bc2-ab76-dc8ebf612fa5 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Start destroying the instance on the hypervisor. {{(pid=74840) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 12:19:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:05 user nova-compute[74840]: DEBUG nova.compute.manager [req-aef2b598-b800-4db7-b5c2-3ccc4f3a406c req-48e31351-37e3-44d1-ad72-f5b6cc4f2959 service nova] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Received event network-vif-unplugged-b3920dbd-57a3-4469-a524-a98d45a157e1 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:19:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-aef2b598-b800-4db7-b5c2-3ccc4f3a406c req-48e31351-37e3-44d1-ad72-f5b6cc4f2959 service nova] Acquiring lock "74a51b1b-103e-49b2-b7a0-ec4625a9445b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:19:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-aef2b598-b800-4db7-b5c2-3ccc4f3a406c req-48e31351-37e3-44d1-ad72-f5b6cc4f2959 service nova] Lock "74a51b1b-103e-49b2-b7a0-ec4625a9445b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:19:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-aef2b598-b800-4db7-b5c2-3ccc4f3a406c req-48e31351-37e3-44d1-ad72-f5b6cc4f2959 service nova] Lock "74a51b1b-103e-49b2-b7a0-ec4625a9445b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:19:05 user nova-compute[74840]: DEBUG nova.compute.manager [req-aef2b598-b800-4db7-b5c2-3ccc4f3a406c req-48e31351-37e3-44d1-ad72-f5b6cc4f2959 service nova] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] No waiting events found dispatching network-vif-unplugged-b3920dbd-57a3-4469-a524-a98d45a157e1 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:19:05 user nova-compute[74840]: DEBUG nova.compute.manager [req-aef2b598-b800-4db7-b5c2-3ccc4f3a406c req-48e31351-37e3-44d1-ad72-f5b6cc4f2959 service nova] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Received event network-vif-unplugged-b3920dbd-57a3-4469-a524-a98d45a157e1 for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:19:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:05 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Instance destroyed successfully.
Nov 08 12:19:05 user nova-compute[74840]: DEBUG nova.objects.instance [None req-801a3eb2-9a62-4bc2-ab76-dc8ebf612fa5 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lazy-loading 'resources' on Instance uuid 74a51b1b-103e-49b2-b7a0-ec4625a9445b {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:19:05 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-801a3eb2-9a62-4bc2-ab76-dc8ebf612fa5 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:15:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-997811358',display_name='tempest-AttachVolumeNegativeTest-server-997811358',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-997811358',id=15,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0EpesumeT5ZVSmj+pF7J8qaag6op2GaiMIIDfcaK76hF2pL8eLRNH6XNHeubEdLP+BiKMNcHj4kp4VPTKIg1DSwR8jLgaqIRzzEMvLlt1p+MMSyASF5VcHXZCF6MwB+w==',key_name='tempest-keypair-1355330745',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:15:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ec082e08ddf4477a721e410fe944d10',ramdisk_id='',reservation_id='r-fgxiq2gu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1526881991',owner_user_name='tempest-AttachVolumeNegativeTest-1526881991-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:15:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e172625e7f334a2b896b2738bbf49aa8',uuid=74a51b1b-103e-49b2-b7a0-ec4625a9445b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3920dbd-57a3-4469-a524-a98d45a157e1", "address": "fa:16:3e:c3:be:3a", "network": {"id": "381cad9f-376a-4335-95a4-4824aa0d7fad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1035058856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ec082e08ddf4477a721e410fe944d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3920dbd-57", "ovs_interfaceid": "b3920dbd-57a3-4469-a524-a98d45a157e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:19:05 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-801a3eb2-9a62-4bc2-ab76-dc8ebf612fa5 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Converting VIF {"id": "b3920dbd-57a3-4469-a524-a98d45a157e1", "address": "fa:16:3e:c3:be:3a", "network": {"id": "381cad9f-376a-4335-95a4-4824aa0d7fad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1035058856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ec082e08ddf4477a721e410fe944d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3920dbd-57", "ovs_interfaceid": "b3920dbd-57a3-4469-a524-a98d45a157e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:19:05 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-801a3eb2-9a62-4bc2-ab76-dc8ebf612fa5 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:be:3a,bridge_name='br-int',has_traffic_filtering=True,id=b3920dbd-57a3-4469-a524-a98d45a157e1,network=Network(381cad9f-376a-4335-95a4-4824aa0d7fad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3920dbd-57') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:19:05 user nova-compute[74840]: DEBUG os_vif [None req-801a3eb2-9a62-4bc2-ab76-dc8ebf612fa5 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:be:3a,bridge_name='br-int',has_traffic_filtering=True,id=b3920dbd-57a3-4469-a524-a98d45a157e1,network=Network(381cad9f-376a-4335-95a4-4824aa0d7fad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3920dbd-57') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:19:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3920dbd-57, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:19:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:19:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1f6fa3fc-d526-4826-9061-1abbc456940a) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:19:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:19:05 user nova-compute[74840]: INFO os_vif [None req-801a3eb2-9a62-4bc2-ab76-dc8ebf612fa5 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:be:3a,bridge_name='br-int',has_traffic_filtering=True,id=b3920dbd-57a3-4469-a524-a98d45a157e1,network=Network(381cad9f-376a-4335-95a4-4824aa0d7fad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3920dbd-57')
Nov 08 12:19:05 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-801a3eb2-9a62-4bc2-ab76-dc8ebf612fa5 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Deleting instance files /opt/stack/data/nova/instances/74a51b1b-103e-49b2-b7a0-ec4625a9445b_del
Nov 08 12:19:05 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-801a3eb2-9a62-4bc2-ab76-dc8ebf612fa5 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Deletion of /opt/stack/data/nova/instances/74a51b1b-103e-49b2-b7a0-ec4625a9445b_del complete
Nov 08 12:19:05 user nova-compute[74840]: INFO nova.compute.manager [None req-801a3eb2-9a62-4bc2-ab76-dc8ebf612fa5 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 08 12:19:05 user nova-compute[74840]: DEBUG oslo.service.loopingcall [None req-801a3eb2-9a62-4bc2-ab76-dc8ebf612fa5 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74840) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 12:19:05 user nova-compute[74840]: DEBUG nova.compute.manager [-] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Deallocating network for instance {{(pid=74840) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 12:19:05 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] deallocate_for_instance() {{(pid=74840) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 12:19:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:06 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:19:06 user nova-compute[74840]: INFO nova.compute.manager [-] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Took 0.80 seconds to deallocate network for instance.
Nov 08 12:19:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-801a3eb2-9a62-4bc2-ab76-dc8ebf612fa5 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:19:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-801a3eb2-9a62-4bc2-ab76-dc8ebf612fa5 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:19:06 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-801a3eb2-9a62-4bc2-ab76-dc8ebf612fa5 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:19:06 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-801a3eb2-9a62-4bc2-ab76-dc8ebf612fa5 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:19:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-801a3eb2-9a62-4bc2-ab76-dc8ebf612fa5 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.313s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:19:07 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-801a3eb2-9a62-4bc2-ab76-dc8ebf612fa5 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Deleted allocations for instance 74a51b1b-103e-49b2-b7a0-ec4625a9445b
Nov 08 12:19:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-801a3eb2-9a62-4bc2-ab76-dc8ebf612fa5 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "74a51b1b-103e-49b2-b7a0-ec4625a9445b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.302s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:19:07 user nova-compute[74840]: DEBUG nova.compute.manager [req-e0f8a86a-dc80-40eb-a746-2aa3792bea83 req-42889990-82f2-47be-9d34-2509a92fabc5 service nova] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Received event network-vif-plugged-b3920dbd-57a3-4469-a524-a98d45a157e1 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:19:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e0f8a86a-dc80-40eb-a746-2aa3792bea83 req-42889990-82f2-47be-9d34-2509a92fabc5 service nova] Acquiring lock "74a51b1b-103e-49b2-b7a0-ec4625a9445b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:19:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e0f8a86a-dc80-40eb-a746-2aa3792bea83 req-42889990-82f2-47be-9d34-2509a92fabc5 service nova] Lock "74a51b1b-103e-49b2-b7a0-ec4625a9445b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:19:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e0f8a86a-dc80-40eb-a746-2aa3792bea83 req-42889990-82f2-47be-9d34-2509a92fabc5 service nova] Lock "74a51b1b-103e-49b2-b7a0-ec4625a9445b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:19:07 user nova-compute[74840]: DEBUG nova.compute.manager [req-e0f8a86a-dc80-40eb-a746-2aa3792bea83 req-42889990-82f2-47be-9d34-2509a92fabc5 service nova] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] No waiting events found dispatching network-vif-plugged-b3920dbd-57a3-4469-a524-a98d45a157e1 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:19:07 user nova-compute[74840]: WARNING nova.compute.manager [req-e0f8a86a-dc80-40eb-a746-2aa3792bea83 req-42889990-82f2-47be-9d34-2509a92fabc5 service nova] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Received unexpected event network-vif-plugged-b3920dbd-57a3-4469-a524-a98d45a157e1 for instance with vm_state deleted and task_state None.
Nov 08 12:19:07 user nova-compute[74840]: DEBUG nova.compute.manager [req-e0f8a86a-dc80-40eb-a746-2aa3792bea83 req-42889990-82f2-47be-9d34-2509a92fabc5 service nova] [instance: 74a51b1b-103e-49b2-b7a0-ec4625a9445b] Received event network-vif-deleted-b3920dbd-57a3-4469-a524-a98d45a157e1 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:19:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Acquiring lock "4b9fe577-1503-4007-be51-2a714363f8c6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:19:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Lock "4b9fe577-1503-4007-be51-2a714363f8c6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:19:09 user nova-compute[74840]: DEBUG nova.compute.manager [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Starting instance... {{(pid=74840) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 12:19:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:19:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:19:09 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:19:09 user nova-compute[74840]: INFO nova.compute.claims [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Claim successful on node user
Nov 08 12:19:10 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:19:10 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:19:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.340s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:19:10 user nova-compute[74840]: DEBUG nova.compute.manager [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Start building networks asynchronously for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 12:19:10 user nova-compute[74840]: DEBUG nova.compute.manager [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Allocating IP information in the background. {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 12:19:10 user nova-compute[74840]: DEBUG nova.network.neutron [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 12:19:10 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 12:19:10 user nova-compute[74840]: DEBUG nova.compute.manager [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Start building block device mappings for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 12:19:10 user nova-compute[74840]: INFO nova.virt.block_device [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Booting with volume d6c66458-63dd-40c6-b1d8-b2cc87cb5578 at /dev/vda
Nov 08 12:19:10 user nova-compute[74840]: DEBUG nova.policy [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1eab1412fcbe44c89af927d874068e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e6bce6148d4a0296ece1b35a2db93d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 12:19:10 user nova-compute[74840]: DEBUG os_brick.utils [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:19:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:19:10 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc24d7d-be71-4854-8169-fd04f6bdd6c1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c8228a11e03c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:19:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:19:10 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c3c02a-4f48-4d4f-b2be-17472f5b10ee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:19:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:19:10 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[2179916c-0a1a-4068-b1d5-164ee27e9480]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:19:10 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a98417-d0c7-4412-ab76-0f3aaf01af45]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:19:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Running cmd (subprocess): nvme version {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] 'nvme version' failed. Not Retrying. {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:19:10 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] nvme not present on system {{(pid=74840) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 12:19:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:19:10 user nova-compute[74840]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 12:19:10 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9cd3df8-8f25-4278-ae0f-3e0e06c6a4c0]: (4, '') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:19:10 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74840) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 12:19:10 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 12:19:10 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] LIGHTOS: no hostnqn found. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 12:19:10 user nova-compute[74840]: DEBUG os_brick.utils [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c8228a11e03c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:19:10 user nova-compute[74840]: DEBUG nova.virt.block_device [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Updating existing volume attachment record: 6a0ac009-9d2e-4069-bea9-ca807b58fe1d {{(pid=74840) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 12:19:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:11 user nova-compute[74840]: DEBUG nova.network.neutron [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Successfully created port: 1fd72b39-7d31-4729-bef7-98f6a5246964 {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:19:12 user nova-compute[74840]: DEBUG nova.network.neutron [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Successfully created port: 538b2412-4ee2-42a6-9cac-f97be4fc341e {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:19:13 user nova-compute[74840]: DEBUG nova.network.neutron [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Successfully created port: afed888a-e688-452a-846f-4e9b398ff736 {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:19:13 user nova-compute[74840]: DEBUG nova.network.neutron [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Successfully created port: 20547543-4dc1-4158-bb9e-515cce88d3ef {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:19:14 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:14 user nova-compute[74840]: DEBUG nova.network.neutron [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Successfully created port: 68377219-20e9-4c9f-b8c7-bcf0a798655e {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:19:15 user nova-compute[74840]: DEBUG nova.network.neutron [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Successfully updated port: 1fd72b39-7d31-4729-bef7-98f6a5246964 {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:19:15 user nova-compute[74840]: DEBUG nova.compute.manager [req-861438b4-c265-44a9-b528-d184b4bd0c9e req-c9edee08-66fa-410d-9012-12dbf99b2319 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received event network-changed-1fd72b39-7d31-4729-bef7-98f6a5246964 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:19:15 user nova-compute[74840]: DEBUG nova.compute.manager [req-861438b4-c265-44a9-b528-d184b4bd0c9e req-c9edee08-66fa-410d-9012-12dbf99b2319 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Refreshing instance network info cache due to event network-changed-1fd72b39-7d31-4729-bef7-98f6a5246964. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:19:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-861438b4-c265-44a9-b528-d184b4bd0c9e req-c9edee08-66fa-410d-9012-12dbf99b2319 service nova] Acquiring lock "refresh_cache-4b9fe577-1503-4007-be51-2a714363f8c6" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:19:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-861438b4-c265-44a9-b528-d184b4bd0c9e req-c9edee08-66fa-410d-9012-12dbf99b2319 service nova] Acquired lock "refresh_cache-4b9fe577-1503-4007-be51-2a714363f8c6" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:19:15 user nova-compute[74840]: DEBUG nova.network.neutron [req-861438b4-c265-44a9-b528-d184b4bd0c9e req-c9edee08-66fa-410d-9012-12dbf99b2319 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Refreshing network info cache for port 1fd72b39-7d31-4729-bef7-98f6a5246964 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:19:15 user nova-compute[74840]: DEBUG nova.network.neutron [req-861438b4-c265-44a9-b528-d184b4bd0c9e req-c9edee08-66fa-410d-9012-12dbf99b2319 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:19:15 user nova-compute[74840]: DEBUG nova.network.neutron [req-861438b4-c265-44a9-b528-d184b4bd0c9e req-c9edee08-66fa-410d-9012-12dbf99b2319 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:19:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-861438b4-c265-44a9-b528-d184b4bd0c9e req-c9edee08-66fa-410d-9012-12dbf99b2319 service nova] Releasing lock "refresh_cache-4b9fe577-1503-4007-be51-2a714363f8c6" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:19:15 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:15 user nova-compute[74840]: DEBUG nova.network.neutron [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Successfully updated port: 87c651bf-a6e8-4290-bbdf-49746754ac54 {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:19:16 user nova-compute[74840]: DEBUG nova.network.neutron [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Successfully updated port: bdec4773-148b-49d7-a461-3a6106fffff6 {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:19:17 user nova-compute[74840]: DEBUG nova.network.neutron [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Successfully updated port: 538b2412-4ee2-42a6-9cac-f97be4fc341e {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:19:17 user nova-compute[74840]: DEBUG nova.compute.manager [req-8086f003-5dc3-4920-a200-c801c2a7ac1d req-375116ce-faa5-46cd-9c68-09b295b8c705 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received event network-changed-87c651bf-a6e8-4290-bbdf-49746754ac54 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:19:17 user nova-compute[74840]: DEBUG nova.compute.manager [req-8086f003-5dc3-4920-a200-c801c2a7ac1d req-375116ce-faa5-46cd-9c68-09b295b8c705 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Refreshing instance network info cache due to event network-changed-87c651bf-a6e8-4290-bbdf-49746754ac54. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:19:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8086f003-5dc3-4920-a200-c801c2a7ac1d req-375116ce-faa5-46cd-9c68-09b295b8c705 service nova] Acquiring lock "refresh_cache-4b9fe577-1503-4007-be51-2a714363f8c6" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:19:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8086f003-5dc3-4920-a200-c801c2a7ac1d req-375116ce-faa5-46cd-9c68-09b295b8c705 service nova] Acquired lock "refresh_cache-4b9fe577-1503-4007-be51-2a714363f8c6" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:19:17 user nova-compute[74840]: DEBUG nova.network.neutron [req-8086f003-5dc3-4920-a200-c801c2a7ac1d req-375116ce-faa5-46cd-9c68-09b295b8c705 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Refreshing network info cache for port 87c651bf-a6e8-4290-bbdf-49746754ac54 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:19:17 user nova-compute[74840]: DEBUG nova.network.neutron [req-8086f003-5dc3-4920-a200-c801c2a7ac1d req-375116ce-faa5-46cd-9c68-09b295b8c705 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:19:17 user nova-compute[74840]: DEBUG nova.network.neutron [req-8086f003-5dc3-4920-a200-c801c2a7ac1d req-375116ce-faa5-46cd-9c68-09b295b8c705 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:19:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8086f003-5dc3-4920-a200-c801c2a7ac1d req-375116ce-faa5-46cd-9c68-09b295b8c705 service nova] Releasing lock "refresh_cache-4b9fe577-1503-4007-be51-2a714363f8c6" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:19:17 user nova-compute[74840]: DEBUG nova.compute.manager [req-8086f003-5dc3-4920-a200-c801c2a7ac1d req-375116ce-faa5-46cd-9c68-09b295b8c705 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received event network-changed-bdec4773-148b-49d7-a461-3a6106fffff6 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:19:17 user nova-compute[74840]: DEBUG nova.compute.manager [req-8086f003-5dc3-4920-a200-c801c2a7ac1d req-375116ce-faa5-46cd-9c68-09b295b8c705 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Refreshing instance network info cache due to event network-changed-bdec4773-148b-49d7-a461-3a6106fffff6. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:19:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8086f003-5dc3-4920-a200-c801c2a7ac1d req-375116ce-faa5-46cd-9c68-09b295b8c705 service nova] Acquiring lock "refresh_cache-4b9fe577-1503-4007-be51-2a714363f8c6" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:19:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8086f003-5dc3-4920-a200-c801c2a7ac1d req-375116ce-faa5-46cd-9c68-09b295b8c705 service nova] Acquired lock "refresh_cache-4b9fe577-1503-4007-be51-2a714363f8c6" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:19:17 user nova-compute[74840]: DEBUG nova.network.neutron [req-8086f003-5dc3-4920-a200-c801c2a7ac1d req-375116ce-faa5-46cd-9c68-09b295b8c705 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Refreshing network info cache for port bdec4773-148b-49d7-a461-3a6106fffff6 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:19:17 user nova-compute[74840]: DEBUG nova.network.neutron [req-8086f003-5dc3-4920-a200-c801c2a7ac1d req-375116ce-faa5-46cd-9c68-09b295b8c705 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:19:17 user nova-compute[74840]: DEBUG nova.network.neutron [req-8086f003-5dc3-4920-a200-c801c2a7ac1d req-375116ce-faa5-46cd-9c68-09b295b8c705 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:19:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8086f003-5dc3-4920-a200-c801c2a7ac1d req-375116ce-faa5-46cd-9c68-09b295b8c705 service nova] Releasing lock "refresh_cache-4b9fe577-1503-4007-be51-2a714363f8c6" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:19:17 user nova-compute[74840]: DEBUG nova.compute.manager [req-8086f003-5dc3-4920-a200-c801c2a7ac1d req-375116ce-faa5-46cd-9c68-09b295b8c705 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received event network-changed-538b2412-4ee2-42a6-9cac-f97be4fc341e {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:19:17 user nova-compute[74840]: DEBUG nova.compute.manager [req-8086f003-5dc3-4920-a200-c801c2a7ac1d req-375116ce-faa5-46cd-9c68-09b295b8c705 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Refreshing instance network info cache due to event network-changed-538b2412-4ee2-42a6-9cac-f97be4fc341e. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:19:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8086f003-5dc3-4920-a200-c801c2a7ac1d req-375116ce-faa5-46cd-9c68-09b295b8c705 service nova] Acquiring lock "refresh_cache-4b9fe577-1503-4007-be51-2a714363f8c6" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:19:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8086f003-5dc3-4920-a200-c801c2a7ac1d req-375116ce-faa5-46cd-9c68-09b295b8c705 service nova] Acquired lock "refresh_cache-4b9fe577-1503-4007-be51-2a714363f8c6" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:19:17 user nova-compute[74840]: DEBUG nova.network.neutron [req-8086f003-5dc3-4920-a200-c801c2a7ac1d req-375116ce-faa5-46cd-9c68-09b295b8c705 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Refreshing network info cache for port 538b2412-4ee2-42a6-9cac-f97be4fc341e {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:19:18 user nova-compute[74840]: DEBUG nova.network.neutron [req-8086f003-5dc3-4920-a200-c801c2a7ac1d req-375116ce-faa5-46cd-9c68-09b295b8c705 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:19:18 user nova-compute[74840]: DEBUG nova.network.neutron [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Successfully updated port: afed888a-e688-452a-846f-4e9b398ff736 {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:19:18 user nova-compute[74840]: DEBUG nova.network.neutron [req-8086f003-5dc3-4920-a200-c801c2a7ac1d req-375116ce-faa5-46cd-9c68-09b295b8c705 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:19:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8086f003-5dc3-4920-a200-c801c2a7ac1d req-375116ce-faa5-46cd-9c68-09b295b8c705 service nova] Releasing lock "refresh_cache-4b9fe577-1503-4007-be51-2a714363f8c6" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:19:18 user nova-compute[74840]: DEBUG nova.network.neutron [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Successfully updated port: 20547543-4dc1-4158-bb9e-515cce88d3ef {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:19:19 user nova-compute[74840]: DEBUG nova.network.neutron [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Successfully updated port: 68377219-20e9-4c9f-b8c7-bcf0a798655e {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:19:19 user nova-compute[74840]: DEBUG nova.compute.manager [req-38f19124-10a5-4634-9d27-e1a4d121aed2 req-4a211bc7-1727-4cab-9686-1f0f944aa793 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received event network-changed-afed888a-e688-452a-846f-4e9b398ff736 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:19:19 user nova-compute[74840]: DEBUG nova.compute.manager [req-38f19124-10a5-4634-9d27-e1a4d121aed2 req-4a211bc7-1727-4cab-9686-1f0f944aa793 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Refreshing instance network info cache due to event network-changed-afed888a-e688-452a-846f-4e9b398ff736. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:19:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-38f19124-10a5-4634-9d27-e1a4d121aed2 req-4a211bc7-1727-4cab-9686-1f0f944aa793 service nova] Acquiring lock "refresh_cache-4b9fe577-1503-4007-be51-2a714363f8c6" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:19:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-38f19124-10a5-4634-9d27-e1a4d121aed2 req-4a211bc7-1727-4cab-9686-1f0f944aa793 service nova] Acquired lock "refresh_cache-4b9fe577-1503-4007-be51-2a714363f8c6" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:19:19 user nova-compute[74840]: DEBUG nova.network.neutron [req-38f19124-10a5-4634-9d27-e1a4d121aed2 req-4a211bc7-1727-4cab-9686-1f0f944aa793 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Refreshing network info cache for port afed888a-e688-452a-846f-4e9b398ff736 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:19:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Acquiring lock "refresh_cache-4b9fe577-1503-4007-be51-2a714363f8c6" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:19:19 user nova-compute[74840]: DEBUG nova.network.neutron [req-38f19124-10a5-4634-9d27-e1a4d121aed2 req-4a211bc7-1727-4cab-9686-1f0f944aa793 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:19:19 user nova-compute[74840]: DEBUG nova.network.neutron [req-38f19124-10a5-4634-9d27-e1a4d121aed2 req-4a211bc7-1727-4cab-9686-1f0f944aa793 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:19:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-38f19124-10a5-4634-9d27-e1a4d121aed2 req-4a211bc7-1727-4cab-9686-1f0f944aa793 service nova] Releasing lock "refresh_cache-4b9fe577-1503-4007-be51-2a714363f8c6" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:19:19 user nova-compute[74840]: DEBUG nova.compute.manager [req-38f19124-10a5-4634-9d27-e1a4d121aed2 req-4a211bc7-1727-4cab-9686-1f0f944aa793 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received event network-changed-20547543-4dc1-4158-bb9e-515cce88d3ef {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:19:19 user nova-compute[74840]: DEBUG nova.compute.manager [req-38f19124-10a5-4634-9d27-e1a4d121aed2 req-4a211bc7-1727-4cab-9686-1f0f944aa793 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Refreshing instance network info cache due to event network-changed-20547543-4dc1-4158-bb9e-515cce88d3ef. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:19:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-38f19124-10a5-4634-9d27-e1a4d121aed2 req-4a211bc7-1727-4cab-9686-1f0f944aa793 service nova] Acquiring lock "refresh_cache-4b9fe577-1503-4007-be51-2a714363f8c6" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:19:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-38f19124-10a5-4634-9d27-e1a4d121aed2 req-4a211bc7-1727-4cab-9686-1f0f944aa793 service nova] Acquired lock "refresh_cache-4b9fe577-1503-4007-be51-2a714363f8c6" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:19:19 user nova-compute[74840]: DEBUG nova.network.neutron [req-38f19124-10a5-4634-9d27-e1a4d121aed2 req-4a211bc7-1727-4cab-9686-1f0f944aa793 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Refreshing network info cache for port 20547543-4dc1-4158-bb9e-515cce88d3ef {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:19:19 user nova-compute[74840]: DEBUG nova.network.neutron [req-38f19124-10a5-4634-9d27-e1a4d121aed2 req-4a211bc7-1727-4cab-9686-1f0f944aa793 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:19:19 user nova-compute[74840]: DEBUG nova.network.neutron [req-38f19124-10a5-4634-9d27-e1a4d121aed2 req-4a211bc7-1727-4cab-9686-1f0f944aa793 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:19:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-38f19124-10a5-4634-9d27-e1a4d121aed2 req-4a211bc7-1727-4cab-9686-1f0f944aa793 service nova] Releasing lock "refresh_cache-4b9fe577-1503-4007-be51-2a714363f8c6" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:19:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Acquired lock "refresh_cache-4b9fe577-1503-4007-be51-2a714363f8c6" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:19:19 user nova-compute[74840]: DEBUG nova.network.neutron [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:19:20 user nova-compute[74840]: DEBUG nova.network.neutron [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:19:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:19:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 12:19:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:19:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:19:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:21 user nova-compute[74840]: DEBUG nova.compute.manager [req-304e8e56-2679-49b2-a730-30d67d9bc510 req-e69e7a37-99cc-4591-8237-c1d483cc298b service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received event network-changed-68377219-20e9-4c9f-b8c7-bcf0a798655e {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:19:21 user nova-compute[74840]: DEBUG nova.compute.manager [req-304e8e56-2679-49b2-a730-30d67d9bc510 req-e69e7a37-99cc-4591-8237-c1d483cc298b service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Refreshing instance network info cache due to event network-changed-68377219-20e9-4c9f-b8c7-bcf0a798655e. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:19:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-304e8e56-2679-49b2-a730-30d67d9bc510 req-e69e7a37-99cc-4591-8237-c1d483cc298b service nova] Acquiring lock "refresh_cache-4b9fe577-1503-4007-be51-2a714363f8c6" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:19:22 user nova-compute[74840]: DEBUG nova.network.neutron [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Updating instance_info_cache with network_info: [{"id": "1fd72b39-7d31-4729-bef7-98f6a5246964", "address": "fa:16:3e:07:9d:e6", "network": {"id": "3fcdf89c-266d-43c1-8ae8-705406698b75", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-157102173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd72b39-7d", "ovs_interfaceid": "1fd72b39-7d31-4729-bef7-98f6a5246964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "87c651bf-a6e8-4290-bbdf-49746754ac54", "address": "fa:16:3e:77:a8:a1", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87c651bf-a6", "ovs_interfaceid": "87c651bf-a6e8-4290-bbdf-49746754ac54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bdec4773-148b-49d7-a461-3a6106fffff6", "address": "fa:16:3e:aa:64:51", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdec4773-14", "ovs_interfaceid": "bdec4773-148b-49d7-a461-3a6106fffff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "538b2412-4ee2-42a6-9cac-f97be4fc341e", "address": "fa:16:3e:d1:64:e8", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap538b2412-4e", "ovs_interfaceid": "538b2412-4ee2-42a6-9cac-f97be4fc341e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "afed888a-e688-452a-846f-4e9b398ff736", "address": "fa:16:3e:72:e8:99", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafed888a-e6", "ovs_interfaceid": "afed888a-e688-452a-846f-4e9b398ff736", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "20547543-4dc1-4158-bb9e-515cce88d3ef", "address": "fa:16:3e:c9:2d:ef", "network": {"id": "4a786612-4da0-47c3-94bb-2a73e6567310", "bridge": "br-int", "label": "tempest-device-tagging-net2-1454321418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20547543-4d", "ovs_interfaceid": "20547543-4dc1-4158-bb9e-515cce88d3ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "68377219-20e9-4c9f-b8c7-bcf0a798655e", "address": "fa:16:3e:24:1b:7e", "network": {"id": "4a786612-4da0-47c3-94bb-2a73e6567310", "bridge": "br-int", "label": "tempest-device-tagging-net2-1454321418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68377219-20", "ovs_interfaceid": "68377219-20e9-4c9f-b8c7-bcf0a798655e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:19:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Releasing lock "refresh_cache-4b9fe577-1503-4007-be51-2a714363f8c6" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:19:22 user nova-compute[74840]: DEBUG nova.compute.manager [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Instance network_info: |[{"id": "1fd72b39-7d31-4729-bef7-98f6a5246964", "address": "fa:16:3e:07:9d:e6", "network": {"id": "3fcdf89c-266d-43c1-8ae8-705406698b75", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-157102173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd72b39-7d", "ovs_interfaceid": "1fd72b39-7d31-4729-bef7-98f6a5246964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "87c651bf-a6e8-4290-bbdf-49746754ac54", "address": "fa:16:3e:77:a8:a1", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87c651bf-a6", "ovs_interfaceid": "87c651bf-a6e8-4290-bbdf-49746754ac54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bdec4773-148b-49d7-a461-3a6106fffff6", "address": "fa:16:3e:aa:64:51", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdec4773-14", "ovs_interfaceid": "bdec4773-148b-49d7-a461-3a6106fffff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "538b2412-4ee2-42a6-9cac-f97be4fc341e", "address": "fa:16:3e:d1:64:e8", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap538b2412-4e", "ovs_interfaceid": "538b2412-4ee2-42a6-9cac-f97be4fc341e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "afed888a-e688-452a-846f-4e9b398ff736", "address": "fa:16:3e:72:e8:99", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafed888a-e6", "ovs_interfaceid": "afed888a-e688-452a-846f-4e9b398ff736", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "20547543-4dc1-4158-bb9e-515cce88d3ef", "address": "fa:16:3e:c9:2d:ef", "network": {"id": "4a786612-4da0-47c3-94bb-2a73e6567310", "bridge": "br-int", "label": "tempest-device-tagging-net2-1454321418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20547543-4d", "ovs_interfaceid": "20547543-4dc1-4158-bb9e-515cce88d3ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "68377219-20e9-4c9f-b8c7-bcf0a798655e", "address": "fa:16:3e:24:1b:7e", "network": {"id": "4a786612-4da0-47c3-94bb-2a73e6567310", "bridge": "br-int", "label": "tempest-device-tagging-net2-1454321418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68377219-20", "ovs_interfaceid": "68377219-20e9-4c9f-b8c7-bcf0a798655e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 12:19:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-304e8e56-2679-49b2-a730-30d67d9bc510 req-e69e7a37-99cc-4591-8237-c1d483cc298b service nova] Acquired lock "refresh_cache-4b9fe577-1503-4007-be51-2a714363f8c6" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:19:22 user nova-compute[74840]: DEBUG nova.network.neutron [req-304e8e56-2679-49b2-a730-30d67d9bc510 req-e69e7a37-99cc-4591-8237-c1d483cc298b service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Refreshing network info cache for port 68377219-20e9-4c9f-b8c7-bcf0a798655e {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:19:22 user nova-compute[74840]: DEBUG nova.network.neutron [req-304e8e56-2679-49b2-a730-30d67d9bc510 req-e69e7a37-99cc-4591-8237-c1d483cc298b service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Updated VIF entry in instance network info cache for port 68377219-20e9-4c9f-b8c7-bcf0a798655e. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:19:22 user nova-compute[74840]: DEBUG nova.network.neutron [req-304e8e56-2679-49b2-a730-30d67d9bc510 req-e69e7a37-99cc-4591-8237-c1d483cc298b service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Updating instance_info_cache with network_info: [{"id": "1fd72b39-7d31-4729-bef7-98f6a5246964", "address": "fa:16:3e:07:9d:e6", "network": {"id": "3fcdf89c-266d-43c1-8ae8-705406698b75", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-157102173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd72b39-7d", "ovs_interfaceid": "1fd72b39-7d31-4729-bef7-98f6a5246964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "87c651bf-a6e8-4290-bbdf-49746754ac54", "address": "fa:16:3e:77:a8:a1", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87c651bf-a6", "ovs_interfaceid": "87c651bf-a6e8-4290-bbdf-49746754ac54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bdec4773-148b-49d7-a461-3a6106fffff6", "address": "fa:16:3e:aa:64:51", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdec4773-14", "ovs_interfaceid": "bdec4773-148b-49d7-a461-3a6106fffff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "538b2412-4ee2-42a6-9cac-f97be4fc341e", "address": "fa:16:3e:d1:64:e8", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap538b2412-4e", "ovs_interfaceid": "538b2412-4ee2-42a6-9cac-f97be4fc341e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "afed888a-e688-452a-846f-4e9b398ff736", "address": "fa:16:3e:72:e8:99", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafed888a-e6", "ovs_interfaceid": "afed888a-e688-452a-846f-4e9b398ff736", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "20547543-4dc1-4158-bb9e-515cce88d3ef", "address": "fa:16:3e:c9:2d:ef", "network": {"id": "4a786612-4da0-47c3-94bb-2a73e6567310", "bridge": "br-int", "label": "tempest-device-tagging-net2-1454321418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20547543-4d", "ovs_interfaceid": "20547543-4dc1-4158-bb9e-515cce88d3ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "68377219-20e9-4c9f-b8c7-bcf0a798655e", "address": "fa:16:3e:24:1b:7e", "network": {"id": "4a786612-4da0-47c3-94bb-2a73e6567310", "bridge": "br-int", "label": "tempest-device-tagging-net2-1454321418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68377219-20", "ovs_interfaceid": "68377219-20e9-4c9f-b8c7-bcf0a798655e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:19:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-304e8e56-2679-49b2-a730-30d67d9bc510 req-e69e7a37-99cc-4591-8237-c1d483cc298b service nova] Releasing lock "refresh_cache-4b9fe577-1503-4007-be51-2a714363f8c6" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:19:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:25 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:30 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4d957bfc-4e56-45fa-95f1-ddc7d774e7bd tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Acquiring lock "e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:19:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4d957bfc-4e56-45fa-95f1-ddc7d774e7bd tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Lock "e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:19:32 user nova-compute[74840]: INFO nova.compute.manager [None req-4d957bfc-4e56-45fa-95f1-ddc7d774e7bd tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Detaching volume 47e08f73-fc30-4ecb-a62f-074aa12560a9
Nov 08 12:19:32 user nova-compute[74840]: INFO nova.virt.block_device [None req-4d957bfc-4e56-45fa-95f1-ddc7d774e7bd tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Attempting to driver detach volume 47e08f73-fc30-4ecb-a62f-074aa12560a9 from mountpoint /dev/vdb
Nov 08 12:19:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4d957bfc-4e56-45fa-95f1-ddc7d774e7bd tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Attempting to detach device vdb from instance e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf from the persistent domain config. {{(pid=74840) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 12:19:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-4d957bfc-4e56-45fa-95f1-ddc7d774e7bd tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 12:19:32 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:19:32 user nova-compute[74840]:   <source dev="/dev/sdb"/>
Nov 08 12:19:32 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:19:32 user nova-compute[74840]:   <serial>47e08f73-fc30-4ecb-a62f-074aa12560a9</serial>
Nov 08 12:19:32 user nova-compute[74840]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 12:19:32 user nova-compute[74840]: </disk>
Nov 08 12:19:32 user nova-compute[74840]:  {{(pid=74840) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 12:19:32 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-4d957bfc-4e56-45fa-95f1-ddc7d774e7bd tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Successfully detached device vdb from instance e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf from the persistent domain config.
Nov 08 12:19:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4d957bfc-4e56-45fa-95f1-ddc7d774e7bd tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf from the live domain config. {{(pid=74840) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 12:19:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-4d957bfc-4e56-45fa-95f1-ddc7d774e7bd tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 12:19:32 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:19:32 user nova-compute[74840]:   <source dev="/dev/sdb"/>
Nov 08 12:19:32 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:19:32 user nova-compute[74840]:   <serial>47e08f73-fc30-4ecb-a62f-074aa12560a9</serial>
Nov 08 12:19:32 user nova-compute[74840]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 12:19:32 user nova-compute[74840]: </disk>
Nov 08 12:19:32 user nova-compute[74840]:  {{(pid=74840) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 12:19:33 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4d957bfc-4e56-45fa-95f1-ddc7d774e7bd tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf {{(pid=74840) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 12:19:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:34 user nova-compute[74840]: INFO nova.virt.block_device [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Booting with volume e7ad280d-7a9d-414d-ad87-3c0daed99fa1 at /dev/vdb
Nov 08 12:19:34 user nova-compute[74840]: DEBUG os_brick.utils [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:19:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:19:34 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[302c46bd-2d2f-4799-b2da-3966a00e2983]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c8228a11e03c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:19:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:19:34 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2db73c-581c-4dde-b33f-7a6261946b17]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:19:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:19:34 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f367e6-6cf3-471f-8543-392d5c00c884]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:19:34 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5cc5a80-0383-4102-b159-06881830ed7c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:19:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Running cmd (subprocess): nvme version {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] 'nvme version' failed. Not Retrying. {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:19:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] nvme not present on system {{(pid=74840) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 12:19:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:19:34 user nova-compute[74840]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 12:19:34 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa130a8-2282-4355-9bac-51a0b822898c]: (4, '') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:19:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74840) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 12:19:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 12:19:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] LIGHTOS: no hostnqn found. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 12:19:34 user nova-compute[74840]: DEBUG os_brick.utils [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c8228a11e03c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:19:34 user nova-compute[74840]: DEBUG nova.virt.block_device [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Updating existing volume attachment record: 4421421d-39b5-417b-9f7f-089760e87f5e {{(pid=74840) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 12:19:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:48 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:19:48 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:19:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "refresh_cache-e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:19:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquired lock "refresh_cache-e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:19:48 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Forcefully refreshing network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 12:19:49 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Updating instance_info_cache with network_info: [{"id": "3d85fb08-7cf4-4f26-a8d0-9de9095f874c", "address": "fa:16:3e:6e:13:a8", "network": {"id": "a6dec0d8-d21a-41d6-9d3a-effe04e7f845", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-780900048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24eea35667934f72bef26febd10192b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d85fb08-7c", "ovs_interfaceid": "3d85fb08-7cf4-4f26-a8d0-9de9095f874c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:19:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Releasing lock "refresh_cache-e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:19:49 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Updated the network info_cache for instance {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 12:19:49 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:19:49 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:19:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fc18679c-83fe-4585-9897-34456d674a2b tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "9b90af19-7629-4d19-ba8f-fae652f62e3e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:19:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fc18679c-83fe-4585-9897-34456d674a2b tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "9b90af19-7629-4d19-ba8f-fae652f62e3e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:19:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fc18679c-83fe-4585-9897-34456d674a2b tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "9b90af19-7629-4d19-ba8f-fae652f62e3e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:19:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fc18679c-83fe-4585-9897-34456d674a2b tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "9b90af19-7629-4d19-ba8f-fae652f62e3e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:19:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fc18679c-83fe-4585-9897-34456d674a2b tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "9b90af19-7629-4d19-ba8f-fae652f62e3e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:19:50 user nova-compute[74840]: INFO nova.compute.manager [None req-fc18679c-83fe-4585-9897-34456d674a2b tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Terminating instance
Nov 08 12:19:50 user nova-compute[74840]: DEBUG nova.compute.manager [None req-fc18679c-83fe-4585-9897-34456d674a2b tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Start destroying the instance on the hypervisor. {{(pid=74840) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 12:19:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:50 user nova-compute[74840]: DEBUG nova.compute.manager [req-59f04631-4b15-4739-ad80-bf6482e24130 req-bf730577-aa18-41bb-8b24-879d130d737c service nova] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Received event network-vif-unplugged-3b079dbf-c166-48cc-a7ad-1a971751ba88 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:19:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-59f04631-4b15-4739-ad80-bf6482e24130 req-bf730577-aa18-41bb-8b24-879d130d737c service nova] Acquiring lock "9b90af19-7629-4d19-ba8f-fae652f62e3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:19:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-59f04631-4b15-4739-ad80-bf6482e24130 req-bf730577-aa18-41bb-8b24-879d130d737c service nova] Lock "9b90af19-7629-4d19-ba8f-fae652f62e3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:19:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-59f04631-4b15-4739-ad80-bf6482e24130 req-bf730577-aa18-41bb-8b24-879d130d737c service nova] Lock "9b90af19-7629-4d19-ba8f-fae652f62e3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:19:50 user nova-compute[74840]: DEBUG nova.compute.manager [req-59f04631-4b15-4739-ad80-bf6482e24130 req-bf730577-aa18-41bb-8b24-879d130d737c service nova] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] No waiting events found dispatching network-vif-unplugged-3b079dbf-c166-48cc-a7ad-1a971751ba88 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:19:50 user nova-compute[74840]: DEBUG nova.compute.manager [req-59f04631-4b15-4739-ad80-bf6482e24130 req-bf730577-aa18-41bb-8b24-879d130d737c service nova] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Received event network-vif-unplugged-3b079dbf-c166-48cc-a7ad-1a971751ba88 for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:19:50 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:19:50 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:19:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:50 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Instance destroyed successfully.
Nov 08 12:19:50 user nova-compute[74840]: DEBUG nova.objects.instance [None req-fc18679c-83fe-4585-9897-34456d674a2b tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lazy-loading 'resources' on Instance uuid 9b90af19-7629-4d19-ba8f-fae652f62e3e {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:19:50 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-fc18679c-83fe-4585-9897-34456d674a2b tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:17:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-548846971',display_name='tempest-TestVolumeBootPattern-server-548846971',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-548846971',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:18:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1250106b55ae44b0b303849df7781ffb',ramdisk_id='',reservation_id='r-6e3k9w8u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-77780905',owner_user_name='tempest-TestVolumeBootPattern-77780905-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:18:11Z,user_data=None,user_id='794c0281e1bf48f79117efdc3907e661',uuid=9b90af19-7629-4d19-ba8f-fae652f62e3e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b079dbf-c166-48cc-a7ad-1a971751ba88", "address": "fa:16:3e:b7:f7:ea", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b079dbf-c1", "ovs_interfaceid": "3b079dbf-c166-48cc-a7ad-1a971751ba88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:19:50 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-fc18679c-83fe-4585-9897-34456d674a2b tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Converting VIF {"id": "3b079dbf-c166-48cc-a7ad-1a971751ba88", "address": "fa:16:3e:b7:f7:ea", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b079dbf-c1", "ovs_interfaceid": "3b079dbf-c166-48cc-a7ad-1a971751ba88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:19:50 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-fc18679c-83fe-4585-9897-34456d674a2b tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:f7:ea,bridge_name='br-int',has_traffic_filtering=True,id=3b079dbf-c166-48cc-a7ad-1a971751ba88,network=Network(174da5e9-78cc-426f-87fb-1d3b23b8b459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b079dbf-c1') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:19:50 user nova-compute[74840]: DEBUG os_vif [None req-fc18679c-83fe-4585-9897-34456d674a2b tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:f7:ea,bridge_name='br-int',has_traffic_filtering=True,id=3b079dbf-c166-48cc-a7ad-1a971751ba88,network=Network(174da5e9-78cc-426f-87fb-1d3b23b8b459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b079dbf-c1') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:19:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b079dbf-c1, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:19:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:19:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=af6ca372-0833-4b1c-bd82-a463047caca9) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:19:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:19:50 user nova-compute[74840]: INFO os_vif [None req-fc18679c-83fe-4585-9897-34456d674a2b tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:f7:ea,bridge_name='br-int',has_traffic_filtering=True,id=3b079dbf-c166-48cc-a7ad-1a971751ba88,network=Network(174da5e9-78cc-426f-87fb-1d3b23b8b459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b079dbf-c1')
Nov 08 12:19:50 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc18679c-83fe-4585-9897-34456d674a2b tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 12:19:50 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc18679c-83fe-4585-9897-34456d674a2b tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XJAkVPia', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:19:50 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-fc18679c-83fe-4585-9897-34456d674a2b tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:19:50 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-fc18679c-83fe-4585-9897-34456d674a2b tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:19:50 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-fc18679c-83fe-4585-9897-34456d674a2b tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:19:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:19:50 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba22e9e1-ed98-4ece-8bf0-e1807c184957]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:19:50 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc18679c-83fe-4585-9897-34456d674a2b tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 12:19:50 user nova-compute[74840]: No targets found.
Nov 08 12:19:50 user nova-compute[74840]: iSNS:
Nov 08 12:19:50 user nova-compute[74840]: No targets found.
Nov 08 12:19:50 user nova-compute[74840]: STATIC:
Nov 08 12:19:50 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9
Nov 08 12:19:50 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:19:50 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:19:50 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665
Nov 08 12:19:50 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:19:50 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:19:50 user nova-compute[74840]: FIRMWARE:
Nov 08 12:19:50 user nova-compute[74840]: No targets found.
Nov 08 12:19:50 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:19:50 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc18679c-83fe-4585-9897-34456d674a2b tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 12:19:50 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 12:19:50 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 12:19:50 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc18679c-83fe-4585-9897-34456d674a2b tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 12:19:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:19:51 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4d56d6-7a45-4f59-9df3-25634f572cfc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:19:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:19:51 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[72fd6693-fe6b-4b24-b0ed-d386038a710a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:19:51 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc18679c-83fe-4585-9897-34456d674a2b tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 (non-flash)
Nov 08 12:19:51 user nova-compute[74840]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665 (non-flash)
Nov 08 12:19:51 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:19:51 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc18679c-83fe-4585-9897-34456d674a2b tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 (non-flash)
Nov 08 12:19:51 user nova-compute[74840]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665 (non-flash)
Nov 08 12:19:51 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:19:51 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc18679c-83fe-4585-9897-34456d674a2b tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7f43f3910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665'): ({'sdd'}, set())}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 12:19:51 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-fc18679c-83fe-4585-9897-34456d674a2b tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Removing single pathed devices sdd {{(pid=74840) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 12:19:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:19:51 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[91eccb67-1f20-4c56-b3a4-f00be7cd1871]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:19:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:19:51 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e14985-923f-4834-913c-6de788b3a004]: (4, ('ok\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:19:51 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-fc18679c-83fe-4585-9897-34456d674a2b tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Flushing IO for device /dev/sdd {{(pid=74840) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 12:19:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:19:51 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44067fa-df5e-4dd7-8192-59c54e59f023]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:19:51 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-fc18679c-83fe-4585-9897-34456d674a2b tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74840) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 12:19:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:19:51 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5c8b25-6053-44ef-bb90-ff408520dc17]: (4, ('1', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:19:51 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-fc18679c-83fe-4585-9897-34456d674a2b tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 12:19:51 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-fc18679c-83fe-4585-9897-34456d674a2b tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] SCSI volumes sdd have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 12:19:51 user nova-compute[74840]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_37c2ed36', '/dev/disk/by-id/scsi-1SCST_BIO37c2ed36-a8c31724d52fa523', '/dev/disk/by-id/scsi-26138633331373234') {{(pid=85688) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 12:19:51 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b202bf-53d8-4b62-a41e-2f8c20f3afef]: (4, None) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:19:51 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc18679c-83fe-4585-9897-34456d674a2b tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665')] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 12:19:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:19:51 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb4716f-8dbd-4921-9087-5699281b377b]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:19:51 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc18679c-83fe-4585-9897-34456d674a2b tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:19:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665 -p 172.16.0.220:3260 --logout {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:19:51 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9040d81-0003-4153-bba9-f2ee456aab4d]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:19:51 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc18679c-83fe-4585-9897-34456d674a2b tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665, portal: 172.16.0.220,3260]
Nov 08 12:19:51 user nova-compute[74840]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665, portal: 172.16.0.220,3260] successful.
Nov 08 12:19:51 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:19:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665 -p 172.16.0.220:3260 --op delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76c4c09e-d3eb-4c13-b405-57ea4c9e3665 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:19:51 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[102fc2b3-08bf-40dd-8214-12c5dd9b15cc]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:19:51 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc18679c-83fe-4585-9897-34456d674a2b tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:19:51 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-fc18679c-83fe-4585-9897-34456d674a2b tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:19:51 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc18679c-83fe-4585-9897-34456d674a2b tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] <== disconnect_volume: return (318ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:19:51 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc18679c-83fe-4585-9897-34456d674a2b tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 12:19:51 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-fc18679c-83fe-4585-9897-34456d674a2b tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Deleting instance files /opt/stack/data/nova/instances/9b90af19-7629-4d19-ba8f-fae652f62e3e_del
Nov 08 12:19:51 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-fc18679c-83fe-4585-9897-34456d674a2b tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Deletion of /opt/stack/data/nova/instances/9b90af19-7629-4d19-ba8f-fae652f62e3e_del complete
Nov 08 12:19:51 user nova-compute[74840]: INFO nova.compute.manager [None req-fc18679c-83fe-4585-9897-34456d674a2b tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 08 12:19:51 user nova-compute[74840]: DEBUG oslo.service.loopingcall [None req-fc18679c-83fe-4585-9897-34456d674a2b tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74840) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 12:19:51 user nova-compute[74840]: DEBUG nova.compute.manager [-] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Deallocating network for instance {{(pid=74840) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 12:19:51 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] deallocate_for_instance() {{(pid=74840) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 12:19:51 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:51 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:19:51 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:19:51 user nova-compute[74840]: INFO nova.compute.manager [-] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Took 0.52 seconds to deallocate network for instance.
Nov 08 12:19:51 user nova-compute[74840]: DEBUG nova.compute.manager [req-0e0305a5-162f-4d02-a64e-fc4835fb52ee req-9cc0384d-9f48-4f2b-b02e-64b2a1eff210 service nova] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Received event network-vif-deleted-3b079dbf-c166-48cc-a7ad-1a971751ba88 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:19:52 user nova-compute[74840]: DEBUG nova.compute.manager [req-5d28e498-e2a0-41a3-a255-2f9377130c75 req-e6842079-735c-4d0b-b146-3c3da87afa10 service nova] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Received event network-vif-plugged-3b079dbf-c166-48cc-a7ad-1a971751ba88 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:19:52 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-5d28e498-e2a0-41a3-a255-2f9377130c75 req-e6842079-735c-4d0b-b146-3c3da87afa10 service nova] Acquiring lock "9b90af19-7629-4d19-ba8f-fae652f62e3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:19:52 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-5d28e498-e2a0-41a3-a255-2f9377130c75 req-e6842079-735c-4d0b-b146-3c3da87afa10 service nova] Lock "9b90af19-7629-4d19-ba8f-fae652f62e3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:19:52 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-5d28e498-e2a0-41a3-a255-2f9377130c75 req-e6842079-735c-4d0b-b146-3c3da87afa10 service nova] Lock "9b90af19-7629-4d19-ba8f-fae652f62e3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:19:52 user nova-compute[74840]: DEBUG nova.compute.manager [req-5d28e498-e2a0-41a3-a255-2f9377130c75 req-e6842079-735c-4d0b-b146-3c3da87afa10 service nova] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] No waiting events found dispatching network-vif-plugged-3b079dbf-c166-48cc-a7ad-1a971751ba88 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:19:52 user nova-compute[74840]: WARNING nova.compute.manager [req-5d28e498-e2a0-41a3-a255-2f9377130c75 req-e6842079-735c-4d0b-b146-3c3da87afa10 service nova] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Received unexpected event network-vif-plugged-3b079dbf-c166-48cc-a7ad-1a971751ba88 for instance with vm_state active and task_state deleting.
Nov 08 12:19:52 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:19:52 user nova-compute[74840]: INFO nova.compute.manager [None req-fc18679c-83fe-4585-9897-34456d674a2b tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Took 1.02 seconds to detach 1 volumes for instance.
Nov 08 12:19:52 user nova-compute[74840]: DEBUG nova.compute.manager [None req-fc18679c-83fe-4585-9897-34456d674a2b tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 9b90af19-7629-4d19-ba8f-fae652f62e3e] Deleting volume: 76c4c09e-d3eb-4c13-b405-57ea4c9e3665 {{(pid=74840) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 12:19:53 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-4d957bfc-4e56-45fa-95f1-ddc7d774e7bd tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf is timed out.
Nov 08 12:19:53 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-4d957bfc-4e56-45fa-95f1-ddc7d774e7bd tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Successfully detached device vdb from instance e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf from the live domain config.
Nov 08 12:19:53 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d957bfc-4e56-45fa-95f1-ddc7d774e7bd tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d957bfc-4e56-45fa-95f1-ddc7d774e7bd tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zBHKyiGW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:19:53 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-4d957bfc-4e56-45fa-95f1-ddc7d774e7bd tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:19:53 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-4d957bfc-4e56-45fa-95f1-ddc7d774e7bd tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-4d957bfc-4e56-45fa-95f1-ddc7d774e7bd tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fc18679c-83fe-4585-9897-34456d674a2b tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fc18679c-83fe-4585-9897-34456d674a2b tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6021272-61b0-4170-895f-6981105a4fcd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d957bfc-4e56-45fa-95f1-ddc7d774e7bd tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 12:19:53 user nova-compute[74840]: No targets found.
Nov 08 12:19:53 user nova-compute[74840]: iSNS:
Nov 08 12:19:53 user nova-compute[74840]: No targets found.
Nov 08 12:19:53 user nova-compute[74840]: STATIC:
Nov 08 12:19:53 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9
Nov 08 12:19:53 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:19:53 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:19:53 user nova-compute[74840]: FIRMWARE:
Nov 08 12:19:53 user nova-compute[74840]: No targets found.
Nov 08 12:19:53 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d957bfc-4e56-45fa-95f1-ddc7d774e7bd tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 12:19:53 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 12:19:53 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d957bfc-4e56-45fa-95f1-ddc7d774e7bd tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa0c568-6931-4352-a3db-bd048ee98639]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e1d55a-b6b7-4acc-8533-07ac675d3f76]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d957bfc-4e56-45fa-95f1-ddc7d774e7bd tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 (non-flash)
Nov 08 12:19:53 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d957bfc-4e56-45fa-95f1-ddc7d774e7bd tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 (non-flash)
Nov 08 12:19:53 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d957bfc-4e56-45fa-95f1-ddc7d774e7bd tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7d4591f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9'): ({'sdb'}, set())}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-4d957bfc-4e56-45fa-95f1-ddc7d774e7bd tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Removing single pathed devices sdb {{(pid=74840) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[870f30a1-8214-46de-b3de-61aa24cef8c0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b57d1e-32d9-4ce4-8042-84ba45c3944e]: (4, ('ok\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-4d957bfc-4e56-45fa-95f1-ddc7d774e7bd tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Flushing IO for device /dev/sdb {{(pid=74840) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf106860-d34e-4f32-bf68-32d49db00c27]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-4d957bfc-4e56-45fa-95f1-ddc7d774e7bd tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74840) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f7daa0-8a4d-40ab-9edf-d0727ef3e439]: (4, ('1', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-4d957bfc-4e56-45fa-95f1-ddc7d774e7bd tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-4d957bfc-4e56-45fa-95f1-ddc7d774e7bd tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] SCSI volumes sdb have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d957bfc-4e56-45fa-95f1-ddc7d774e7bd tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9')] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e952a32-f75a-4380-8d06-98248f634b02]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d957bfc-4e56-45fa-95f1-ddc7d774e7bd tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 -p 172.16.0.220:3260 --logout {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-fc18679c-83fe-4585-9897-34456d674a2b tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ba0b6f-1b0e-45db-a8c4-5154a193ca18]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d957bfc-4e56-45fa-95f1-ddc7d774e7bd tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9, portal: 172.16.0.220,3260]
Nov 08 12:19:53 user nova-compute[74840]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9, portal: 172.16.0.220,3260] successful.
Nov 08 12:19:53 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 -p 172.16.0.220:3260 --op delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-fc18679c-83fe-4585-9897-34456d674a2b tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47e08f73-fc30-4ecb-a62f-074aa12560a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b90f0e8-c2f5-47f0-bbd9-1c6d266921ff]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d957bfc-4e56-45fa-95f1-ddc7d774e7bd tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-4d957bfc-4e56-45fa-95f1-ddc7d774e7bd tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d957bfc-4e56-45fa-95f1-ddc7d774e7bd tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] <== disconnect_volume: return (376ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d957bfc-4e56-45fa-95f1-ddc7d774e7bd tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fc18679c-83fe-4585-9897-34456d674a2b tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.389s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:19:53 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-fc18679c-83fe-4585-9897-34456d674a2b tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Deleted allocations for instance 9b90af19-7629-4d19-ba8f-fae652f62e3e
Nov 08 12:19:53 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fc18679c-83fe-4585-9897-34456d674a2b tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "9b90af19-7629-4d19-ba8f-fae652f62e3e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.542s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:19:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:54 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:19:54 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:54 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:19:54 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d00e1756-34cd-4847-b108-023ba273444a/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:54 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d00e1756-34cd-4847-b108-023ba273444a/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:19:54 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d00e1756-34cd-4847-b108-023ba273444a/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:54 user nova-compute[74840]: DEBUG nova.objects.instance [None req-4d957bfc-4e56-45fa-95f1-ddc7d774e7bd tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Lazy-loading 'flavor' on Instance uuid e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:19:54 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4d957bfc-4e56-45fa-95f1-ddc7d774e7bd tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Lock "e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.311s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:19:54 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d00e1756-34cd-4847-b108-023ba273444a/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:19:54 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:19:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Acquiring lock "83c035a0-880b-4170-98bc-b18cae712cfa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:19:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Lock "83c035a0-880b-4170-98bc-b18cae712cfa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:19:55 user nova-compute[74840]: DEBUG nova.compute.manager [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Starting instance... {{(pid=74840) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 12:19:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:19:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032e6584-9acf-469f-b661-faf6555659e1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:19:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:19:55 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:19:55 user nova-compute[74840]: INFO nova.compute.claims [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Claim successful on node user
Nov 08 12:19:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032e6584-9acf-469f-b661-faf6555659e1/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:19:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032e6584-9acf-469f-b661-faf6555659e1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032e6584-9acf-469f-b661-faf6555659e1/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:19:55 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:19:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:56 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:19:56 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:19:56 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:19:56 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=8179MB free_disk=25.31503677368164GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:19:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:19:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.912s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:19:56 user nova-compute[74840]: DEBUG nova.compute.manager [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Start building networks asynchronously for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 12:19:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.040s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:19:56 user nova-compute[74840]: DEBUG nova.compute.manager [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Allocating IP information in the background. {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 12:19:56 user nova-compute[74840]: DEBUG nova.network.neutron [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 12:19:56 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 12:19:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:56 user nova-compute[74840]: DEBUG nova.compute.manager [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Start building block device mappings for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 12:19:56 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:19:56 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance d3e8efc6-7146-46ef-8433-380d7e69120c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:19:56 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 032e6584-9acf-469f-b661-faf6555659e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:19:56 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance d00e1756-34cd-4847-b108-023ba273444a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:19:56 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 4b9fe577-1503-4007-be51-2a714363f8c6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:19:56 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 83c035a0-880b-4170-98bc-b18cae712cfa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:19:56 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:19:56 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:19:56 user nova-compute[74840]: DEBUG nova.policy [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe87f6d61cea4243a123420baf15279a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8bdf3f4296441799bd44bd993d3111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 12:19:56 user nova-compute[74840]: DEBUG nova.compute.manager [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Start spawning the instance on the hypervisor. {{(pid=74840) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 12:19:56 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:19:56 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Creating image(s)
Nov 08 12:19:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Acquiring lock "/opt/stack/data/nova/instances/83c035a0-880b-4170-98bc-b18cae712cfa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:19:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Lock "/opt/stack/data/nova/instances/83c035a0-880b-4170-98bc-b18cae712cfa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:19:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Lock "/opt/stack/data/nova/instances/83c035a0-880b-4170-98bc-b18cae712cfa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:19:56 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:56 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:19:56 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:19:56 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:19:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.531s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:19:56 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:19:56 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74840) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 12:19:56 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.206s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:19:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Acquiring lock "5d26578eba85497f494c575690c4248f381a0fe6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:19:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:19:56 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:56 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:19:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.205s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:19:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/83c035a0-880b-4170-98bc-b18cae712cfa/disk 1073741824 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/83c035a0-880b-4170-98bc-b18cae712cfa/disk 1073741824" returned: 0 in 0.059s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:19:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:19:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:57 user nova-compute[74840]: DEBUG nova.network.neutron [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Successfully created port: 75ded381-268f-487c-bf3b-1aad4d3909ae {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:19:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.272s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:19:57 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Checking if we can resize image /opt/stack/data/nova/instances/83c035a0-880b-4170-98bc-b18cae712cfa/disk. size=1073741824 {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 12:19:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83c035a0-880b-4170-98bc-b18cae712cfa/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:57 user nova-compute[74840]: DEBUG nova.compute.manager [req-4febc656-b517-4eb1-bd0c-11c13c607da5 req-8c2132d6-7f85-4f61-96d5-c011bb4006ca service nova] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Received event network-changed-4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:19:57 user nova-compute[74840]: DEBUG nova.compute.manager [req-4febc656-b517-4eb1-bd0c-11c13c607da5 req-8c2132d6-7f85-4f61-96d5-c011bb4006ca service nova] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Refreshing instance network info cache due to event network-changed-4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:19:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4febc656-b517-4eb1-bd0c-11c13c607da5 req-8c2132d6-7f85-4f61-96d5-c011bb4006ca service nova] Acquiring lock "refresh_cache-032e6584-9acf-469f-b661-faf6555659e1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:19:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4febc656-b517-4eb1-bd0c-11c13c607da5 req-8c2132d6-7f85-4f61-96d5-c011bb4006ca service nova] Acquired lock "refresh_cache-032e6584-9acf-469f-b661-faf6555659e1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:19:57 user nova-compute[74840]: DEBUG nova.network.neutron [req-4febc656-b517-4eb1-bd0c-11c13c607da5 req-8c2132d6-7f85-4f61-96d5-c011bb4006ca service nova] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Refreshing network info cache for port 4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:19:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83c035a0-880b-4170-98bc-b18cae712cfa/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:19:57 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Cannot resize image /opt/stack/data/nova/instances/83c035a0-880b-4170-98bc-b18cae712cfa/disk to a smaller size. {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 12:19:57 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Created local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 12:19:57 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Ensure instance console log exists: /opt/stack/data/nova/instances/83c035a0-880b-4170-98bc-b18cae712cfa/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:19:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:19:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:19:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:19:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Acquiring lock "032e6584-9acf-469f-b661-faf6555659e1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:19:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "032e6584-9acf-469f-b661-faf6555659e1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:19:57 user nova-compute[74840]: DEBUG nova.objects.instance [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lazy-loading 'flavor' on Instance uuid 032e6584-9acf-469f-b661-faf6555659e1 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:19:57 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Ignoring supplied device name: /dev/vdb
Nov 08 12:19:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "032e6584-9acf-469f-b661-faf6555659e1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:19:57 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Acquiring lock "032e6584-9acf-469f-b661-faf6555659e1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "032e6584-9acf-469f-b661-faf6555659e1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:19:58 user nova-compute[74840]: INFO nova.compute.manager [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Attaching volume d116702a-23fe-4e9a-8afe-ee88c802d41e to /dev/vdb
Nov 08 12:19:58 user nova-compute[74840]: DEBUG os_brick.utils [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb9588d-07e4-4ec8-95c8-8f23b4799943]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c8228a11e03c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05ef192-dfc8-4da5-8441-89532d511d3b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[4188ddea-c7f8-4760-a716-527c23a39515]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3701ea4f-e20d-46d8-abf6-d9cc66fdf3c3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Running cmd (subprocess): nvme version {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] 'nvme version' failed. Not Retrying. {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG nova.network.neutron [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Successfully updated port: 75ded381-268f-487c-bf3b-1aad4d3909ae {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] nvme not present on system {{(pid=74840) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Acquiring lock "refresh_cache-83c035a0-880b-4170-98bc-b18cae712cfa" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Acquired lock "refresh_cache-83c035a0-880b-4170-98bc-b18cae712cfa" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG nova.network.neutron [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:19:58 user nova-compute[74840]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 12:19:58 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[022998de-5253-45c1-ad3b-17ee09bbef6c]: (4, '') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG nova.compute.manager [req-91984cc9-b6df-40f8-b5ab-baf13260d936 req-10227358-3bac-4b2e-a32c-9f7b76eda897 service nova] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Received event network-changed-75ded381-268f-487c-bf3b-1aad4d3909ae {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG nova.compute.manager [req-91984cc9-b6df-40f8-b5ab-baf13260d936 req-10227358-3bac-4b2e-a32c-9f7b76eda897 service nova] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Refreshing instance network info cache due to event network-changed-75ded381-268f-487c-bf3b-1aad4d3909ae. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-91984cc9-b6df-40f8-b5ab-baf13260d936 req-10227358-3bac-4b2e-a32c-9f7b76eda897 service nova] Acquiring lock "refresh_cache-83c035a0-880b-4170-98bc-b18cae712cfa" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74840) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] LIGHTOS: no hostnqn found. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG os_brick.utils [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c8228a11e03c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG nova.virt.block_device [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Updating existing volume attachment record: 2689ba17-ed3d-440a-b6cc-8f4afddb5cc1 {{(pid=74840) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG nova.network.neutron [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG nova.network.neutron [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Updating instance_info_cache with network_info: [{"id": "75ded381-268f-487c-bf3b-1aad4d3909ae", "address": "fa:16:3e:56:38:57", "network": {"id": "22514061-e390-4fd9-943b-0dedf57a323e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1978465085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c8bdf3f4296441799bd44bd993d3111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75ded381-26", "ovs_interfaceid": "75ded381-268f-487c-bf3b-1aad4d3909ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Releasing lock "refresh_cache-83c035a0-880b-4170-98bc-b18cae712cfa" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG nova.compute.manager [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Instance network_info: |[{"id": "75ded381-268f-487c-bf3b-1aad4d3909ae", "address": "fa:16:3e:56:38:57", "network": {"id": "22514061-e390-4fd9-943b-0dedf57a323e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1978465085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c8bdf3f4296441799bd44bd993d3111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75ded381-26", "ovs_interfaceid": "75ded381-268f-487c-bf3b-1aad4d3909ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-91984cc9-b6df-40f8-b5ab-baf13260d936 req-10227358-3bac-4b2e-a32c-9f7b76eda897 service nova] Acquired lock "refresh_cache-83c035a0-880b-4170-98bc-b18cae712cfa" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG nova.network.neutron [req-91984cc9-b6df-40f8-b5ab-baf13260d936 req-10227358-3bac-4b2e-a32c-9f7b76eda897 service nova] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Refreshing network info cache for port 75ded381-268f-487c-bf3b-1aad4d3909ae {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Start _get_guest_xml network_info=[{"id": "75ded381-268f-487c-bf3b-1aad4d3909ae", "address": "fa:16:3e:56:38:57", "network": {"id": "22514061-e390-4fd9-943b-0dedf57a323e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1978465085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c8bdf3f4296441799bd44bd993d3111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75ded381-26", "ovs_interfaceid": "75ded381-268f-487c-bf3b-1aad4d3909ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'image_id': '4fa17706-d304-4117-a420-dab994c703dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:19:58 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:19:58 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:19:58 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:19:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1248482414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1248482414',id=22,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE08F5Vdqafx8ionT0o99nYONzOMoa/3pOusA/wlvX3fSXRcA+RhI/2hy/w+tkl5A+C6lKye9AkVRPFr99hJwoo+GJvdV7gC/UTzKzbtU6DDZO8zP9SCuNQkk2JKp43yVA==',key_name='tempest-keypair-1343265406',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c8bdf3f4296441799bd44bd993d3111',ramdisk_id='',reservation_id='r-wyshdnxz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-807651925',owner_user_name='tempest-TaggedAttachmentsTest-807651925-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:19:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe87f6d61cea4243a123420baf15279a',uuid=83c035a0-880b-4170-98bc-b18cae712cfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75ded381-268f-487c-bf3b-1aad4d3909ae", "address": "fa:16:3e:56:38:57", "network": {"id": "22514061-e390-4fd9-943b-0dedf57a323e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1978465085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c8bdf3f4296441799bd44bd993d3111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75ded381-26", "ovs_interfaceid": "75ded381-268f-487c-bf3b-1aad4d3909ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Converting VIF {"id": "75ded381-268f-487c-bf3b-1aad4d3909ae", "address": "fa:16:3e:56:38:57", "network": {"id": "22514061-e390-4fd9-943b-0dedf57a323e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1978465085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c8bdf3f4296441799bd44bd993d3111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75ded381-26", "ovs_interfaceid": "75ded381-268f-487c-bf3b-1aad4d3909ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:38:57,bridge_name='br-int',has_traffic_filtering=True,id=75ded381-268f-487c-bf3b-1aad4d3909ae,network=Network(22514061-e390-4fd9-943b-0dedf57a323e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75ded381-26') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG nova.objects.instance [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Lazy-loading 'pci_devices' on Instance uuid 83c035a0-880b-4170-98bc-b18cae712cfa {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG nova.network.neutron [req-4febc656-b517-4eb1-bd0c-11c13c607da5 req-8c2132d6-7f85-4f61-96d5-c011bb4006ca service nova] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Updated VIF entry in instance network info cache for port 4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG nova.network.neutron [req-4febc656-b517-4eb1-bd0c-11c13c607da5 req-8c2132d6-7f85-4f61-96d5-c011bb4006ca service nova] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Updating instance_info_cache with network_info: [{"id": "4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd", "address": "fa:16:3e:d3:22:7c", "network": {"id": "89a24eca-8c74-4e0e-b778-275f200927f0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1409559017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a082f8090094f009393593fb26b445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d59d0f9-05", "ovs_interfaceid": "4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:19:58 user nova-compute[74840]:   <uuid>83c035a0-880b-4170-98bc-b18cae712cfa</uuid>
Nov 08 12:19:58 user nova-compute[74840]:   <name>instance-00000016</name>
Nov 08 12:19:58 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:19:58 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:19:58 user nova-compute[74840]:   <metadata>
Nov 08 12:19:58 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:19:58 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:19:58 user nova-compute[74840]:       <nova:name>tempest-device-tagging-server-1248482414</nova:name>
Nov 08 12:19:58 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:19:58</nova:creationTime>
Nov 08 12:19:58 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:19:58 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:19:58 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:19:58 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:19:58 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:19:58 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:19:58 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:19:58 user nova-compute[74840]:       <nova:owner>
Nov 08 12:19:58 user nova-compute[74840]:         <nova:user uuid="fe87f6d61cea4243a123420baf15279a">tempest-TaggedAttachmentsTest-807651925-project-member</nova:user>
Nov 08 12:19:58 user nova-compute[74840]:         <nova:project uuid="8c8bdf3f4296441799bd44bd993d3111">tempest-TaggedAttachmentsTest-807651925</nova:project>
Nov 08 12:19:58 user nova-compute[74840]:       </nova:owner>
Nov 08 12:19:58 user nova-compute[74840]:       <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:19:58 user nova-compute[74840]:       <nova:ports>
Nov 08 12:19:58 user nova-compute[74840]:         <nova:port uuid="75ded381-268f-487c-bf3b-1aad4d3909ae">
Nov 08 12:19:58 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 08 12:19:58 user nova-compute[74840]:         </nova:port>
Nov 08 12:19:58 user nova-compute[74840]:       </nova:ports>
Nov 08 12:19:58 user nova-compute[74840]:     </nova:instance>
Nov 08 12:19:58 user nova-compute[74840]:   </metadata>
Nov 08 12:19:58 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:19:58 user nova-compute[74840]:     <system>
Nov 08 12:19:58 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:19:58 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:19:58 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:19:58 user nova-compute[74840]:       <entry name="serial">83c035a0-880b-4170-98bc-b18cae712cfa</entry>
Nov 08 12:19:58 user nova-compute[74840]:       <entry name="uuid">83c035a0-880b-4170-98bc-b18cae712cfa</entry>
Nov 08 12:19:58 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:19:58 user nova-compute[74840]:     </system>
Nov 08 12:19:58 user nova-compute[74840]:   </sysinfo>
Nov 08 12:19:58 user nova-compute[74840]:   <os>
Nov 08 12:19:58 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:19:58 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:19:58 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:19:58 user nova-compute[74840]:   </os>
Nov 08 12:19:58 user nova-compute[74840]:   <features>
Nov 08 12:19:58 user nova-compute[74840]:     <acpi/>
Nov 08 12:19:58 user nova-compute[74840]:     <apic/>
Nov 08 12:19:58 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:19:58 user nova-compute[74840]:   </features>
Nov 08 12:19:58 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:19:58 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:19:58 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:19:58 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:19:58 user nova-compute[74840]:   </clock>
Nov 08 12:19:58 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:19:58 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:19:58 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:19:58 user nova-compute[74840]:   </cpu>
Nov 08 12:19:58 user nova-compute[74840]:   <devices>
Nov 08 12:19:58 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:19:58 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:19:58 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/83c035a0-880b-4170-98bc-b18cae712cfa/disk"/>
Nov 08 12:19:58 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:19:58 user nova-compute[74840]:     </disk>
Nov 08 12:19:58 user nova-compute[74840]:     <disk type="file" device="cdrom">
Nov 08 12:19:58 user nova-compute[74840]:       <driver name="qemu" type="raw" cache="none"/>
Nov 08 12:19:58 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/83c035a0-880b-4170-98bc-b18cae712cfa/disk.config"/>
Nov 08 12:19:58 user nova-compute[74840]:       <target dev="hda" bus="ide"/>
Nov 08 12:19:58 user nova-compute[74840]:     </disk>
Nov 08 12:19:58 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:19:58 user nova-compute[74840]:       <mac address="fa:16:3e:56:38:57"/>
Nov 08 12:19:58 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:19:58 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:19:58 user nova-compute[74840]:       <target dev="tap75ded381-26"/>
Nov 08 12:19:58 user nova-compute[74840]:     </interface>
Nov 08 12:19:58 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:19:58 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/83c035a0-880b-4170-98bc-b18cae712cfa/console.log" append="off"/>
Nov 08 12:19:58 user nova-compute[74840]:     </serial>
Nov 08 12:19:58 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:19:58 user nova-compute[74840]:     <video>
Nov 08 12:19:58 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:19:58 user nova-compute[74840]:     </video>
Nov 08 12:19:58 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:19:58 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:19:58 user nova-compute[74840]:     </rng>
Nov 08 12:19:58 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:19:58 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:19:58 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:19:58 user nova-compute[74840]:     </memballoon>
Nov 08 12:19:58 user nova-compute[74840]:   </devices>
Nov 08 12:19:58 user nova-compute[74840]: </domain>
Nov 08 12:19:58 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:19:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1248482414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1248482414',id=22,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE08F5Vdqafx8ionT0o99nYONzOMoa/3pOusA/wlvX3fSXRcA+RhI/2hy/w+tkl5A+C6lKye9AkVRPFr99hJwoo+GJvdV7gC/UTzKzbtU6DDZO8zP9SCuNQkk2JKp43yVA==',key_name='tempest-keypair-1343265406',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c8bdf3f4296441799bd44bd993d3111',ramdisk_id='',reservation_id='r-wyshdnxz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-807651925',owner_user_name='tempest-TaggedAttachmentsTest-807651925-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:19:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe87f6d61cea4243a123420baf15279a',uuid=83c035a0-880b-4170-98bc-b18cae712cfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75ded381-268f-487c-bf3b-1aad4d3909ae", "address": "fa:16:3e:56:38:57", "network": {"id": "22514061-e390-4fd9-943b-0dedf57a323e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1978465085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c8bdf3f4296441799bd44bd993d3111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75ded381-26", "ovs_interfaceid": "75ded381-268f-487c-bf3b-1aad4d3909ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Converting VIF {"id": "75ded381-268f-487c-bf3b-1aad4d3909ae", "address": "fa:16:3e:56:38:57", "network": {"id": "22514061-e390-4fd9-943b-0dedf57a323e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1978465085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c8bdf3f4296441799bd44bd993d3111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75ded381-26", "ovs_interfaceid": "75ded381-268f-487c-bf3b-1aad4d3909ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:38:57,bridge_name='br-int',has_traffic_filtering=True,id=75ded381-268f-487c-bf3b-1aad4d3909ae,network=Network(22514061-e390-4fd9-943b-0dedf57a323e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75ded381-26') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG os_vif [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:38:57,bridge_name='br-int',has_traffic_filtering=True,id=75ded381-268f-487c-bf3b-1aad4d3909ae,network=Network(22514061-e390-4fd9-943b-0dedf57a323e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75ded381-26') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e42f7e05-89db-5887-b25b-90fbe8b53128', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4febc656-b517-4eb1-bd0c-11c13c607da5 req-8c2132d6-7f85-4f61-96d5-c011bb4006ca service nova] Releasing lock "refresh_cache-032e6584-9acf-469f-b661-faf6555659e1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap75ded381-26, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap75ded381-26, col_values=(('qos', UUID('6135742f-609c-46c8-9cb9-176fc3574890')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap75ded381-26, col_values=(('external_ids', {'iface-id': '75ded381-268f-487c-bf3b-1aad4d3909ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:38:57', 'vm-uuid': '83c035a0-880b-4170-98bc-b18cae712cfa'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:19:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:19:58 user nova-compute[74840]: INFO os_vif [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:38:57,bridge_name='br-int',has_traffic_filtering=True,id=75ded381-268f-487c-bf3b-1aad4d3909ae,network=Network(22514061-e390-4fd9-943b-0dedf57a323e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75ded381-26')
Nov 08 12:19:59 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:19:59 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] No BDM found with device name hda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:19:59 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] No VIF found with MAC fa:16:3e:56:38:57, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:19:59 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Using config drive
Nov 08 12:19:59 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Creating config drive at /opt/stack/data/nova/instances/83c035a0-880b-4170-98bc-b18cae712cfa/disk.config
Nov 08 12:19:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/83c035a0-880b-4170-98bc-b18cae712cfa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp5a5o_mfu {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:19:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/83c035a0-880b-4170-98bc-b18cae712cfa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp5a5o_mfu" returned: 0 in 0.054s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:00 user nova-compute[74840]: DEBUG nova.network.neutron [req-91984cc9-b6df-40f8-b5ab-baf13260d936 req-10227358-3bac-4b2e-a32c-9f7b76eda897 service nova] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Updated VIF entry in instance network info cache for port 75ded381-268f-487c-bf3b-1aad4d3909ae. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:20:00 user nova-compute[74840]: DEBUG nova.network.neutron [req-91984cc9-b6df-40f8-b5ab-baf13260d936 req-10227358-3bac-4b2e-a32c-9f7b76eda897 service nova] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Updating instance_info_cache with network_info: [{"id": "75ded381-268f-487c-bf3b-1aad4d3909ae", "address": "fa:16:3e:56:38:57", "network": {"id": "22514061-e390-4fd9-943b-0dedf57a323e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1978465085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c8bdf3f4296441799bd44bd993d3111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75ded381-26", "ovs_interfaceid": "75ded381-268f-487c-bf3b-1aad4d3909ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:20:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-91984cc9-b6df-40f8-b5ab-baf13260d936 req-10227358-3bac-4b2e-a32c-9f7b76eda897 service nova] Releasing lock "refresh_cache-83c035a0-880b-4170-98bc-b18cae712cfa" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:20:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "4f6c75c0-e820-47eb-be3e-51179b6df1a3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:20:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "4f6c75c0-e820-47eb-be3e-51179b6df1a3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:20:00 user nova-compute[74840]: DEBUG nova.compute.manager [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Starting instance... {{(pid=74840) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 12:20:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:20:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:20:00 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:20:00 user nova-compute[74840]: INFO nova.compute.claims [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Claim successful on node user
Nov 08 12:20:00 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:20:00 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:20:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.378s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:20:00 user nova-compute[74840]: DEBUG nova.compute.manager [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Start building networks asynchronously for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 12:20:00 user nova-compute[74840]: DEBUG nova.compute.manager [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Allocating IP information in the background. {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 12:20:00 user nova-compute[74840]: DEBUG nova.network.neutron [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 12:20:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:00 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 12:20:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:00 user nova-compute[74840]: DEBUG nova.compute.manager [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Start building block device mappings for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 12:20:00 user nova-compute[74840]: DEBUG nova.policy [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e172625e7f334a2b896b2738bbf49aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ec082e08ddf4477a721e410fe944d10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 12:20:00 user nova-compute[74840]: DEBUG nova.compute.manager [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Start spawning the instance on the hypervisor. {{(pid=74840) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 12:20:00 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:20:00 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Creating image(s)
Nov 08 12:20:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "/opt/stack/data/nova/instances/4f6c75c0-e820-47eb-be3e-51179b6df1a3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:20:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "/opt/stack/data/nova/instances/4f6c75c0-e820-47eb-be3e-51179b6df1a3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:20:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "/opt/stack/data/nova/instances/4f6c75c0-e820-47eb-be3e-51179b6df1a3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.031s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:20:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:01 user nova-compute[74840]: DEBUG nova.compute.manager [req-f81c7de5-e37d-4c6f-8ee4-e14afc2c442d req-d9a2be6f-5e5d-4d8d-9198-fc04321091a6 service nova] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Received event network-vif-plugged-75ded381-268f-487c-bf3b-1aad4d3909ae {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:20:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-f81c7de5-e37d-4c6f-8ee4-e14afc2c442d req-d9a2be6f-5e5d-4d8d-9198-fc04321091a6 service nova] Acquiring lock "83c035a0-880b-4170-98bc-b18cae712cfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:20:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-f81c7de5-e37d-4c6f-8ee4-e14afc2c442d req-d9a2be6f-5e5d-4d8d-9198-fc04321091a6 service nova] Lock "83c035a0-880b-4170-98bc-b18cae712cfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:20:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-f81c7de5-e37d-4c6f-8ee4-e14afc2c442d req-d9a2be6f-5e5d-4d8d-9198-fc04321091a6 service nova] Lock "83c035a0-880b-4170-98bc-b18cae712cfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:20:01 user nova-compute[74840]: DEBUG nova.compute.manager [req-f81c7de5-e37d-4c6f-8ee4-e14afc2c442d req-d9a2be6f-5e5d-4d8d-9198-fc04321091a6 service nova] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] No waiting events found dispatching network-vif-plugged-75ded381-268f-487c-bf3b-1aad4d3909ae {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:20:01 user nova-compute[74840]: WARNING nova.compute.manager [req-f81c7de5-e37d-4c6f-8ee4-e14afc2c442d req-d9a2be6f-5e5d-4d8d-9198-fc04321091a6 service nova] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Received unexpected event network-vif-plugged-75ded381-268f-487c-bf3b-1aad4d3909ae for instance with vm_state building and task_state spawning.
Nov 08 12:20:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.269s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "5d26578eba85497f494c575690c4248f381a0fe6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:20:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:20:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.215s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/4f6c75c0-e820-47eb-be3e-51179b6df1a3/disk 1073741824 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/4f6c75c0-e820-47eb-be3e-51179b6df1a3/disk 1073741824" returned: 0 in 0.070s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:20:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:01 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:20:01 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Cleaning up deleted instances {{(pid=74840) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 12:20:01 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] There are 0 instances to clean {{(pid=74840) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 12:20:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.209s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:01 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4f6c75c0-e820-47eb-be3e-51179b6df1a3/disk. size=1073741824 {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 12:20:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f6c75c0-e820-47eb-be3e-51179b6df1a3/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f6c75c0-e820-47eb-be3e-51179b6df1a3/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:02 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Cannot resize image /opt/stack/data/nova/instances/4f6c75c0-e820-47eb-be3e-51179b6df1a3/disk to a smaller size. {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 12:20:02 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Created local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 12:20:02 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Ensure instance console log exists: /opt/stack/data/nova/instances/4f6c75c0-e820-47eb-be3e-51179b6df1a3/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:20:02 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:20:02 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:20:02 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:20:02 user nova-compute[74840]: DEBUG nova.network.neutron [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Successfully created port: 2f320dfe-5946-496e-81e8-922587cc240b {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:20:02 user nova-compute[74840]: DEBUG nova.network.neutron [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Successfully updated port: 2f320dfe-5946-496e-81e8-922587cc240b {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:20:02 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "refresh_cache-4f6c75c0-e820-47eb-be3e-51179b6df1a3" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:20:02 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquired lock "refresh_cache-4f6c75c0-e820-47eb-be3e-51179b6df1a3" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:20:02 user nova-compute[74840]: DEBUG nova.network.neutron [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:20:02 user nova-compute[74840]: DEBUG nova.network.neutron [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG nova.network.neutron [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Updating instance_info_cache with network_info: [{"id": "2f320dfe-5946-496e-81e8-922587cc240b", "address": "fa:16:3e:ed:7d:8e", "network": {"id": "381cad9f-376a-4335-95a4-4824aa0d7fad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1035058856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ec082e08ddf4477a721e410fe944d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f320dfe-59", "ovs_interfaceid": "2f320dfe-5946-496e-81e8-922587cc240b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Releasing lock "refresh_cache-4f6c75c0-e820-47eb-be3e-51179b6df1a3" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG nova.compute.manager [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Instance network_info: |[{"id": "2f320dfe-5946-496e-81e8-922587cc240b", "address": "fa:16:3e:ed:7d:8e", "network": {"id": "381cad9f-376a-4335-95a4-4824aa0d7fad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1035058856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ec082e08ddf4477a721e410fe944d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f320dfe-59", "ovs_interfaceid": "2f320dfe-5946-496e-81e8-922587cc240b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Start _get_guest_xml network_info=[{"id": "2f320dfe-5946-496e-81e8-922587cc240b", "address": "fa:16:3e:ed:7d:8e", "network": {"id": "381cad9f-376a-4335-95a4-4824aa0d7fad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1035058856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ec082e08ddf4477a721e410fe944d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f320dfe-59", "ovs_interfaceid": "2f320dfe-5946-496e-81e8-922587cc240b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'image_id': '4fa17706-d304-4117-a420-dab994c703dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG nova.compute.manager [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:20:03 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Instance spawned successfully.
Nov 08 12:20:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:20:03 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:20:03 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:20:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:19:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-959394704',display_name='tempest-AttachVolumeNegativeTest-server-959394704',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-959394704',id=23,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAiadOEGIpof+u0WfpATxWsGryrSTrRf2i9G9993iMEUd2kCtbc/mKLObammRGOTVQJdLo5MwAP4V6v3eAfC4wfOCJX1O+E+dpMLOGAxDcpf2pE0Ot7IAaSgyXg++yPG3g==',key_name='tempest-keypair-1008695350',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ec082e08ddf4477a721e410fe944d10',ramdisk_id='',reservation_id='r-48ng4pro',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1526881991',owner_user_name='tempest-AttachVolumeNegativeTest-1526881991-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:20:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e172625e7f334a2b896b2738bbf49aa8',uuid=4f6c75c0-e820-47eb-be3e-51179b6df1a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f320dfe-5946-496e-81e8-922587cc240b", "address": "fa:16:3e:ed:7d:8e", "network": {"id": "381cad9f-376a-4335-95a4-4824aa0d7fad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1035058856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ec082e08ddf4477a721e410fe944d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f320dfe-59", "ovs_interfaceid": "2f320dfe-5946-496e-81e8-922587cc240b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Converting VIF {"id": "2f320dfe-5946-496e-81e8-922587cc240b", "address": "fa:16:3e:ed:7d:8e", "network": {"id": "381cad9f-376a-4335-95a4-4824aa0d7fad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1035058856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ec082e08ddf4477a721e410fe944d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f320dfe-59", "ovs_interfaceid": "2f320dfe-5946-496e-81e8-922587cc240b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:7d:8e,bridge_name='br-int',has_traffic_filtering=True,id=2f320dfe-5946-496e-81e8-922587cc240b,network=Network(381cad9f-376a-4335-95a4-4824aa0d7fad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f320dfe-59') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG nova.objects.instance [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f6c75c0-e820-47eb-be3e-51179b6df1a3 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG nova.compute.manager [req-45037ed6-613b-4872-81cf-e509904668af req-317ce1ef-370d-4004-8dc4-94e6a9e1f4ff service nova] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Received event network-vif-plugged-75ded381-268f-487c-bf3b-1aad4d3909ae {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-45037ed6-613b-4872-81cf-e509904668af req-317ce1ef-370d-4004-8dc4-94e6a9e1f4ff service nova] Acquiring lock "83c035a0-880b-4170-98bc-b18cae712cfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-45037ed6-613b-4872-81cf-e509904668af req-317ce1ef-370d-4004-8dc4-94e6a9e1f4ff service nova] Lock "83c035a0-880b-4170-98bc-b18cae712cfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-45037ed6-613b-4872-81cf-e509904668af req-317ce1ef-370d-4004-8dc4-94e6a9e1f4ff service nova] Lock "83c035a0-880b-4170-98bc-b18cae712cfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG nova.compute.manager [req-45037ed6-613b-4872-81cf-e509904668af req-317ce1ef-370d-4004-8dc4-94e6a9e1f4ff service nova] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] No waiting events found dispatching network-vif-plugged-75ded381-268f-487c-bf3b-1aad4d3909ae {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:20:03 user nova-compute[74840]: WARNING nova.compute.manager [req-45037ed6-613b-4872-81cf-e509904668af req-317ce1ef-370d-4004-8dc4-94e6a9e1f4ff service nova] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Received unexpected event network-vif-plugged-75ded381-268f-487c-bf3b-1aad4d3909ae for instance with vm_state building and task_state spawning.
Nov 08 12:20:03 user nova-compute[74840]: DEBUG nova.compute.manager [req-45037ed6-613b-4872-81cf-e509904668af req-317ce1ef-370d-4004-8dc4-94e6a9e1f4ff service nova] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Received event network-changed-2f320dfe-5946-496e-81e8-922587cc240b {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG nova.compute.manager [req-45037ed6-613b-4872-81cf-e509904668af req-317ce1ef-370d-4004-8dc4-94e6a9e1f4ff service nova] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Refreshing instance network info cache due to event network-changed-2f320dfe-5946-496e-81e8-922587cc240b. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-45037ed6-613b-4872-81cf-e509904668af req-317ce1ef-370d-4004-8dc4-94e6a9e1f4ff service nova] Acquiring lock "refresh_cache-4f6c75c0-e820-47eb-be3e-51179b6df1a3" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-45037ed6-613b-4872-81cf-e509904668af req-317ce1ef-370d-4004-8dc4-94e6a9e1f4ff service nova] Acquired lock "refresh_cache-4f6c75c0-e820-47eb-be3e-51179b6df1a3" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG nova.network.neutron [req-45037ed6-613b-4872-81cf-e509904668af req-317ce1ef-370d-4004-8dc4-94e6a9e1f4ff service nova] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Refreshing network info cache for port 2f320dfe-5946-496e-81e8-922587cc240b {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Found default for hw_cdrom_bus of ide {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Found default for hw_disk_bus of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Found default for hw_video_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Found default for hw_vif_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:20:03 user nova-compute[74840]:   <uuid>4f6c75c0-e820-47eb-be3e-51179b6df1a3</uuid>
Nov 08 12:20:03 user nova-compute[74840]:   <name>instance-00000017</name>
Nov 08 12:20:03 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:20:03 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:20:03 user nova-compute[74840]:   <metadata>
Nov 08 12:20:03 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:20:03 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:20:03 user nova-compute[74840]:       <nova:name>tempest-AttachVolumeNegativeTest-server-959394704</nova:name>
Nov 08 12:20:03 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:20:03</nova:creationTime>
Nov 08 12:20:03 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:20:03 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:20:03 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:20:03 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:20:03 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:20:03 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:20:03 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:20:03 user nova-compute[74840]:       <nova:owner>
Nov 08 12:20:03 user nova-compute[74840]:         <nova:user uuid="e172625e7f334a2b896b2738bbf49aa8">tempest-AttachVolumeNegativeTest-1526881991-project-member</nova:user>
Nov 08 12:20:03 user nova-compute[74840]:         <nova:project uuid="3ec082e08ddf4477a721e410fe944d10">tempest-AttachVolumeNegativeTest-1526881991</nova:project>
Nov 08 12:20:03 user nova-compute[74840]:       </nova:owner>
Nov 08 12:20:03 user nova-compute[74840]:       <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:20:03 user nova-compute[74840]:       <nova:ports>
Nov 08 12:20:03 user nova-compute[74840]:         <nova:port uuid="2f320dfe-5946-496e-81e8-922587cc240b">
Nov 08 12:20:03 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 08 12:20:03 user nova-compute[74840]:         </nova:port>
Nov 08 12:20:03 user nova-compute[74840]:       </nova:ports>
Nov 08 12:20:03 user nova-compute[74840]:     </nova:instance>
Nov 08 12:20:03 user nova-compute[74840]:   </metadata>
Nov 08 12:20:03 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:20:03 user nova-compute[74840]:     <system>
Nov 08 12:20:03 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:20:03 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:20:03 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:20:03 user nova-compute[74840]:       <entry name="serial">4f6c75c0-e820-47eb-be3e-51179b6df1a3</entry>
Nov 08 12:20:03 user nova-compute[74840]:       <entry name="uuid">4f6c75c0-e820-47eb-be3e-51179b6df1a3</entry>
Nov 08 12:20:03 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:20:03 user nova-compute[74840]:     </system>
Nov 08 12:20:03 user nova-compute[74840]:   </sysinfo>
Nov 08 12:20:03 user nova-compute[74840]:   <os>
Nov 08 12:20:03 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:20:03 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:20:03 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:20:03 user nova-compute[74840]:   </os>
Nov 08 12:20:03 user nova-compute[74840]:   <features>
Nov 08 12:20:03 user nova-compute[74840]:     <acpi/>
Nov 08 12:20:03 user nova-compute[74840]:     <apic/>
Nov 08 12:20:03 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:20:03 user nova-compute[74840]:   </features>
Nov 08 12:20:03 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:20:03 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:20:03 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:20:03 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:20:03 user nova-compute[74840]:   </clock>
Nov 08 12:20:03 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:20:03 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:20:03 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:20:03 user nova-compute[74840]:   </cpu>
Nov 08 12:20:03 user nova-compute[74840]:   <devices>
Nov 08 12:20:03 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:20:03 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:20:03 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/4f6c75c0-e820-47eb-be3e-51179b6df1a3/disk"/>
Nov 08 12:20:03 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:20:03 user nova-compute[74840]:     </disk>
Nov 08 12:20:03 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:20:03 user nova-compute[74840]:       <mac address="fa:16:3e:ed:7d:8e"/>
Nov 08 12:20:03 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:20:03 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:20:03 user nova-compute[74840]:       <target dev="tap2f320dfe-59"/>
Nov 08 12:20:03 user nova-compute[74840]:     </interface>
Nov 08 12:20:03 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:20:03 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/4f6c75c0-e820-47eb-be3e-51179b6df1a3/console.log" append="off"/>
Nov 08 12:20:03 user nova-compute[74840]:     </serial>
Nov 08 12:20:03 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:20:03 user nova-compute[74840]:     <video>
Nov 08 12:20:03 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:20:03 user nova-compute[74840]:     </video>
Nov 08 12:20:03 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:20:03 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:20:03 user nova-compute[74840]:     </rng>
Nov 08 12:20:03 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:20:03 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:20:03 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:20:03 user nova-compute[74840]:     </memballoon>
Nov 08 12:20:03 user nova-compute[74840]:   </devices>
Nov 08 12:20:03 user nova-compute[74840]: </domain>
Nov 08 12:20:03 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:19:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-959394704',display_name='tempest-AttachVolumeNegativeTest-server-959394704',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-959394704',id=23,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAiadOEGIpof+u0WfpATxWsGryrSTrRf2i9G9993iMEUd2kCtbc/mKLObammRGOTVQJdLo5MwAP4V6v3eAfC4wfOCJX1O+E+dpMLOGAxDcpf2pE0Ot7IAaSgyXg++yPG3g==',key_name='tempest-keypair-1008695350',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ec082e08ddf4477a721e410fe944d10',ramdisk_id='',reservation_id='r-48ng4pro',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1526881991',owner_user_name='tempest-AttachVolumeNegativeTest-1526881991-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:20:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e172625e7f334a2b896b2738bbf49aa8',uuid=4f6c75c0-e820-47eb-be3e-51179b6df1a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f320dfe-5946-496e-81e8-922587cc240b", "address": "fa:16:3e:ed:7d:8e", "network": {"id": "381cad9f-376a-4335-95a4-4824aa0d7fad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1035058856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ec082e08ddf4477a721e410fe944d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f320dfe-59", "ovs_interfaceid": "2f320dfe-5946-496e-81e8-922587cc240b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Converting VIF {"id": "2f320dfe-5946-496e-81e8-922587cc240b", "address": "fa:16:3e:ed:7d:8e", "network": {"id": "381cad9f-376a-4335-95a4-4824aa0d7fad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1035058856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ec082e08ddf4477a721e410fe944d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f320dfe-59", "ovs_interfaceid": "2f320dfe-5946-496e-81e8-922587cc240b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:7d:8e,bridge_name='br-int',has_traffic_filtering=True,id=2f320dfe-5946-496e-81e8-922587cc240b,network=Network(381cad9f-376a-4335-95a4-4824aa0d7fad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f320dfe-59') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG os_vif [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:7d:8e,bridge_name='br-int',has_traffic_filtering=True,id=2f320dfe-5946-496e-81e8-922587cc240b,network=Network(381cad9f-376a-4335-95a4-4824aa0d7fad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f320dfe-59') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '034d36f0-3758-58db-81bf-8eec9cd1d81c', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f320dfe-59, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2f320dfe-59, col_values=(('qos', UUID('a574c0c9-1349-4c2b-8804-8660dede5bb0')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2f320dfe-59, col_values=(('external_ids', {'iface-id': '2f320dfe-5946-496e-81e8-922587cc240b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:7d:8e', 'vm-uuid': '4f6c75c0-e820-47eb-be3e-51179b6df1a3'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:03 user nova-compute[74840]: INFO os_vif [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:7d:8e,bridge_name='br-int',has_traffic_filtering=True,id=2f320dfe-5946-496e-81e8-922587cc240b,network=Network(381cad9f-376a-4335-95a4-4824aa0d7fad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f320dfe-59')
Nov 08 12:20:03 user nova-compute[74840]: INFO nova.compute.manager [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Took 6.79 seconds to spawn the instance on the hypervisor.
Nov 08 12:20:03 user nova-compute[74840]: DEBUG nova.compute.manager [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] No VIF found with MAC fa:16:3e:ed:7d:8e, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:20:03 user nova-compute[74840]: INFO nova.compute.manager [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Took 8.19 seconds to build instance.
Nov 08 12:20:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f6ea5264-f7d3-4d3b-89ad-2bd9d5fe38ff tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Lock "83c035a0-880b-4170-98bc-b18cae712cfa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.338s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG nova.network.neutron [req-45037ed6-613b-4872-81cf-e509904668af req-317ce1ef-370d-4004-8dc4-94e6a9e1f4ff service nova] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Updated VIF entry in instance network info cache for port 2f320dfe-5946-496e-81e8-922587cc240b. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG nova.network.neutron [req-45037ed6-613b-4872-81cf-e509904668af req-317ce1ef-370d-4004-8dc4-94e6a9e1f4ff service nova] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Updating instance_info_cache with network_info: [{"id": "2f320dfe-5946-496e-81e8-922587cc240b", "address": "fa:16:3e:ed:7d:8e", "network": {"id": "381cad9f-376a-4335-95a4-4824aa0d7fad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1035058856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ec082e08ddf4477a721e410fe944d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f320dfe-59", "ovs_interfaceid": "2f320dfe-5946-496e-81e8-922587cc240b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:20:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-45037ed6-613b-4872-81cf-e509904668af req-317ce1ef-370d-4004-8dc4-94e6a9e1f4ff service nova] Releasing lock "refresh_cache-4f6c75c0-e820-47eb-be3e-51179b6df1a3" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:20:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:05 user nova-compute[74840]: DEBUG nova.compute.manager [req-3d3f5cd0-961d-479e-bfcd-ce308b2825af req-c97079b3-2fee-4a54-8194-f35593a85438 service nova] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Received event network-vif-plugged-2f320dfe-5946-496e-81e8-922587cc240b {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:20:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3d3f5cd0-961d-479e-bfcd-ce308b2825af req-c97079b3-2fee-4a54-8194-f35593a85438 service nova] Acquiring lock "4f6c75c0-e820-47eb-be3e-51179b6df1a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:20:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3d3f5cd0-961d-479e-bfcd-ce308b2825af req-c97079b3-2fee-4a54-8194-f35593a85438 service nova] Lock "4f6c75c0-e820-47eb-be3e-51179b6df1a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:20:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3d3f5cd0-961d-479e-bfcd-ce308b2825af req-c97079b3-2fee-4a54-8194-f35593a85438 service nova] Lock "4f6c75c0-e820-47eb-be3e-51179b6df1a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:20:05 user nova-compute[74840]: DEBUG nova.compute.manager [req-3d3f5cd0-961d-479e-bfcd-ce308b2825af req-c97079b3-2fee-4a54-8194-f35593a85438 service nova] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] No waiting events found dispatching network-vif-plugged-2f320dfe-5946-496e-81e8-922587cc240b {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:20:05 user nova-compute[74840]: WARNING nova.compute.manager [req-3d3f5cd0-961d-479e-bfcd-ce308b2825af req-c97079b3-2fee-4a54-8194-f35593a85438 service nova] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Received unexpected event network-vif-plugged-2f320dfe-5946-496e-81e8-922587cc240b for instance with vm_state building and task_state spawning.
Nov 08 12:20:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:07 user nova-compute[74840]: DEBUG nova.compute.manager [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:20:07 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:20:07 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Instance spawned successfully.
Nov 08 12:20:07 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:20:07 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Found default for hw_cdrom_bus of ide {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:20:07 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Found default for hw_disk_bus of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:20:07 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:20:07 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:20:07 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Found default for hw_video_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:20:07 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Found default for hw_vif_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:20:07 user nova-compute[74840]: DEBUG nova.compute.manager [req-e6b3bbdd-fd9f-493b-99b7-3b21d094cdd9 req-af691bd2-885f-4e0a-b5f5-eb8221e4b3a6 service nova] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Received event network-vif-plugged-2f320dfe-5946-496e-81e8-922587cc240b {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:20:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e6b3bbdd-fd9f-493b-99b7-3b21d094cdd9 req-af691bd2-885f-4e0a-b5f5-eb8221e4b3a6 service nova] Acquiring lock "4f6c75c0-e820-47eb-be3e-51179b6df1a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:20:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e6b3bbdd-fd9f-493b-99b7-3b21d094cdd9 req-af691bd2-885f-4e0a-b5f5-eb8221e4b3a6 service nova] Lock "4f6c75c0-e820-47eb-be3e-51179b6df1a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:20:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e6b3bbdd-fd9f-493b-99b7-3b21d094cdd9 req-af691bd2-885f-4e0a-b5f5-eb8221e4b3a6 service nova] Lock "4f6c75c0-e820-47eb-be3e-51179b6df1a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:20:07 user nova-compute[74840]: DEBUG nova.compute.manager [req-e6b3bbdd-fd9f-493b-99b7-3b21d094cdd9 req-af691bd2-885f-4e0a-b5f5-eb8221e4b3a6 service nova] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] No waiting events found dispatching network-vif-plugged-2f320dfe-5946-496e-81e8-922587cc240b {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:20:07 user nova-compute[74840]: WARNING nova.compute.manager [req-e6b3bbdd-fd9f-493b-99b7-3b21d094cdd9 req-af691bd2-885f-4e0a-b5f5-eb8221e4b3a6 service nova] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Received unexpected event network-vif-plugged-2f320dfe-5946-496e-81e8-922587cc240b for instance with vm_state building and task_state spawning.
Nov 08 12:20:07 user nova-compute[74840]: INFO nova.compute.manager [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Took 6.55 seconds to spawn the instance on the hypervisor.
Nov 08 12:20:07 user nova-compute[74840]: DEBUG nova.compute.manager [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:20:07 user nova-compute[74840]: INFO nova.compute.manager [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Took 7.37 seconds to build instance.
Nov 08 12:20:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ffb3aa37-c3ee-408a-89a4-e9f18726336c tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "4f6c75c0-e820-47eb-be3e-51179b6df1a3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.480s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:20:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:13 user nova-compute[74840]: INFO nova.virt.block_device [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Booting with volume 1778abb2-81cd-4a05-8063-b6ea529685a7 at /dev/vdc
Nov 08 12:20:13 user nova-compute[74840]: DEBUG os_brick.utils [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:20:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:13 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9c63ba-fe25-4dc9-a939-bc389372266a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c8228a11e03c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:20:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:13 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd378d8-e535-4901-9483-21c46ee4b6b6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:20:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:13 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4fc582-ee26-448c-aa1e-172a0ca07aaf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:20:13 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5dcf9a-4030-4a95-8360-8aaf915f9994]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:20:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Running cmd (subprocess): nvme version {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] 'nvme version' failed. Not Retrying. {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:20:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] nvme not present on system {{(pid=74840) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 12:20:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:20:13 user nova-compute[74840]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 12:20:13 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[03fbcde4-60c2-49d7-8d4c-0a91569227cd]: (4, '') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:20:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74840) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 12:20:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 12:20:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] LIGHTOS: no hostnqn found. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 12:20:13 user nova-compute[74840]: DEBUG os_brick.utils [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c8228a11e03c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:20:13 user nova-compute[74840]: DEBUG nova.virt.block_device [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Updating existing volume attachment record: 69428147-ca72-4c20-96e2-96df6c8b6318 {{(pid=74840) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 12:20:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0e28fe11-f8f9-48ee-91c7-8c3342e86256 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Acquiring lock "e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:20:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0e28fe11-f8f9-48ee-91c7-8c3342e86256 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Lock "e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:20:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0e28fe11-f8f9-48ee-91c7-8c3342e86256 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Acquiring lock "e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:20:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0e28fe11-f8f9-48ee-91c7-8c3342e86256 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Lock "e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:20:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0e28fe11-f8f9-48ee-91c7-8c3342e86256 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Lock "e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:20:23 user nova-compute[74840]: INFO nova.compute.manager [None req-0e28fe11-f8f9-48ee-91c7-8c3342e86256 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Terminating instance
Nov 08 12:20:23 user nova-compute[74840]: DEBUG nova.compute.manager [None req-0e28fe11-f8f9-48ee-91c7-8c3342e86256 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Start destroying the instance on the hypervisor. {{(pid=74840) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 12:20:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:23 user nova-compute[74840]: DEBUG nova.compute.manager [req-6dc333f8-ad66-4b17-ae8a-0debaced181f req-f83c48dc-9865-4d6f-81f2-63168fd671c8 service nova] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Received event network-vif-unplugged-3d85fb08-7cf4-4f26-a8d0-9de9095f874c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:20:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-6dc333f8-ad66-4b17-ae8a-0debaced181f req-f83c48dc-9865-4d6f-81f2-63168fd671c8 service nova] Acquiring lock "e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:20:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-6dc333f8-ad66-4b17-ae8a-0debaced181f req-f83c48dc-9865-4d6f-81f2-63168fd671c8 service nova] Lock "e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:20:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-6dc333f8-ad66-4b17-ae8a-0debaced181f req-f83c48dc-9865-4d6f-81f2-63168fd671c8 service nova] Lock "e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:20:23 user nova-compute[74840]: DEBUG nova.compute.manager [req-6dc333f8-ad66-4b17-ae8a-0debaced181f req-f83c48dc-9865-4d6f-81f2-63168fd671c8 service nova] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] No waiting events found dispatching network-vif-unplugged-3d85fb08-7cf4-4f26-a8d0-9de9095f874c {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:20:23 user nova-compute[74840]: DEBUG nova.compute.manager [req-6dc333f8-ad66-4b17-ae8a-0debaced181f req-f83c48dc-9865-4d6f-81f2-63168fd671c8 service nova] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Received event network-vif-unplugged-3d85fb08-7cf4-4f26-a8d0-9de9095f874c for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:20:23 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Instance destroyed successfully.
Nov 08 12:20:23 user nova-compute[74840]: DEBUG nova.objects.instance [None req-0e28fe11-f8f9-48ee-91c7-8c3342e86256 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Lazy-loading 'resources' on Instance uuid e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:20:23 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-0e28fe11-f8f9-48ee-91c7-8c3342e86256 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:15:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-539454341',display_name='tempest-TestServerVolumeAttachmentScenario-server-539454341',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-539454341',id=14,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPIUCivH5dqp+8G+VDAaB9quGsl40+835InkBq91B7snyaqGexenRT97XM03D/07Q3Ndqly9DDY98ZaKE/wpDZRLx2V2mkhsIyrvIdpLhsxGYB3NQnaw7DdUqJK2uZvrmg==',key_name='tempest-keypair-1872878997',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:15:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='24eea35667934f72bef26febd10192b3',ramdisk_id='',reservation_id='r-um0chbdc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-447500273',owner_user_name='tempest-TestServerVolumeAttachmentScenario-447500273-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:15:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='676dcf6c3bb441b48da69412ced1c019',uuid=e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d85fb08-7cf4-4f26-a8d0-9de9095f874c", "address": "fa:16:3e:6e:13:a8", "network": {"id": "a6dec0d8-d21a-41d6-9d3a-effe04e7f845", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-780900048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24eea35667934f72bef26febd10192b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d85fb08-7c", "ovs_interfaceid": "3d85fb08-7cf4-4f26-a8d0-9de9095f874c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:20:23 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-0e28fe11-f8f9-48ee-91c7-8c3342e86256 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Converting VIF {"id": "3d85fb08-7cf4-4f26-a8d0-9de9095f874c", "address": "fa:16:3e:6e:13:a8", "network": {"id": "a6dec0d8-d21a-41d6-9d3a-effe04e7f845", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-780900048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24eea35667934f72bef26febd10192b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d85fb08-7c", "ovs_interfaceid": "3d85fb08-7cf4-4f26-a8d0-9de9095f874c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:20:23 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-0e28fe11-f8f9-48ee-91c7-8c3342e86256 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:13:a8,bridge_name='br-int',has_traffic_filtering=True,id=3d85fb08-7cf4-4f26-a8d0-9de9095f874c,network=Network(a6dec0d8-d21a-41d6-9d3a-effe04e7f845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d85fb08-7c') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:20:23 user nova-compute[74840]: DEBUG os_vif [None req-0e28fe11-f8f9-48ee-91c7-8c3342e86256 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:13:a8,bridge_name='br-int',has_traffic_filtering=True,id=3d85fb08-7cf4-4f26-a8d0-9de9095f874c,network=Network(a6dec0d8-d21a-41d6-9d3a-effe04e7f845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d85fb08-7c') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:20:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d85fb08-7c, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:20:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:20:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5d911517-193c-48e0-b76c-d12d085ee5d5) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:20:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:20:23 user nova-compute[74840]: INFO os_vif [None req-0e28fe11-f8f9-48ee-91c7-8c3342e86256 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:13:a8,bridge_name='br-int',has_traffic_filtering=True,id=3d85fb08-7cf4-4f26-a8d0-9de9095f874c,network=Network(a6dec0d8-d21a-41d6-9d3a-effe04e7f845),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d85fb08-7c')
Nov 08 12:20:23 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-0e28fe11-f8f9-48ee-91c7-8c3342e86256 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Deleting instance files /opt/stack/data/nova/instances/e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf_del
Nov 08 12:20:23 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-0e28fe11-f8f9-48ee-91c7-8c3342e86256 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Deletion of /opt/stack/data/nova/instances/e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf_del complete
Nov 08 12:20:24 user nova-compute[74840]: INFO nova.compute.manager [None req-0e28fe11-f8f9-48ee-91c7-8c3342e86256 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 08 12:20:24 user nova-compute[74840]: DEBUG oslo.service.loopingcall [None req-0e28fe11-f8f9-48ee-91c7-8c3342e86256 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74840) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 12:20:24 user nova-compute[74840]: DEBUG nova.compute.manager [-] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Deallocating network for instance {{(pid=74840) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 12:20:24 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] deallocate_for_instance() {{(pid=74840) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 12:20:24 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Calling os-brick to attach iSCSI Volume {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 12:20:24 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fwaUcTXC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:20:24 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:20:24 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:20:24 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:20:24 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:20:24 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:20:24 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:20:24 user nova-compute[74840]: INFO os_brick.initiator.connectors.iscsi [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 12:20:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e -p 172.16.0.220:3260 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:24 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[02aabe8c-ade4-483e-bd89-92addb6d35d5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:20:24 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 12:20:24 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:20:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e -p 172.16.0.220:3260 --interface default --op new {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:24 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfa95d0-6640-405f-90c5-928621ff504a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e] added\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:20:24 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e] added
Nov 08 12:20:24 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:20:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:24 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4c1297-93f2-4e06-b7f4-06677be6604f]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:20:24 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:20:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:24 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3cf2cd-0dcd-4a8f-8739-bd9e8de14f95]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:20:24 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:20:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fwaUcTXC {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fwaUcTXC" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:24 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6065064-a7b7-49cd-993a-81da0e52fd78]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:20:24 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fwaUcTXC'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:20:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:24 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3f46e1-fa6c-42b8-8e12-42fff408e0e2]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:20:24 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:20:25 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:25 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:25 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a2f943-c46c-472a-9a80-98cdb95d30ce]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:20:25 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 12:20:25 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:20:25 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 12:20:25 user nova-compute[74840]:  {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:20:25 user nova-compute[74840]: WARNING os_brick.initiator.connectors.iscsi [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 12:20:25 user nova-compute[74840]: 
Nov 08 12:20:25 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e -p 172.16.0.220:3260 --login {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:25 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:25 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[056ea16a-267e-482d-bf93-3379c235e5f5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:20:25 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e, portal: 172.16.0.220,3260]
Nov 08 12:20:25 user nova-compute[74840]: Login to [iface: default, target: iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e, portal: 172.16.0.220,3260] successful.
Nov 08 12:20:25 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:20:25 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:25 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:25 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba030b2-fc11-4299-8625-10e31a885d6a]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:20:25 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:20:25 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:25 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:25 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9bd068-5572-4ca5-92cb-17776b01ed22]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:20:25 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e (non-flash)
Nov 08 12:20:25 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:20:25 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e (non-flash)
Nov 08 12:20:25 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:20:25 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:20:25 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Connected to 172.16.0.220:3260 {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 12:20:25 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=74840) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 12:20:25 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74840) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 12:20:25 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:25 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:25 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8959be3-b003-49ed-ae38-ee426f805716]: (4, ('- - 0', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:20:25 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:20:25 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fwaUcTXC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 12:20:25 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:20:25 user nova-compute[74840]: INFO nova.compute.manager [-] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Took 1.19 seconds to deallocate network for instance.
Nov 08 12:20:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0e28fe11-f8f9-48ee-91c7-8c3342e86256 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:20:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0e28fe11-f8f9-48ee-91c7-8c3342e86256 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:20:25 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-0e28fe11-f8f9-48ee-91c7-8c3342e86256 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Refreshing inventories for resource provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 12:20:25 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-0e28fe11-f8f9-48ee-91c7-8c3342e86256 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Updating ProviderTree inventory for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 12:20:25 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-0e28fe11-f8f9-48ee-91c7-8c3342e86256 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Updating inventory in ProviderTree for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 12:20:25 user nova-compute[74840]: DEBUG nova.compute.manager [req-0c297e2a-a130-4df3-a82d-63a570022491 req-ecc8b7fd-8e22-4923-9105-232132cda505 service nova] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Received event network-vif-plugged-3d85fb08-7cf4-4f26-a8d0-9de9095f874c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:20:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0c297e2a-a130-4df3-a82d-63a570022491 req-ecc8b7fd-8e22-4923-9105-232132cda505 service nova] Acquiring lock "e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:20:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0c297e2a-a130-4df3-a82d-63a570022491 req-ecc8b7fd-8e22-4923-9105-232132cda505 service nova] Lock "e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:20:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0c297e2a-a130-4df3-a82d-63a570022491 req-ecc8b7fd-8e22-4923-9105-232132cda505 service nova] Lock "e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:20:25 user nova-compute[74840]: DEBUG nova.compute.manager [req-0c297e2a-a130-4df3-a82d-63a570022491 req-ecc8b7fd-8e22-4923-9105-232132cda505 service nova] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] No waiting events found dispatching network-vif-plugged-3d85fb08-7cf4-4f26-a8d0-9de9095f874c {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:20:25 user nova-compute[74840]: WARNING nova.compute.manager [req-0c297e2a-a130-4df3-a82d-63a570022491 req-ecc8b7fd-8e22-4923-9105-232132cda505 service nova] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Received unexpected event network-vif-plugged-3d85fb08-7cf4-4f26-a8d0-9de9095f874c for instance with vm_state deleted and task_state None.
Nov 08 12:20:25 user nova-compute[74840]: DEBUG nova.compute.manager [req-0c297e2a-a130-4df3-a82d-63a570022491 req-ecc8b7fd-8e22-4923-9105-232132cda505 service nova] [instance: e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf] Received event network-vif-deleted-3d85fb08-7cf4-4f26-a8d0-9de9095f874c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:20:25 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-0e28fe11-f8f9-48ee-91c7-8c3342e86256 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Refreshing aggregate associations for resource provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e, aggregates: None {{(pid=74840) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 12:20:25 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-0e28fe11-f8f9-48ee-91c7-8c3342e86256 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Refreshing trait associations for resource provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=74840) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 12:20:25 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-0e28fe11-f8f9-48ee-91c7-8c3342e86256 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:20:25 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-0e28fe11-f8f9-48ee-91c7-8c3342e86256 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:20:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0e28fe11-f8f9-48ee-91c7-8c3342e86256 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.587s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:20:25 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-0e28fe11-f8f9-48ee-91c7-8c3342e86256 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Deleted allocations for instance e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf
Nov 08 12:20:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:26 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0e28fe11-f8f9-48ee-91c7-8c3342e86256 tempest-TestServerVolumeAttachmentScenario-447500273 tempest-TestServerVolumeAttachmentScenario-447500273-project-member] Lock "e218cd5c-4f3a-43ca-bcfa-bcb10e8d1bcf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.991s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:20:26 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:20:26 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '26633646636396665', 'path': '/dev/sdb'} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:20:26 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633646636396665', 'path': '/dev/sdb'} {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 12:20:26 user nova-compute[74840]: DEBUG nova.objects.instance [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lazy-loading 'flavor' on Instance uuid 032e6584-9acf-469f-b661-faf6555659e1 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:20:26 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 12:20:26 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:20:26 user nova-compute[74840]:   <source dev="/dev/sdb"/>
Nov 08 12:20:26 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:20:26 user nova-compute[74840]:   <serial>d116702a-23fe-4e9a-8afe-ee88c802d41e</serial>
Nov 08 12:20:26 user nova-compute[74840]: </disk>
Nov 08 12:20:26 user nova-compute[74840]:  {{(pid=74840) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 12:20:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:26 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:20:26 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:20:26 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] No VIF found with MAC fa:16:3e:d3:22:7c, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:20:26 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-3aff1108-05ad-43f3-8c95-cd300bd8408e tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "032e6584-9acf-469f-b661-faf6555659e1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.690s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:20:28 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquiring lock "ffe50042-29bf-4ef3-a148-8698bc75233b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:20:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "ffe50042-29bf-4ef3-a148-8698bc75233b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:20:28 user nova-compute[74840]: DEBUG nova.compute.manager [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Starting instance... {{(pid=74840) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 12:20:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:20:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:20:28 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:20:28 user nova-compute[74840]: INFO nova.compute.claims [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Claim successful on node user
Nov 08 12:20:28 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:20:28 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:20:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.431s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:20:28 user nova-compute[74840]: DEBUG nova.compute.manager [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Start building networks asynchronously for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 12:20:28 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:28 user nova-compute[74840]: DEBUG nova.compute.manager [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Allocating IP information in the background. {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 12:20:28 user nova-compute[74840]: DEBUG nova.network.neutron [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 12:20:28 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 12:20:29 user nova-compute[74840]: DEBUG nova.compute.manager [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Start building block device mappings for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 12:20:29 user nova-compute[74840]: INFO nova.virt.block_device [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Booting with blank volume at /dev/vda
Nov 08 12:20:29 user nova-compute[74840]: DEBUG nova.policy [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '275e3d340c9d4d9e90b579e4bc0bfe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c97c47ab144ef3a8d5e9ee1ecc059e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 12:20:29 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Acquiring lock "8b7c490e-4c78-4e07-bc8a-3be2328963d7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:20:29 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "8b7c490e-4c78-4e07-bc8a-3be2328963d7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:20:29 user nova-compute[74840]: DEBUG nova.compute.manager [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Starting instance... {{(pid=74840) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 12:20:29 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:20:29 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:20:29 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:20:29 user nova-compute[74840]: INFO nova.compute.claims [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Claim successful on node user
Nov 08 12:20:30 user nova-compute[74840]: DEBUG nova.network.neutron [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Successfully created port: 6169b221-7840-4cfb-ba25-e34a95b35e77 {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:20:30 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:20:30 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:20:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.520s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:20:30 user nova-compute[74840]: DEBUG nova.compute.manager [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Start building networks asynchronously for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 12:20:30 user nova-compute[74840]: DEBUG nova.compute.manager [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Allocating IP information in the background. {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 12:20:30 user nova-compute[74840]: DEBUG nova.network.neutron [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 12:20:30 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 12:20:30 user nova-compute[74840]: DEBUG nova.compute.manager [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Start building block device mappings for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 12:20:30 user nova-compute[74840]: DEBUG nova.policy [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6d4a3286c7d64d59b8ce2e4456db9cc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457d61e0588847528ef3dd42a6146599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 12:20:30 user nova-compute[74840]: DEBUG nova.compute.manager [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Start spawning the instance on the hypervisor. {{(pid=74840) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 12:20:30 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:20:30 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Creating image(s)
Nov 08 12:20:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Acquiring lock "/opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:20:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "/opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:20:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "/opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:20:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Acquiring lock "832a6445-84ee-43a8-a5bc-a07670602912" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:20:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "832a6445-84ee-43a8-a5bc-a07670602912" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:20:30 user nova-compute[74840]: DEBUG nova.compute.manager [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Starting instance... {{(pid=74840) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 12:20:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.288s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Acquiring lock "5d26578eba85497f494c575690c4248f381a0fe6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:20:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:20:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:31 user nova-compute[74840]: DEBUG nova.network.neutron [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Successfully updated port: 6169b221-7840-4cfb-ba25-e34a95b35e77 {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:20:31 user nova-compute[74840]: DEBUG nova.compute.manager [req-a625344e-3303-478b-a286-2dce79dfc884 req-c41544a6-d4f7-4b8f-b16a-0dc2c19eeef0 service nova] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Received event network-changed-6169b221-7840-4cfb-ba25-e34a95b35e77 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:20:31 user nova-compute[74840]: DEBUG nova.compute.manager [req-a625344e-3303-478b-a286-2dce79dfc884 req-c41544a6-d4f7-4b8f-b16a-0dc2c19eeef0 service nova] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Refreshing instance network info cache due to event network-changed-6169b221-7840-4cfb-ba25-e34a95b35e77. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:20:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a625344e-3303-478b-a286-2dce79dfc884 req-c41544a6-d4f7-4b8f-b16a-0dc2c19eeef0 service nova] Acquiring lock "refresh_cache-ffe50042-29bf-4ef3-a148-8698bc75233b" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:20:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a625344e-3303-478b-a286-2dce79dfc884 req-c41544a6-d4f7-4b8f-b16a-0dc2c19eeef0 service nova] Acquired lock "refresh_cache-ffe50042-29bf-4ef3-a148-8698bc75233b" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:20:31 user nova-compute[74840]: DEBUG nova.network.neutron [req-a625344e-3303-478b-a286-2dce79dfc884 req-c41544a6-d4f7-4b8f-b16a-0dc2c19eeef0 service nova] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Refreshing network info cache for port 6169b221-7840-4cfb-ba25-e34a95b35e77 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:20:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquiring lock "refresh_cache-ffe50042-29bf-4ef3-a148-8698bc75233b" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:20:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:20:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:20:31 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:20:31 user nova-compute[74840]: INFO nova.compute.claims [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Claim successful on node user
Nov 08 12:20:31 user nova-compute[74840]: DEBUG nova.network.neutron [req-a625344e-3303-478b-a286-2dce79dfc884 req-c41544a6-d4f7-4b8f-b16a-0dc2c19eeef0 service nova] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:20:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.196s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk 1073741824 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk 1073741824" returned: 0 in 0.062s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:20:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:31 user nova-compute[74840]: DEBUG nova.network.neutron [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Successfully created port: d9df071e-c4f0-4c80-9d63-3a41c849dca5 {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:20:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:31 user nova-compute[74840]: DEBUG nova.network.neutron [req-a625344e-3303-478b-a286-2dce79dfc884 req-c41544a6-d4f7-4b8f-b16a-0dc2c19eeef0 service nova] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:20:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a625344e-3303-478b-a286-2dce79dfc884 req-c41544a6-d4f7-4b8f-b16a-0dc2c19eeef0 service nova] Releasing lock "refresh_cache-ffe50042-29bf-4ef3-a148-8698bc75233b" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:20:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquired lock "refresh_cache-ffe50042-29bf-4ef3-a148-8698bc75233b" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:20:31 user nova-compute[74840]: DEBUG nova.network.neutron [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:20:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.212s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:31 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk. size=1073741824 {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 12:20:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:31 user nova-compute[74840]: DEBUG nova.network.neutron [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:20:31 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:20:31 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:20:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:31 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Cannot resize image /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk to a smaller size. {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 12:20:31 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Created local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 12:20:31 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Ensure instance console log exists: /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:20:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:20:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:20:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:20:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.619s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:20:31 user nova-compute[74840]: DEBUG nova.compute.manager [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Start building networks asynchronously for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 12:20:31 user nova-compute[74840]: DEBUG nova.compute.manager [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Allocating IP information in the background. {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 12:20:31 user nova-compute[74840]: DEBUG nova.network.neutron [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 12:20:31 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 12:20:31 user nova-compute[74840]: DEBUG nova.network.neutron [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Updating instance_info_cache with network_info: [{"id": "6169b221-7840-4cfb-ba25-e34a95b35e77", "address": "fa:16:3e:b0:6a:c2", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6169b221-78", "ovs_interfaceid": "6169b221-7840-4cfb-ba25-e34a95b35e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:20:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Releasing lock "refresh_cache-ffe50042-29bf-4ef3-a148-8698bc75233b" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:20:31 user nova-compute[74840]: DEBUG nova.compute.manager [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Instance network_info: |[{"id": "6169b221-7840-4cfb-ba25-e34a95b35e77", "address": "fa:16:3e:b0:6a:c2", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6169b221-78", "ovs_interfaceid": "6169b221-7840-4cfb-ba25-e34a95b35e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 12:20:31 user nova-compute[74840]: DEBUG nova.compute.manager [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Start building block device mappings for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG nova.policy [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6d4a3286c7d64d59b8ce2e4456db9cc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457d61e0588847528ef3dd42a6146599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG nova.compute.manager [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Start spawning the instance on the hypervisor. {{(pid=74840) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:20:32 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Creating image(s)
Nov 08 12:20:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Acquiring lock "/opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "/opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "/opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG nova.network.neutron [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Successfully updated port: d9df071e-c4f0-4c80-9d63-3a41c849dca5 {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Acquiring lock "refresh_cache-8b7c490e-4c78-4e07-bc8a-3be2328963d7" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Acquired lock "refresh_cache-8b7c490e-4c78-4e07-bc8a-3be2328963d7" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG nova.network.neutron [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG nova.compute.manager [req-f7344c79-9961-4749-9b08-44c776b947c6 req-9692fc13-5a71-47bd-a508-5cc1d8c4a095 service nova] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Received event network-changed-d9df071e-c4f0-4c80-9d63-3a41c849dca5 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG nova.compute.manager [req-f7344c79-9961-4749-9b08-44c776b947c6 req-9692fc13-5a71-47bd-a508-5cc1d8c4a095 service nova] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Refreshing instance network info cache due to event network-changed-d9df071e-c4f0-4c80-9d63-3a41c849dca5. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-f7344c79-9961-4749-9b08-44c776b947c6 req-9692fc13-5a71-47bd-a508-5cc1d8c4a095 service nova] Acquiring lock "refresh_cache-8b7c490e-4c78-4e07-bc8a-3be2328963d7" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG nova.network.neutron [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.186s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Acquiring lock "5d26578eba85497f494c575690c4248f381a0fe6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.207s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk 1073741824 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG nova.network.neutron [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Updating instance_info_cache with network_info: [{"id": "d9df071e-c4f0-4c80-9d63-3a41c849dca5", "address": "fa:16:3e:32:c4:9b", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9df071e-c4", "ovs_interfaceid": "d9df071e-c4f0-4c80-9d63-3a41c849dca5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk 1073741824" returned: 0 in 0.062s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Releasing lock "refresh_cache-8b7c490e-4c78-4e07-bc8a-3be2328963d7" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG nova.compute.manager [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Instance network_info: |[{"id": "d9df071e-c4f0-4c80-9d63-3a41c849dca5", "address": "fa:16:3e:32:c4:9b", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9df071e-c4", "ovs_interfaceid": "d9df071e-c4f0-4c80-9d63-3a41c849dca5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-f7344c79-9961-4749-9b08-44c776b947c6 req-9692fc13-5a71-47bd-a508-5cc1d8c4a095 service nova] Acquired lock "refresh_cache-8b7c490e-4c78-4e07-bc8a-3be2328963d7" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG nova.network.neutron [req-f7344c79-9961-4749-9b08-44c776b947c6 req-9692fc13-5a71-47bd-a508-5cc1d8c4a095 service nova] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Refreshing network info cache for port d9df071e-c4f0-4c80-9d63-3a41c849dca5 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Start _get_guest_xml network_info=[{"id": "d9df071e-c4f0-4c80-9d63-3a41c849dca5", "address": "fa:16:3e:32:c4:9b", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9df071e-c4", "ovs_interfaceid": "d9df071e-c4f0-4c80-9d63-3a41c849dca5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'image_id': '4fa17706-d304-4117-a420-dab994c703dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:20:32 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:20:32 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:20:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:20:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1812155088',display_name='tempest-ServerRescueNegativeTestJSON-server-1812155088',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1812155088',id=25,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='457d61e0588847528ef3dd42a6146599',ramdisk_id='',reservation_id='r-gqzxr43e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1814868989',owner_user_name='tempest-ServerRescueNegativeTestJSON-1814868989-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:20:31Z,user_data=None,user_id='6d4a3286c7d64d59b8ce2e4456db9cc2',uuid=8b7c490e-4c78-4e07-bc8a-3be2328963d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9df071e-c4f0-4c80-9d63-3a41c849dca5", "address": "fa:16:3e:32:c4:9b", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9df071e-c4", "ovs_interfaceid": "d9df071e-c4f0-4c80-9d63-3a41c849dca5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Converting VIF {"id": "d9df071e-c4f0-4c80-9d63-3a41c849dca5", "address": "fa:16:3e:32:c4:9b", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9df071e-c4", "ovs_interfaceid": "d9df071e-c4f0-4c80-9d63-3a41c849dca5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:c4:9b,bridge_name='br-int',has_traffic_filtering=True,id=d9df071e-c4f0-4c80-9d63-3a41c849dca5,network=Network(5ee2626f-3d55-44da-a731-761059adfa85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9df071e-c4') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG nova.objects.instance [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lazy-loading 'pci_devices' on Instance uuid 8b7c490e-4c78-4e07-bc8a-3be2328963d7 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG nova.network.neutron [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Successfully created port: 48ba3111-f22a-4a29-8183-ccd94efa9086 {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:20:32 user nova-compute[74840]:   <uuid>8b7c490e-4c78-4e07-bc8a-3be2328963d7</uuid>
Nov 08 12:20:32 user nova-compute[74840]:   <name>instance-00000019</name>
Nov 08 12:20:32 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:20:32 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:20:32 user nova-compute[74840]:   <metadata>
Nov 08 12:20:32 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:20:32 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:20:32 user nova-compute[74840]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1812155088</nova:name>
Nov 08 12:20:32 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:20:32</nova:creationTime>
Nov 08 12:20:32 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:20:32 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:20:32 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:20:32 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:20:32 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:20:32 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:20:32 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:20:32 user nova-compute[74840]:       <nova:owner>
Nov 08 12:20:32 user nova-compute[74840]:         <nova:user uuid="6d4a3286c7d64d59b8ce2e4456db9cc2">tempest-ServerRescueNegativeTestJSON-1814868989-project-member</nova:user>
Nov 08 12:20:32 user nova-compute[74840]:         <nova:project uuid="457d61e0588847528ef3dd42a6146599">tempest-ServerRescueNegativeTestJSON-1814868989</nova:project>
Nov 08 12:20:32 user nova-compute[74840]:       </nova:owner>
Nov 08 12:20:32 user nova-compute[74840]:       <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:20:32 user nova-compute[74840]:       <nova:ports>
Nov 08 12:20:32 user nova-compute[74840]:         <nova:port uuid="d9df071e-c4f0-4c80-9d63-3a41c849dca5">
Nov 08 12:20:32 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 12:20:32 user nova-compute[74840]:         </nova:port>
Nov 08 12:20:32 user nova-compute[74840]:       </nova:ports>
Nov 08 12:20:32 user nova-compute[74840]:     </nova:instance>
Nov 08 12:20:32 user nova-compute[74840]:   </metadata>
Nov 08 12:20:32 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:20:32 user nova-compute[74840]:     <system>
Nov 08 12:20:32 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:20:32 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:20:32 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:20:32 user nova-compute[74840]:       <entry name="serial">8b7c490e-4c78-4e07-bc8a-3be2328963d7</entry>
Nov 08 12:20:32 user nova-compute[74840]:       <entry name="uuid">8b7c490e-4c78-4e07-bc8a-3be2328963d7</entry>
Nov 08 12:20:32 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:20:32 user nova-compute[74840]:     </system>
Nov 08 12:20:32 user nova-compute[74840]:   </sysinfo>
Nov 08 12:20:32 user nova-compute[74840]:   <os>
Nov 08 12:20:32 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:20:32 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:20:32 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:20:32 user nova-compute[74840]:   </os>
Nov 08 12:20:32 user nova-compute[74840]:   <features>
Nov 08 12:20:32 user nova-compute[74840]:     <acpi/>
Nov 08 12:20:32 user nova-compute[74840]:     <apic/>
Nov 08 12:20:32 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:20:32 user nova-compute[74840]:   </features>
Nov 08 12:20:32 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:20:32 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:20:32 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:20:32 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:20:32 user nova-compute[74840]:   </clock>
Nov 08 12:20:32 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:20:32 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:20:32 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:20:32 user nova-compute[74840]:   </cpu>
Nov 08 12:20:32 user nova-compute[74840]:   <devices>
Nov 08 12:20:32 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:20:32 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:20:32 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk"/>
Nov 08 12:20:32 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:20:32 user nova-compute[74840]:     </disk>
Nov 08 12:20:32 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:20:32 user nova-compute[74840]:       <mac address="fa:16:3e:32:c4:9b"/>
Nov 08 12:20:32 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:20:32 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:20:32 user nova-compute[74840]:       <target dev="tapd9df071e-c4"/>
Nov 08 12:20:32 user nova-compute[74840]:     </interface>
Nov 08 12:20:32 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:20:32 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/console.log" append="off"/>
Nov 08 12:20:32 user nova-compute[74840]:     </serial>
Nov 08 12:20:32 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:20:32 user nova-compute[74840]:     <video>
Nov 08 12:20:32 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:20:32 user nova-compute[74840]:     </video>
Nov 08 12:20:32 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:20:32 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:20:32 user nova-compute[74840]:     </rng>
Nov 08 12:20:32 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:20:32 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:20:32 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:20:32 user nova-compute[74840]:     </memballoon>
Nov 08 12:20:32 user nova-compute[74840]:   </devices>
Nov 08 12:20:32 user nova-compute[74840]: </domain>
Nov 08 12:20:32 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:20:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1812155088',display_name='tempest-ServerRescueNegativeTestJSON-server-1812155088',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1812155088',id=25,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='457d61e0588847528ef3dd42a6146599',ramdisk_id='',reservation_id='r-gqzxr43e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1814868989',owner_user_name='tempest-ServerRescueNegativeTestJSON-1814868989-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:20:31Z,user_data=None,user_id='6d4a3286c7d64d59b8ce2e4456db9cc2',uuid=8b7c490e-4c78-4e07-bc8a-3be2328963d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9df071e-c4f0-4c80-9d63-3a41c849dca5", "address": "fa:16:3e:32:c4:9b", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9df071e-c4", "ovs_interfaceid": "d9df071e-c4f0-4c80-9d63-3a41c849dca5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Converting VIF {"id": "d9df071e-c4f0-4c80-9d63-3a41c849dca5", "address": "fa:16:3e:32:c4:9b", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9df071e-c4", "ovs_interfaceid": "d9df071e-c4f0-4c80-9d63-3a41c849dca5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:c4:9b,bridge_name='br-int',has_traffic_filtering=True,id=d9df071e-c4f0-4c80-9d63-3a41c849dca5,network=Network(5ee2626f-3d55-44da-a731-761059adfa85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9df071e-c4') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG os_vif [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:c4:9b,bridge_name='br-int',has_traffic_filtering=True,id=d9df071e-c4f0-4c80-9d63-3a41c849dca5,network=Network(5ee2626f-3d55-44da-a731-761059adfa85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9df071e-c4') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0dfe2eab-b43e-5144-a83b-9aa3f3be73f8', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9df071e-c4, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd9df071e-c4, col_values=(('qos', UUID('75e275f0-0014-4098-8792-3e657cb4b7a8')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd9df071e-c4, col_values=(('external_ids', {'iface-id': 'd9df071e-c4f0-4c80-9d63-3a41c849dca5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:c4:9b', 'vm-uuid': '8b7c490e-4c78-4e07-bc8a-3be2328963d7'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:32 user nova-compute[74840]: INFO os_vif [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:c4:9b,bridge_name='br-int',has_traffic_filtering=True,id=d9df071e-c4f0-4c80-9d63-3a41c849dca5,network=Network(5ee2626f-3d55-44da-a731-761059adfa85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9df071e-c4')
Nov 08 12:20:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.204s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Checking if we can resize image /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk. size=1073741824 {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] No VIF found with MAC fa:16:3e:32:c4:9b, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Cannot resize image /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk to a smaller size. {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Created local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Ensure instance console log exists: /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:20:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:20:33 user nova-compute[74840]: DEBUG nova.network.neutron [req-f7344c79-9961-4749-9b08-44c776b947c6 req-9692fc13-5a71-47bd-a508-5cc1d8c4a095 service nova] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Updated VIF entry in instance network info cache for port d9df071e-c4f0-4c80-9d63-3a41c849dca5. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:20:33 user nova-compute[74840]: DEBUG nova.network.neutron [req-f7344c79-9961-4749-9b08-44c776b947c6 req-9692fc13-5a71-47bd-a508-5cc1d8c4a095 service nova] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Updating instance_info_cache with network_info: [{"id": "d9df071e-c4f0-4c80-9d63-3a41c849dca5", "address": "fa:16:3e:32:c4:9b", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9df071e-c4", "ovs_interfaceid": "d9df071e-c4f0-4c80-9d63-3a41c849dca5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:20:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-f7344c79-9961-4749-9b08-44c776b947c6 req-9692fc13-5a71-47bd-a508-5cc1d8c4a095 service nova] Releasing lock "refresh_cache-8b7c490e-4c78-4e07-bc8a-3be2328963d7" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:20:33 user nova-compute[74840]: DEBUG nova.network.neutron [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Successfully updated port: 48ba3111-f22a-4a29-8183-ccd94efa9086 {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:20:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Acquiring lock "refresh_cache-832a6445-84ee-43a8-a5bc-a07670602912" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:20:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Acquired lock "refresh_cache-832a6445-84ee-43a8-a5bc-a07670602912" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:20:33 user nova-compute[74840]: DEBUG nova.network.neutron [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:20:33 user nova-compute[74840]: DEBUG nova.compute.manager [req-e9cef982-e0d7-4f84-bff4-1d59f56a2718 req-9eecb12a-8863-4396-8fed-aaf350530254 service nova] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Received event network-changed-48ba3111-f22a-4a29-8183-ccd94efa9086 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:20:33 user nova-compute[74840]: DEBUG nova.compute.manager [req-e9cef982-e0d7-4f84-bff4-1d59f56a2718 req-9eecb12a-8863-4396-8fed-aaf350530254 service nova] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Refreshing instance network info cache due to event network-changed-48ba3111-f22a-4a29-8183-ccd94efa9086. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:20:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e9cef982-e0d7-4f84-bff4-1d59f56a2718 req-9eecb12a-8863-4396-8fed-aaf350530254 service nova] Acquiring lock "refresh_cache-832a6445-84ee-43a8-a5bc-a07670602912" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:20:33 user nova-compute[74840]: DEBUG nova.network.neutron [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:20:33 user nova-compute[74840]: DEBUG nova.network.neutron [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Updating instance_info_cache with network_info: [{"id": "48ba3111-f22a-4a29-8183-ccd94efa9086", "address": "fa:16:3e:83:fc:39", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ba3111-f2", "ovs_interfaceid": "48ba3111-f22a-4a29-8183-ccd94efa9086", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:20:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Releasing lock "refresh_cache-832a6445-84ee-43a8-a5bc-a07670602912" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:20:33 user nova-compute[74840]: DEBUG nova.compute.manager [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Instance network_info: |[{"id": "48ba3111-f22a-4a29-8183-ccd94efa9086", "address": "fa:16:3e:83:fc:39", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ba3111-f2", "ovs_interfaceid": "48ba3111-f22a-4a29-8183-ccd94efa9086", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 12:20:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e9cef982-e0d7-4f84-bff4-1d59f56a2718 req-9eecb12a-8863-4396-8fed-aaf350530254 service nova] Acquired lock "refresh_cache-832a6445-84ee-43a8-a5bc-a07670602912" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:20:33 user nova-compute[74840]: DEBUG nova.network.neutron [req-e9cef982-e0d7-4f84-bff4-1d59f56a2718 req-9eecb12a-8863-4396-8fed-aaf350530254 service nova] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Refreshing network info cache for port 48ba3111-f22a-4a29-8183-ccd94efa9086 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:20:33 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Start _get_guest_xml network_info=[{"id": "48ba3111-f22a-4a29-8183-ccd94efa9086", "address": "fa:16:3e:83:fc:39", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ba3111-f2", "ovs_interfaceid": "48ba3111-f22a-4a29-8183-ccd94efa9086", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'image_id': '4fa17706-d304-4117-a420-dab994c703dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:20:34 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:20:34 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:20:34 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:20:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-859288350',display_name='tempest-ServerRescueNegativeTestJSON-server-859288350',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-859288350',id=26,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='457d61e0588847528ef3dd42a6146599',ramdisk_id='',reservation_id='r-o8yv1yn5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1814868989',owner_user_name='tempest-ServerRescueNegativeTestJSON-1814868989-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:20:32Z,user_data=None,user_id='6d4a3286c7d64d59b8ce2e4456db9cc2',uuid=832a6445-84ee-43a8-a5bc-a07670602912,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48ba3111-f22a-4a29-8183-ccd94efa9086", "address": "fa:16:3e:83:fc:39", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ba3111-f2", "ovs_interfaceid": "48ba3111-f22a-4a29-8183-ccd94efa9086", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Converting VIF {"id": "48ba3111-f22a-4a29-8183-ccd94efa9086", "address": "fa:16:3e:83:fc:39", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ba3111-f2", "ovs_interfaceid": "48ba3111-f22a-4a29-8183-ccd94efa9086", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:fc:39,bridge_name='br-int',has_traffic_filtering=True,id=48ba3111-f22a-4a29-8183-ccd94efa9086,network=Network(5ee2626f-3d55-44da-a731-761059adfa85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48ba3111-f2') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG nova.objects.instance [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lazy-loading 'pci_devices' on Instance uuid 832a6445-84ee-43a8-a5bc-a07670602912 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:20:34 user nova-compute[74840]:   <uuid>832a6445-84ee-43a8-a5bc-a07670602912</uuid>
Nov 08 12:20:34 user nova-compute[74840]:   <name>instance-0000001a</name>
Nov 08 12:20:34 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:20:34 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:20:34 user nova-compute[74840]:   <metadata>
Nov 08 12:20:34 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:20:34 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:20:34 user nova-compute[74840]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-859288350</nova:name>
Nov 08 12:20:34 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:20:34</nova:creationTime>
Nov 08 12:20:34 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:20:34 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:20:34 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:20:34 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:20:34 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:20:34 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:20:34 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:20:34 user nova-compute[74840]:       <nova:owner>
Nov 08 12:20:34 user nova-compute[74840]:         <nova:user uuid="6d4a3286c7d64d59b8ce2e4456db9cc2">tempest-ServerRescueNegativeTestJSON-1814868989-project-member</nova:user>
Nov 08 12:20:34 user nova-compute[74840]:         <nova:project uuid="457d61e0588847528ef3dd42a6146599">tempest-ServerRescueNegativeTestJSON-1814868989</nova:project>
Nov 08 12:20:34 user nova-compute[74840]:       </nova:owner>
Nov 08 12:20:34 user nova-compute[74840]:       <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:20:34 user nova-compute[74840]:       <nova:ports>
Nov 08 12:20:34 user nova-compute[74840]:         <nova:port uuid="48ba3111-f22a-4a29-8183-ccd94efa9086">
Nov 08 12:20:34 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 12:20:34 user nova-compute[74840]:         </nova:port>
Nov 08 12:20:34 user nova-compute[74840]:       </nova:ports>
Nov 08 12:20:34 user nova-compute[74840]:     </nova:instance>
Nov 08 12:20:34 user nova-compute[74840]:   </metadata>
Nov 08 12:20:34 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:20:34 user nova-compute[74840]:     <system>
Nov 08 12:20:34 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:20:34 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:20:34 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:20:34 user nova-compute[74840]:       <entry name="serial">832a6445-84ee-43a8-a5bc-a07670602912</entry>
Nov 08 12:20:34 user nova-compute[74840]:       <entry name="uuid">832a6445-84ee-43a8-a5bc-a07670602912</entry>
Nov 08 12:20:34 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:20:34 user nova-compute[74840]:     </system>
Nov 08 12:20:34 user nova-compute[74840]:   </sysinfo>
Nov 08 12:20:34 user nova-compute[74840]:   <os>
Nov 08 12:20:34 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:20:34 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:20:34 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:20:34 user nova-compute[74840]:   </os>
Nov 08 12:20:34 user nova-compute[74840]:   <features>
Nov 08 12:20:34 user nova-compute[74840]:     <acpi/>
Nov 08 12:20:34 user nova-compute[74840]:     <apic/>
Nov 08 12:20:34 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:20:34 user nova-compute[74840]:   </features>
Nov 08 12:20:34 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:20:34 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:20:34 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:20:34 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:20:34 user nova-compute[74840]:   </clock>
Nov 08 12:20:34 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:20:34 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:20:34 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:20:34 user nova-compute[74840]:   </cpu>
Nov 08 12:20:34 user nova-compute[74840]:   <devices>
Nov 08 12:20:34 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:20:34 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:20:34 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk"/>
Nov 08 12:20:34 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:20:34 user nova-compute[74840]:     </disk>
Nov 08 12:20:34 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:20:34 user nova-compute[74840]:       <mac address="fa:16:3e:83:fc:39"/>
Nov 08 12:20:34 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:20:34 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:20:34 user nova-compute[74840]:       <target dev="tap48ba3111-f2"/>
Nov 08 12:20:34 user nova-compute[74840]:     </interface>
Nov 08 12:20:34 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:20:34 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/console.log" append="off"/>
Nov 08 12:20:34 user nova-compute[74840]:     </serial>
Nov 08 12:20:34 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:20:34 user nova-compute[74840]:     <video>
Nov 08 12:20:34 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:20:34 user nova-compute[74840]:     </video>
Nov 08 12:20:34 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:20:34 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:20:34 user nova-compute[74840]:     </rng>
Nov 08 12:20:34 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:20:34 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:20:34 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:20:34 user nova-compute[74840]:     </memballoon>
Nov 08 12:20:34 user nova-compute[74840]:   </devices>
Nov 08 12:20:34 user nova-compute[74840]: </domain>
Nov 08 12:20:34 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:20:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-859288350',display_name='tempest-ServerRescueNegativeTestJSON-server-859288350',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-859288350',id=26,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='457d61e0588847528ef3dd42a6146599',ramdisk_id='',reservation_id='r-o8yv1yn5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1814868989',owner_user_name='tempest-ServerRescueNegativeTestJSON-1814868989-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:20:32Z,user_data=None,user_id='6d4a3286c7d64d59b8ce2e4456db9cc2',uuid=832a6445-84ee-43a8-a5bc-a07670602912,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48ba3111-f22a-4a29-8183-ccd94efa9086", "address": "fa:16:3e:83:fc:39", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ba3111-f2", "ovs_interfaceid": "48ba3111-f22a-4a29-8183-ccd94efa9086", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Converting VIF {"id": "48ba3111-f22a-4a29-8183-ccd94efa9086", "address": "fa:16:3e:83:fc:39", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ba3111-f2", "ovs_interfaceid": "48ba3111-f22a-4a29-8183-ccd94efa9086", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:fc:39,bridge_name='br-int',has_traffic_filtering=True,id=48ba3111-f22a-4a29-8183-ccd94efa9086,network=Network(5ee2626f-3d55-44da-a731-761059adfa85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48ba3111-f2') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG os_vif [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:fc:39,bridge_name='br-int',has_traffic_filtering=True,id=48ba3111-f22a-4a29-8183-ccd94efa9086,network=Network(5ee2626f-3d55-44da-a731-761059adfa85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48ba3111-f2') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '52ee3aff-9011-547f-bd04-e971c18d98e1', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap48ba3111-f2, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap48ba3111-f2, col_values=(('qos', UUID('5b8eb24f-2e74-4514-8c6d-b072a2b4611c')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap48ba3111-f2, col_values=(('external_ids', {'iface-id': '48ba3111-f22a-4a29-8183-ccd94efa9086', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:fc:39', 'vm-uuid': '832a6445-84ee-43a8-a5bc-a07670602912'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:34 user nova-compute[74840]: INFO os_vif [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:fc:39,bridge_name='br-int',has_traffic_filtering=True,id=48ba3111-f22a-4a29-8183-ccd94efa9086,network=Network(5ee2626f-3d55-44da-a731-761059adfa85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48ba3111-f2')
Nov 08 12:20:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] No VIF found with MAC fa:16:3e:83:fc:39, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG nova.network.neutron [req-e9cef982-e0d7-4f84-bff4-1d59f56a2718 req-9eecb12a-8863-4396-8fed-aaf350530254 service nova] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Updated VIF entry in instance network info cache for port 48ba3111-f22a-4a29-8183-ccd94efa9086. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG nova.network.neutron [req-e9cef982-e0d7-4f84-bff4-1d59f56a2718 req-9eecb12a-8863-4396-8fed-aaf350530254 service nova] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Updating instance_info_cache with network_info: [{"id": "48ba3111-f22a-4a29-8183-ccd94efa9086", "address": "fa:16:3e:83:fc:39", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ba3111-f2", "ovs_interfaceid": "48ba3111-f22a-4a29-8183-ccd94efa9086", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e9cef982-e0d7-4f84-bff4-1d59f56a2718 req-9eecb12a-8863-4396-8fed-aaf350530254 service nova] Releasing lock "refresh_cache-832a6445-84ee-43a8-a5bc-a07670602912" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG nova.compute.manager [req-bc711256-4a0a-4111-a206-389369740557 req-0f196b1e-2690-428c-9ed8-d50106fdaf90 service nova] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Received event network-vif-plugged-d9df071e-c4f0-4c80-9d63-3a41c849dca5 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-bc711256-4a0a-4111-a206-389369740557 req-0f196b1e-2690-428c-9ed8-d50106fdaf90 service nova] Acquiring lock "8b7c490e-4c78-4e07-bc8a-3be2328963d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-bc711256-4a0a-4111-a206-389369740557 req-0f196b1e-2690-428c-9ed8-d50106fdaf90 service nova] Lock "8b7c490e-4c78-4e07-bc8a-3be2328963d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-bc711256-4a0a-4111-a206-389369740557 req-0f196b1e-2690-428c-9ed8-d50106fdaf90 service nova] Lock "8b7c490e-4c78-4e07-bc8a-3be2328963d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG nova.compute.manager [req-bc711256-4a0a-4111-a206-389369740557 req-0f196b1e-2690-428c-9ed8-d50106fdaf90 service nova] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] No waiting events found dispatching network-vif-plugged-d9df071e-c4f0-4c80-9d63-3a41c849dca5 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:20:34 user nova-compute[74840]: WARNING nova.compute.manager [req-bc711256-4a0a-4111-a206-389369740557 req-0f196b1e-2690-428c-9ed8-d50106fdaf90 service nova] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Received unexpected event network-vif-plugged-d9df071e-c4f0-4c80-9d63-3a41c849dca5 for instance with vm_state building and task_state spawning.
Nov 08 12:20:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:36 user nova-compute[74840]: DEBUG nova.compute.manager [req-860bc637-0843-41ac-a307-a1a07ffc92af req-9c3a2ded-f7da-437c-9765-86b5fea2b628 service nova] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Received event network-vif-plugged-48ba3111-f22a-4a29-8183-ccd94efa9086 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:20:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-860bc637-0843-41ac-a307-a1a07ffc92af req-9c3a2ded-f7da-437c-9765-86b5fea2b628 service nova] Acquiring lock "832a6445-84ee-43a8-a5bc-a07670602912-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:20:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-860bc637-0843-41ac-a307-a1a07ffc92af req-9c3a2ded-f7da-437c-9765-86b5fea2b628 service nova] Lock "832a6445-84ee-43a8-a5bc-a07670602912-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:20:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-860bc637-0843-41ac-a307-a1a07ffc92af req-9c3a2ded-f7da-437c-9765-86b5fea2b628 service nova] Lock "832a6445-84ee-43a8-a5bc-a07670602912-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:20:36 user nova-compute[74840]: DEBUG nova.compute.manager [req-860bc637-0843-41ac-a307-a1a07ffc92af req-9c3a2ded-f7da-437c-9765-86b5fea2b628 service nova] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] No waiting events found dispatching network-vif-plugged-48ba3111-f22a-4a29-8183-ccd94efa9086 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:20:36 user nova-compute[74840]: WARNING nova.compute.manager [req-860bc637-0843-41ac-a307-a1a07ffc92af req-9c3a2ded-f7da-437c-9765-86b5fea2b628 service nova] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Received unexpected event network-vif-plugged-48ba3111-f22a-4a29-8183-ccd94efa9086 for instance with vm_state building and task_state spawning.
Nov 08 12:20:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:36 user nova-compute[74840]: DEBUG nova.compute.manager [req-20574260-323f-406c-8d72-5d04bf58a3cd req-df079e38-f8a4-40de-ad48-affb7e3b2c4b service nova] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Received event network-vif-plugged-d9df071e-c4f0-4c80-9d63-3a41c849dca5 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:20:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-20574260-323f-406c-8d72-5d04bf58a3cd req-df079e38-f8a4-40de-ad48-affb7e3b2c4b service nova] Acquiring lock "8b7c490e-4c78-4e07-bc8a-3be2328963d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:20:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-20574260-323f-406c-8d72-5d04bf58a3cd req-df079e38-f8a4-40de-ad48-affb7e3b2c4b service nova] Lock "8b7c490e-4c78-4e07-bc8a-3be2328963d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:20:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-20574260-323f-406c-8d72-5d04bf58a3cd req-df079e38-f8a4-40de-ad48-affb7e3b2c4b service nova] Lock "8b7c490e-4c78-4e07-bc8a-3be2328963d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:20:36 user nova-compute[74840]: DEBUG nova.compute.manager [req-20574260-323f-406c-8d72-5d04bf58a3cd req-df079e38-f8a4-40de-ad48-affb7e3b2c4b service nova] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] No waiting events found dispatching network-vif-plugged-d9df071e-c4f0-4c80-9d63-3a41c849dca5 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:20:36 user nova-compute[74840]: WARNING nova.compute.manager [req-20574260-323f-406c-8d72-5d04bf58a3cd req-df079e38-f8a4-40de-ad48-affb7e3b2c4b service nova] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Received unexpected event network-vif-plugged-d9df071e-c4f0-4c80-9d63-3a41c849dca5 for instance with vm_state building and task_state spawning.
Nov 08 12:20:37 user nova-compute[74840]: DEBUG nova.compute.manager [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:20:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:20:37 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Instance spawned successfully.
Nov 08 12:20:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:20:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Found default for hw_cdrom_bus of ide {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:20:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Found default for hw_disk_bus of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:20:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:20:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:20:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Found default for hw_video_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:20:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Found default for hw_vif_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:20:37 user nova-compute[74840]: INFO nova.compute.manager [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Took 7.12 seconds to spawn the instance on the hypervisor.
Nov 08 12:20:37 user nova-compute[74840]: DEBUG nova.compute.manager [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:20:38 user nova-compute[74840]: INFO nova.compute.manager [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Took 8.07 seconds to build instance.
Nov 08 12:20:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1f5d8d7d-d4f8-4781-8a97-1506a0e0f310 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "8b7c490e-4c78-4e07-bc8a-3be2328963d7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.207s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:20:38 user nova-compute[74840]: DEBUG nova.compute.manager [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:20:38 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:20:38 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Instance spawned successfully.
Nov 08 12:20:38 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:20:38 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Found default for hw_cdrom_bus of ide {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:20:38 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Found default for hw_disk_bus of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:20:38 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:20:38 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:20:38 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Found default for hw_video_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:20:38 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Found default for hw_vif_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:20:38 user nova-compute[74840]: INFO nova.compute.manager [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Took 6.17 seconds to spawn the instance on the hypervisor.
Nov 08 12:20:38 user nova-compute[74840]: DEBUG nova.compute.manager [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:20:38 user nova-compute[74840]: DEBUG nova.compute.manager [req-e340dadf-aad9-4d67-8e89-93524533f56a req-f0759ccd-5393-4340-a3be-ba404acd9303 service nova] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Received event network-vif-plugged-48ba3111-f22a-4a29-8183-ccd94efa9086 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:20:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e340dadf-aad9-4d67-8e89-93524533f56a req-f0759ccd-5393-4340-a3be-ba404acd9303 service nova] Acquiring lock "832a6445-84ee-43a8-a5bc-a07670602912-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:20:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e340dadf-aad9-4d67-8e89-93524533f56a req-f0759ccd-5393-4340-a3be-ba404acd9303 service nova] Lock "832a6445-84ee-43a8-a5bc-a07670602912-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:20:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e340dadf-aad9-4d67-8e89-93524533f56a req-f0759ccd-5393-4340-a3be-ba404acd9303 service nova] Lock "832a6445-84ee-43a8-a5bc-a07670602912-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:20:38 user nova-compute[74840]: DEBUG nova.compute.manager [req-e340dadf-aad9-4d67-8e89-93524533f56a req-f0759ccd-5393-4340-a3be-ba404acd9303 service nova] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] No waiting events found dispatching network-vif-plugged-48ba3111-f22a-4a29-8183-ccd94efa9086 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:20:38 user nova-compute[74840]: WARNING nova.compute.manager [req-e340dadf-aad9-4d67-8e89-93524533f56a req-f0759ccd-5393-4340-a3be-ba404acd9303 service nova] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Received unexpected event network-vif-plugged-48ba3111-f22a-4a29-8183-ccd94efa9086 for instance with vm_state building and task_state spawning.
Nov 08 12:20:38 user nova-compute[74840]: INFO nova.compute.manager [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Took 7.21 seconds to build instance.
Nov 08 12:20:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8720da30-a5c0-44b9-ac79-db59d180bc63 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "832a6445-84ee-43a8-a5bc-a07670602912" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.436s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:20:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:20:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 12:20:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:20:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:20:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:20:50 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:20:50 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:20:50 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:20:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "refresh_cache-d3e8efc6-7146-46ef-8433-380d7e69120c" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:20:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquired lock "refresh_cache-d3e8efc6-7146-46ef-8433-380d7e69120c" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:20:50 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Forcefully refreshing network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 12:20:51 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Updating instance_info_cache with network_info: [{"id": "5c942bb3-846b-4319-961f-42aed0e55bdf", "address": "fa:16:3e:29:6a:cd", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c942bb3-84", "ovs_interfaceid": "5c942bb3-846b-4319-961f-42aed0e55bdf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:20:51 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Releasing lock "refresh_cache-d3e8efc6-7146-46ef-8433-380d7e69120c" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:20:51 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Updated the network info_cache for instance {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 12:20:51 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:20:51 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:20:51 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:20:52 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:20:53 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:20:54 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:20:54 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:54 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 12:20:54 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:20:54 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:20:54 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:54 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:20:55 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:20:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:20:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:20:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:20:55 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:20:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f6c75c0-e820-47eb-be3e-51179b6df1a3/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:56 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f6c75c0-e820-47eb-be3e-51179b6df1a3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:56 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f6c75c0-e820-47eb-be3e-51179b6df1a3/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:56 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f6c75c0-e820-47eb-be3e-51179b6df1a3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:56 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d00e1756-34cd-4847-b108-023ba273444a/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:56 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d00e1756-34cd-4847-b108-023ba273444a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:56 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d00e1756-34cd-4847-b108-023ba273444a/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:56 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d00e1756-34cd-4847-b108-023ba273444a/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:56 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:56 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:56 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-48f8d86e-6dc0-454f-847d-fce35862933b tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Acquiring lock "d00e1756-34cd-4847-b108-023ba273444a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:20:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-48f8d86e-6dc0-454f-847d-fce35862933b tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Lock "d00e1756-34cd-4847-b108-023ba273444a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:20:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-48f8d86e-6dc0-454f-847d-fce35862933b tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Acquiring lock "d00e1756-34cd-4847-b108-023ba273444a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:20:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-48f8d86e-6dc0-454f-847d-fce35862933b tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Lock "d00e1756-34cd-4847-b108-023ba273444a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:20:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-48f8d86e-6dc0-454f-847d-fce35862933b tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Lock "d00e1756-34cd-4847-b108-023ba273444a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:20:57 user nova-compute[74840]: INFO nova.compute.manager [None req-48f8d86e-6dc0-454f-847d-fce35862933b tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: d00e1756-34cd-4847-b108-023ba273444a] Terminating instance
Nov 08 12:20:57 user nova-compute[74840]: DEBUG nova.compute.manager [None req-48f8d86e-6dc0-454f-847d-fce35862933b tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: d00e1756-34cd-4847-b108-023ba273444a] Start destroying the instance on the hypervisor. {{(pid=74840) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 12:20:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:57 user nova-compute[74840]: DEBUG nova.compute.manager [req-06969fe5-55c2-4ead-ae6b-45501131055d req-04e7a44e-3bfe-4d20-b987-3ad89a317d25 service nova] [instance: d00e1756-34cd-4847-b108-023ba273444a] Received event network-vif-unplugged-0273291b-7186-488c-baf2-5f971efec444 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:20:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-06969fe5-55c2-4ead-ae6b-45501131055d req-04e7a44e-3bfe-4d20-b987-3ad89a317d25 service nova] Acquiring lock "d00e1756-34cd-4847-b108-023ba273444a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:20:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-06969fe5-55c2-4ead-ae6b-45501131055d req-04e7a44e-3bfe-4d20-b987-3ad89a317d25 service nova] Lock "d00e1756-34cd-4847-b108-023ba273444a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:20:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-06969fe5-55c2-4ead-ae6b-45501131055d req-04e7a44e-3bfe-4d20-b987-3ad89a317d25 service nova] Lock "d00e1756-34cd-4847-b108-023ba273444a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:20:57 user nova-compute[74840]: DEBUG nova.compute.manager [req-06969fe5-55c2-4ead-ae6b-45501131055d req-04e7a44e-3bfe-4d20-b987-3ad89a317d25 service nova] [instance: d00e1756-34cd-4847-b108-023ba273444a] No waiting events found dispatching network-vif-unplugged-0273291b-7186-488c-baf2-5f971efec444 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:20:57 user nova-compute[74840]: DEBUG nova.compute.manager [req-06969fe5-55c2-4ead-ae6b-45501131055d req-04e7a44e-3bfe-4d20-b987-3ad89a317d25 service nova] [instance: d00e1756-34cd-4847-b108-023ba273444a] Received event network-vif-unplugged-0273291b-7186-488c-baf2-5f971efec444 for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:20:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83c035a0-880b-4170-98bc-b18cae712cfa/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83c035a0-880b-4170-98bc-b18cae712cfa/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83c035a0-880b-4170-98bc-b18cae712cfa/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:57 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: d00e1756-34cd-4847-b108-023ba273444a] Instance destroyed successfully.
Nov 08 12:20:57 user nova-compute[74840]: DEBUG nova.objects.instance [None req-48f8d86e-6dc0-454f-847d-fce35862933b tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Lazy-loading 'resources' on Instance uuid d00e1756-34cd-4847-b108-023ba273444a {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:20:57 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-48f8d86e-6dc0-454f-847d-fce35862933b tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:18:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-379032465',display_name='tempest-VolumesActionsTest-instance-379032465',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-379032465',id=20,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:19:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aee170af16c94cb0ac38095060bcb498',ramdisk_id='',reservation_id='r-tu05uggp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-549796604',owner_user_name='tempest-VolumesActionsTest-549796604-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:19:03Z,user_data=None,user_id='82d4449a578d4eb99cb9159a9cb35bf1',uuid=d00e1756-34cd-4847-b108-023ba273444a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0273291b-7186-488c-baf2-5f971efec444", "address": "fa:16:3e:5d:d0:05", "network": {"id": "fcca035f-b03c-407d-99c5-4e1a46ef8354", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1402418482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aee170af16c94cb0ac38095060bcb498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0273291b-71", "ovs_interfaceid": "0273291b-7186-488c-baf2-5f971efec444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:20:57 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-48f8d86e-6dc0-454f-847d-fce35862933b tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Converting VIF {"id": "0273291b-7186-488c-baf2-5f971efec444", "address": "fa:16:3e:5d:d0:05", "network": {"id": "fcca035f-b03c-407d-99c5-4e1a46ef8354", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1402418482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aee170af16c94cb0ac38095060bcb498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0273291b-71", "ovs_interfaceid": "0273291b-7186-488c-baf2-5f971efec444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:20:57 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-48f8d86e-6dc0-454f-847d-fce35862933b tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:d0:05,bridge_name='br-int',has_traffic_filtering=True,id=0273291b-7186-488c-baf2-5f971efec444,network=Network(fcca035f-b03c-407d-99c5-4e1a46ef8354),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0273291b-71') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:20:57 user nova-compute[74840]: DEBUG os_vif [None req-48f8d86e-6dc0-454f-847d-fce35862933b tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:d0:05,bridge_name='br-int',has_traffic_filtering=True,id=0273291b-7186-488c-baf2-5f971efec444,network=Network(fcca035f-b03c-407d-99c5-4e1a46ef8354),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0273291b-71') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:20:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0273291b-71, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:20:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:20:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=49bdc062-a965-447f-81fb-e777224ac6a4) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:20:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:20:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:20:57 user nova-compute[74840]: INFO os_vif [None req-48f8d86e-6dc0-454f-847d-fce35862933b tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:d0:05,bridge_name='br-int',has_traffic_filtering=True,id=0273291b-7186-488c-baf2-5f971efec444,network=Network(fcca035f-b03c-407d-99c5-4e1a46ef8354),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0273291b-71')
Nov 08 12:20:57 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-48f8d86e-6dc0-454f-847d-fce35862933b tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: d00e1756-34cd-4847-b108-023ba273444a] Deleting instance files /opt/stack/data/nova/instances/d00e1756-34cd-4847-b108-023ba273444a_del
Nov 08 12:20:57 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-48f8d86e-6dc0-454f-847d-fce35862933b tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: d00e1756-34cd-4847-b108-023ba273444a] Deletion of /opt/stack/data/nova/instances/d00e1756-34cd-4847-b108-023ba273444a_del complete
Nov 08 12:20:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83c035a0-880b-4170-98bc-b18cae712cfa/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:58 user nova-compute[74840]: INFO nova.compute.manager [None req-48f8d86e-6dc0-454f-847d-fce35862933b tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] [instance: d00e1756-34cd-4847-b108-023ba273444a] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 08 12:20:58 user nova-compute[74840]: DEBUG oslo.service.loopingcall [None req-48f8d86e-6dc0-454f-847d-fce35862933b tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74840) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG nova.compute.manager [-] [instance: d00e1756-34cd-4847-b108-023ba273444a] Deallocating network for instance {{(pid=74840) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: d00e1756-34cd-4847-b108-023ba273444a] deallocate_for_instance() {{(pid=74840) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032e6584-9acf-469f-b661-faf6555659e1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG nova.compute.manager [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Start spawning the instance on the hypervisor. {{(pid=74840) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:20:58 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Creating image(s)
Nov 08 12:20:58 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Did not create local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Ensure instance console log exists: /opt/stack/data/nova/instances/4b9fe577-1503-4007-be51-2a714363f8c6/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Start _get_guest_xml network_info=[{"id": "1fd72b39-7d31-4729-bef7-98f6a5246964", "address": "fa:16:3e:07:9d:e6", "network": {"id": "3fcdf89c-266d-43c1-8ae8-705406698b75", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-157102173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd72b39-7d", "ovs_interfaceid": "1fd72b39-7d31-4729-bef7-98f6a5246964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "87c651bf-a6e8-4290-bbdf-49746754ac54", "address": "fa:16:3e:77:a8:a1", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87c651bf-a6", "ovs_interfaceid": "87c651bf-a6e8-4290-bbdf-49746754ac54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bdec4773-148b-49d7-a461-3a6106fffff6", "address": "fa:16:3e:aa:64:51", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdec4773-14", "ovs_interfaceid": "bdec4773-148b-49d7-a461-3a6106fffff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "538b2412-4ee2-42a6-9cac-f97be4fc341e", "address": "fa:16:3e:d1:64:e8", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap538b2412-4e", "ovs_interfaceid": "538b2412-4ee2-42a6-9cac-f97be4fc341e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "afed888a-e688-452a-846f-4e9b398ff736", "address": "fa:16:3e:72:e8:99", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafed888a-e6", "ovs_interfaceid": "afed888a-e688-452a-846f-4e9b398ff736", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "20547543-4dc1-4158-bb9e-515cce88d3ef", "address": "fa:16:3e:c9:2d:ef", "network": {"id": "4a786612-4da0-47c3-94bb-2a73e6567310", "bridge": "br-int", "label": "tempest-device-tagging-net2-1454321418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20547543-4d", "ovs_interfaceid": "20547543-4dc1-4158-bb9e-515cce88d3ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "68377219-20e9-4c9f-b8c7-bcf0a798655e", "address": "fa:16:3e:24:1b:7e", "network": {"id": "4a786612-4da0-47c3-94bb-2a73e6567310", "bridge": "br-int", "label": "tempest-device-tagging-net2-1454321418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68377219-20", "ovs_interfaceid": "68377219-20e9-4c9f-b8c7-bcf0a798655e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '6a0ac009-9d2e-4069-bea9-ca807b58fe1d', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZJyeiAtw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4b9fe577-1503-4007-be51-2a714363f8c6', 'attached_at': '', 'detached_at': '', 'volume_id': 'd6c66458-63dd-40c6-b1d8-b2cc87cb5578', 'serial': 'd6c66458-63dd-40c6-b1d8-b2cc87cb5578'}, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None}, {'attachment_id': '4421421d-39b5-417b-9f7f-089760e87f5e', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IHKjeFBk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4b9fe577-1503-4007-be51-2a714363f8c6', 'attached_at': '', 'detached_at': '', 'volume_id': 'e7ad280d-7a9d-414d-ad87-3c0daed99fa1', 'serial': 'e7ad280d-7a9d-414d-ad87-3c0daed99fa1'}, 'boot_index': 1, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'volume_type': None}, {'attachment_id': '69428147-ca72-4c20-96e2-96df6c8b6318', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JQtxDMqH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4b9fe577-1503-4007-be51-2a714363f8c6', 'attached_at': '', 'detached_at': '', 'volume_id': '1778abb2-81cd-4a05-8063-b6ea529685a7', 'serial': '1778abb2-81cd-4a05-8063-b6ea529685a7'}, 'boot_index': 2, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:20:58 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:20:58 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:20:58 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Calling os-brick to attach iSCSI Volume {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZJyeiAtw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:20:58 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:20:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:20:58 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:20:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:20:58 user nova-compute[74840]: INFO os_brick.initiator.connectors.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 12:20:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 -p 172.16.0.220:3260 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032e6584-9acf-469f-b661-faf6555659e1/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032e6584-9acf-469f-b661-faf6555659e1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44e0ecd-cbad-485b-a679-2ba4746209d7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 12:20:58 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 -p 172.16.0.220:3260 --interface default --op new {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3574dd79-5295-4b3b-95e3-721cc3a32ca5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578] added\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578] added
Nov 08 12:20:58 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd052c7-f7f1-4b98-9c9a-a998bb08f38d]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[148394da-55d8-4579-95a8-11f46370e3fc]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZJyeiAtw {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZJyeiAtw" returned: 0 in 0.026s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd61ff7-700b-4498-9c22-7cf35d676232]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZJyeiAtw'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a73ea3-6422-4abc-8e05-f75135d4d0bb]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[28eaf460-949d-48d8-a9b8-01cf26b3c398]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e (non-flash)
Nov 08 12:20:58 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:20:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e (non-flash)
Nov 08 12:20:58 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:20:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 -p 172.16.0.220:3260 --login {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032e6584-9acf-469f-b661-faf6555659e1/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:59 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:20:59 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: d00e1756-34cd-4847-b108-023ba273444a] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:20:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:59 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c35bfe-26fa-4371-b6b6-128e9a355d85]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:20:59 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578, portal: 172.16.0.220,3260]
Nov 08 12:20:59 user nova-compute[74840]: Login to [iface: default, target: iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578, portal: 172.16.0.220,3260] successful.
Nov 08 12:20:59 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:20:59 user nova-compute[74840]: DEBUG nova.compute.manager [req-e5f7d633-f41d-43fe-bee6-bd5dd43a790e req-607f816f-f4cd-4a12-8c2d-10352df10d9b service nova] [instance: d00e1756-34cd-4847-b108-023ba273444a] Received event network-vif-deleted-0273291b-7186-488c-baf2-5f971efec444 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:20:59 user nova-compute[74840]: INFO nova.compute.manager [req-e5f7d633-f41d-43fe-bee6-bd5dd43a790e req-607f816f-f4cd-4a12-8c2d-10352df10d9b service nova] [instance: d00e1756-34cd-4847-b108-023ba273444a] Neutron deleted interface 0273291b-7186-488c-baf2-5f971efec444; detaching it from the instance and deleting it from the info cache
Nov 08 12:20:59 user nova-compute[74840]: DEBUG nova.network.neutron [req-e5f7d633-f41d-43fe-bee6-bd5dd43a790e req-607f816f-f4cd-4a12-8c2d-10352df10d9b service nova] [instance: d00e1756-34cd-4847-b108-023ba273444a] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:20:59 user nova-compute[74840]: INFO nova.compute.manager [-] [instance: d00e1756-34cd-4847-b108-023ba273444a] Took 1.32 seconds to deallocate network for instance.
Nov 08 12:20:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:59 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5842fb9b-25ec-4629-b681-9caec6a42565]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:20:59 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:20:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:59 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:20:59 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:20:59 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=7694MB free_disk=25.218063354492188GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:20:59 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:20:59 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:20:59 user nova-compute[74840]: DEBUG nova.compute.manager [req-e5f7d633-f41d-43fe-bee6-bd5dd43a790e req-607f816f-f4cd-4a12-8c2d-10352df10d9b service nova] [instance: d00e1756-34cd-4847-b108-023ba273444a] Detach interface failed, port_id=0273291b-7186-488c-baf2-5f971efec444, reason: Instance d00e1756-34cd-4847-b108-023ba273444a could not be found. {{(pid=74840) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 12:20:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:59 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd519bcf-5ac7-47a3-9bc2-fea6c32ab8c8]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:20:59 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e (non-flash)
Nov 08 12:20:59 user nova-compute[74840]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)
Nov 08 12:20:59 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:20:59 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e (non-flash)
Nov 08 12:20:59 user nova-compute[74840]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)
Nov 08 12:20:59 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:20:59 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.732s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:20:59 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Connected to 172.16.0.220:3260 {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 12:20:59 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=74840) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 12:20:59 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74840) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 12:20:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:20:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:20:59 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1447cfd-af17-4b33-a0b1-b7dda9f739a9]: (4, ('- - 0', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:20:59 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:20:59 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZJyeiAtw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 12:20:59 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-48f8d86e-6dc0-454f-847d-fce35862933b tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:20:59 user nova-compute[74840]: DEBUG nova.compute.manager [req-0db4b33b-8fa7-407c-9304-ad093741d086 req-103a1d22-1f42-44fc-be78-72058c1ca14f service nova] [instance: d00e1756-34cd-4847-b108-023ba273444a] Received event network-vif-plugged-0273291b-7186-488c-baf2-5f971efec444 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:20:59 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0db4b33b-8fa7-407c-9304-ad093741d086 req-103a1d22-1f42-44fc-be78-72058c1ca14f service nova] Acquiring lock "d00e1756-34cd-4847-b108-023ba273444a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:20:59 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0db4b33b-8fa7-407c-9304-ad093741d086 req-103a1d22-1f42-44fc-be78-72058c1ca14f service nova] Lock "d00e1756-34cd-4847-b108-023ba273444a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:20:59 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0db4b33b-8fa7-407c-9304-ad093741d086 req-103a1d22-1f42-44fc-be78-72058c1ca14f service nova] Lock "d00e1756-34cd-4847-b108-023ba273444a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:20:59 user nova-compute[74840]: DEBUG nova.compute.manager [req-0db4b33b-8fa7-407c-9304-ad093741d086 req-103a1d22-1f42-44fc-be78-72058c1ca14f service nova] [instance: d00e1756-34cd-4847-b108-023ba273444a] No waiting events found dispatching network-vif-plugged-0273291b-7186-488c-baf2-5f971efec444 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:20:59 user nova-compute[74840]: WARNING nova.compute.manager [req-0db4b33b-8fa7-407c-9304-ad093741d086 req-103a1d22-1f42-44fc-be78-72058c1ca14f service nova] [instance: d00e1756-34cd-4847-b108-023ba273444a] Received unexpected event network-vif-plugged-0273291b-7186-488c-baf2-5f971efec444 for instance with vm_state deleted and task_state None.
Nov 08 12:20:59 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance d3e8efc6-7146-46ef-8433-380d7e69120c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:20:59 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 032e6584-9acf-469f-b661-faf6555659e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:20:59 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance d00e1756-34cd-4847-b108-023ba273444a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:20:59 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 4b9fe577-1503-4007-be51-2a714363f8c6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:20:59 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 83c035a0-880b-4170-98bc-b18cae712cfa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:20:59 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 4f6c75c0-e820-47eb-be3e-51179b6df1a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:20:59 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance ffe50042-29bf-4ef3-a148-8698bc75233b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:20:59 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 8b7c490e-4c78-4e07-bc8a-3be2328963d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:20:59 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 832a6445-84ee-43a8-a5bc-a07670602912 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:20:59 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:20:59 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.583s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-48f8d86e-6dc0-454f-847d-fce35862933b tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.509s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG os_brick.utils [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf975f2-8110-457e-9605-fcfb43ff0314]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c8228a11e03c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b4610c-3004-4d7a-9c7f-ce507e0fe52b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cefa399-cd0b-49d5-838f-bff7642e95a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6dc12ff-0e6b-4b6c-91f7-366d039eedda]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Running cmd (subprocess): nvme version {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] 'nvme version' failed. Not Retrying. {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] nvme not present on system {{(pid=74840) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:21:00 user nova-compute[74840]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 12:21:00 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04772c5-687b-44cd-a924-197787e923b7]: (4, '') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74840) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] LIGHTOS: no hostnqn found. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG os_brick.utils [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c8228a11e03c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG nova.virt.block_device [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Updating existing volume attachment record: 92fd702c-1735-45b7-895c-6c10b7feb235 {{(pid=74840) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-48f8d86e-6dc0-454f-847d-fce35862933b tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-48f8d86e-6dc0-454f-847d-fce35862933b tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-48f8d86e-6dc0-454f-847d-fce35862933b tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.400s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:21:00 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-48f8d86e-6dc0-454f-847d-fce35862933b tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Deleted allocations for instance d00e1756-34cd-4847-b108-023ba273444a
Nov 08 12:21:00 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.773s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] <== connect_volume: return (1775ms) {'type': 'block', 'scsi_wwn': '23764383161656562', 'path': '/dev/sdc'} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764383161656562', 'path': '/dev/sdc'} {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Calling os-brick to attach iSCSI Volume {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IHKjeFBk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:21:00 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:21:00 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:21:00 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:21:00 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:21:00 user nova-compute[74840]: INFO os_brick.initiator.connectors.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 12:21:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 -p 172.16.0.220:3260 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb73907-3c33-4470-8466-984d50bfb5d5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 12:21:00 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[01afa6d9-e2b3-427c-b257-738312a8695b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1] added\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1] added
Nov 08 12:21:00 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-48f8d86e-6dc0-454f-847d-fce35862933b tempest-VolumesActionsTest-549796604 tempest-VolumesActionsTest-549796604-project-member] Lock "d00e1756-34cd-4847-b108-023ba273444a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.511s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd50a8e-8605-49c7-a0ec-55a8837f0973]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d639656-bd5c-49ad-982a-38b409bd7cde]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IHKjeFBk {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IHKjeFBk" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b100990a-f1fb-47ce-9b77-9caeee2644bf]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IHKjeFBk'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1fa8fa-e4d8-4ff7-8cb9-4697e6a335ae]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[691142cb-0ce4-4df4-aa75-c8876ba04094]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e (non-flash)
Nov 08 12:21:00 user nova-compute[74840]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)
Nov 08 12:21:00 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e (non-flash)
Nov 08 12:21:00 user nova-compute[74840]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)
Nov 08 12:21:00 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:21:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 -p 172.16.0.220:3260 --login {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 -p 172.16.0.220:3260 --login" returned: 0 in 1.069s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:01 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ced7f51-07de-4ec6-bfbb-51596e15ed68]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:01 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1, portal: 172.16.0.220,3260]
Nov 08 12:21:01 user nova-compute[74840]: Login to [iface: default, target: iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1, portal: 172.16.0.220,3260] successful.
Nov 08 12:21:01 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:21:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:01 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0e5987-1147-4d57-bf01-64b4f94bf607]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:01 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:21:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:01 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e751d6e-f48f-4428-b1cc-aeb714d1b511]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:01 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e (non-flash)
Nov 08 12:21:01 user nova-compute[74840]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)
Nov 08 12:21:01 user nova-compute[74840]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 (non-flash)
Nov 08 12:21:01 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:21:01 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e (non-flash)
Nov 08 12:21:01 user nova-compute[74840]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)
Nov 08 12:21:01 user nova-compute[74840]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 (non-flash)
Nov 08 12:21:01 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:21:01 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.323s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:21:01 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Connected to 172.16.0.220:3260 {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 12:21:01 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=74840) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 12:21:01 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74840) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 12:21:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:01 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c96b2f-7468-4ae0-acc5-cbc4b6c0dea4]: (4, ('- - 0', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:01 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: None {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:21:02 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:21:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IHKjeFBk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 12:21:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.360s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:21:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] <== connect_volume: return (2362ms) {'type': 'block', 'scsi_wwn': '23335373432343932', 'path': '/dev/sdd'} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:21:02 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335373432343932', 'path': '/dev/sdd'} {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 12:21:02 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:02 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Calling os-brick to attach iSCSI Volume {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 12:21:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JQtxDMqH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:21:02 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:21:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:21:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:21:02 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:21:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:21:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:21:02 user nova-compute[74840]: INFO os_brick.initiator.connectors.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 12:21:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 -p 172.16.0.220:3260 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 -p 172.16.0.220:3260" returned: 21 in 0.032s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:03 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8afa3966-733d-47ee-89e5-6d4744e65aba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 12:21:03 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:21:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:03 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb37964d-e68f-4498-b376-3461e157d1e1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7] added\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7] added
Nov 08 12:21:03 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:21:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:03 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[93058d25-feef-4715-b24f-710e20ced163]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:21:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:03 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:21:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:03 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64089b3-52a3-421a-9816-08a009dc47f1]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:21:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JQtxDMqH {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JQtxDMqH" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:03 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56c1e6a-1c77-4ec5-828e-d77716e640fa]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JQtxDMqH'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:21:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:03 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9a810e-664e-4ef6-92cb-ba8e75479a8d]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:21:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:03 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ee4a03-cd55-47f9-a568-655359283354]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e (non-flash)
Nov 08 12:21:03 user nova-compute[74840]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)
Nov 08 12:21:03 user nova-compute[74840]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 (non-flash)
Nov 08 12:21:03 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:21:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e (non-flash)
Nov 08 12:21:03 user nova-compute[74840]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)
Nov 08 12:21:03 user nova-compute[74840]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 (non-flash)
Nov 08 12:21:03 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:21:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 -p 172.16.0.220:3260 --login {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:03 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b11425-f22f-4d9c-a0f2-8c3f9a432053]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7, portal: 172.16.0.220,3260]
Nov 08 12:21:03 user nova-compute[74840]: Login to [iface: default, target: iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7, portal: 172.16.0.220,3260] successful.
Nov 08 12:21:03 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:21:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:03 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf249c6-dd91-4500-b51d-fa5703330444]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:21:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:03 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dfaf6cf-1bb4-43a9-8289-5673e56d55bd]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e (non-flash)
Nov 08 12:21:03 user nova-compute[74840]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)
Nov 08 12:21:03 user nova-compute[74840]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 (non-flash)
Nov 08 12:21:03 user nova-compute[74840]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 (non-flash)
Nov 08 12:21:03 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:21:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e (non-flash)
Nov 08 12:21:03 user nova-compute[74840]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)
Nov 08 12:21:03 user nova-compute[74840]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 (non-flash)
Nov 08 12:21:03 user nova-compute[74840]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 (non-flash)
Nov 08 12:21:03 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:21:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:21:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Connected to 172.16.0.220:3260 {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 12:21:03 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] HCTL ('36', '-', '-', 0) found on session 22 with lun 0 {{(pid=74840) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 12:21:03 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74840) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 12:21:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:03 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6194f891-1eb6-40e3-9e3c-294fcca6f387]: (4, ('- - 0', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:03 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:21:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JQtxDMqH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23264393632633337', 'path': '/dev/sde'} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264393632633337', 'path': '/dev/sde'} {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:19:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-466514081',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-466514081',id=21,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJ9ewnswCin9d0ksrvZPetSoHSWVhALZkDxKTDnNCu1Z50OR8n+Idiz9tDLM+PSL/w10zzvauInz3PdSFJX20TTSB0Hgr43GdvUa1dg0TRW5OrJcMq9AnrhvGJBs502eQ==',key_name='tempest-keypair-385572257',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54e6bce6148d4a0296ece1b35a2db93d',ramdisk_id='',reservation_id='r-e5b9kv2x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1224547504',owner_user_name='tempest-TaggedBootDevicesTest_v242-1224547504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:19:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1eab1412fcbe44c89af927d874068e53',uuid=4b9fe577-1503-4007-be51-2a714363f8c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1fd72b39-7d31-4729-bef7-98f6a5246964", "address": "fa:16:3e:07:9d:e6", "network": {"id": "3fcdf89c-266d-43c1-8ae8-705406698b75", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-157102173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd72b39-7d", "ovs_interfaceid": "1fd72b39-7d31-4729-bef7-98f6a5246964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Converting VIF {"id": "1fd72b39-7d31-4729-bef7-98f6a5246964", "address": "fa:16:3e:07:9d:e6", "network": {"id": "3fcdf89c-266d-43c1-8ae8-705406698b75", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-157102173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd72b39-7d", "ovs_interfaceid": "1fd72b39-7d31-4729-bef7-98f6a5246964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:9d:e6,bridge_name='br-int',has_traffic_filtering=True,id=1fd72b39-7d31-4729-bef7-98f6a5246964,network=Network(3fcdf89c-266d-43c1-8ae8-705406698b75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fd72b39-7d') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:19:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-466514081',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-466514081',id=21,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJ9ewnswCin9d0ksrvZPetSoHSWVhALZkDxKTDnNCu1Z50OR8n+Idiz9tDLM+PSL/w10zzvauInz3PdSFJX20TTSB0Hgr43GdvUa1dg0TRW5OrJcMq9AnrhvGJBs502eQ==',key_name='tempest-keypair-385572257',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54e6bce6148d4a0296ece1b35a2db93d',ramdisk_id='',reservation_id='r-e5b9kv2x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1224547504',owner_user_name='tempest-TaggedBootDevicesTest_v242-1224547504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:19:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1eab1412fcbe44c89af927d874068e53',uuid=4b9fe577-1503-4007-be51-2a714363f8c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87c651bf-a6e8-4290-bbdf-49746754ac54", "address": "fa:16:3e:77:a8:a1", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87c651bf-a6", "ovs_interfaceid": "87c651bf-a6e8-4290-bbdf-49746754ac54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Converting VIF {"id": "87c651bf-a6e8-4290-bbdf-49746754ac54", "address": "fa:16:3e:77:a8:a1", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87c651bf-a6", "ovs_interfaceid": "87c651bf-a6e8-4290-bbdf-49746754ac54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:a8:a1,bridge_name='br-int',has_traffic_filtering=True,id=87c651bf-a6e8-4290-bbdf-49746754ac54,network=Network(9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap87c651bf-a6') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:19:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-466514081',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-466514081',id=21,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJ9ewnswCin9d0ksrvZPetSoHSWVhALZkDxKTDnNCu1Z50OR8n+Idiz9tDLM+PSL/w10zzvauInz3PdSFJX20TTSB0Hgr43GdvUa1dg0TRW5OrJcMq9AnrhvGJBs502eQ==',key_name='tempest-keypair-385572257',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54e6bce6148d4a0296ece1b35a2db93d',ramdisk_id='',reservation_id='r-e5b9kv2x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1224547504',owner_user_name='tempest-TaggedBootDevicesTest_v242-1224547504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:19:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1eab1412fcbe44c89af927d874068e53',uuid=4b9fe577-1503-4007-be51-2a714363f8c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bdec4773-148b-49d7-a461-3a6106fffff6", "address": "fa:16:3e:aa:64:51", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdec4773-14", "ovs_interfaceid": "bdec4773-148b-49d7-a461-3a6106fffff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Converting VIF {"id": "bdec4773-148b-49d7-a461-3a6106fffff6", "address": "fa:16:3e:aa:64:51", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdec4773-14", "ovs_interfaceid": "bdec4773-148b-49d7-a461-3a6106fffff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:64:51,bridge_name='br-int',has_traffic_filtering=True,id=bdec4773-148b-49d7-a461-3a6106fffff6,network=Network(9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbdec4773-14') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:19:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-466514081',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-466514081',id=21,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJ9ewnswCin9d0ksrvZPetSoHSWVhALZkDxKTDnNCu1Z50OR8n+Idiz9tDLM+PSL/w10zzvauInz3PdSFJX20TTSB0Hgr43GdvUa1dg0TRW5OrJcMq9AnrhvGJBs502eQ==',key_name='tempest-keypair-385572257',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54e6bce6148d4a0296ece1b35a2db93d',ramdisk_id='',reservation_id='r-e5b9kv2x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1224547504',owner_user_name='tempest-TaggedBootDevicesTest_v242-1224547504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:19:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1eab1412fcbe44c89af927d874068e53',uuid=4b9fe577-1503-4007-be51-2a714363f8c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "538b2412-4ee2-42a6-9cac-f97be4fc341e", "address": "fa:16:3e:d1:64:e8", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap538b2412-4e", "ovs_interfaceid": "538b2412-4ee2-42a6-9cac-f97be4fc341e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Converting VIF {"id": "538b2412-4ee2-42a6-9cac-f97be4fc341e", "address": "fa:16:3e:d1:64:e8", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap538b2412-4e", "ovs_interfaceid": "538b2412-4ee2-42a6-9cac-f97be4fc341e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:64:e8,bridge_name='br-int',has_traffic_filtering=True,id=538b2412-4ee2-42a6-9cac-f97be4fc341e,network=Network(9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap538b2412-4e') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:19:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-466514081',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-466514081',id=21,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJ9ewnswCin9d0ksrvZPetSoHSWVhALZkDxKTDnNCu1Z50OR8n+Idiz9tDLM+PSL/w10zzvauInz3PdSFJX20TTSB0Hgr43GdvUa1dg0TRW5OrJcMq9AnrhvGJBs502eQ==',key_name='tempest-keypair-385572257',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54e6bce6148d4a0296ece1b35a2db93d',ramdisk_id='',reservation_id='r-e5b9kv2x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1224547504',owner_user_name='tempest-TaggedBootDevicesTest_v242-1224547504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:19:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1eab1412fcbe44c89af927d874068e53',uuid=4b9fe577-1503-4007-be51-2a714363f8c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "afed888a-e688-452a-846f-4e9b398ff736", "address": "fa:16:3e:72:e8:99", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafed888a-e6", "ovs_interfaceid": "afed888a-e688-452a-846f-4e9b398ff736", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Converting VIF {"id": "afed888a-e688-452a-846f-4e9b398ff736", "address": "fa:16:3e:72:e8:99", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafed888a-e6", "ovs_interfaceid": "afed888a-e688-452a-846f-4e9b398ff736", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:e8:99,bridge_name='br-int',has_traffic_filtering=True,id=afed888a-e688-452a-846f-4e9b398ff736,network=Network(9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafed888a-e6') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:19:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-466514081',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-466514081',id=21,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJ9ewnswCin9d0ksrvZPetSoHSWVhALZkDxKTDnNCu1Z50OR8n+Idiz9tDLM+PSL/w10zzvauInz3PdSFJX20TTSB0Hgr43GdvUa1dg0TRW5OrJcMq9AnrhvGJBs502eQ==',key_name='tempest-keypair-385572257',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54e6bce6148d4a0296ece1b35a2db93d',ramdisk_id='',reservation_id='r-e5b9kv2x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1224547504',owner_user_name='tempest-TaggedBootDevicesTest_v242-1224547504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:19:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1eab1412fcbe44c89af927d874068e53',uuid=4b9fe577-1503-4007-be51-2a714363f8c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20547543-4dc1-4158-bb9e-515cce88d3ef", "address": "fa:16:3e:c9:2d:ef", "network": {"id": "4a786612-4da0-47c3-94bb-2a73e6567310", "bridge": "br-int", "label": "tempest-device-tagging-net2-1454321418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20547543-4d", "ovs_interfaceid": "20547543-4dc1-4158-bb9e-515cce88d3ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Converting VIF {"id": "20547543-4dc1-4158-bb9e-515cce88d3ef", "address": "fa:16:3e:c9:2d:ef", "network": {"id": "4a786612-4da0-47c3-94bb-2a73e6567310", "bridge": "br-int", "label": "tempest-device-tagging-net2-1454321418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20547543-4d", "ovs_interfaceid": "20547543-4dc1-4158-bb9e-515cce88d3ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:2d:ef,bridge_name='br-int',has_traffic_filtering=True,id=20547543-4dc1-4158-bb9e-515cce88d3ef,network=Network(4a786612-4da0-47c3-94bb-2a73e6567310),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20547543-4d') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:19:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-466514081',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-466514081',id=21,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJ9ewnswCin9d0ksrvZPetSoHSWVhALZkDxKTDnNCu1Z50OR8n+Idiz9tDLM+PSL/w10zzvauInz3PdSFJX20TTSB0Hgr43GdvUa1dg0TRW5OrJcMq9AnrhvGJBs502eQ==',key_name='tempest-keypair-385572257',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54e6bce6148d4a0296ece1b35a2db93d',ramdisk_id='',reservation_id='r-e5b9kv2x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1224547504',owner_user_name='tempest-TaggedBootDevicesTest_v242-1224547504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:19:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1eab1412fcbe44c89af927d874068e53',uuid=4b9fe577-1503-4007-be51-2a714363f8c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68377219-20e9-4c9f-b8c7-bcf0a798655e", "address": "fa:16:3e:24:1b:7e", "network": {"id": "4a786612-4da0-47c3-94bb-2a73e6567310", "bridge": "br-int", "label": "tempest-device-tagging-net2-1454321418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68377219-20", "ovs_interfaceid": "68377219-20e9-4c9f-b8c7-bcf0a798655e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Converting VIF {"id": "68377219-20e9-4c9f-b8c7-bcf0a798655e", "address": "fa:16:3e:24:1b:7e", "network": {"id": "4a786612-4da0-47c3-94bb-2a73e6567310", "bridge": "br-int", "label": "tempest-device-tagging-net2-1454321418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68377219-20", "ovs_interfaceid": "68377219-20e9-4c9f-b8c7-bcf0a798655e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:1b:7e,bridge_name='br-int',has_traffic_filtering=True,id=68377219-20e9-4c9f-b8c7-bcf0a798655e,network=Network(4a786612-4da0-47c3-94bb-2a73e6567310),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68377219-20') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG nova.objects.instance [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b9fe577-1503-4007-be51-2a714363f8c6 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:21:04 user nova-compute[74840]:   <uuid>4b9fe577-1503-4007-be51-2a714363f8c6</uuid>
Nov 08 12:21:04 user nova-compute[74840]:   <name>instance-00000015</name>
Nov 08 12:21:04 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:21:04 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:21:04 user nova-compute[74840]:   <metadata>
Nov 08 12:21:04 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:21:04 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:21:04 user nova-compute[74840]:       <nova:name>tempest-device-tagging-server-466514081</nova:name>
Nov 08 12:21:04 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:20:58</nova:creationTime>
Nov 08 12:21:04 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:21:04 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:21:04 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:21:04 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:21:04 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:21:04 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:21:04 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:21:04 user nova-compute[74840]:       <nova:owner>
Nov 08 12:21:04 user nova-compute[74840]:         <nova:user uuid="1eab1412fcbe44c89af927d874068e53">tempest-TaggedBootDevicesTest_v242-1224547504-project-member</nova:user>
Nov 08 12:21:04 user nova-compute[74840]:         <nova:project uuid="54e6bce6148d4a0296ece1b35a2db93d">tempest-TaggedBootDevicesTest_v242-1224547504</nova:project>
Nov 08 12:21:04 user nova-compute[74840]:       </nova:owner>
Nov 08 12:21:04 user nova-compute[74840]:       <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:21:04 user nova-compute[74840]:       <nova:ports>
Nov 08 12:21:04 user nova-compute[74840]:         <nova:port uuid="1fd72b39-7d31-4729-bef7-98f6a5246964">
Nov 08 12:21:04 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 08 12:21:04 user nova-compute[74840]:         </nova:port>
Nov 08 12:21:04 user nova-compute[74840]:         <nova:port uuid="87c651bf-a6e8-4290-bbdf-49746754ac54">
Nov 08 12:21:04 user nova-compute[74840]:           <nova:ip type="fixed" address="10.1.1.244" ipVersion="4"/>
Nov 08 12:21:04 user nova-compute[74840]:         </nova:port>
Nov 08 12:21:04 user nova-compute[74840]:         <nova:port uuid="bdec4773-148b-49d7-a461-3a6106fffff6">
Nov 08 12:21:04 user nova-compute[74840]:           <nova:ip type="fixed" address="10.1.1.65" ipVersion="4"/>
Nov 08 12:21:04 user nova-compute[74840]:         </nova:port>
Nov 08 12:21:04 user nova-compute[74840]:         <nova:port uuid="538b2412-4ee2-42a6-9cac-f97be4fc341e">
Nov 08 12:21:04 user nova-compute[74840]:           <nova:ip type="fixed" address="10.1.1.105" ipVersion="4"/>
Nov 08 12:21:04 user nova-compute[74840]:         </nova:port>
Nov 08 12:21:04 user nova-compute[74840]:         <nova:port uuid="afed888a-e688-452a-846f-4e9b398ff736">
Nov 08 12:21:04 user nova-compute[74840]:           <nova:ip type="fixed" address="10.1.1.162" ipVersion="4"/>
Nov 08 12:21:04 user nova-compute[74840]:         </nova:port>
Nov 08 12:21:04 user nova-compute[74840]:         <nova:port uuid="20547543-4dc1-4158-bb9e-515cce88d3ef">
Nov 08 12:21:04 user nova-compute[74840]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 08 12:21:04 user nova-compute[74840]:         </nova:port>
Nov 08 12:21:04 user nova-compute[74840]:         <nova:port uuid="68377219-20e9-4c9f-b8c7-bcf0a798655e">
Nov 08 12:21:04 user nova-compute[74840]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 08 12:21:04 user nova-compute[74840]:         </nova:port>
Nov 08 12:21:04 user nova-compute[74840]:       </nova:ports>
Nov 08 12:21:04 user nova-compute[74840]:     </nova:instance>
Nov 08 12:21:04 user nova-compute[74840]:   </metadata>
Nov 08 12:21:04 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:21:04 user nova-compute[74840]:     <system>
Nov 08 12:21:04 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:21:04 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:21:04 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:21:04 user nova-compute[74840]:       <entry name="serial">4b9fe577-1503-4007-be51-2a714363f8c6</entry>
Nov 08 12:21:04 user nova-compute[74840]:       <entry name="uuid">4b9fe577-1503-4007-be51-2a714363f8c6</entry>
Nov 08 12:21:04 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:21:04 user nova-compute[74840]:     </system>
Nov 08 12:21:04 user nova-compute[74840]:   </sysinfo>
Nov 08 12:21:04 user nova-compute[74840]:   <os>
Nov 08 12:21:04 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:21:04 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:21:04 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:21:04 user nova-compute[74840]:   </os>
Nov 08 12:21:04 user nova-compute[74840]:   <features>
Nov 08 12:21:04 user nova-compute[74840]:     <acpi/>
Nov 08 12:21:04 user nova-compute[74840]:     <apic/>
Nov 08 12:21:04 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:21:04 user nova-compute[74840]:   </features>
Nov 08 12:21:04 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:21:04 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:21:04 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:21:04 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:21:04 user nova-compute[74840]:   </clock>
Nov 08 12:21:04 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:21:04 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:21:04 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:21:04 user nova-compute[74840]:   </cpu>
Nov 08 12:21:04 user nova-compute[74840]:   <devices>
Nov 08 12:21:04 user nova-compute[74840]:     <disk type="file" device="cdrom">
Nov 08 12:21:04 user nova-compute[74840]:       <driver name="qemu" type="raw" cache="none"/>
Nov 08 12:21:04 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/4b9fe577-1503-4007-be51-2a714363f8c6/disk.config"/>
Nov 08 12:21:04 user nova-compute[74840]:       <target dev="hda" bus="ide"/>
Nov 08 12:21:04 user nova-compute[74840]:     </disk>
Nov 08 12:21:04 user nova-compute[74840]:     <disk type="block" device="disk">
Nov 08 12:21:04 user nova-compute[74840]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:21:04 user nova-compute[74840]:       <source dev="/dev/sdc"/>
Nov 08 12:21:04 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:21:04 user nova-compute[74840]:       <serial>d6c66458-63dd-40c6-b1d8-b2cc87cb5578</serial>
Nov 08 12:21:04 user nova-compute[74840]:     </disk>
Nov 08 12:21:04 user nova-compute[74840]:     <disk type="block" device="disk">
Nov 08 12:21:04 user nova-compute[74840]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:21:04 user nova-compute[74840]:       <source dev="/dev/sdd"/>
Nov 08 12:21:04 user nova-compute[74840]:       <target dev="vdb" bus="virtio"/>
Nov 08 12:21:04 user nova-compute[74840]:       <serial>e7ad280d-7a9d-414d-ad87-3c0daed99fa1</serial>
Nov 08 12:21:04 user nova-compute[74840]:     </disk>
Nov 08 12:21:04 user nova-compute[74840]:     <disk type="block" device="disk">
Nov 08 12:21:04 user nova-compute[74840]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:21:04 user nova-compute[74840]:       <source dev="/dev/sde"/>
Nov 08 12:21:04 user nova-compute[74840]:       <target dev="vdc" bus="virtio"/>
Nov 08 12:21:04 user nova-compute[74840]:       <serial>1778abb2-81cd-4a05-8063-b6ea529685a7</serial>
Nov 08 12:21:04 user nova-compute[74840]:     </disk>
Nov 08 12:21:04 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:21:04 user nova-compute[74840]:       <mac address="fa:16:3e:07:9d:e6"/>
Nov 08 12:21:04 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:21:04 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:21:04 user nova-compute[74840]:       <target dev="tap1fd72b39-7d"/>
Nov 08 12:21:04 user nova-compute[74840]:     </interface>
Nov 08 12:21:04 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:21:04 user nova-compute[74840]:       <mac address="fa:16:3e:77:a8:a1"/>
Nov 08 12:21:04 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:21:04 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:21:04 user nova-compute[74840]:       <target dev="tap87c651bf-a6"/>
Nov 08 12:21:04 user nova-compute[74840]:     </interface>
Nov 08 12:21:04 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:21:04 user nova-compute[74840]:       <mac address="fa:16:3e:aa:64:51"/>
Nov 08 12:21:04 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:21:04 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:21:04 user nova-compute[74840]:       <target dev="tapbdec4773-14"/>
Nov 08 12:21:04 user nova-compute[74840]:     </interface>
Nov 08 12:21:04 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:21:04 user nova-compute[74840]:       <mac address="fa:16:3e:d1:64:e8"/>
Nov 08 12:21:04 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:21:04 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:21:04 user nova-compute[74840]:       <target dev="tap538b2412-4e"/>
Nov 08 12:21:04 user nova-compute[74840]:     </interface>
Nov 08 12:21:04 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:21:04 user nova-compute[74840]:       <mac address="fa:16:3e:72:e8:99"/>
Nov 08 12:21:04 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:21:04 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:21:04 user nova-compute[74840]:       <target dev="tapafed888a-e6"/>
Nov 08 12:21:04 user nova-compute[74840]:     </interface>
Nov 08 12:21:04 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:21:04 user nova-compute[74840]:       <mac address="fa:16:3e:c9:2d:ef"/>
Nov 08 12:21:04 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:21:04 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:21:04 user nova-compute[74840]:       <target dev="tap20547543-4d"/>
Nov 08 12:21:04 user nova-compute[74840]:     </interface>
Nov 08 12:21:04 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:21:04 user nova-compute[74840]:       <mac address="fa:16:3e:24:1b:7e"/>
Nov 08 12:21:04 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:21:04 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:21:04 user nova-compute[74840]:       <target dev="tap68377219-20"/>
Nov 08 12:21:04 user nova-compute[74840]:     </interface>
Nov 08 12:21:04 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:21:04 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/4b9fe577-1503-4007-be51-2a714363f8c6/console.log" append="off"/>
Nov 08 12:21:04 user nova-compute[74840]:     </serial>
Nov 08 12:21:04 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:21:04 user nova-compute[74840]:     <video>
Nov 08 12:21:04 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:21:04 user nova-compute[74840]:     </video>
Nov 08 12:21:04 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:21:04 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:21:04 user nova-compute[74840]:     </rng>
Nov 08 12:21:04 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:21:04 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:21:04 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:21:04 user nova-compute[74840]:     </memballoon>
Nov 08 12:21:04 user nova-compute[74840]:   </devices>
Nov 08 12:21:04 user nova-compute[74840]: </domain>
Nov 08 12:21:04 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:19:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-466514081',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-466514081',id=21,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJ9ewnswCin9d0ksrvZPetSoHSWVhALZkDxKTDnNCu1Z50OR8n+Idiz9tDLM+PSL/w10zzvauInz3PdSFJX20TTSB0Hgr43GdvUa1dg0TRW5OrJcMq9AnrhvGJBs502eQ==',key_name='tempest-keypair-385572257',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54e6bce6148d4a0296ece1b35a2db93d',ramdisk_id='',reservation_id='r-e5b9kv2x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1224547504',owner_user_name='tempest-TaggedBootDevicesTest_v242-1224547504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:19:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1eab1412fcbe44c89af927d874068e53',uuid=4b9fe577-1503-4007-be51-2a714363f8c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1fd72b39-7d31-4729-bef7-98f6a5246964", "address": "fa:16:3e:07:9d:e6", "network": {"id": "3fcdf89c-266d-43c1-8ae8-705406698b75", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-157102173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd72b39-7d", "ovs_interfaceid": "1fd72b39-7d31-4729-bef7-98f6a5246964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Converting VIF {"id": "1fd72b39-7d31-4729-bef7-98f6a5246964", "address": "fa:16:3e:07:9d:e6", "network": {"id": "3fcdf89c-266d-43c1-8ae8-705406698b75", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-157102173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd72b39-7d", "ovs_interfaceid": "1fd72b39-7d31-4729-bef7-98f6a5246964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:9d:e6,bridge_name='br-int',has_traffic_filtering=True,id=1fd72b39-7d31-4729-bef7-98f6a5246964,network=Network(3fcdf89c-266d-43c1-8ae8-705406698b75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fd72b39-7d') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG os_vif [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:9d:e6,bridge_name='br-int',has_traffic_filtering=True,id=1fd72b39-7d31-4729-bef7-98f6a5246964,network=Network(3fcdf89c-266d-43c1-8ae8-705406698b75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fd72b39-7d') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '07f31423-93c6-5e36-b889-e958e7fa51d5', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1fd72b39-7d, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1fd72b39-7d, col_values=(('qos', UUID('fcca6a0a-a643-42e4-8e07-02a5b45ea2c2')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1fd72b39-7d, col_values=(('external_ids', {'iface-id': '1fd72b39-7d31-4729-bef7-98f6a5246964', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:9d:e6', 'vm-uuid': '4b9fe577-1503-4007-be51-2a714363f8c6'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:04 user nova-compute[74840]: INFO os_vif [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:9d:e6,bridge_name='br-int',has_traffic_filtering=True,id=1fd72b39-7d31-4729-bef7-98f6a5246964,network=Network(3fcdf89c-266d-43c1-8ae8-705406698b75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fd72b39-7d')
Nov 08 12:21:04 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:19:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-466514081',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-466514081',id=21,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJ9ewnswCin9d0ksrvZPetSoHSWVhALZkDxKTDnNCu1Z50OR8n+Idiz9tDLM+PSL/w10zzvauInz3PdSFJX20TTSB0Hgr43GdvUa1dg0TRW5OrJcMq9AnrhvGJBs502eQ==',key_name='tempest-keypair-385572257',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54e6bce6148d4a0296ece1b35a2db93d',ramdisk_id='',reservation_id='r-e5b9kv2x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1224547504',owner_user_name='tempest-TaggedBootDevicesTest_v242-1224547504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:19:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1eab1412fcbe44c89af927d874068e53',uuid=4b9fe577-1503-4007-be51-2a714363f8c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87c651bf-a6e8-4290-bbdf-49746754ac54", "address": "fa:16:3e:77:a8:a1", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87c651bf-a6", "ovs_interfaceid": "87c651bf-a6e8-4290-bbdf-49746754ac54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Converting VIF {"id": "87c651bf-a6e8-4290-bbdf-49746754ac54", "address": "fa:16:3e:77:a8:a1", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87c651bf-a6", "ovs_interfaceid": "87c651bf-a6e8-4290-bbdf-49746754ac54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:a8:a1,bridge_name='br-int',has_traffic_filtering=True,id=87c651bf-a6e8-4290-bbdf-49746754ac54,network=Network(9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap87c651bf-a6') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG os_vif [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:a8:a1,bridge_name='br-int',has_traffic_filtering=True,id=87c651bf-a6e8-4290-bbdf-49746754ac54,network=Network(9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap87c651bf-a6') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '08078bc7-1ccd-5d7b-b341-8d32fcd5c9db', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap87c651bf-a6, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap87c651bf-a6, col_values=(('qos', UUID('08611cb3-46b2-4376-b435-4adac6057eb6')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap87c651bf-a6, col_values=(('external_ids', {'iface-id': '87c651bf-a6e8-4290-bbdf-49746754ac54', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:a8:a1', 'vm-uuid': '4b9fe577-1503-4007-be51-2a714363f8c6'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:04 user nova-compute[74840]: INFO os_vif [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:a8:a1,bridge_name='br-int',has_traffic_filtering=True,id=87c651bf-a6e8-4290-bbdf-49746754ac54,network=Network(9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap87c651bf-a6')
Nov 08 12:21:04 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:19:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-466514081',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-466514081',id=21,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJ9ewnswCin9d0ksrvZPetSoHSWVhALZkDxKTDnNCu1Z50OR8n+Idiz9tDLM+PSL/w10zzvauInz3PdSFJX20TTSB0Hgr43GdvUa1dg0TRW5OrJcMq9AnrhvGJBs502eQ==',key_name='tempest-keypair-385572257',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54e6bce6148d4a0296ece1b35a2db93d',ramdisk_id='',reservation_id='r-e5b9kv2x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1224547504',owner_user_name='tempest-TaggedBootDevicesTest_v242-1224547504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:19:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1eab1412fcbe44c89af927d874068e53',uuid=4b9fe577-1503-4007-be51-2a714363f8c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bdec4773-148b-49d7-a461-3a6106fffff6", "address": "fa:16:3e:aa:64:51", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdec4773-14", "ovs_interfaceid": "bdec4773-148b-49d7-a461-3a6106fffff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Converting VIF {"id": "bdec4773-148b-49d7-a461-3a6106fffff6", "address": "fa:16:3e:aa:64:51", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdec4773-14", "ovs_interfaceid": "bdec4773-148b-49d7-a461-3a6106fffff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:64:51,bridge_name='br-int',has_traffic_filtering=True,id=bdec4773-148b-49d7-a461-3a6106fffff6,network=Network(9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbdec4773-14') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG os_vif [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:64:51,bridge_name='br-int',has_traffic_filtering=True,id=bdec4773-148b-49d7-a461-3a6106fffff6,network=Network(9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbdec4773-14') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a9c7353a-9487-5a9c-9800-343d36556a74', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbdec4773-14, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbdec4773-14, col_values=(('qos', UUID('933b845a-cc4e-451b-b0a6-6e44b503eecd')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbdec4773-14, col_values=(('external_ids', {'iface-id': 'bdec4773-148b-49d7-a461-3a6106fffff6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:64:51', 'vm-uuid': '4b9fe577-1503-4007-be51-2a714363f8c6'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:04 user nova-compute[74840]: INFO os_vif [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:64:51,bridge_name='br-int',has_traffic_filtering=True,id=bdec4773-148b-49d7-a461-3a6106fffff6,network=Network(9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbdec4773-14')
Nov 08 12:21:04 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:19:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-466514081',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-466514081',id=21,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJ9ewnswCin9d0ksrvZPetSoHSWVhALZkDxKTDnNCu1Z50OR8n+Idiz9tDLM+PSL/w10zzvauInz3PdSFJX20TTSB0Hgr43GdvUa1dg0TRW5OrJcMq9AnrhvGJBs502eQ==',key_name='tempest-keypair-385572257',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54e6bce6148d4a0296ece1b35a2db93d',ramdisk_id='',reservation_id='r-e5b9kv2x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1224547504',owner_user_name='tempest-TaggedBootDevicesTest_v242-1224547504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:19:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1eab1412fcbe44c89af927d874068e53',uuid=4b9fe577-1503-4007-be51-2a714363f8c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "538b2412-4ee2-42a6-9cac-f97be4fc341e", "address": "fa:16:3e:d1:64:e8", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap538b2412-4e", "ovs_interfaceid": "538b2412-4ee2-42a6-9cac-f97be4fc341e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Converting VIF {"id": "538b2412-4ee2-42a6-9cac-f97be4fc341e", "address": "fa:16:3e:d1:64:e8", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap538b2412-4e", "ovs_interfaceid": "538b2412-4ee2-42a6-9cac-f97be4fc341e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:64:e8,bridge_name='br-int',has_traffic_filtering=True,id=538b2412-4ee2-42a6-9cac-f97be4fc341e,network=Network(9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap538b2412-4e') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG os_vif [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:64:e8,bridge_name='br-int',has_traffic_filtering=True,id=538b2412-4ee2-42a6-9cac-f97be4fc341e,network=Network(9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap538b2412-4e') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e5c66607-a655-5a5b-bf01-ab07728701ce', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap538b2412-4e, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap538b2412-4e, col_values=(('qos', UUID('fdb71d99-8001-4ef1-a395-b8241c88062f')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap538b2412-4e, col_values=(('external_ids', {'iface-id': '538b2412-4ee2-42a6-9cac-f97be4fc341e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:64:e8', 'vm-uuid': '4b9fe577-1503-4007-be51-2a714363f8c6'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:04 user nova-compute[74840]: INFO os_vif [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:64:e8,bridge_name='br-int',has_traffic_filtering=True,id=538b2412-4ee2-42a6-9cac-f97be4fc341e,network=Network(9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap538b2412-4e')
Nov 08 12:21:04 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:19:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-466514081',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-466514081',id=21,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJ9ewnswCin9d0ksrvZPetSoHSWVhALZkDxKTDnNCu1Z50OR8n+Idiz9tDLM+PSL/w10zzvauInz3PdSFJX20TTSB0Hgr43GdvUa1dg0TRW5OrJcMq9AnrhvGJBs502eQ==',key_name='tempest-keypair-385572257',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54e6bce6148d4a0296ece1b35a2db93d',ramdisk_id='',reservation_id='r-e5b9kv2x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1224547504',owner_user_name='tempest-TaggedBootDevicesTest_v242-1224547504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:19:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1eab1412fcbe44c89af927d874068e53',uuid=4b9fe577-1503-4007-be51-2a714363f8c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "afed888a-e688-452a-846f-4e9b398ff736", "address": "fa:16:3e:72:e8:99", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafed888a-e6", "ovs_interfaceid": "afed888a-e688-452a-846f-4e9b398ff736", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Converting VIF {"id": "afed888a-e688-452a-846f-4e9b398ff736", "address": "fa:16:3e:72:e8:99", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafed888a-e6", "ovs_interfaceid": "afed888a-e688-452a-846f-4e9b398ff736", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:e8:99,bridge_name='br-int',has_traffic_filtering=True,id=afed888a-e688-452a-846f-4e9b398ff736,network=Network(9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafed888a-e6') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG os_vif [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:e8:99,bridge_name='br-int',has_traffic_filtering=True,id=afed888a-e688-452a-846f-4e9b398ff736,network=Network(9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafed888a-e6') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e96fb48b-8f47-5267-b49f-4d0aae3cf07e', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapafed888a-e6, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapafed888a-e6, col_values=(('qos', UUID('03cebdac-d95a-4c3c-b910-6adc8e53d1fb')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapafed888a-e6, col_values=(('external_ids', {'iface-id': 'afed888a-e688-452a-846f-4e9b398ff736', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:e8:99', 'vm-uuid': '4b9fe577-1503-4007-be51-2a714363f8c6'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:04 user nova-compute[74840]: INFO os_vif [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:e8:99,bridge_name='br-int',has_traffic_filtering=True,id=afed888a-e688-452a-846f-4e9b398ff736,network=Network(9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafed888a-e6')
Nov 08 12:21:04 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:19:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-466514081',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-466514081',id=21,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJ9ewnswCin9d0ksrvZPetSoHSWVhALZkDxKTDnNCu1Z50OR8n+Idiz9tDLM+PSL/w10zzvauInz3PdSFJX20TTSB0Hgr43GdvUa1dg0TRW5OrJcMq9AnrhvGJBs502eQ==',key_name='tempest-keypair-385572257',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54e6bce6148d4a0296ece1b35a2db93d',ramdisk_id='',reservation_id='r-e5b9kv2x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1224547504',owner_user_name='tempest-TaggedBootDevicesTest_v242-1224547504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:19:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1eab1412fcbe44c89af927d874068e53',uuid=4b9fe577-1503-4007-be51-2a714363f8c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20547543-4dc1-4158-bb9e-515cce88d3ef", "address": "fa:16:3e:c9:2d:ef", "network": {"id": "4a786612-4da0-47c3-94bb-2a73e6567310", "bridge": "br-int", "label": "tempest-device-tagging-net2-1454321418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20547543-4d", "ovs_interfaceid": "20547543-4dc1-4158-bb9e-515cce88d3ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Converting VIF {"id": "20547543-4dc1-4158-bb9e-515cce88d3ef", "address": "fa:16:3e:c9:2d:ef", "network": {"id": "4a786612-4da0-47c3-94bb-2a73e6567310", "bridge": "br-int", "label": "tempest-device-tagging-net2-1454321418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20547543-4d", "ovs_interfaceid": "20547543-4dc1-4158-bb9e-515cce88d3ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:2d:ef,bridge_name='br-int',has_traffic_filtering=True,id=20547543-4dc1-4158-bb9e-515cce88d3ef,network=Network(4a786612-4da0-47c3-94bb-2a73e6567310),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20547543-4d') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG os_vif [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:2d:ef,bridge_name='br-int',has_traffic_filtering=True,id=20547543-4dc1-4158-bb9e-515cce88d3ef,network=Network(4a786612-4da0-47c3-94bb-2a73e6567310),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20547543-4d') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '15486876-f974-54c9-8e67-1f9b80fb6d33', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap20547543-4d, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap20547543-4d, col_values=(('qos', UUID('ca253e76-20d7-439f-b384-807443b3f54e')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap20547543-4d, col_values=(('external_ids', {'iface-id': '20547543-4dc1-4158-bb9e-515cce88d3ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:2d:ef', 'vm-uuid': '4b9fe577-1503-4007-be51-2a714363f8c6'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:04 user nova-compute[74840]: INFO os_vif [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:2d:ef,bridge_name='br-int',has_traffic_filtering=True,id=20547543-4dc1-4158-bb9e-515cce88d3ef,network=Network(4a786612-4da0-47c3-94bb-2a73e6567310),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20547543-4d')
Nov 08 12:21:04 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:19:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-466514081',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-466514081',id=21,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJ9ewnswCin9d0ksrvZPetSoHSWVhALZkDxKTDnNCu1Z50OR8n+Idiz9tDLM+PSL/w10zzvauInz3PdSFJX20TTSB0Hgr43GdvUa1dg0TRW5OrJcMq9AnrhvGJBs502eQ==',key_name='tempest-keypair-385572257',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54e6bce6148d4a0296ece1b35a2db93d',ramdisk_id='',reservation_id='r-e5b9kv2x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1224547504',owner_user_name='tempest-TaggedBootDevicesTest_v242-1224547504-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:19:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1eab1412fcbe44c89af927d874068e53',uuid=4b9fe577-1503-4007-be51-2a714363f8c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68377219-20e9-4c9f-b8c7-bcf0a798655e", "address": "fa:16:3e:24:1b:7e", "network": {"id": "4a786612-4da0-47c3-94bb-2a73e6567310", "bridge": "br-int", "label": "tempest-device-tagging-net2-1454321418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68377219-20", "ovs_interfaceid": "68377219-20e9-4c9f-b8c7-bcf0a798655e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Converting VIF {"id": "68377219-20e9-4c9f-b8c7-bcf0a798655e", "address": "fa:16:3e:24:1b:7e", "network": {"id": "4a786612-4da0-47c3-94bb-2a73e6567310", "bridge": "br-int", "label": "tempest-device-tagging-net2-1454321418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68377219-20", "ovs_interfaceid": "68377219-20e9-4c9f-b8c7-bcf0a798655e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:1b:7e,bridge_name='br-int',has_traffic_filtering=True,id=68377219-20e9-4c9f-b8c7-bcf0a798655e,network=Network(4a786612-4da0-47c3-94bb-2a73e6567310),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68377219-20') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG os_vif [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:1b:7e,bridge_name='br-int',has_traffic_filtering=True,id=68377219-20e9-4c9f-b8c7-bcf0a798655e,network=Network(4a786612-4da0-47c3-94bb-2a73e6567310),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68377219-20') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4736c684-4383-5f6e-bb26-eadc3352f434', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap68377219-20, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap68377219-20, col_values=(('qos', UUID('92643742-af81-4096-a1f4-3cef74c3fbaf')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap68377219-20, col_values=(('external_ids', {'iface-id': '68377219-20e9-4c9f-b8c7-bcf0a798655e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:1b:7e', 'vm-uuid': '4b9fe577-1503-4007-be51-2a714363f8c6'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:21:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:05 user nova-compute[74840]: INFO os_vif [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:1b:7e,bridge_name='br-int',has_traffic_filtering=True,id=68377219-20e9-4c9f-b8c7-bcf0a798655e,network=Network(4a786612-4da0-47c3-94bb-2a73e6567310),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68377219-20')
Nov 08 12:21:05 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] No BDM found with device name hda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:21:05 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:21:05 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] No VIF found with MAC fa:16:3e:07:9d:e6, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:21:05 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] No VIF found with MAC fa:16:3e:72:e8:99, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:21:05 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Using config drive
Nov 08 12:21:05 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Creating config drive at /opt/stack/data/nova/instances/4b9fe577-1503-4007-be51-2a714363f8c6/disk.config
Nov 08 12:21:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4b9fe577-1503-4007-be51-2a714363f8c6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpf7d_d_wv {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4b9fe577-1503-4007-be51-2a714363f8c6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpf7d_d_wv" returned: 0 in 0.055s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:05 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:21:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:07 user nova-compute[74840]: DEBUG nova.compute.manager [req-aea1e6ac-b562-4220-b3f1-4e0fc6ee7a6c req-647f5a75-7a72-498a-ab49-cf0a112b1a62 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received event network-vif-plugged-1fd72b39-7d31-4729-bef7-98f6a5246964 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:21:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-aea1e6ac-b562-4220-b3f1-4e0fc6ee7a6c req-647f5a75-7a72-498a-ab49-cf0a112b1a62 service nova] Acquiring lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:21:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-aea1e6ac-b562-4220-b3f1-4e0fc6ee7a6c req-647f5a75-7a72-498a-ab49-cf0a112b1a62 service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:21:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-aea1e6ac-b562-4220-b3f1-4e0fc6ee7a6c req-647f5a75-7a72-498a-ab49-cf0a112b1a62 service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:21:07 user nova-compute[74840]: DEBUG nova.compute.manager [req-aea1e6ac-b562-4220-b3f1-4e0fc6ee7a6c req-647f5a75-7a72-498a-ab49-cf0a112b1a62 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] No waiting events found dispatching network-vif-plugged-1fd72b39-7d31-4729-bef7-98f6a5246964 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:21:07 user nova-compute[74840]: WARNING nova.compute.manager [req-aea1e6ac-b562-4220-b3f1-4e0fc6ee7a6c req-647f5a75-7a72-498a-ab49-cf0a112b1a62 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received unexpected event network-vif-plugged-1fd72b39-7d31-4729-bef7-98f6a5246964 for instance with vm_state building and task_state spawning.
Nov 08 12:21:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:07 user nova-compute[74840]: DEBUG nova.compute.manager [req-3bd863a1-6a26-4d75-b05e-ca61df42e173 req-57ded179-c013-4a85-a7fd-50659aa9fdb2 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received event network-vif-plugged-87c651bf-a6e8-4290-bbdf-49746754ac54 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:21:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3bd863a1-6a26-4d75-b05e-ca61df42e173 req-57ded179-c013-4a85-a7fd-50659aa9fdb2 service nova] Acquiring lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:21:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3bd863a1-6a26-4d75-b05e-ca61df42e173 req-57ded179-c013-4a85-a7fd-50659aa9fdb2 service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:21:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3bd863a1-6a26-4d75-b05e-ca61df42e173 req-57ded179-c013-4a85-a7fd-50659aa9fdb2 service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:21:07 user nova-compute[74840]: DEBUG nova.compute.manager [req-3bd863a1-6a26-4d75-b05e-ca61df42e173 req-57ded179-c013-4a85-a7fd-50659aa9fdb2 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] No waiting events found dispatching network-vif-plugged-87c651bf-a6e8-4290-bbdf-49746754ac54 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:21:07 user nova-compute[74840]: WARNING nova.compute.manager [req-3bd863a1-6a26-4d75-b05e-ca61df42e173 req-57ded179-c013-4a85-a7fd-50659aa9fdb2 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received unexpected event network-vif-plugged-87c651bf-a6e8-4290-bbdf-49746754ac54 for instance with vm_state building and task_state spawning.
Nov 08 12:21:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:07 user nova-compute[74840]: DEBUG nova.compute.manager [req-dc7d6254-a642-4af5-9923-088fdbae29d5 req-d4d9daee-2d61-4dd0-9273-8471ecdc67e3 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received event network-vif-plugged-bdec4773-148b-49d7-a461-3a6106fffff6 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:21:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-dc7d6254-a642-4af5-9923-088fdbae29d5 req-d4d9daee-2d61-4dd0-9273-8471ecdc67e3 service nova] Acquiring lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:21:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-dc7d6254-a642-4af5-9923-088fdbae29d5 req-d4d9daee-2d61-4dd0-9273-8471ecdc67e3 service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:21:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-dc7d6254-a642-4af5-9923-088fdbae29d5 req-d4d9daee-2d61-4dd0-9273-8471ecdc67e3 service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:21:07 user nova-compute[74840]: DEBUG nova.compute.manager [req-dc7d6254-a642-4af5-9923-088fdbae29d5 req-d4d9daee-2d61-4dd0-9273-8471ecdc67e3 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] No waiting events found dispatching network-vif-plugged-bdec4773-148b-49d7-a461-3a6106fffff6 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:21:07 user nova-compute[74840]: WARNING nova.compute.manager [req-dc7d6254-a642-4af5-9923-088fdbae29d5 req-d4d9daee-2d61-4dd0-9273-8471ecdc67e3 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received unexpected event network-vif-plugged-bdec4773-148b-49d7-a461-3a6106fffff6 for instance with vm_state building and task_state spawning.
Nov 08 12:21:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:09 user nova-compute[74840]: DEBUG nova.compute.manager [req-be132169-4a51-4a16-ad4d-1394851edab4 req-bcec2265-5728-45c6-91e6-75e3b87700be service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received event network-vif-plugged-1fd72b39-7d31-4729-bef7-98f6a5246964 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:21:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-be132169-4a51-4a16-ad4d-1394851edab4 req-bcec2265-5728-45c6-91e6-75e3b87700be service nova] Acquiring lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:21:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-be132169-4a51-4a16-ad4d-1394851edab4 req-bcec2265-5728-45c6-91e6-75e3b87700be service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:21:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-be132169-4a51-4a16-ad4d-1394851edab4 req-bcec2265-5728-45c6-91e6-75e3b87700be service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:21:09 user nova-compute[74840]: DEBUG nova.compute.manager [req-be132169-4a51-4a16-ad4d-1394851edab4 req-bcec2265-5728-45c6-91e6-75e3b87700be service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] No waiting events found dispatching network-vif-plugged-1fd72b39-7d31-4729-bef7-98f6a5246964 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:21:09 user nova-compute[74840]: WARNING nova.compute.manager [req-be132169-4a51-4a16-ad4d-1394851edab4 req-bcec2265-5728-45c6-91e6-75e3b87700be service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received unexpected event network-vif-plugged-1fd72b39-7d31-4729-bef7-98f6a5246964 for instance with vm_state building and task_state spawning.
Nov 08 12:21:09 user nova-compute[74840]: DEBUG nova.compute.manager [req-be132169-4a51-4a16-ad4d-1394851edab4 req-bcec2265-5728-45c6-91e6-75e3b87700be service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received event network-vif-plugged-afed888a-e688-452a-846f-4e9b398ff736 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:21:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-be132169-4a51-4a16-ad4d-1394851edab4 req-bcec2265-5728-45c6-91e6-75e3b87700be service nova] Acquiring lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:21:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-be132169-4a51-4a16-ad4d-1394851edab4 req-bcec2265-5728-45c6-91e6-75e3b87700be service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:21:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-be132169-4a51-4a16-ad4d-1394851edab4 req-bcec2265-5728-45c6-91e6-75e3b87700be service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:21:09 user nova-compute[74840]: DEBUG nova.compute.manager [req-be132169-4a51-4a16-ad4d-1394851edab4 req-bcec2265-5728-45c6-91e6-75e3b87700be service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] No waiting events found dispatching network-vif-plugged-afed888a-e688-452a-846f-4e9b398ff736 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:21:09 user nova-compute[74840]: WARNING nova.compute.manager [req-be132169-4a51-4a16-ad4d-1394851edab4 req-bcec2265-5728-45c6-91e6-75e3b87700be service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received unexpected event network-vif-plugged-afed888a-e688-452a-846f-4e9b398ff736 for instance with vm_state building and task_state spawning.
Nov 08 12:21:09 user nova-compute[74840]: DEBUG nova.compute.manager [req-be132169-4a51-4a16-ad4d-1394851edab4 req-bcec2265-5728-45c6-91e6-75e3b87700be service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received event network-vif-plugged-afed888a-e688-452a-846f-4e9b398ff736 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:21:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-be132169-4a51-4a16-ad4d-1394851edab4 req-bcec2265-5728-45c6-91e6-75e3b87700be service nova] Acquiring lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:21:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-be132169-4a51-4a16-ad4d-1394851edab4 req-bcec2265-5728-45c6-91e6-75e3b87700be service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:21:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-be132169-4a51-4a16-ad4d-1394851edab4 req-bcec2265-5728-45c6-91e6-75e3b87700be service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:21:09 user nova-compute[74840]: DEBUG nova.compute.manager [req-be132169-4a51-4a16-ad4d-1394851edab4 req-bcec2265-5728-45c6-91e6-75e3b87700be service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] No waiting events found dispatching network-vif-plugged-afed888a-e688-452a-846f-4e9b398ff736 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:21:09 user nova-compute[74840]: WARNING nova.compute.manager [req-be132169-4a51-4a16-ad4d-1394851edab4 req-bcec2265-5728-45c6-91e6-75e3b87700be service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received unexpected event network-vif-plugged-afed888a-e688-452a-846f-4e9b398ff736 for instance with vm_state building and task_state spawning.
Nov 08 12:21:09 user nova-compute[74840]: DEBUG nova.compute.manager [req-be132169-4a51-4a16-ad4d-1394851edab4 req-bcec2265-5728-45c6-91e6-75e3b87700be service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received event network-vif-plugged-20547543-4dc1-4158-bb9e-515cce88d3ef {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:21:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-be132169-4a51-4a16-ad4d-1394851edab4 req-bcec2265-5728-45c6-91e6-75e3b87700be service nova] Acquiring lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:21:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-be132169-4a51-4a16-ad4d-1394851edab4 req-bcec2265-5728-45c6-91e6-75e3b87700be service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:21:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-be132169-4a51-4a16-ad4d-1394851edab4 req-bcec2265-5728-45c6-91e6-75e3b87700be service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:21:09 user nova-compute[74840]: DEBUG nova.compute.manager [req-be132169-4a51-4a16-ad4d-1394851edab4 req-bcec2265-5728-45c6-91e6-75e3b87700be service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] No waiting events found dispatching network-vif-plugged-20547543-4dc1-4158-bb9e-515cce88d3ef {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:21:09 user nova-compute[74840]: WARNING nova.compute.manager [req-be132169-4a51-4a16-ad4d-1394851edab4 req-bcec2265-5728-45c6-91e6-75e3b87700be service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received unexpected event network-vif-plugged-20547543-4dc1-4158-bb9e-515cce88d3ef for instance with vm_state building and task_state spawning.
Nov 08 12:21:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:09 user nova-compute[74840]: DEBUG nova.compute.manager [req-c5ce43ab-34f7-4080-9c41-4f5b56353294 req-8fb83993-527a-427a-8420-2430aab7d6e8 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received event network-vif-plugged-87c651bf-a6e8-4290-bbdf-49746754ac54 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:21:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-c5ce43ab-34f7-4080-9c41-4f5b56353294 req-8fb83993-527a-427a-8420-2430aab7d6e8 service nova] Acquiring lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:21:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-c5ce43ab-34f7-4080-9c41-4f5b56353294 req-8fb83993-527a-427a-8420-2430aab7d6e8 service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:21:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-c5ce43ab-34f7-4080-9c41-4f5b56353294 req-8fb83993-527a-427a-8420-2430aab7d6e8 service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:21:09 user nova-compute[74840]: DEBUG nova.compute.manager [req-c5ce43ab-34f7-4080-9c41-4f5b56353294 req-8fb83993-527a-427a-8420-2430aab7d6e8 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] No waiting events found dispatching network-vif-plugged-87c651bf-a6e8-4290-bbdf-49746754ac54 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:21:09 user nova-compute[74840]: WARNING nova.compute.manager [req-c5ce43ab-34f7-4080-9c41-4f5b56353294 req-8fb83993-527a-427a-8420-2430aab7d6e8 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received unexpected event network-vif-plugged-87c651bf-a6e8-4290-bbdf-49746754ac54 for instance with vm_state building and task_state spawning.
Nov 08 12:21:09 user nova-compute[74840]: DEBUG nova.compute.manager [req-c5ce43ab-34f7-4080-9c41-4f5b56353294 req-8fb83993-527a-427a-8420-2430aab7d6e8 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received event network-vif-plugged-538b2412-4ee2-42a6-9cac-f97be4fc341e {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:21:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-c5ce43ab-34f7-4080-9c41-4f5b56353294 req-8fb83993-527a-427a-8420-2430aab7d6e8 service nova] Acquiring lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:21:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-c5ce43ab-34f7-4080-9c41-4f5b56353294 req-8fb83993-527a-427a-8420-2430aab7d6e8 service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:21:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-c5ce43ab-34f7-4080-9c41-4f5b56353294 req-8fb83993-527a-427a-8420-2430aab7d6e8 service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:21:09 user nova-compute[74840]: DEBUG nova.compute.manager [req-c5ce43ab-34f7-4080-9c41-4f5b56353294 req-8fb83993-527a-427a-8420-2430aab7d6e8 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] No waiting events found dispatching network-vif-plugged-538b2412-4ee2-42a6-9cac-f97be4fc341e {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:21:09 user nova-compute[74840]: WARNING nova.compute.manager [req-c5ce43ab-34f7-4080-9c41-4f5b56353294 req-8fb83993-527a-427a-8420-2430aab7d6e8 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received unexpected event network-vif-plugged-538b2412-4ee2-42a6-9cac-f97be4fc341e for instance with vm_state building and task_state spawning.
Nov 08 12:21:09 user nova-compute[74840]: DEBUG nova.compute.manager [req-c5ce43ab-34f7-4080-9c41-4f5b56353294 req-8fb83993-527a-427a-8420-2430aab7d6e8 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received event network-vif-plugged-538b2412-4ee2-42a6-9cac-f97be4fc341e {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:21:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-c5ce43ab-34f7-4080-9c41-4f5b56353294 req-8fb83993-527a-427a-8420-2430aab7d6e8 service nova] Acquiring lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:21:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-c5ce43ab-34f7-4080-9c41-4f5b56353294 req-8fb83993-527a-427a-8420-2430aab7d6e8 service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:21:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-c5ce43ab-34f7-4080-9c41-4f5b56353294 req-8fb83993-527a-427a-8420-2430aab7d6e8 service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:21:09 user nova-compute[74840]: DEBUG nova.compute.manager [req-c5ce43ab-34f7-4080-9c41-4f5b56353294 req-8fb83993-527a-427a-8420-2430aab7d6e8 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] No waiting events found dispatching network-vif-plugged-538b2412-4ee2-42a6-9cac-f97be4fc341e {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:21:09 user nova-compute[74840]: WARNING nova.compute.manager [req-c5ce43ab-34f7-4080-9c41-4f5b56353294 req-8fb83993-527a-427a-8420-2430aab7d6e8 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received unexpected event network-vif-plugged-538b2412-4ee2-42a6-9cac-f97be4fc341e for instance with vm_state building and task_state spawning.
Nov 08 12:21:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:10 user nova-compute[74840]: DEBUG nova.compute.manager [req-daaa1de1-39fa-4df0-ba1a-427329f0fc50 req-eaaf051f-08fd-4339-aaee-a5ad7c972764 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received event network-vif-plugged-bdec4773-148b-49d7-a461-3a6106fffff6 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:21:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-daaa1de1-39fa-4df0-ba1a-427329f0fc50 req-eaaf051f-08fd-4339-aaee-a5ad7c972764 service nova] Acquiring lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:21:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-daaa1de1-39fa-4df0-ba1a-427329f0fc50 req-eaaf051f-08fd-4339-aaee-a5ad7c972764 service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:21:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-daaa1de1-39fa-4df0-ba1a-427329f0fc50 req-eaaf051f-08fd-4339-aaee-a5ad7c972764 service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:21:10 user nova-compute[74840]: DEBUG nova.compute.manager [req-daaa1de1-39fa-4df0-ba1a-427329f0fc50 req-eaaf051f-08fd-4339-aaee-a5ad7c972764 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] No waiting events found dispatching network-vif-plugged-bdec4773-148b-49d7-a461-3a6106fffff6 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:21:10 user nova-compute[74840]: WARNING nova.compute.manager [req-daaa1de1-39fa-4df0-ba1a-427329f0fc50 req-eaaf051f-08fd-4339-aaee-a5ad7c972764 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received unexpected event network-vif-plugged-bdec4773-148b-49d7-a461-3a6106fffff6 for instance with vm_state building and task_state spawning.
Nov 08 12:21:10 user nova-compute[74840]: DEBUG nova.compute.manager [req-daaa1de1-39fa-4df0-ba1a-427329f0fc50 req-eaaf051f-08fd-4339-aaee-a5ad7c972764 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received event network-vif-plugged-68377219-20e9-4c9f-b8c7-bcf0a798655e {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:21:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-daaa1de1-39fa-4df0-ba1a-427329f0fc50 req-eaaf051f-08fd-4339-aaee-a5ad7c972764 service nova] Acquiring lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:21:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-daaa1de1-39fa-4df0-ba1a-427329f0fc50 req-eaaf051f-08fd-4339-aaee-a5ad7c972764 service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:21:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-daaa1de1-39fa-4df0-ba1a-427329f0fc50 req-eaaf051f-08fd-4339-aaee-a5ad7c972764 service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:21:10 user nova-compute[74840]: DEBUG nova.compute.manager [req-daaa1de1-39fa-4df0-ba1a-427329f0fc50 req-eaaf051f-08fd-4339-aaee-a5ad7c972764 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] No waiting events found dispatching network-vif-plugged-68377219-20e9-4c9f-b8c7-bcf0a798655e {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:21:10 user nova-compute[74840]: WARNING nova.compute.manager [req-daaa1de1-39fa-4df0-ba1a-427329f0fc50 req-eaaf051f-08fd-4339-aaee-a5ad7c972764 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received unexpected event network-vif-plugged-68377219-20e9-4c9f-b8c7-bcf0a798655e for instance with vm_state building and task_state spawning.
Nov 08 12:21:10 user nova-compute[74840]: DEBUG nova.compute.manager [req-daaa1de1-39fa-4df0-ba1a-427329f0fc50 req-eaaf051f-08fd-4339-aaee-a5ad7c972764 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received event network-vif-plugged-68377219-20e9-4c9f-b8c7-bcf0a798655e {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:21:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-daaa1de1-39fa-4df0-ba1a-427329f0fc50 req-eaaf051f-08fd-4339-aaee-a5ad7c972764 service nova] Acquiring lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:21:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-daaa1de1-39fa-4df0-ba1a-427329f0fc50 req-eaaf051f-08fd-4339-aaee-a5ad7c972764 service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:21:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-daaa1de1-39fa-4df0-ba1a-427329f0fc50 req-eaaf051f-08fd-4339-aaee-a5ad7c972764 service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:21:10 user nova-compute[74840]: DEBUG nova.compute.manager [req-daaa1de1-39fa-4df0-ba1a-427329f0fc50 req-eaaf051f-08fd-4339-aaee-a5ad7c972764 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] No waiting events found dispatching network-vif-plugged-68377219-20e9-4c9f-b8c7-bcf0a798655e {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:21:10 user nova-compute[74840]: WARNING nova.compute.manager [req-daaa1de1-39fa-4df0-ba1a-427329f0fc50 req-eaaf051f-08fd-4339-aaee-a5ad7c972764 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received unexpected event network-vif-plugged-68377219-20e9-4c9f-b8c7-bcf0a798655e for instance with vm_state building and task_state spawning.
Nov 08 12:21:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:11 user nova-compute[74840]: DEBUG nova.compute.manager [req-164682be-ceca-4bbe-8ea3-12ff7693a4eb req-19f7233f-23ba-45ef-872b-732e87b4508b service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received event network-vif-plugged-20547543-4dc1-4158-bb9e-515cce88d3ef {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:21:11 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-164682be-ceca-4bbe-8ea3-12ff7693a4eb req-19f7233f-23ba-45ef-872b-732e87b4508b service nova] Acquiring lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:21:11 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-164682be-ceca-4bbe-8ea3-12ff7693a4eb req-19f7233f-23ba-45ef-872b-732e87b4508b service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:21:11 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-164682be-ceca-4bbe-8ea3-12ff7693a4eb req-19f7233f-23ba-45ef-872b-732e87b4508b service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:21:11 user nova-compute[74840]: DEBUG nova.compute.manager [req-164682be-ceca-4bbe-8ea3-12ff7693a4eb req-19f7233f-23ba-45ef-872b-732e87b4508b service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] No waiting events found dispatching network-vif-plugged-20547543-4dc1-4158-bb9e-515cce88d3ef {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:21:11 user nova-compute[74840]: WARNING nova.compute.manager [req-164682be-ceca-4bbe-8ea3-12ff7693a4eb req-19f7233f-23ba-45ef-872b-732e87b4508b service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received unexpected event network-vif-plugged-20547543-4dc1-4158-bb9e-515cce88d3ef for instance with vm_state building and task_state spawning.
Nov 08 12:21:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:11 user nova-compute[74840]: DEBUG nova.compute.manager [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:21:11 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:21:11 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Instance spawned successfully.
Nov 08 12:21:11 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:21:11 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Found default for hw_cdrom_bus of ide {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:21:11 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Found default for hw_disk_bus of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:21:11 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:21:11 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:21:11 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Found default for hw_video_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:21:11 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Found default for hw_vif_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:21:11 user nova-compute[74840]: INFO nova.compute.manager [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Took 13.26 seconds to spawn the instance on the hypervisor.
Nov 08 12:21:11 user nova-compute[74840]: DEBUG nova.compute.manager [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:21:12 user nova-compute[74840]: INFO nova.compute.manager [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Took 122.23 seconds to build instance.
Nov 08 12:21:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1a808765-2a58-42d7-9e5b-12551b08466a tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Lock "4b9fe577-1503-4007-be51-2a714363f8c6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 122.331s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:21:14 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:21:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "4ce94f9d-be90-4b82-bc83-6777d2c871a6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:21:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "4ce94f9d-be90-4b82-bc83-6777d2c871a6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:21:28 user nova-compute[74840]: DEBUG nova.compute.manager [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Starting instance... {{(pid=74840) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 12:21:29 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:21:29 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:21:29 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:21:29 user nova-compute[74840]: INFO nova.compute.claims [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Claim successful on node user
Nov 08 12:21:29 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:21:29 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:21:29 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.437s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:21:29 user nova-compute[74840]: DEBUG nova.compute.manager [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Start building networks asynchronously for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 12:21:29 user nova-compute[74840]: DEBUG nova.compute.manager [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Allocating IP information in the background. {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 12:21:29 user nova-compute[74840]: DEBUG nova.network.neutron [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 12:21:29 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 12:21:29 user nova-compute[74840]: DEBUG nova.compute.manager [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Start building block device mappings for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 12:21:29 user nova-compute[74840]: INFO nova.virt.block_device [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Booting with volume 162867f5-948b-4308-8ee5-d43ad791b1bc at /dev/vda
Nov 08 12:21:29 user nova-compute[74840]: DEBUG nova.policy [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '794c0281e1bf48f79117efdc3907e661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1250106b55ae44b0b303849df7781ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 12:21:29 user nova-compute[74840]: DEBUG os_brick.utils [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:21:29 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:29 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:29 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fd63ce-0be6-4170-9887-76940ac672ee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c8228a11e03c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:29 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:29 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:29 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7312e73-8639-47ca-9b6c-759b452c17fc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:29 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:29 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:29 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7389446-06fa-4e6e-a876-2fb4b123d943]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:29 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b8f24b-f2dd-42ff-a06d-51a425563ec3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:29 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Running cmd (subprocess): nvme version {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:29 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] 'nvme version' failed. Not Retrying. {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:21:29 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] nvme not present on system {{(pid=74840) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 12:21:29 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:29 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:21:29 user nova-compute[74840]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 12:21:29 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7278b680-cf73-4920-a50c-0c8ae1e0e67f]: (4, '') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:29 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74840) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 12:21:29 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 12:21:29 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] LIGHTOS: no hostnqn found. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 12:21:29 user nova-compute[74840]: DEBUG os_brick.utils [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c8228a11e03c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:21:29 user nova-compute[74840]: DEBUG nova.virt.block_device [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Updating existing volume attachment record: 286b3cae-8118-4529-9cb5-20483e0463e3 {{(pid=74840) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 12:21:29 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:30 user nova-compute[74840]: DEBUG nova.network.neutron [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Successfully created port: ab70d9c8-3258-4119-ac39-e681ca7011a5 {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:21:31 user nova-compute[74840]: DEBUG nova.network.neutron [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Successfully updated port: ab70d9c8-3258-4119-ac39-e681ca7011a5 {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:21:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "refresh_cache-4ce94f9d-be90-4b82-bc83-6777d2c871a6" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:21:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquired lock "refresh_cache-4ce94f9d-be90-4b82-bc83-6777d2c871a6" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:21:31 user nova-compute[74840]: DEBUG nova.network.neutron [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:21:31 user nova-compute[74840]: DEBUG nova.compute.manager [req-5342864e-a7cb-4479-b0a3-6d2def381705 req-1a42a1ec-4710-4455-9203-df135de78527 service nova] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Received event network-changed-ab70d9c8-3258-4119-ac39-e681ca7011a5 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:21:31 user nova-compute[74840]: DEBUG nova.compute.manager [req-5342864e-a7cb-4479-b0a3-6d2def381705 req-1a42a1ec-4710-4455-9203-df135de78527 service nova] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Refreshing instance network info cache due to event network-changed-ab70d9c8-3258-4119-ac39-e681ca7011a5. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:21:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-5342864e-a7cb-4479-b0a3-6d2def381705 req-1a42a1ec-4710-4455-9203-df135de78527 service nova] Acquiring lock "refresh_cache-4ce94f9d-be90-4b82-bc83-6777d2c871a6" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:21:31 user nova-compute[74840]: DEBUG nova.network.neutron [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:21:31 user nova-compute[74840]: DEBUG nova.network.neutron [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Updating instance_info_cache with network_info: [{"id": "ab70d9c8-3258-4119-ac39-e681ca7011a5", "address": "fa:16:3e:15:31:2f", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab70d9c8-32", "ovs_interfaceid": "ab70d9c8-3258-4119-ac39-e681ca7011a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:21:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Releasing lock "refresh_cache-4ce94f9d-be90-4b82-bc83-6777d2c871a6" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:21:31 user nova-compute[74840]: DEBUG nova.compute.manager [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Instance network_info: |[{"id": "ab70d9c8-3258-4119-ac39-e681ca7011a5", "address": "fa:16:3e:15:31:2f", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab70d9c8-32", "ovs_interfaceid": "ab70d9c8-3258-4119-ac39-e681ca7011a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 12:21:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-5342864e-a7cb-4479-b0a3-6d2def381705 req-1a42a1ec-4710-4455-9203-df135de78527 service nova] Acquired lock "refresh_cache-4ce94f9d-be90-4b82-bc83-6777d2c871a6" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:21:31 user nova-compute[74840]: DEBUG nova.network.neutron [req-5342864e-a7cb-4479-b0a3-6d2def381705 req-1a42a1ec-4710-4455-9203-df135de78527 service nova] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Refreshing network info cache for port ab70d9c8-3258-4119-ac39-e681ca7011a5 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:21:32 user nova-compute[74840]: DEBUG nova.network.neutron [req-5342864e-a7cb-4479-b0a3-6d2def381705 req-1a42a1ec-4710-4455-9203-df135de78527 service nova] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Updated VIF entry in instance network info cache for port ab70d9c8-3258-4119-ac39-e681ca7011a5. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:21:32 user nova-compute[74840]: DEBUG nova.network.neutron [req-5342864e-a7cb-4479-b0a3-6d2def381705 req-1a42a1ec-4710-4455-9203-df135de78527 service nova] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Updating instance_info_cache with network_info: [{"id": "ab70d9c8-3258-4119-ac39-e681ca7011a5", "address": "fa:16:3e:15:31:2f", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab70d9c8-32", "ovs_interfaceid": "ab70d9c8-3258-4119-ac39-e681ca7011a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:21:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-5342864e-a7cb-4479-b0a3-6d2def381705 req-1a42a1ec-4710-4455-9203-df135de78527 service nova] Releasing lock "refresh_cache-4ce94f9d-be90-4b82-bc83-6777d2c871a6" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:21:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:45 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e396495e-74ad-4971-a3ab-4b911b6f2658 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Acquiring lock "032e6584-9acf-469f-b661-faf6555659e1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:21:45 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e396495e-74ad-4971-a3ab-4b911b6f2658 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "032e6584-9acf-469f-b661-faf6555659e1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:21:45 user nova-compute[74840]: INFO nova.compute.manager [None req-e396495e-74ad-4971-a3ab-4b911b6f2658 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Detaching volume d116702a-23fe-4e9a-8afe-ee88c802d41e
Nov 08 12:21:45 user nova-compute[74840]: INFO nova.virt.block_device [None req-e396495e-74ad-4971-a3ab-4b911b6f2658 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Attempting to driver detach volume d116702a-23fe-4e9a-8afe-ee88c802d41e from mountpoint /dev/vdb
Nov 08 12:21:45 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-a4aa7b21-8147-4bf6-b409-9a120f2cf9d7 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Acquiring lock "032e6584-9acf-469f-b661-faf6555659e1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:21:45 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-e396495e-74ad-4971-a3ab-4b911b6f2658 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Attempting to detach device vdb from instance 032e6584-9acf-469f-b661-faf6555659e1 from the persistent domain config. {{(pid=74840) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 12:21:45 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-e396495e-74ad-4971-a3ab-4b911b6f2658 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 12:21:45 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:21:45 user nova-compute[74840]:   <source dev="/dev/sdb"/>
Nov 08 12:21:45 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:21:45 user nova-compute[74840]:   <serial>d116702a-23fe-4e9a-8afe-ee88c802d41e</serial>
Nov 08 12:21:45 user nova-compute[74840]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 12:21:45 user nova-compute[74840]: </disk>
Nov 08 12:21:45 user nova-compute[74840]:  {{(pid=74840) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 12:21:45 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-e396495e-74ad-4971-a3ab-4b911b6f2658 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Successfully detached device vdb from instance 032e6584-9acf-469f-b661-faf6555659e1 from the persistent domain config.
Nov 08 12:21:45 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-e396495e-74ad-4971-a3ab-4b911b6f2658 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 032e6584-9acf-469f-b661-faf6555659e1 from the live domain config. {{(pid=74840) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 12:21:45 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-e396495e-74ad-4971-a3ab-4b911b6f2658 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 12:21:45 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:21:45 user nova-compute[74840]:   <source dev="/dev/sdb"/>
Nov 08 12:21:45 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:21:45 user nova-compute[74840]:   <serial>d116702a-23fe-4e9a-8afe-ee88c802d41e</serial>
Nov 08 12:21:45 user nova-compute[74840]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 12:21:45 user nova-compute[74840]: </disk>
Nov 08 12:21:45 user nova-compute[74840]:  {{(pid=74840) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 12:21:46 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-e396495e-74ad-4971-a3ab-4b911b6f2658 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 032e6584-9acf-469f-b661-faf6555659e1 {{(pid=74840) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 12:21:46 user nova-compute[74840]: DEBUG nova.compute.manager [req-86c4728b-6434-498c-b497-3128d0b30b8e req-a760e3af-632c-4309-bd55-1445f911c336 service nova] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Received event network-changed-75ded381-268f-487c-bf3b-1aad4d3909ae {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:21:46 user nova-compute[74840]: DEBUG nova.compute.manager [req-86c4728b-6434-498c-b497-3128d0b30b8e req-a760e3af-632c-4309-bd55-1445f911c336 service nova] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Refreshing instance network info cache due to event network-changed-75ded381-268f-487c-bf3b-1aad4d3909ae. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:21:46 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-86c4728b-6434-498c-b497-3128d0b30b8e req-a760e3af-632c-4309-bd55-1445f911c336 service nova] Acquiring lock "refresh_cache-83c035a0-880b-4170-98bc-b18cae712cfa" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:21:46 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-86c4728b-6434-498c-b497-3128d0b30b8e req-a760e3af-632c-4309-bd55-1445f911c336 service nova] Acquired lock "refresh_cache-83c035a0-880b-4170-98bc-b18cae712cfa" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:21:46 user nova-compute[74840]: DEBUG nova.network.neutron [req-86c4728b-6434-498c-b497-3128d0b30b8e req-a760e3af-632c-4309-bd55-1445f911c336 service nova] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Refreshing network info cache for port 75ded381-268f-487c-bf3b-1aad4d3909ae {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:21:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:46 user nova-compute[74840]: DEBUG nova.network.neutron [req-86c4728b-6434-498c-b497-3128d0b30b8e req-a760e3af-632c-4309-bd55-1445f911c336 service nova] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Updated VIF entry in instance network info cache for port 75ded381-268f-487c-bf3b-1aad4d3909ae. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:21:46 user nova-compute[74840]: DEBUG nova.network.neutron [req-86c4728b-6434-498c-b497-3128d0b30b8e req-a760e3af-632c-4309-bd55-1445f911c336 service nova] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Updating instance_info_cache with network_info: [{"id": "75ded381-268f-487c-bf3b-1aad4d3909ae", "address": "fa:16:3e:56:38:57", "network": {"id": "22514061-e390-4fd9-943b-0dedf57a323e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1978465085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c8bdf3f4296441799bd44bd993d3111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75ded381-26", "ovs_interfaceid": "75ded381-268f-487c-bf3b-1aad4d3909ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:21:46 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-86c4728b-6434-498c-b497-3128d0b30b8e req-a760e3af-632c-4309-bd55-1445f911c336 service nova] Releasing lock "refresh_cache-83c035a0-880b-4170-98bc-b18cae712cfa" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:21:46 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c7ec5938-af01-4b9e-80f0-e6663bbfb829 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Acquiring lock "interface-83c035a0-880b-4170-98bc-b18cae712cfa-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:21:46 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c7ec5938-af01-4b9e-80f0-e6663bbfb829 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Lock "interface-83c035a0-880b-4170-98bc-b18cae712cfa-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:21:46 user nova-compute[74840]: DEBUG nova.objects.instance [None req-c7ec5938-af01-4b9e-80f0-e6663bbfb829 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Lazy-loading 'flavor' on Instance uuid 83c035a0-880b-4170-98bc-b18cae712cfa {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:21:47 user nova-compute[74840]: DEBUG nova.objects.instance [None req-c7ec5938-af01-4b9e-80f0-e6663bbfb829 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Lazy-loading 'pci_requests' on Instance uuid 83c035a0-880b-4170-98bc-b18cae712cfa {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:21:47 user nova-compute[74840]: DEBUG nova.objects.base [None req-c7ec5938-af01-4b9e-80f0-e6663bbfb829 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Object Instance<83c035a0-880b-4170-98bc-b18cae712cfa> lazy-loaded attributes: flavor,pci_requests {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:21:47 user nova-compute[74840]: DEBUG nova.network.neutron [None req-c7ec5938-af01-4b9e-80f0-e6663bbfb829 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 12:21:47 user nova-compute[74840]: DEBUG nova.policy [None req-c7ec5938-af01-4b9e-80f0-e6663bbfb829 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe87f6d61cea4243a123420baf15279a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8bdf3f4296441799bd44bd993d3111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 12:21:47 user nova-compute[74840]: DEBUG nova.network.neutron [None req-c7ec5938-af01-4b9e-80f0-e6663bbfb829 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Successfully created port: 0ce328c3-b755-4d90-b0af-f4b2beef1bec {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG nova.network.neutron [None req-c7ec5938-af01-4b9e-80f0-e6663bbfb829 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Successfully updated port: 0ce328c3-b755-4d90-b0af-f4b2beef1bec {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c7ec5938-af01-4b9e-80f0-e6663bbfb829 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Acquiring lock "refresh_cache-83c035a0-880b-4170-98bc-b18cae712cfa" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c7ec5938-af01-4b9e-80f0-e6663bbfb829 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Acquired lock "refresh_cache-83c035a0-880b-4170-98bc-b18cae712cfa" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG nova.network.neutron [None req-c7ec5938-af01-4b9e-80f0-e6663bbfb829 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG nova.compute.manager [req-c05ced5f-8920-4464-ab29-b22c3dcc2c32 req-6759d084-b9f2-483b-88f2-4de47bd0df41 service nova] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Received event network-changed-0ce328c3-b755-4d90-b0af-f4b2beef1bec {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG nova.compute.manager [req-c05ced5f-8920-4464-ab29-b22c3dcc2c32 req-6759d084-b9f2-483b-88f2-4de47bd0df41 service nova] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Refreshing instance network info cache due to event network-changed-0ce328c3-b755-4d90-b0af-f4b2beef1bec. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-c05ced5f-8920-4464-ab29-b22c3dcc2c32 req-6759d084-b9f2-483b-88f2-4de47bd0df41 service nova] Acquiring lock "refresh_cache-83c035a0-880b-4170-98bc-b18cae712cfa" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG nova.compute.manager [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Start spawning the instance on the hypervisor. {{(pid=74840) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:21:48 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Creating image(s)
Nov 08 12:21:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Did not create local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Ensure instance console log exists: /opt/stack/data/nova/instances/ffe50042-29bf-4ef3-a148-8698bc75233b/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Start _get_guest_xml network_info=[{"id": "6169b221-7840-4cfb-ba25-e34a95b35e77", "address": "fa:16:3e:b0:6a:c2", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6169b221-78", "ovs_interfaceid": "6169b221-7840-4cfb-ba25-e34a95b35e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '92fd702c-1735-45b7-895c-6c10b7feb235', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'veKSyoaB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ffe50042-29bf-4ef3-a148-8698bc75233b', 'attached_at': '', 'detached_at': '', 'volume_id': '10d90d99-351a-48a3-8ad3-37a2bbbc76a4', 'serial': '10d90d99-351a-48a3-8ad3-37a2bbbc76a4'}, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:21:48 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:21:48 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:21:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Calling os-brick to attach iSCSI Volume {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'veKSyoaB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:21:48 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:21:48 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:21:48 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:21:48 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:21:48 user nova-compute[74840]: INFO os_brick.initiator.connectors.iscsi [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 12:21:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 -p 172.16.0.220:3260 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dab5616-fe31-441d-85ef-b239df0a7fc8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 12:21:48 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9746dcec-ebc4-4456-a53e-31aa2fd2e6ed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4] added\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4] added
Nov 08 12:21:48 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6951c560-bb50-4eee-87ce-aa58b953f897]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd048f90-7150-4ea5-ac6c-30b257c40b75]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v veKSyoaB {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v veKSyoaB" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9084c94-8049-43ae-a8d3-94e4fccd6594]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'veKSyoaB'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:21:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7acb0f6-18a0-4847-a5f1-22d17dce5473]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12c9af2-6c99-448e-ab9e-894b5811e3d8]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e (non-flash)
Nov 08 12:21:49 user nova-compute[74840]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)
Nov 08 12:21:49 user nova-compute[74840]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 (non-flash)
Nov 08 12:21:49 user nova-compute[74840]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 (non-flash)
Nov 08 12:21:49 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e (non-flash)
Nov 08 12:21:49 user nova-compute[74840]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)
Nov 08 12:21:49 user nova-compute[74840]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 (non-flash)
Nov 08 12:21:49 user nova-compute[74840]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 (non-flash)
Nov 08 12:21:49 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 -p 172.16.0.220:3260 --login {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 -p 172.16.0.220:3260 --login" returned: 0 in 0.154s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa073e39-ea65-4f8a-a009-f035c815b1c2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4, portal: 172.16.0.220,3260]
Nov 08 12:21:49 user nova-compute[74840]: Login to [iface: default, target: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4, portal: 172.16.0.220,3260] successful.
Nov 08 12:21:49 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f1fb47-54d6-44d4-aa26-aa5b51426359]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ddc03d-7435-4558-96b8-27a53e3ed90e]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e (non-flash)
Nov 08 12:21:49 user nova-compute[74840]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)
Nov 08 12:21:49 user nova-compute[74840]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 (non-flash)
Nov 08 12:21:49 user nova-compute[74840]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 (non-flash)
Nov 08 12:21:49 user nova-compute[74840]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:21:49 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e (non-flash)
Nov 08 12:21:49 user nova-compute[74840]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)
Nov 08 12:21:49 user nova-compute[74840]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 (non-flash)
Nov 08 12:21:49 user nova-compute[74840]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 (non-flash)
Nov 08 12:21:49 user nova-compute[74840]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:21:49 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.406s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Connected to 172.16.0.220:3260 {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] HCTL ('37', '-', '-', 0) found on session 23 with lun 0 {{(pid=74840) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74840) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4b1ea4-dfba-4ff8-afad-8c368e0d2fee]: (4, ('- - 0', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Searching for a device in session 23 and hctl ['37', '*', '*', 0] yield: None {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG nova.network.neutron [None req-c7ec5938-af01-4b9e-80f0-e6663bbfb829 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Updating instance_info_cache with network_info: [{"id": "75ded381-268f-487c-bf3b-1aad4d3909ae", "address": "fa:16:3e:56:38:57", "network": {"id": "22514061-e390-4fd9-943b-0dedf57a323e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1978465085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c8bdf3f4296441799bd44bd993d3111", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75ded381-26", "ovs_interfaceid": "75ded381-268f-487c-bf3b-1aad4d3909ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0ce328c3-b755-4d90-b0af-f4b2beef1bec", "address": "fa:16:3e:17:9b:c8", "network": {"id": "93688dc9-a647-4983-a0e4-f187716ca66e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1203286658", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8c8bdf3f4296441799bd44bd993d3111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ce328c3-b7", "ovs_interfaceid": "0ce328c3-b755-4d90-b0af-f4b2beef1bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c7ec5938-af01-4b9e-80f0-e6663bbfb829 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Releasing lock "refresh_cache-83c035a0-880b-4170-98bc-b18cae712cfa" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-c05ced5f-8920-4464-ab29-b22c3dcc2c32 req-6759d084-b9f2-483b-88f2-4de47bd0df41 service nova] Acquired lock "refresh_cache-83c035a0-880b-4170-98bc-b18cae712cfa" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG nova.network.neutron [req-c05ced5f-8920-4464-ab29-b22c3dcc2c32 req-6759d084-b9f2-483b-88f2-4de47bd0df41 service nova] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Refreshing network info cache for port 0ce328c3-b755-4d90-b0af-f4b2beef1bec {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-c7ec5938-af01-4b9e-80f0-e6663bbfb829 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:19:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1248482414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1248482414',id=22,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE08F5Vdqafx8ionT0o99nYONzOMoa/3pOusA/wlvX3fSXRcA+RhI/2hy/w+tkl5A+C6lKye9AkVRPFr99hJwoo+GJvdV7gC/UTzKzbtU6DDZO8zP9SCuNQkk2JKp43yVA==',key_name='tempest-keypair-1343265406',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:20:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8c8bdf3f4296441799bd44bd993d3111',ramdisk_id='',reservation_id='r-wyshdnxz',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-807651925',owner_user_name='tempest-TaggedAttachmentsTest-807651925-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:20:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe87f6d61cea4243a123420baf15279a',uuid=83c035a0-880b-4170-98bc-b18cae712cfa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ce328c3-b755-4d90-b0af-f4b2beef1bec", "address": "fa:16:3e:17:9b:c8", "network": {"id": "93688dc9-a647-4983-a0e4-f187716ca66e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1203286658", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8c8bdf3f4296441799bd44bd993d3111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ce328c3-b7", "ovs_interfaceid": "0ce328c3-b755-4d90-b0af-f4b2beef1bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-c7ec5938-af01-4b9e-80f0-e6663bbfb829 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Converting VIF {"id": "0ce328c3-b755-4d90-b0af-f4b2beef1bec", "address": "fa:16:3e:17:9b:c8", "network": {"id": "93688dc9-a647-4983-a0e4-f187716ca66e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1203286658", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8c8bdf3f4296441799bd44bd993d3111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ce328c3-b7", "ovs_interfaceid": "0ce328c3-b755-4d90-b0af-f4b2beef1bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-c7ec5938-af01-4b9e-80f0-e6663bbfb829 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:9b:c8,bridge_name='br-int',has_traffic_filtering=True,id=0ce328c3-b755-4d90-b0af-f4b2beef1bec,network=Network(93688dc9-a647-4983-a0e4-f187716ca66e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ce328c3-b7') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG os_vif [None req-c7ec5938-af01-4b9e-80f0-e6663bbfb829 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:9b:c8,bridge_name='br-int',has_traffic_filtering=True,id=0ce328c3-b755-4d90-b0af-f4b2beef1bec,network=Network(93688dc9-a647-4983-a0e4-f187716ca66e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ce328c3-b7') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c665916a-d467-5fa3-8c00-17dac33008d9', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ce328c3-b7, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ce328c3-b7, col_values=(('qos', UUID('8902844b-aad8-4fd5-9f62-98d9f07b62ec')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ce328c3-b7, col_values=(('external_ids', {'iface-id': '0ce328c3-b755-4d90-b0af-f4b2beef1bec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:9b:c8', 'vm-uuid': '83c035a0-880b-4170-98bc-b18cae712cfa'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:49 user nova-compute[74840]: INFO os_vif [None req-c7ec5938-af01-4b9e-80f0-e6663bbfb829 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:9b:c8,bridge_name='br-int',has_traffic_filtering=True,id=0ce328c3-b755-4d90-b0af-f4b2beef1bec,network=Network(93688dc9-a647-4983-a0e4-f187716ca66e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ce328c3-b7')
Nov 08 12:21:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-c7ec5938-af01-4b9e-80f0-e6663bbfb829 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:19:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1248482414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1248482414',id=22,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE08F5Vdqafx8ionT0o99nYONzOMoa/3pOusA/wlvX3fSXRcA+RhI/2hy/w+tkl5A+C6lKye9AkVRPFr99hJwoo+GJvdV7gC/UTzKzbtU6DDZO8zP9SCuNQkk2JKp43yVA==',key_name='tempest-keypair-1343265406',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:20:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8c8bdf3f4296441799bd44bd993d3111',ramdisk_id='',reservation_id='r-wyshdnxz',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-807651925',owner_user_name='tempest-TaggedAttachmentsTest-807651925-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:20:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe87f6d61cea4243a123420baf15279a',uuid=83c035a0-880b-4170-98bc-b18cae712cfa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ce328c3-b755-4d90-b0af-f4b2beef1bec", "address": "fa:16:3e:17:9b:c8", "network": {"id": "93688dc9-a647-4983-a0e4-f187716ca66e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1203286658", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8c8bdf3f4296441799bd44bd993d3111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ce328c3-b7", "ovs_interfaceid": "0ce328c3-b755-4d90-b0af-f4b2beef1bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-c7ec5938-af01-4b9e-80f0-e6663bbfb829 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Converting VIF {"id": "0ce328c3-b755-4d90-b0af-f4b2beef1bec", "address": "fa:16:3e:17:9b:c8", "network": {"id": "93688dc9-a647-4983-a0e4-f187716ca66e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1203286658", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8c8bdf3f4296441799bd44bd993d3111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ce328c3-b7", "ovs_interfaceid": "0ce328c3-b755-4d90-b0af-f4b2beef1bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-c7ec5938-af01-4b9e-80f0-e6663bbfb829 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:9b:c8,bridge_name='br-int',has_traffic_filtering=True,id=0ce328c3-b755-4d90-b0af-f4b2beef1bec,network=Network(93688dc9-a647-4983-a0e4-f187716ca66e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ce328c3-b7') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-c7ec5938-af01-4b9e-80f0-e6663bbfb829 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] attach device xml: <interface type="ethernet">
Nov 08 12:21:49 user nova-compute[74840]:   <mac address="fa:16:3e:17:9b:c8"/>
Nov 08 12:21:49 user nova-compute[74840]:   <model type="virtio"/>
Nov 08 12:21:49 user nova-compute[74840]:   <mtu size="1442"/>
Nov 08 12:21:49 user nova-compute[74840]:   <target dev="tap0ce328c3-b7"/>
Nov 08 12:21:49 user nova-compute[74840]: </interface>
Nov 08 12:21:49 user nova-compute[74840]:  {{(pid=74840) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:50 user nova-compute[74840]: DEBUG nova.compute.manager [req-61314409-84db-47d9-83c6-be753d766128 req-d86d8c86-656d-4d29-8062-c2fdda75435b service nova] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Received event network-vif-plugged-0ce328c3-b755-4d90-b0af-f4b2beef1bec {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:21:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-61314409-84db-47d9-83c6-be753d766128 req-d86d8c86-656d-4d29-8062-c2fdda75435b service nova] Acquiring lock "83c035a0-880b-4170-98bc-b18cae712cfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:21:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-61314409-84db-47d9-83c6-be753d766128 req-d86d8c86-656d-4d29-8062-c2fdda75435b service nova] Lock "83c035a0-880b-4170-98bc-b18cae712cfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:21:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-61314409-84db-47d9-83c6-be753d766128 req-d86d8c86-656d-4d29-8062-c2fdda75435b service nova] Lock "83c035a0-880b-4170-98bc-b18cae712cfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:21:50 user nova-compute[74840]: DEBUG nova.compute.manager [req-61314409-84db-47d9-83c6-be753d766128 req-d86d8c86-656d-4d29-8062-c2fdda75435b service nova] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] No waiting events found dispatching network-vif-plugged-0ce328c3-b755-4d90-b0af-f4b2beef1bec {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:21:50 user nova-compute[74840]: WARNING nova.compute.manager [req-61314409-84db-47d9-83c6-be753d766128 req-d86d8c86-656d-4d29-8062-c2fdda75435b service nova] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Received unexpected event network-vif-plugged-0ce328c3-b755-4d90-b0af-f4b2beef1bec for instance with vm_state active and task_state None.
Nov 08 12:21:50 user nova-compute[74840]: DEBUG nova.network.neutron [req-c05ced5f-8920-4464-ab29-b22c3dcc2c32 req-6759d084-b9f2-483b-88f2-4de47bd0df41 service nova] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Updated VIF entry in instance network info cache for port 0ce328c3-b755-4d90-b0af-f4b2beef1bec. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:21:50 user nova-compute[74840]: DEBUG nova.network.neutron [req-c05ced5f-8920-4464-ab29-b22c3dcc2c32 req-6759d084-b9f2-483b-88f2-4de47bd0df41 service nova] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Updating instance_info_cache with network_info: [{"id": "75ded381-268f-487c-bf3b-1aad4d3909ae", "address": "fa:16:3e:56:38:57", "network": {"id": "22514061-e390-4fd9-943b-0dedf57a323e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1978465085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c8bdf3f4296441799bd44bd993d3111", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75ded381-26", "ovs_interfaceid": "75ded381-268f-487c-bf3b-1aad4d3909ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0ce328c3-b755-4d90-b0af-f4b2beef1bec", "address": "fa:16:3e:17:9b:c8", "network": {"id": "93688dc9-a647-4983-a0e4-f187716ca66e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1203286658", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8c8bdf3f4296441799bd44bd993d3111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ce328c3-b7", "ovs_interfaceid": "0ce328c3-b755-4d90-b0af-f4b2beef1bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:21:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-c05ced5f-8920-4464-ab29-b22c3dcc2c32 req-6759d084-b9f2-483b-88f2-4de47bd0df41 service nova] Releasing lock "refresh_cache-83c035a0-880b-4170-98bc-b18cae712cfa" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:21:50 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Searching for a device in session 23 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:21:50 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'veKSyoaB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 12:21:50 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.443s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:21:50 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] <== connect_volume: return (1445ms) {'type': 'block', 'scsi_wwn': '23665353135643039', 'path': '/dev/sdf'} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:21:50 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665353135643039', 'path': '/dev/sdf'} {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 12:21:50 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-c7ec5938-af01-4b9e-80f0-e6663bbfb829 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:21:50 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-c7ec5938-af01-4b9e-80f0-e6663bbfb829 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] No BDM found with device name hda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:21:50 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-c7ec5938-af01-4b9e-80f0-e6663bbfb829 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] No VIF found with MAC fa:16:3e:56:38:57, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:21:50 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:20:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1225300234',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1225300234',id=24,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72c97c47ab144ef3a8d5e9ee1ecc059e',ramdisk_id='',reservation_id='r-pfesogm8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-297593405',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:20:29Z,user_data=None,user_id='275e3d340c9d4d9e90b579e4bc0bfe0b',uuid=ffe50042-29bf-4ef3-a148-8698bc75233b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6169b221-7840-4cfb-ba25-e34a95b35e77", "address": "fa:16:3e:b0:6a:c2", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6169b221-78", "ovs_interfaceid": "6169b221-7840-4cfb-ba25-e34a95b35e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:21:50 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Converting VIF {"id": "6169b221-7840-4cfb-ba25-e34a95b35e77", "address": "fa:16:3e:b0:6a:c2", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6169b221-78", "ovs_interfaceid": "6169b221-7840-4cfb-ba25-e34a95b35e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:21:50 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:6a:c2,bridge_name='br-int',has_traffic_filtering=True,id=6169b221-7840-4cfb-ba25-e34a95b35e77,network=Network(8388eafb-b115-49c7-82cd-0d85d0ee12e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6169b221-78') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:21:50 user nova-compute[74840]: DEBUG nova.objects.instance [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lazy-loading 'pci_devices' on Instance uuid ffe50042-29bf-4ef3-a148-8698bc75233b {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:21:50 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:21:50 user nova-compute[74840]:   <uuid>ffe50042-29bf-4ef3-a148-8698bc75233b</uuid>
Nov 08 12:21:50 user nova-compute[74840]:   <name>instance-00000018</name>
Nov 08 12:21:50 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:21:50 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:21:50 user nova-compute[74840]:   <metadata>
Nov 08 12:21:50 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:21:50 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:21:50 user nova-compute[74840]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1225300234</nova:name>
Nov 08 12:21:50 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:21:48</nova:creationTime>
Nov 08 12:21:50 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:21:50 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:21:50 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:21:50 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:21:50 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:21:50 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:21:50 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:21:50 user nova-compute[74840]:       <nova:owner>
Nov 08 12:21:50 user nova-compute[74840]:         <nova:user uuid="275e3d340c9d4d9e90b579e4bc0bfe0b">tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member</nova:user>
Nov 08 12:21:50 user nova-compute[74840]:         <nova:project uuid="72c97c47ab144ef3a8d5e9ee1ecc059e">tempest-ServerBootFromVolumeStableRescueTest-297593405</nova:project>
Nov 08 12:21:50 user nova-compute[74840]:       </nova:owner>
Nov 08 12:21:50 user nova-compute[74840]:       <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:21:50 user nova-compute[74840]:       <nova:ports>
Nov 08 12:21:50 user nova-compute[74840]:         <nova:port uuid="6169b221-7840-4cfb-ba25-e34a95b35e77">
Nov 08 12:21:50 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 12:21:50 user nova-compute[74840]:         </nova:port>
Nov 08 12:21:50 user nova-compute[74840]:       </nova:ports>
Nov 08 12:21:50 user nova-compute[74840]:     </nova:instance>
Nov 08 12:21:50 user nova-compute[74840]:   </metadata>
Nov 08 12:21:50 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:21:50 user nova-compute[74840]:     <system>
Nov 08 12:21:50 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:21:50 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:21:50 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:21:50 user nova-compute[74840]:       <entry name="serial">ffe50042-29bf-4ef3-a148-8698bc75233b</entry>
Nov 08 12:21:50 user nova-compute[74840]:       <entry name="uuid">ffe50042-29bf-4ef3-a148-8698bc75233b</entry>
Nov 08 12:21:50 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:21:50 user nova-compute[74840]:     </system>
Nov 08 12:21:50 user nova-compute[74840]:   </sysinfo>
Nov 08 12:21:50 user nova-compute[74840]:   <os>
Nov 08 12:21:50 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:21:50 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:21:50 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:21:50 user nova-compute[74840]:   </os>
Nov 08 12:21:50 user nova-compute[74840]:   <features>
Nov 08 12:21:50 user nova-compute[74840]:     <acpi/>
Nov 08 12:21:50 user nova-compute[74840]:     <apic/>
Nov 08 12:21:50 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:21:50 user nova-compute[74840]:   </features>
Nov 08 12:21:50 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:21:50 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:21:50 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:21:50 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:21:50 user nova-compute[74840]:   </clock>
Nov 08 12:21:50 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:21:50 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:21:50 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:21:50 user nova-compute[74840]:   </cpu>
Nov 08 12:21:50 user nova-compute[74840]:   <devices>
Nov 08 12:21:50 user nova-compute[74840]:     <disk type="block" device="disk">
Nov 08 12:21:50 user nova-compute[74840]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:21:50 user nova-compute[74840]:       <source dev="/dev/sdf"/>
Nov 08 12:21:50 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:21:50 user nova-compute[74840]:       <serial>10d90d99-351a-48a3-8ad3-37a2bbbc76a4</serial>
Nov 08 12:21:50 user nova-compute[74840]:     </disk>
Nov 08 12:21:50 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:21:50 user nova-compute[74840]:       <mac address="fa:16:3e:b0:6a:c2"/>
Nov 08 12:21:50 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:21:50 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:21:50 user nova-compute[74840]:       <target dev="tap6169b221-78"/>
Nov 08 12:21:50 user nova-compute[74840]:     </interface>
Nov 08 12:21:50 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:21:50 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/ffe50042-29bf-4ef3-a148-8698bc75233b/console.log" append="off"/>
Nov 08 12:21:50 user nova-compute[74840]:     </serial>
Nov 08 12:21:50 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:21:50 user nova-compute[74840]:     <video>
Nov 08 12:21:50 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:21:50 user nova-compute[74840]:     </video>
Nov 08 12:21:50 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:21:50 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:21:50 user nova-compute[74840]:     </rng>
Nov 08 12:21:50 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:21:50 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:21:50 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:21:50 user nova-compute[74840]:     </memballoon>
Nov 08 12:21:50 user nova-compute[74840]:   </devices>
Nov 08 12:21:50 user nova-compute[74840]: </domain>
Nov 08 12:21:50 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:21:50 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:20:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1225300234',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1225300234',id=24,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72c97c47ab144ef3a8d5e9ee1ecc059e',ramdisk_id='',reservation_id='r-pfesogm8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-297593405',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:20:29Z,user_data=None,user_id='275e3d340c9d4d9e90b579e4bc0bfe0b',uuid=ffe50042-29bf-4ef3-a148-8698bc75233b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6169b221-7840-4cfb-ba25-e34a95b35e77", "address": "fa:16:3e:b0:6a:c2", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6169b221-78", "ovs_interfaceid": "6169b221-7840-4cfb-ba25-e34a95b35e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:21:50 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Converting VIF {"id": "6169b221-7840-4cfb-ba25-e34a95b35e77", "address": "fa:16:3e:b0:6a:c2", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6169b221-78", "ovs_interfaceid": "6169b221-7840-4cfb-ba25-e34a95b35e77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:21:50 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:6a:c2,bridge_name='br-int',has_traffic_filtering=True,id=6169b221-7840-4cfb-ba25-e34a95b35e77,network=Network(8388eafb-b115-49c7-82cd-0d85d0ee12e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6169b221-78') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:21:50 user nova-compute[74840]: DEBUG os_vif [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:6a:c2,bridge_name='br-int',has_traffic_filtering=True,id=6169b221-7840-4cfb-ba25-e34a95b35e77,network=Network(8388eafb-b115-49c7-82cd-0d85d0ee12e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6169b221-78') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:21:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:21:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:21:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a33e391e-5b39-516e-b1d2-af6ac98a8ead', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:21:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:21:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6169b221-78, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:21:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6169b221-78, col_values=(('qos', UUID('683c15f9-d730-47a4-84ba-aeffb274f6a9')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:21:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6169b221-78, col_values=(('external_ids', {'iface-id': '6169b221-7840-4cfb-ba25-e34a95b35e77', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:6a:c2', 'vm-uuid': 'ffe50042-29bf-4ef3-a148-8698bc75233b'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:21:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:50 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-c7ec5938-af01-4b9e-80f0-e6663bbfb829 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:21:50 user nova-compute[74840]:   <nova:package version="0.0.0"/>
Nov 08 12:21:50 user nova-compute[74840]:   <nova:name>tempest-device-tagging-server-1248482414</nova:name>
Nov 08 12:21:50 user nova-compute[74840]:   <nova:creationTime>2023-11-08 12:21:50</nova:creationTime>
Nov 08 12:21:50 user nova-compute[74840]:   <nova:flavor name="m1.tiny">
Nov 08 12:21:50 user nova-compute[74840]:     <nova:memory>512</nova:memory>
Nov 08 12:21:50 user nova-compute[74840]:     <nova:disk>1</nova:disk>
Nov 08 12:21:50 user nova-compute[74840]:     <nova:swap>0</nova:swap>
Nov 08 12:21:50 user nova-compute[74840]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:21:50 user nova-compute[74840]:     <nova:vcpus>1</nova:vcpus>
Nov 08 12:21:50 user nova-compute[74840]:   </nova:flavor>
Nov 08 12:21:50 user nova-compute[74840]:   <nova:owner>
Nov 08 12:21:50 user nova-compute[74840]:     <nova:user uuid="fe87f6d61cea4243a123420baf15279a">tempest-TaggedAttachmentsTest-807651925-project-member</nova:user>
Nov 08 12:21:50 user nova-compute[74840]:     <nova:project uuid="8c8bdf3f4296441799bd44bd993d3111">tempest-TaggedAttachmentsTest-807651925</nova:project>
Nov 08 12:21:50 user nova-compute[74840]:   </nova:owner>
Nov 08 12:21:50 user nova-compute[74840]:   <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:21:50 user nova-compute[74840]:   <nova:ports>
Nov 08 12:21:50 user nova-compute[74840]:     <nova:port uuid="75ded381-268f-487c-bf3b-1aad4d3909ae">
Nov 08 12:21:50 user nova-compute[74840]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 08 12:21:50 user nova-compute[74840]:     </nova:port>
Nov 08 12:21:50 user nova-compute[74840]:     <nova:port uuid="0ce328c3-b755-4d90-b0af-f4b2beef1bec">
Nov 08 12:21:50 user nova-compute[74840]:       <nova:ip type="fixed" address="10.10.10.232" ipVersion="4"/>
Nov 08 12:21:50 user nova-compute[74840]:     </nova:port>
Nov 08 12:21:50 user nova-compute[74840]:   </nova:ports>
Nov 08 12:21:50 user nova-compute[74840]: </nova:instance>
Nov 08 12:21:50 user nova-compute[74840]:  {{(pid=74840) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 08 12:21:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:21:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:50 user nova-compute[74840]: INFO os_vif [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:6a:c2,bridge_name='br-int',has_traffic_filtering=True,id=6169b221-7840-4cfb-ba25-e34a95b35e77,network=Network(8388eafb-b115-49c7-82cd-0d85d0ee12e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6169b221-78')
Nov 08 12:21:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c7ec5938-af01-4b9e-80f0-e6663bbfb829 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Lock "interface-83c035a0-880b-4170-98bc-b18cae712cfa-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.566s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:21:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:50 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:21:50 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] No VIF found with MAC fa:16:3e:b0:6a:c2, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:21:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-7af99f47-c6fa-431f-a23b-7d7225f0cf25 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Acquiring lock "83c035a0-880b-4170-98bc-b18cae712cfa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:21:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-7af99f47-c6fa-431f-a23b-7d7225f0cf25 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Lock "83c035a0-880b-4170-98bc-b18cae712cfa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:21:50 user nova-compute[74840]: DEBUG nova.objects.instance [None req-7af99f47-c6fa-431f-a23b-7d7225f0cf25 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Lazy-loading 'flavor' on Instance uuid 83c035a0-880b-4170-98bc-b18cae712cfa {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:21:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-7af99f47-c6fa-431f-a23b-7d7225f0cf25 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Lock "83c035a0-880b-4170-98bc-b18cae712cfa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:21:51 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-7af99f47-c6fa-431f-a23b-7d7225f0cf25 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Acquiring lock "83c035a0-880b-4170-98bc-b18cae712cfa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:21:51 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-7af99f47-c6fa-431f-a23b-7d7225f0cf25 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Lock "83c035a0-880b-4170-98bc-b18cae712cfa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:21:51 user nova-compute[74840]: INFO nova.compute.manager [None req-7af99f47-c6fa-431f-a23b-7d7225f0cf25 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Attaching volume cb04a72b-24aa-47ec-90ec-7e71b7ec321e to /dev/vdb
Nov 08 12:21:51 user nova-compute[74840]: DEBUG os_brick.utils [None req-7af99f47-c6fa-431f-a23b-7d7225f0cf25 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:21:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:51 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b7b08e-7abd-4732-b1e2-42af57328788]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c8228a11e03c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:51 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f1cdf7-f68f-49e3-ab1e-2a42c15c9d50]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:51 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed9a9c7-0033-4937-b0cc-180a38fd5591]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:51 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe65748-ff63-410c-9a10-771f5d077533]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-7af99f47-c6fa-431f-a23b-7d7225f0cf25 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Running cmd (subprocess): nvme version {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-7af99f47-c6fa-431f-a23b-7d7225f0cf25 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] 'nvme version' failed. Not Retrying. {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:21:51 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7af99f47-c6fa-431f-a23b-7d7225f0cf25 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] nvme not present on system {{(pid=74840) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 12:21:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:21:51 user nova-compute[74840]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 12:21:51 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ea5761-f960-4a5b-b95c-c4b918bd011b]: (4, '') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:51 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-7af99f47-c6fa-431f-a23b-7d7225f0cf25 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74840) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 12:21:51 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-7af99f47-c6fa-431f-a23b-7d7225f0cf25 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 12:21:51 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-7af99f47-c6fa-431f-a23b-7d7225f0cf25 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] LIGHTOS: no hostnqn found. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 12:21:51 user nova-compute[74840]: DEBUG os_brick.utils [None req-7af99f47-c6fa-431f-a23b-7d7225f0cf25 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c8228a11e03c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:21:51 user nova-compute[74840]: DEBUG nova.virt.block_device [None req-7af99f47-c6fa-431f-a23b-7d7225f0cf25 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Updating existing volume attachment record: 6aa26aef-4bd9-44c5-9c6f-c844be963bdc {{(pid=74840) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 12:21:51 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:51 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:21:51 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:21:51 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:21:51 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:21:51 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:51 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:51 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:52 user nova-compute[74840]: DEBUG nova.compute.manager [req-1959591a-40cc-48ce-b96f-39253735ccd0 req-7f41ffa4-1d22-46d0-9867-efb747e1c99c service nova] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Received event network-vif-plugged-0ce328c3-b755-4d90-b0af-f4b2beef1bec {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:21:52 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-1959591a-40cc-48ce-b96f-39253735ccd0 req-7f41ffa4-1d22-46d0-9867-efb747e1c99c service nova] Acquiring lock "83c035a0-880b-4170-98bc-b18cae712cfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:21:52 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-1959591a-40cc-48ce-b96f-39253735ccd0 req-7f41ffa4-1d22-46d0-9867-efb747e1c99c service nova] Lock "83c035a0-880b-4170-98bc-b18cae712cfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:21:52 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-1959591a-40cc-48ce-b96f-39253735ccd0 req-7f41ffa4-1d22-46d0-9867-efb747e1c99c service nova] Lock "83c035a0-880b-4170-98bc-b18cae712cfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:21:52 user nova-compute[74840]: DEBUG nova.compute.manager [req-1959591a-40cc-48ce-b96f-39253735ccd0 req-7f41ffa4-1d22-46d0-9867-efb747e1c99c service nova] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] No waiting events found dispatching network-vif-plugged-0ce328c3-b755-4d90-b0af-f4b2beef1bec {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:21:52 user nova-compute[74840]: WARNING nova.compute.manager [req-1959591a-40cc-48ce-b96f-39253735ccd0 req-7f41ffa4-1d22-46d0-9867-efb747e1c99c service nova] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Received unexpected event network-vif-plugged-0ce328c3-b755-4d90-b0af-f4b2beef1bec for instance with vm_state active and task_state None.
Nov 08 12:21:52 user nova-compute[74840]: DEBUG nova.compute.manager [req-1959591a-40cc-48ce-b96f-39253735ccd0 req-7f41ffa4-1d22-46d0-9867-efb747e1c99c service nova] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Received event network-changed-2f320dfe-5946-496e-81e8-922587cc240b {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:21:52 user nova-compute[74840]: DEBUG nova.compute.manager [req-1959591a-40cc-48ce-b96f-39253735ccd0 req-7f41ffa4-1d22-46d0-9867-efb747e1c99c service nova] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Refreshing instance network info cache due to event network-changed-2f320dfe-5946-496e-81e8-922587cc240b. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:21:52 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-1959591a-40cc-48ce-b96f-39253735ccd0 req-7f41ffa4-1d22-46d0-9867-efb747e1c99c service nova] Acquiring lock "refresh_cache-4f6c75c0-e820-47eb-be3e-51179b6df1a3" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:21:52 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-1959591a-40cc-48ce-b96f-39253735ccd0 req-7f41ffa4-1d22-46d0-9867-efb747e1c99c service nova] Acquired lock "refresh_cache-4f6c75c0-e820-47eb-be3e-51179b6df1a3" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:21:52 user nova-compute[74840]: DEBUG nova.network.neutron [req-1959591a-40cc-48ce-b96f-39253735ccd0 req-7f41ffa4-1d22-46d0-9867-efb747e1c99c service nova] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Refreshing network info cache for port 2f320dfe-5946-496e-81e8-922587cc240b {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:21:52 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:21:52 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:21:52 user nova-compute[74840]: DEBUG nova.network.neutron [req-1959591a-40cc-48ce-b96f-39253735ccd0 req-7f41ffa4-1d22-46d0-9867-efb747e1c99c service nova] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Updated VIF entry in instance network info cache for port 2f320dfe-5946-496e-81e8-922587cc240b. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:21:52 user nova-compute[74840]: DEBUG nova.network.neutron [req-1959591a-40cc-48ce-b96f-39253735ccd0 req-7f41ffa4-1d22-46d0-9867-efb747e1c99c service nova] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Updating instance_info_cache with network_info: [{"id": "2f320dfe-5946-496e-81e8-922587cc240b", "address": "fa:16:3e:ed:7d:8e", "network": {"id": "381cad9f-376a-4335-95a4-4824aa0d7fad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1035058856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ec082e08ddf4477a721e410fe944d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f320dfe-59", "ovs_interfaceid": "2f320dfe-5946-496e-81e8-922587cc240b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:21:52 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Skipping network cache update for instance because it is being deleted. {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9971}}
Nov 08 12:21:52 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Didn't find any instances for network info cache update. {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 12:21:52 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:21:52 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-1959591a-40cc-48ce-b96f-39253735ccd0 req-7f41ffa4-1d22-46d0-9867-efb747e1c99c service nova] Releasing lock "refresh_cache-4f6c75c0-e820-47eb-be3e-51179b6df1a3" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:21:52 user nova-compute[74840]: DEBUG nova.compute.manager [req-1959591a-40cc-48ce-b96f-39253735ccd0 req-7f41ffa4-1d22-46d0-9867-efb747e1c99c service nova] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Received event network-vif-plugged-6169b221-7840-4cfb-ba25-e34a95b35e77 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:21:52 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-1959591a-40cc-48ce-b96f-39253735ccd0 req-7f41ffa4-1d22-46d0-9867-efb747e1c99c service nova] Acquiring lock "ffe50042-29bf-4ef3-a148-8698bc75233b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:21:52 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-1959591a-40cc-48ce-b96f-39253735ccd0 req-7f41ffa4-1d22-46d0-9867-efb747e1c99c service nova] Lock "ffe50042-29bf-4ef3-a148-8698bc75233b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:21:52 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-1959591a-40cc-48ce-b96f-39253735ccd0 req-7f41ffa4-1d22-46d0-9867-efb747e1c99c service nova] Lock "ffe50042-29bf-4ef3-a148-8698bc75233b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:21:52 user nova-compute[74840]: DEBUG nova.compute.manager [req-1959591a-40cc-48ce-b96f-39253735ccd0 req-7f41ffa4-1d22-46d0-9867-efb747e1c99c service nova] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] No waiting events found dispatching network-vif-plugged-6169b221-7840-4cfb-ba25-e34a95b35e77 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:21:52 user nova-compute[74840]: WARNING nova.compute.manager [req-1959591a-40cc-48ce-b96f-39253735ccd0 req-7f41ffa4-1d22-46d0-9867-efb747e1c99c service nova] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Received unexpected event network-vif-plugged-6169b221-7840-4cfb-ba25-e34a95b35e77 for instance with vm_state building and task_state spawning.
Nov 08 12:21:53 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:21:54 user nova-compute[74840]: DEBUG nova.compute.manager [req-00d58272-4c70-48ab-9782-5b90c10b0bbb req-a4ae5152-c8d5-4e77-971f-1d2bd4fe39ce service nova] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Received event network-vif-plugged-6169b221-7840-4cfb-ba25-e34a95b35e77 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:21:54 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-00d58272-4c70-48ab-9782-5b90c10b0bbb req-a4ae5152-c8d5-4e77-971f-1d2bd4fe39ce service nova] Acquiring lock "ffe50042-29bf-4ef3-a148-8698bc75233b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:21:54 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-00d58272-4c70-48ab-9782-5b90c10b0bbb req-a4ae5152-c8d5-4e77-971f-1d2bd4fe39ce service nova] Lock "ffe50042-29bf-4ef3-a148-8698bc75233b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:21:54 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-00d58272-4c70-48ab-9782-5b90c10b0bbb req-a4ae5152-c8d5-4e77-971f-1d2bd4fe39ce service nova] Lock "ffe50042-29bf-4ef3-a148-8698bc75233b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:21:54 user nova-compute[74840]: DEBUG nova.compute.manager [req-00d58272-4c70-48ab-9782-5b90c10b0bbb req-a4ae5152-c8d5-4e77-971f-1d2bd4fe39ce service nova] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] No waiting events found dispatching network-vif-plugged-6169b221-7840-4cfb-ba25-e34a95b35e77 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:21:54 user nova-compute[74840]: WARNING nova.compute.manager [req-00d58272-4c70-48ab-9782-5b90c10b0bbb req-a4ae5152-c8d5-4e77-971f-1d2bd4fe39ce service nova] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Received unexpected event network-vif-plugged-6169b221-7840-4cfb-ba25-e34a95b35e77 for instance with vm_state building and task_state spawning.
Nov 08 12:21:54 user nova-compute[74840]: DEBUG nova.compute.manager [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:21:54 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:21:54 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Instance spawned successfully.
Nov 08 12:21:54 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:21:54 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Found default for hw_cdrom_bus of ide {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:21:54 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Found default for hw_disk_bus of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:21:54 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:21:54 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:21:54 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Found default for hw_video_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:21:54 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Found default for hw_vif_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:21:54 user nova-compute[74840]: INFO nova.compute.manager [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Took 5.79 seconds to spawn the instance on the hypervisor.
Nov 08 12:21:54 user nova-compute[74840]: DEBUG nova.compute.manager [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:21:54 user nova-compute[74840]: INFO nova.compute.manager [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Took 86.31 seconds to build instance.
Nov 08 12:21:54 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5f55aef2-d907-4503-b222-abe1f9d4176b tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "ffe50042-29bf-4ef3-a148-8698bc75233b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 86.425s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:21:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:55 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:21:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG nova.compute.manager [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Start spawning the instance on the hypervisor. {{(pid=74840) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:21:57 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Creating image(s)
Nov 08 12:21:57 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Did not create local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Ensure instance console log exists: /opt/stack/data/nova/instances/4ce94f9d-be90-4b82-bc83-6777d2c871a6/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Start _get_guest_xml network_info=[{"id": "ab70d9c8-3258-4119-ac39-e681ca7011a5", "address": "fa:16:3e:15:31:2f", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab70d9c8-32", "ovs_interfaceid": "ab70d9c8-3258-4119-ac39-e681ca7011a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '286b3cae-8118-4529-9cb5-20483e0463e3', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EFBzDwJC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4ce94f9d-be90-4b82-bc83-6777d2c871a6', 'attached_at': '', 'detached_at': '', 'volume_id': '162867f5-948b-4308-8ee5-d43ad791b1bc', 'serial': '162867f5-948b-4308-8ee5-d43ad791b1bc'}, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:21:57 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:21:57 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:21:57 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Calling os-brick to attach iSCSI Volume {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EFBzDwJC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:21:57 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:21:57 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:21:57 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:21:57 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:21:57 user nova-compute[74840]: INFO os_brick.initiator.connectors.iscsi [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 12:21:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc -p 172.16.0.220:3260 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3559719e-4f7b-41e0-84c8-ab6d06d2219a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 12:21:57 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc -p 172.16.0.220:3260 --interface default --op new {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bacf9bc-90c3-4c04-9fd6-3fcbec595eb5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc] added\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc] added
Nov 08 12:21:57 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fc1afb-02d9-4a46-b15c-d5bd4db2885b]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[12312e6f-d831-4fa7-bfa1-22f87bf272d4]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EFBzDwJC {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EFBzDwJC" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0254a6f-db10-4c85-9c65-63f8159bcf8a]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EFBzDwJC'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2ef150-eaf0-47a2-b346-7c17330c3a15]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[df707e55-ecb2-4b8a-a7e8-60c6e6ba5aa4]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e (non-flash)
Nov 08 12:21:57 user nova-compute[74840]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)
Nov 08 12:21:57 user nova-compute[74840]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 (non-flash)
Nov 08 12:21:57 user nova-compute[74840]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 (non-flash)
Nov 08 12:21:57 user nova-compute[74840]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:21:57 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e (non-flash)
Nov 08 12:21:57 user nova-compute[74840]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)
Nov 08 12:21:57 user nova-compute[74840]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 (non-flash)
Nov 08 12:21:57 user nova-compute[74840]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 (non-flash)
Nov 08 12:21:57 user nova-compute[74840]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:21:57 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc -p 172.16.0.220:3260 --login {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3883b1e-f969-4077-aa12-1be63c2609b8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc, portal: 172.16.0.220,3260]
Nov 08 12:21:57 user nova-compute[74840]: Login to [iface: default, target: iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc, portal: 172.16.0.220,3260] successful.
Nov 08 12:21:57 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[050e1989-8169-4183-99fe-72ece17c9f89]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d3308f-3f35-4ab9-a26a-5be287f8e5a4]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e (non-flash)
Nov 08 12:21:57 user nova-compute[74840]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)
Nov 08 12:21:57 user nova-compute[74840]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 (non-flash)
Nov 08 12:21:57 user nova-compute[74840]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 (non-flash)
Nov 08 12:21:57 user nova-compute[74840]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:21:57 user nova-compute[74840]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)
Nov 08 12:21:57 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e (non-flash)
Nov 08 12:21:57 user nova-compute[74840]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)
Nov 08 12:21:57 user nova-compute[74840]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 (non-flash)
Nov 08 12:21:57 user nova-compute[74840]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 (non-flash)
Nov 08 12:21:57 user nova-compute[74840]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:21:57 user nova-compute[74840]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)
Nov 08 12:21:57 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Connected to 172.16.0.220:3260 {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] HCTL ('38', '-', '-', 0) found on session 24 with lun 0 {{(pid=74840) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74840) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ce5587-47bb-4a98-af2f-a2428f04696f]: (4, ('- - 0', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Searching for a device in session 24 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EFBzDwJC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:21:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f6c75c0-e820-47eb-be3e-51179b6df1a3/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f6c75c0-e820-47eb-be3e-51179b6df1a3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f6c75c0-e820-47eb-be3e-51179b6df1a3/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f6c75c0-e820-47eb-be3e-51179b6df1a3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-34a89cbc-1dce-4b1d-bf9a-1053f542fb49 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "4f6c75c0-e820-47eb-be3e-51179b6df1a3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-34a89cbc-1dce-4b1d-bf9a-1053f542fb49 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "4f6c75c0-e820-47eb-be3e-51179b6df1a3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG nova.objects.instance [None req-34a89cbc-1dce-4b1d-bf9a-1053f542fb49 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lazy-loading 'flavor' on Instance uuid 4f6c75c0-e820-47eb-be3e-51179b6df1a3 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-34a89cbc-1dce-4b1d-bf9a-1053f542fb49 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "4f6c75c0-e820-47eb-be3e-51179b6df1a3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.100s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.391s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] <== connect_volume: return (1394ms) {'type': 'block', 'scsi_wwn': '23435663566353932', 'path': '/dev/sdg'} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435663566353932', 'path': '/dev/sdg'} {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-34a89cbc-1dce-4b1d-bf9a-1053f542fb49 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "4f6c75c0-e820-47eb-be3e-51179b6df1a3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-34a89cbc-1dce-4b1d-bf9a-1053f542fb49 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "4f6c75c0-e820-47eb-be3e-51179b6df1a3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:21:58 user nova-compute[74840]: INFO nova.compute.manager [None req-34a89cbc-1dce-4b1d-bf9a-1053f542fb49 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Attaching volume 0de9a650-fb67-477a-9c8a-471e27ed445e to /dev/vdb
Nov 08 12:21:58 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:21:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-992505877',display_name='tempest-TestVolumeBootPattern-volume-backed-server-992505877',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-992505877',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAktHMgLbzBDoAyofm4phxzUUjJ/jYNKXRmMuTLv1Nzengag+nAAYXwXmxWmxXy2Gw3i1/IQY50cFfNuIFbyRx5q6+RCEetV30L+xiihEpyjC3ZjftWMSsT3eoUJtfTDWQ==',key_name='tempest-keypair-587177639',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1250106b55ae44b0b303849df7781ffb',ramdisk_id='',reservation_id='r-dz82j42i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-77780905',owner_user_name='tempest-TestVolumeBootPattern-77780905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:21:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='794c0281e1bf48f79117efdc3907e661',uuid=4ce94f9d-be90-4b82-bc83-6777d2c871a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab70d9c8-3258-4119-ac39-e681ca7011a5", "address": "fa:16:3e:15:31:2f", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab70d9c8-32", "ovs_interfaceid": "ab70d9c8-3258-4119-ac39-e681ca7011a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Converting VIF {"id": "ab70d9c8-3258-4119-ac39-e681ca7011a5", "address": "fa:16:3e:15:31:2f", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab70d9c8-32", "ovs_interfaceid": "ab70d9c8-3258-4119-ac39-e681ca7011a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:31:2f,bridge_name='br-int',has_traffic_filtering=True,id=ab70d9c8-3258-4119-ac39-e681ca7011a5,network=Network(174da5e9-78cc-426f-87fb-1d3b23b8b459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab70d9c8-32') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG nova.objects.instance [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lazy-loading 'pci_devices' on Instance uuid 4ce94f9d-be90-4b82-bc83-6777d2c871a6 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:21:58 user nova-compute[74840]:   <uuid>4ce94f9d-be90-4b82-bc83-6777d2c871a6</uuid>
Nov 08 12:21:58 user nova-compute[74840]:   <name>instance-0000001b</name>
Nov 08 12:21:58 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:21:58 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:21:58 user nova-compute[74840]:   <metadata>
Nov 08 12:21:58 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:21:58 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:21:58 user nova-compute[74840]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-992505877</nova:name>
Nov 08 12:21:58 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:21:57</nova:creationTime>
Nov 08 12:21:58 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:21:58 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:21:58 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:21:58 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:21:58 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:21:58 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:21:58 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:21:58 user nova-compute[74840]:       <nova:owner>
Nov 08 12:21:58 user nova-compute[74840]:         <nova:user uuid="794c0281e1bf48f79117efdc3907e661">tempest-TestVolumeBootPattern-77780905-project-member</nova:user>
Nov 08 12:21:58 user nova-compute[74840]:         <nova:project uuid="1250106b55ae44b0b303849df7781ffb">tempest-TestVolumeBootPattern-77780905</nova:project>
Nov 08 12:21:58 user nova-compute[74840]:       </nova:owner>
Nov 08 12:21:58 user nova-compute[74840]:       <nova:ports>
Nov 08 12:21:58 user nova-compute[74840]:         <nova:port uuid="ab70d9c8-3258-4119-ac39-e681ca7011a5">
Nov 08 12:21:58 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 08 12:21:58 user nova-compute[74840]:         </nova:port>
Nov 08 12:21:58 user nova-compute[74840]:       </nova:ports>
Nov 08 12:21:58 user nova-compute[74840]:     </nova:instance>
Nov 08 12:21:58 user nova-compute[74840]:   </metadata>
Nov 08 12:21:58 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:21:58 user nova-compute[74840]:     <system>
Nov 08 12:21:58 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:21:58 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:21:58 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:21:58 user nova-compute[74840]:       <entry name="serial">4ce94f9d-be90-4b82-bc83-6777d2c871a6</entry>
Nov 08 12:21:58 user nova-compute[74840]:       <entry name="uuid">4ce94f9d-be90-4b82-bc83-6777d2c871a6</entry>
Nov 08 12:21:58 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:21:58 user nova-compute[74840]:     </system>
Nov 08 12:21:58 user nova-compute[74840]:   </sysinfo>
Nov 08 12:21:58 user nova-compute[74840]:   <os>
Nov 08 12:21:58 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:21:58 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:21:58 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:21:58 user nova-compute[74840]:   </os>
Nov 08 12:21:58 user nova-compute[74840]:   <features>
Nov 08 12:21:58 user nova-compute[74840]:     <acpi/>
Nov 08 12:21:58 user nova-compute[74840]:     <apic/>
Nov 08 12:21:58 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:21:58 user nova-compute[74840]:   </features>
Nov 08 12:21:58 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:21:58 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:21:58 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:21:58 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:21:58 user nova-compute[74840]:   </clock>
Nov 08 12:21:58 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:21:58 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:21:58 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:21:58 user nova-compute[74840]:   </cpu>
Nov 08 12:21:58 user nova-compute[74840]:   <devices>
Nov 08 12:21:58 user nova-compute[74840]:     <disk type="block" device="disk">
Nov 08 12:21:58 user nova-compute[74840]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:21:58 user nova-compute[74840]:       <source dev="/dev/sdg"/>
Nov 08 12:21:58 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:21:58 user nova-compute[74840]:       <serial>162867f5-948b-4308-8ee5-d43ad791b1bc</serial>
Nov 08 12:21:58 user nova-compute[74840]:     </disk>
Nov 08 12:21:58 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:21:58 user nova-compute[74840]:       <mac address="fa:16:3e:15:31:2f"/>
Nov 08 12:21:58 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:21:58 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:21:58 user nova-compute[74840]:       <target dev="tapab70d9c8-32"/>
Nov 08 12:21:58 user nova-compute[74840]:     </interface>
Nov 08 12:21:58 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:21:58 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/4ce94f9d-be90-4b82-bc83-6777d2c871a6/console.log" append="off"/>
Nov 08 12:21:58 user nova-compute[74840]:     </serial>
Nov 08 12:21:58 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:21:58 user nova-compute[74840]:     <video>
Nov 08 12:21:58 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:21:58 user nova-compute[74840]:     </video>
Nov 08 12:21:58 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:21:58 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:21:58 user nova-compute[74840]:     </rng>
Nov 08 12:21:58 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:21:58 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:21:58 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:21:58 user nova-compute[74840]:     </memballoon>
Nov 08 12:21:58 user nova-compute[74840]:   </devices>
Nov 08 12:21:58 user nova-compute[74840]: </domain>
Nov 08 12:21:58 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:21:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-992505877',display_name='tempest-TestVolumeBootPattern-volume-backed-server-992505877',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-992505877',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAktHMgLbzBDoAyofm4phxzUUjJ/jYNKXRmMuTLv1Nzengag+nAAYXwXmxWmxXy2Gw3i1/IQY50cFfNuIFbyRx5q6+RCEetV30L+xiihEpyjC3ZjftWMSsT3eoUJtfTDWQ==',key_name='tempest-keypair-587177639',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1250106b55ae44b0b303849df7781ffb',ramdisk_id='',reservation_id='r-dz82j42i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-77780905',owner_user_name='tempest-TestVolumeBootPattern-77780905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:21:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='794c0281e1bf48f79117efdc3907e661',uuid=4ce94f9d-be90-4b82-bc83-6777d2c871a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab70d9c8-3258-4119-ac39-e681ca7011a5", "address": "fa:16:3e:15:31:2f", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab70d9c8-32", "ovs_interfaceid": "ab70d9c8-3258-4119-ac39-e681ca7011a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Converting VIF {"id": "ab70d9c8-3258-4119-ac39-e681ca7011a5", "address": "fa:16:3e:15:31:2f", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab70d9c8-32", "ovs_interfaceid": "ab70d9c8-3258-4119-ac39-e681ca7011a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:31:2f,bridge_name='br-int',has_traffic_filtering=True,id=ab70d9c8-3258-4119-ac39-e681ca7011a5,network=Network(174da5e9-78cc-426f-87fb-1d3b23b8b459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab70d9c8-32') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG os_vif [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:31:2f,bridge_name='br-int',has_traffic_filtering=True,id=ab70d9c8-3258-4119-ac39-e681ca7011a5,network=Network(174da5e9-78cc-426f-87fb-1d3b23b8b459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab70d9c8-32') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '28c91907-6e2d-5e87-ba54-e555964a09e4', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapab70d9c8-32, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapab70d9c8-32, col_values=(('qos', UUID('13575d9b-1d02-4971-a145-193162fb2b60')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapab70d9c8-32, col_values=(('external_ids', {'iface-id': 'ab70d9c8-3258-4119-ac39-e681ca7011a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:31:2f', 'vm-uuid': '4ce94f9d-be90-4b82-bc83-6777d2c871a6'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG os_brick.utils [None req-34a89cbc-1dce-4b1d-bf9a-1053f542fb49 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:21:58 user nova-compute[74840]: INFO os_vif [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:31:2f,bridge_name='br-int',has_traffic_filtering=True,id=ab70d9c8-3258-4119-ac39-e681ca7011a5,network=Network(174da5e9-78cc-426f-87fb-1d3b23b8b459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab70d9c8-32')
Nov 08 12:21:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2f87c7-ea7b-41ac-bfc0-716f3e5c7be2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c8228a11e03c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c653909-85ad-43e8-b9d1-b4a54e979f87]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d44485-1933-4ef5-9605-b5a77bdc3b03]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d3b776-ae0a-4fcb-9ff4-2908adc48744]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-34a89cbc-1dce-4b1d-bf9a-1053f542fb49 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Running cmd (subprocess): nvme version {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-34a89cbc-1dce-4b1d-bf9a-1053f542fb49 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] 'nvme version' failed. Not Retrying. {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34a89cbc-1dce-4b1d-bf9a-1053f542fb49 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] nvme not present on system {{(pid=74840) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] No VIF found with MAC fa:16:3e:15:31:2f, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:21:58 user nova-compute[74840]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 12:21:58 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3191982-0c15-4bd8-b4c6-4cc3b5c26d6c]: (4, '') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-34a89cbc-1dce-4b1d-bf9a-1053f542fb49 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74840) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-34a89cbc-1dce-4b1d-bf9a-1053f542fb49 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-34a89cbc-1dce-4b1d-bf9a-1053f542fb49 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] LIGHTOS: no hostnqn found. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG os_brick.utils [None req-34a89cbc-1dce-4b1d-bf9a-1053f542fb49 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c8228a11e03c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:21:58 user nova-compute[74840]: DEBUG nova.virt.block_device [None req-34a89cbc-1dce-4b1d-bf9a-1053f542fb49 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Updating existing volume attachment record: 5a0d9225-75da-4527-bcb0-710afbcd5479 {{(pid=74840) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 12:21:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83c035a0-880b-4170-98bc-b18cae712cfa/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83c035a0-880b-4170-98bc-b18cae712cfa/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83c035a0-880b-4170-98bc-b18cae712cfa/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83c035a0-880b-4170-98bc-b18cae712cfa/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032e6584-9acf-469f-b661-faf6555659e1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:21:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032e6584-9acf-469f-b661-faf6555659e1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:21:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032e6584-9acf-469f-b661-faf6555659e1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/032e6584-9acf-469f-b661-faf6555659e1/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:00 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:22:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:03 user nova-compute[74840]: DEBUG nova.compute.manager [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:22:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:22:03 user nova-compute[74840]: DEBUG nova.compute.manager [req-4a3b68e8-cd67-4bed-8250-8fe46ac8555c req-9e059a0c-3bb6-4807-a873-cb623a5c1771 service nova] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Received event network-vif-plugged-ab70d9c8-3258-4119-ac39-e681ca7011a5 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:22:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4a3b68e8-cd67-4bed-8250-8fe46ac8555c req-9e059a0c-3bb6-4807-a873-cb623a5c1771 service nova] Acquiring lock "4ce94f9d-be90-4b82-bc83-6777d2c871a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:22:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4a3b68e8-cd67-4bed-8250-8fe46ac8555c req-9e059a0c-3bb6-4807-a873-cb623a5c1771 service nova] Lock "4ce94f9d-be90-4b82-bc83-6777d2c871a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:22:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4a3b68e8-cd67-4bed-8250-8fe46ac8555c req-9e059a0c-3bb6-4807-a873-cb623a5c1771 service nova] Lock "4ce94f9d-be90-4b82-bc83-6777d2c871a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:22:03 user nova-compute[74840]: DEBUG nova.compute.manager [req-4a3b68e8-cd67-4bed-8250-8fe46ac8555c req-9e059a0c-3bb6-4807-a873-cb623a5c1771 service nova] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] No waiting events found dispatching network-vif-plugged-ab70d9c8-3258-4119-ac39-e681ca7011a5 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:22:03 user nova-compute[74840]: WARNING nova.compute.manager [req-4a3b68e8-cd67-4bed-8250-8fe46ac8555c req-9e059a0c-3bb6-4807-a873-cb623a5c1771 service nova] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Received unexpected event network-vif-plugged-ab70d9c8-3258-4119-ac39-e681ca7011a5 for instance with vm_state building and task_state spawning.
Nov 08 12:22:03 user nova-compute[74840]: DEBUG nova.compute.manager [req-e3076728-1d69-4d9b-9fb3-8e8c60d8a3bf req-2310562c-1b0e-4dcb-8e2c-ac950d1ee035 service nova] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Received event network-vif-plugged-ab70d9c8-3258-4119-ac39-e681ca7011a5 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:22:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e3076728-1d69-4d9b-9fb3-8e8c60d8a3bf req-2310562c-1b0e-4dcb-8e2c-ac950d1ee035 service nova] Acquiring lock "4ce94f9d-be90-4b82-bc83-6777d2c871a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:22:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e3076728-1d69-4d9b-9fb3-8e8c60d8a3bf req-2310562c-1b0e-4dcb-8e2c-ac950d1ee035 service nova] Lock "4ce94f9d-be90-4b82-bc83-6777d2c871a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:22:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e3076728-1d69-4d9b-9fb3-8e8c60d8a3bf req-2310562c-1b0e-4dcb-8e2c-ac950d1ee035 service nova] Lock "4ce94f9d-be90-4b82-bc83-6777d2c871a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:22:03 user nova-compute[74840]: DEBUG nova.compute.manager [req-e3076728-1d69-4d9b-9fb3-8e8c60d8a3bf req-2310562c-1b0e-4dcb-8e2c-ac950d1ee035 service nova] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] No waiting events found dispatching network-vif-plugged-ab70d9c8-3258-4119-ac39-e681ca7011a5 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:22:03 user nova-compute[74840]: WARNING nova.compute.manager [req-e3076728-1d69-4d9b-9fb3-8e8c60d8a3bf req-2310562c-1b0e-4dcb-8e2c-ac950d1ee035 service nova] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Received unexpected event network-vif-plugged-ab70d9c8-3258-4119-ac39-e681ca7011a5 for instance with vm_state building and task_state spawning.
Nov 08 12:22:03 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Instance spawned successfully.
Nov 08 12:22:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:22:03 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:22:03 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:22:03 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=7687MB free_disk=25.235088348388672GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:22:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:22:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:22:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Found default for hw_cdrom_bus of ide {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:22:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Found default for hw_disk_bus of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:22:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:22:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:22:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Found default for hw_video_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:22:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Found default for hw_vif_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:22:03 user nova-compute[74840]: INFO nova.compute.manager [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Took 6.02 seconds to spawn the instance on the hypervisor.
Nov 08 12:22:03 user nova-compute[74840]: DEBUG nova.compute.manager [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:22:03 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance d3e8efc6-7146-46ef-8433-380d7e69120c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:22:03 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 032e6584-9acf-469f-b661-faf6555659e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:22:03 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 4b9fe577-1503-4007-be51-2a714363f8c6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:22:03 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 83c035a0-880b-4170-98bc-b18cae712cfa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:22:03 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 4f6c75c0-e820-47eb-be3e-51179b6df1a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:22:03 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance ffe50042-29bf-4ef3-a148-8698bc75233b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:22:03 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 8b7c490e-4c78-4e07-bc8a-3be2328963d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:22:03 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 832a6445-84ee-43a8-a5bc-a07670602912 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:22:03 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 4ce94f9d-be90-4b82-bc83-6777d2c871a6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:22:03 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:22:03 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:22:03 user nova-compute[74840]: INFO nova.compute.manager [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Took 34.38 seconds to build instance.
Nov 08 12:22:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e4af2c13-de0d-4fd8-9d30-a7c444043401 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "4ce94f9d-be90-4b82-bc83-6777d2c871a6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 34.540s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:22:03 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:22:03 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:22:03 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:22:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.641s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:22:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:04 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:22:06 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-e396495e-74ad-4971-a3ab-4b911b6f2658 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 032e6584-9acf-469f-b661-faf6555659e1 is timed out.
Nov 08 12:22:06 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-e396495e-74ad-4971-a3ab-4b911b6f2658 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Successfully detached device vdb from instance 032e6584-9acf-469f-b661-faf6555659e1 from the live domain config.
Nov 08 12:22:06 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e396495e-74ad-4971-a3ab-4b911b6f2658 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: 032e6584-9acf-469f-b661-faf6555659e1] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 12:22:06 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e396495e-74ad-4971-a3ab-4b911b6f2658 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fwaUcTXC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:22:06 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-e396495e-74ad-4971-a3ab-4b911b6f2658 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:22:06 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-e396495e-74ad-4971-a3ab-4b911b6f2658 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:22:06 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-e396495e-74ad-4971-a3ab-4b911b6f2658 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:22:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.034s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:06 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c6bc2b-e71a-48d4-9a32-3d80e32ddda6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:06 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e396495e-74ad-4971-a3ab-4b911b6f2658 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 12:22:06 user nova-compute[74840]: No targets found.
Nov 08 12:22:06 user nova-compute[74840]: iSNS:
Nov 08 12:22:06 user nova-compute[74840]: No targets found.
Nov 08 12:22:06 user nova-compute[74840]: STATIC:
Nov 08 12:22:06 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1
Nov 08 12:22:06 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:22:06 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:22:06 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4
Nov 08 12:22:06 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:22:06 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:22:06 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578
Nov 08 12:22:06 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:22:06 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:22:06 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e
Nov 08 12:22:06 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:22:06 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:22:06 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc
Nov 08 12:22:06 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:22:06 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:22:06 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7
Nov 08 12:22:06 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:22:06 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:22:06 user nova-compute[74840]: FIRMWARE:
Nov 08 12:22:06 user nova-compute[74840]: No targets found.
Nov 08 12:22:06 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:22:06 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e396495e-74ad-4971-a3ab-4b911b6f2658 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 12:22:06 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 12:22:06 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 12:22:06 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e396495e-74ad-4971-a3ab-4b911b6f2658 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 12:22:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:06 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cde586a-7da4-4b93-a750-b19294d25bb5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:06 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4ebc42-8028-45a4-a5a8-4d117021a492]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:06 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e396495e-74ad-4971-a3ab-4b911b6f2658 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e (non-flash)
Nov 08 12:22:06 user nova-compute[74840]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)
Nov 08 12:22:06 user nova-compute[74840]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 (non-flash)
Nov 08 12:22:06 user nova-compute[74840]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 (non-flash)
Nov 08 12:22:06 user nova-compute[74840]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:22:06 user nova-compute[74840]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)
Nov 08 12:22:06 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:22:06 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e396495e-74ad-4971-a3ab-4b911b6f2658 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e (non-flash)
Nov 08 12:22:06 user nova-compute[74840]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)
Nov 08 12:22:06 user nova-compute[74840]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 (non-flash)
Nov 08 12:22:06 user nova-compute[74840]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 (non-flash)
Nov 08 12:22:06 user nova-compute[74840]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:22:06 user nova-compute[74840]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)
Nov 08 12:22:06 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:22:06 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e396495e-74ad-4971-a3ab-4b911b6f2658 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7f43796c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e'): ({'sdb'}, set())}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 12:22:06 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-e396495e-74ad-4971-a3ab-4b911b6f2658 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Removing single pathed devices sdb {{(pid=74840) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 12:22:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:06 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[2603e141-3582-4dfb-800a-e3ec15308637]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:06 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[af47003b-b4af-4cc3-bdb1-1b9ee36ed214]: (4, ('ok\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:06 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-e396495e-74ad-4971-a3ab-4b911b6f2658 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Flushing IO for device /dev/sdb {{(pid=74840) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 12:22:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:06 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1de931-07cf-412b-b735-e1b30c93c45f]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:06 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-e396495e-74ad-4971-a3ab-4b911b6f2658 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74840) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 12:22:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:06 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e38c6a-8568-4446-b5a9-b3255955f671]: (4, ('1', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:06 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-e396495e-74ad-4971-a3ab-4b911b6f2658 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 12:22:06 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-e396495e-74ad-4971-a3ab-4b911b6f2658 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] SCSI volumes sdb have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 12:22:06 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e396495e-74ad-4971-a3ab-4b911b6f2658 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e')] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 12:22:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:06 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9712cfe5-5162-46e3-b5fb-31cc279c0d7d]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:06 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e396495e-74ad-4971-a3ab-4b911b6f2658 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:22:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e -p 172.16.0.220:3260 --logout {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:06 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce3df8b-9678-41df-8e46-45efd93e0673]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:06 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e396495e-74ad-4971-a3ab-4b911b6f2658 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e, portal: 172.16.0.220,3260]
Nov 08 12:22:06 user nova-compute[74840]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e, portal: 172.16.0.220,3260] successful.
Nov 08 12:22:06 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:22:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e -p 172.16.0.220:3260 --op delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:06 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e23be2b-aa66-49b5-8787-f767f661ea49]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:06 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e396495e-74ad-4971-a3ab-4b911b6f2658 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:22:06 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-e396495e-74ad-4971-a3ab-4b911b6f2658 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.389s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:22:06 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e396495e-74ad-4971-a3ab-4b911b6f2658 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] <== disconnect_volume: return (392ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:22:06 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e396495e-74ad-4971-a3ab-4b911b6f2658 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 12:22:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:18 user nova-compute[74840]: DEBUG nova.objects.instance [None req-e396495e-74ad-4971-a3ab-4b911b6f2658 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lazy-loading 'flavor' on Instance uuid 032e6584-9acf-469f-b661-faf6555659e1 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:22:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e396495e-74ad-4971-a3ab-4b911b6f2658 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "032e6584-9acf-469f-b661-faf6555659e1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 33.272s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:22:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-a4aa7b21-8147-4bf6-b409-9a120f2cf9d7 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "032e6584-9acf-469f-b661-faf6555659e1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 33.187s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:22:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-a4aa7b21-8147-4bf6-b409-9a120f2cf9d7 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Acquiring lock "032e6584-9acf-469f-b661-faf6555659e1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:22:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-a4aa7b21-8147-4bf6-b409-9a120f2cf9d7 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "032e6584-9acf-469f-b661-faf6555659e1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:22:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-a4aa7b21-8147-4bf6-b409-9a120f2cf9d7 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "032e6584-9acf-469f-b661-faf6555659e1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:22:19 user nova-compute[74840]: INFO nova.compute.manager [None req-a4aa7b21-8147-4bf6-b409-9a120f2cf9d7 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Terminating instance
Nov 08 12:22:19 user nova-compute[74840]: DEBUG nova.compute.manager [None req-a4aa7b21-8147-4bf6-b409-9a120f2cf9d7 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Start destroying the instance on the hypervisor. {{(pid=74840) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 12:22:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:19 user nova-compute[74840]: DEBUG nova.compute.manager [req-5e7f6174-bd8d-498f-8a5d-6ca36bbdc880 req-558e730e-598e-4ae3-bdb0-a9f232c70041 service nova] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Received event network-vif-unplugged-4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:22:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-5e7f6174-bd8d-498f-8a5d-6ca36bbdc880 req-558e730e-598e-4ae3-bdb0-a9f232c70041 service nova] Acquiring lock "032e6584-9acf-469f-b661-faf6555659e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:22:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-5e7f6174-bd8d-498f-8a5d-6ca36bbdc880 req-558e730e-598e-4ae3-bdb0-a9f232c70041 service nova] Lock "032e6584-9acf-469f-b661-faf6555659e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:22:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-5e7f6174-bd8d-498f-8a5d-6ca36bbdc880 req-558e730e-598e-4ae3-bdb0-a9f232c70041 service nova] Lock "032e6584-9acf-469f-b661-faf6555659e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:22:19 user nova-compute[74840]: DEBUG nova.compute.manager [req-5e7f6174-bd8d-498f-8a5d-6ca36bbdc880 req-558e730e-598e-4ae3-bdb0-a9f232c70041 service nova] [instance: 032e6584-9acf-469f-b661-faf6555659e1] No waiting events found dispatching network-vif-unplugged-4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:22:19 user nova-compute[74840]: DEBUG nova.compute.manager [req-5e7f6174-bd8d-498f-8a5d-6ca36bbdc880 req-558e730e-598e-4ae3-bdb0-a9f232c70041 service nova] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Received event network-vif-unplugged-4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:22:19 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Instance destroyed successfully.
Nov 08 12:22:19 user nova-compute[74840]: DEBUG nova.objects.instance [None req-a4aa7b21-8147-4bf6-b409-9a120f2cf9d7 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lazy-loading 'resources' on Instance uuid 032e6584-9acf-469f-b661-faf6555659e1 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:22:19 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-a4aa7b21-8147-4bf6-b409-9a120f2cf9d7 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:18:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1321940893',display_name='tempest-VolumesSnapshotTestJSON-instance-1321940893',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1321940893',id=19,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdD2/O3Di67E6V+l5UJO4rtKB350T1sBCd0VKZ9Ym+COxks8E0hODzCW14hQCkCQx8YNCSbmMMFMAqHvrf+utZtpInDwIft4hu1HbOky8hwV+dUqvmmS31J+tw13c2hbA==',key_name='tempest-keypair-603358064',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:18:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9a082f8090094f009393593fb26b445b',ramdisk_id='',reservation_id='r-h659hzxt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1995603553',owner_user_name='tempest-VolumesSnapshotTestJSON-1995603553-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:18:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5a96f2e0a304f278120312edb71d7ac',uuid=032e6584-9acf-469f-b661-faf6555659e1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd", "address": "fa:16:3e:d3:22:7c", "network": {"id": "89a24eca-8c74-4e0e-b778-275f200927f0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1409559017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a082f8090094f009393593fb26b445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d59d0f9-05", "ovs_interfaceid": "4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:22:19 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-a4aa7b21-8147-4bf6-b409-9a120f2cf9d7 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Converting VIF {"id": "4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd", "address": "fa:16:3e:d3:22:7c", "network": {"id": "89a24eca-8c74-4e0e-b778-275f200927f0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1409559017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a082f8090094f009393593fb26b445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d59d0f9-05", "ovs_interfaceid": "4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:22:19 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-a4aa7b21-8147-4bf6-b409-9a120f2cf9d7 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:22:7c,bridge_name='br-int',has_traffic_filtering=True,id=4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd,network=Network(89a24eca-8c74-4e0e-b778-275f200927f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d59d0f9-05') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:22:19 user nova-compute[74840]: DEBUG os_vif [None req-a4aa7b21-8147-4bf6-b409-9a120f2cf9d7 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:22:7c,bridge_name='br-int',has_traffic_filtering=True,id=4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd,network=Network(89a24eca-8c74-4e0e-b778-275f200927f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d59d0f9-05') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:22:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d59d0f9-05, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:22:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:22:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=31c92fee-0251-4c0e-8b59-538c93134fdd) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:22:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:22:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:19 user nova-compute[74840]: INFO os_vif [None req-a4aa7b21-8147-4bf6-b409-9a120f2cf9d7 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:22:7c,bridge_name='br-int',has_traffic_filtering=True,id=4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd,network=Network(89a24eca-8c74-4e0e-b778-275f200927f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d59d0f9-05')
Nov 08 12:22:19 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4aa7b21-8147-4bf6-b409-9a120f2cf9d7 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: 032e6584-9acf-469f-b661-faf6555659e1] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 12:22:19 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4aa7b21-8147-4bf6-b409-9a120f2cf9d7 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fwaUcTXC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:22:19 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-a4aa7b21-8147-4bf6-b409-9a120f2cf9d7 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:22:19 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-a4aa7b21-8147-4bf6-b409-9a120f2cf9d7 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:22:19 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-a4aa7b21-8147-4bf6-b409-9a120f2cf9d7 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:22:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:20 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[de927d58-c118-417f-8e5d-eb3a679c2875]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4aa7b21-8147-4bf6-b409-9a120f2cf9d7 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 12:22:20 user nova-compute[74840]: No targets found.
Nov 08 12:22:20 user nova-compute[74840]: iSNS:
Nov 08 12:22:20 user nova-compute[74840]: No targets found.
Nov 08 12:22:20 user nova-compute[74840]: STATIC:
Nov 08 12:22:20 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1
Nov 08 12:22:20 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:22:20 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:22:20 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4
Nov 08 12:22:20 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:22:20 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:22:20 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578
Nov 08 12:22:20 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:22:20 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:22:20 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc
Nov 08 12:22:20 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:22:20 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:22:20 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7
Nov 08 12:22:20 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:22:20 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:22:20 user nova-compute[74840]: FIRMWARE:
Nov 08 12:22:20 user nova-compute[74840]: No targets found.
Nov 08 12:22:20 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:22:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4aa7b21-8147-4bf6-b409-9a120f2cf9d7 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 12:22:20 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 12:22:20 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 12:22:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4aa7b21-8147-4bf6-b409-9a120f2cf9d7 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d116702a-23fe-4e9a-8afe-ee88c802d41e', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 12:22:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:20 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0194d8-2556-4799-98f0-f76a9767659a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:20 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c7499c-87a5-4be4-857b-696612c688ee]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4aa7b21-8147-4bf6-b409-9a120f2cf9d7 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)
Nov 08 12:22:20 user nova-compute[74840]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 (non-flash)
Nov 08 12:22:20 user nova-compute[74840]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 (non-flash)
Nov 08 12:22:20 user nova-compute[74840]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:22:20 user nova-compute[74840]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)
Nov 08 12:22:20 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:22:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4aa7b21-8147-4bf6-b409-9a120f2cf9d7 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)
Nov 08 12:22:20 user nova-compute[74840]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 (non-flash)
Nov 08 12:22:20 user nova-compute[74840]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 (non-flash)
Nov 08 12:22:20 user nova-compute[74840]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:22:20 user nova-compute[74840]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)
Nov 08 12:22:20 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:22:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4aa7b21-8147-4bf6-b409-9a120f2cf9d7 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7d45105e0>, {}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 12:22:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4aa7b21-8147-4bf6-b409-9a120f2cf9d7 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Disconnecting from: [] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 12:22:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-a4aa7b21-8147-4bf6-b409-9a120f2cf9d7 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.091s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:22:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4aa7b21-8147-4bf6-b409-9a120f2cf9d7 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] <== disconnect_volume: return (93ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:22:20 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4aa7b21-8147-4bf6-b409-9a120f2cf9d7 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 12:22:20 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-a4aa7b21-8147-4bf6-b409-9a120f2cf9d7 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Deleting instance files /opt/stack/data/nova/instances/032e6584-9acf-469f-b661-faf6555659e1_del
Nov 08 12:22:20 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-a4aa7b21-8147-4bf6-b409-9a120f2cf9d7 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Deletion of /opt/stack/data/nova/instances/032e6584-9acf-469f-b661-faf6555659e1_del complete
Nov 08 12:22:20 user nova-compute[74840]: INFO nova.compute.manager [None req-a4aa7b21-8147-4bf6-b409-9a120f2cf9d7 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Took 1.11 seconds to destroy the instance on the hypervisor.
Nov 08 12:22:20 user nova-compute[74840]: DEBUG oslo.service.loopingcall [None req-a4aa7b21-8147-4bf6-b409-9a120f2cf9d7 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74840) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 12:22:20 user nova-compute[74840]: DEBUG nova.compute.manager [-] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Deallocating network for instance {{(pid=74840) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 12:22:20 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 032e6584-9acf-469f-b661-faf6555659e1] deallocate_for_instance() {{(pid=74840) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG nova.compute.manager [req-91b44e5f-6e5c-4e98-8ac4-e9409d2bb758 req-5b6970f4-023d-4c07-8ebe-6aa51ba357fc service nova] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Received event network-vif-deleted-4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:22:21 user nova-compute[74840]: INFO nova.compute.manager [req-91b44e5f-6e5c-4e98-8ac4-e9409d2bb758 req-5b6970f4-023d-4c07-8ebe-6aa51ba357fc service nova] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Neutron deleted interface 4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd; detaching it from the instance and deleting it from the info cache
Nov 08 12:22:21 user nova-compute[74840]: DEBUG nova.network.neutron [req-91b44e5f-6e5c-4e98-8ac4-e9409d2bb758 req-5b6970f4-023d-4c07-8ebe-6aa51ba357fc service nova] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:22:21 user nova-compute[74840]: INFO nova.compute.manager [-] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Took 0.99 seconds to deallocate network for instance.
Nov 08 12:22:21 user nova-compute[74840]: INFO nova.compute.manager [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Rescuing
Nov 08 12:22:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Acquiring lock "refresh_cache-832a6445-84ee-43a8-a5bc-a07670602912" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Acquired lock "refresh_cache-832a6445-84ee-43a8-a5bc-a07670602912" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG nova.network.neutron [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG nova.compute.manager [req-91b44e5f-6e5c-4e98-8ac4-e9409d2bb758 req-5b6970f4-023d-4c07-8ebe-6aa51ba357fc service nova] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Detach interface failed, port_id=4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd, reason: Instance 032e6584-9acf-469f-b661-faf6555659e1 could not be found. {{(pid=74840) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 12:22:21 user nova-compute[74840]: WARNING nova.volume.cinder [None req-a4aa7b21-8147-4bf6-b409-9a120f2cf9d7 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Attachment 2689ba17-ed3d-440a-b6cc-8f4afddb5cc1 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 2689ba17-ed3d-440a-b6cc-8f4afddb5cc1. (HTTP 404) (Request-ID: req-2f7f6e1d-70ea-4dc8-a701-2e0b5421704d)
Nov 08 12:22:21 user nova-compute[74840]: INFO nova.compute.manager [None req-a4aa7b21-8147-4bf6-b409-9a120f2cf9d7 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Took 0.05 seconds to detach 1 volumes for instance.
Nov 08 12:22:21 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7af99f47-c6fa-431f-a23b-7d7225f0cf25 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Calling os-brick to attach iSCSI Volume {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af99f47-c6fa-431f-a23b-7d7225f0cf25 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AyejdHVh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:22:21 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-7af99f47-c6fa-431f-a23b-7d7225f0cf25 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:22:21 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-7af99f47-c6fa-431f-a23b-7d7225f0cf25 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-7af99f47-c6fa-431f-a23b-7d7225f0cf25 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:22:21 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-7af99f47-c6fa-431f-a23b-7d7225f0cf25 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:22:21 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-7af99f47-c6fa-431f-a23b-7d7225f0cf25 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-7af99f47-c6fa-431f-a23b-7d7225f0cf25 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:22:21 user nova-compute[74840]: INFO os_brick.initiator.connectors.iscsi [None req-7af99f47-c6fa-431f-a23b-7d7225f0cf25 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 12:22:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e -p 172.16.0.220:3260 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[680caf75-147f-4d0e-abc6-d0b39603440a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af99f47-c6fa-431f-a23b-7d7225f0cf25 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 12:22:21 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e -p 172.16.0.220:3260 --interface default --op new {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-a4aa7b21-8147-4bf6-b409-9a120f2cf9d7 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-a4aa7b21-8147-4bf6-b409-9a120f2cf9d7 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71f57ce-f777-4ef0-b7d9-f84bc97d9dd7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e] added\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af99f47-c6fa-431f-a23b-7d7225f0cf25 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e] added
Nov 08 12:22:21 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57d7dd8-788a-47b6-a772-d344d8ece2d3]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af99f47-c6fa-431f-a23b-7d7225f0cf25 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f802a0c0-5893-410e-a1ba-fa99786268fa]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af99f47-c6fa-431f-a23b-7d7225f0cf25 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AyejdHVh {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AyejdHVh" returned: 0 in 0.026s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ed0771-aac7-4edc-a42e-4ab55edb25e2]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af99f47-c6fa-431f-a23b-7d7225f0cf25 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AyejdHVh'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8640711-747a-4842-b541-085b78224525]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af99f47-c6fa-431f-a23b-7d7225f0cf25 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d102d380-237e-424b-a2b4-20adacb48794]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af99f47-c6fa-431f-a23b-7d7225f0cf25 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)
Nov 08 12:22:21 user nova-compute[74840]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 (non-flash)
Nov 08 12:22:21 user nova-compute[74840]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 (non-flash)
Nov 08 12:22:21 user nova-compute[74840]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:22:21 user nova-compute[74840]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)
Nov 08 12:22:21 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af99f47-c6fa-431f-a23b-7d7225f0cf25 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)
Nov 08 12:22:21 user nova-compute[74840]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 (non-flash)
Nov 08 12:22:21 user nova-compute[74840]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 (non-flash)
Nov 08 12:22:21 user nova-compute[74840]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:22:21 user nova-compute[74840]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)
Nov 08 12:22:21 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e -p 172.16.0.220:3260 --login {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d465192c-3060-49b4-a2b8-70a61f348661]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af99f47-c6fa-431f-a23b-7d7225f0cf25 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e, portal: 172.16.0.220,3260]
Nov 08 12:22:21 user nova-compute[74840]: Login to [iface: default, target: iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e, portal: 172.16.0.220,3260] successful.
Nov 08 12:22:21 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1cc47fb-7c0a-4f07-b385-b0c2736c2d29]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af99f47-c6fa-431f-a23b-7d7225f0cf25 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-a4aa7b21-8147-4bf6-b409-9a120f2cf9d7 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-a4aa7b21-8147-4bf6-b409-9a120f2cf9d7 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a675e3-8f17-403d-a6ff-5a206b8dcf6c]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af99f47-c6fa-431f-a23b-7d7225f0cf25 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)
Nov 08 12:22:21 user nova-compute[74840]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 (non-flash)
Nov 08 12:22:21 user nova-compute[74840]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 (non-flash)
Nov 08 12:22:21 user nova-compute[74840]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:22:21 user nova-compute[74840]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)
Nov 08 12:22:21 user nova-compute[74840]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e (non-flash)
Nov 08 12:22:21 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af99f47-c6fa-431f-a23b-7d7225f0cf25 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)
Nov 08 12:22:21 user nova-compute[74840]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 (non-flash)
Nov 08 12:22:21 user nova-compute[74840]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 (non-flash)
Nov 08 12:22:21 user nova-compute[74840]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:22:21 user nova-compute[74840]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)
Nov 08 12:22:21 user nova-compute[74840]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e (non-flash)
Nov 08 12:22:21 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-7af99f47-c6fa-431f-a23b-7d7225f0cf25 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.394s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af99f47-c6fa-431f-a23b-7d7225f0cf25 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Connected to 172.16.0.220:3260 {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-7af99f47-c6fa-431f-a23b-7d7225f0cf25 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=74840) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-7af99f47-c6fa-431f-a23b-7d7225f0cf25 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74840) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-a4aa7b21-8147-4bf6-b409-9a120f2cf9d7 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.376s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66ef260-94c6-43ad-ad73-81237430d5d0]: (4, ('- - 0', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-7af99f47-c6fa-431f-a23b-7d7225f0cf25 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af99f47-c6fa-431f-a23b-7d7225f0cf25 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AyejdHVh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 12:22:21 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-a4aa7b21-8147-4bf6-b409-9a120f2cf9d7 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Deleted allocations for instance 032e6584-9acf-469f-b661-faf6555659e1
Nov 08 12:22:21 user nova-compute[74840]: DEBUG nova.network.neutron [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Updating instance_info_cache with network_info: [{"id": "48ba3111-f22a-4a29-8183-ccd94efa9086", "address": "fa:16:3e:83:fc:39", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ba3111-f2", "ovs_interfaceid": "48ba3111-f22a-4a29-8183-ccd94efa9086", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Releasing lock "refresh_cache-832a6445-84ee-43a8-a5bc-a07670602912" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:22:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-a4aa7b21-8147-4bf6-b409-9a120f2cf9d7 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "032e6584-9acf-469f-b661-faf6555659e1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.843s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:22:22 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:22 user nova-compute[74840]: DEBUG nova.compute.manager [req-37a0f23e-94d3-45a0-87be-6c7b2ee18b10 req-b0541cc2-fcff-429d-92ad-dc4bd8a59b59 service nova] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Received event network-vif-plugged-4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:22:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-37a0f23e-94d3-45a0-87be-6c7b2ee18b10 req-b0541cc2-fcff-429d-92ad-dc4bd8a59b59 service nova] Acquiring lock "032e6584-9acf-469f-b661-faf6555659e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:22:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-37a0f23e-94d3-45a0-87be-6c7b2ee18b10 req-b0541cc2-fcff-429d-92ad-dc4bd8a59b59 service nova] Lock "032e6584-9acf-469f-b661-faf6555659e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:22:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-37a0f23e-94d3-45a0-87be-6c7b2ee18b10 req-b0541cc2-fcff-429d-92ad-dc4bd8a59b59 service nova] Lock "032e6584-9acf-469f-b661-faf6555659e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:22:22 user nova-compute[74840]: DEBUG nova.compute.manager [req-37a0f23e-94d3-45a0-87be-6c7b2ee18b10 req-b0541cc2-fcff-429d-92ad-dc4bd8a59b59 service nova] [instance: 032e6584-9acf-469f-b661-faf6555659e1] No waiting events found dispatching network-vif-plugged-4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:22:22 user nova-compute[74840]: WARNING nova.compute.manager [req-37a0f23e-94d3-45a0-87be-6c7b2ee18b10 req-b0541cc2-fcff-429d-92ad-dc4bd8a59b59 service nova] [instance: 032e6584-9acf-469f-b661-faf6555659e1] Received unexpected event network-vif-plugged-4d59d0f9-05b7-4b1c-8d3a-52cd3d216ccd for instance with vm_state deleted and task_state None.
Nov 08 12:22:22 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:22 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:22 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:22 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Instance destroyed successfully.
Nov 08 12:22:22 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Attempting rescue
Nov 08 12:22:22 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74840) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 12:22:22 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Instance directory exists: not creating {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 12:22:22 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Creating image(s)
Nov 08 12:22:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Acquiring lock "/opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:22:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "/opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:22:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "/opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:22:22 user nova-compute[74840]: DEBUG nova.objects.instance [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lazy-loading 'trusted_certs' on Instance uuid 832a6445-84ee-43a8-a5bc-a07670602912 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:22:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Acquiring lock "5d26578eba85497f494c575690c4248f381a0fe6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:22:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:22:22 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:22 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-7af99f47-c6fa-431f-a23b-7d7225f0cf25 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.449s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:22:22 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af99f47-c6fa-431f-a23b-7d7225f0cf25 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] <== connect_volume: return (1453ms) {'type': 'block', 'scsi_wwn': '26465396533356164', 'path': '/dev/sdb'} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:22:22 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7af99f47-c6fa-431f-a23b-7d7225f0cf25 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465396533356164', 'path': '/dev/sdb'} {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 12:22:22 user nova-compute[74840]: DEBUG nova.objects.instance [None req-7af99f47-c6fa-431f-a23b-7d7225f0cf25 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Lazy-loading 'flavor' on Instance uuid 83c035a0-880b-4170-98bc-b18cae712cfa {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:22:22 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.174s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:22 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:22 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-7af99f47-c6fa-431f-a23b-7d7225f0cf25 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 12:22:22 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:22:22 user nova-compute[74840]:   <source dev="/dev/sdb"/>
Nov 08 12:22:22 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:22:22 user nova-compute[74840]:   <serial>cb04a72b-24aa-47ec-90ec-7e71b7ec321e</serial>
Nov 08 12:22:22 user nova-compute[74840]: </disk>
Nov 08 12:22:22 user nova-compute[74840]:  {{(pid=74840) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 12:22:22 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue" returned: 0 in 0.056s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:22:22 user nova-compute[74840]: DEBUG nova.objects.instance [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lazy-loading 'migration_context' on Instance uuid 832a6445-84ee-43a8-a5bc-a07670602912 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:22:22 user nova-compute[74840]: DEBUG nova.objects.base [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Object Instance<832a6445-84ee-43a8-a5bc-a07670602912> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:22:22 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Created local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 12:22:22 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Start _get_guest_xml network_info=[{"id": "48ba3111-f22a-4a29-8183-ccd94efa9086", "address": "fa:16:3e:83:fc:39", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "vif_mac": "fa:16:3e:83:fc:39"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ba3111-f2", "ovs_interfaceid": "48ba3111-f22a-4a29-8183-ccd94efa9086", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '4fa17706-d304-4117-a420-dab994c703dc', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:22:22 user nova-compute[74840]: DEBUG nova.objects.instance [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lazy-loading 'resources' on Instance uuid 832a6445-84ee-43a8-a5bc-a07670602912 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:22:22 user nova-compute[74840]: DEBUG nova.objects.base [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Object Instance<832a6445-84ee-43a8-a5bc-a07670602912> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:22:22 user nova-compute[74840]: DEBUG nova.objects.instance [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lazy-loading 'numa_topology' on Instance uuid 832a6445-84ee-43a8-a5bc-a07670602912 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:22:22 user nova-compute[74840]: DEBUG nova.objects.base [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Object Instance<832a6445-84ee-43a8-a5bc-a07670602912> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:22:22 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:22:22 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:22:22 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:22:22 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:22:22 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:22:22 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:22:22 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:22:22 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:22:22 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:22:22 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:22:22 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:22:22 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:22:22 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:22:22 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:22:22 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:22:22 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:22:22 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:22:22 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:22:22 user nova-compute[74840]: DEBUG nova.objects.instance [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lazy-loading 'vcpu_model' on Instance uuid 832a6445-84ee-43a8-a5bc-a07670602912 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:22:22 user nova-compute[74840]: DEBUG nova.objects.base [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Object Instance<832a6445-84ee-43a8-a5bc-a07670602912> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:22:22 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:20:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-859288350',display_name='tempest-ServerRescueNegativeTestJSON-server-859288350',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-859288350',id=26,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:20:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='457d61e0588847528ef3dd42a6146599',ramdisk_id='',reservation_id='r-o8yv1yn5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1814868989',owner_user_name='tempest-ServerRescueNegativeTestJSON-1814868989-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:20:38Z,user_data=None,user_id='6d4a3286c7d64d59b8ce2e4456db9cc2',uuid=832a6445-84ee-43a8-a5bc-a07670602912,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48ba3111-f22a-4a29-8183-ccd94efa9086", "address": "fa:16:3e:83:fc:39", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "vif_mac": "fa:16:3e:83:fc:39"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ba3111-f2", "ovs_interfaceid": "48ba3111-f22a-4a29-8183-ccd94efa9086", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:22:22 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Converting VIF {"id": "48ba3111-f22a-4a29-8183-ccd94efa9086", "address": "fa:16:3e:83:fc:39", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "vif_mac": "fa:16:3e:83:fc:39"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ba3111-f2", "ovs_interfaceid": "48ba3111-f22a-4a29-8183-ccd94efa9086", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:22:22 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:fc:39,bridge_name='br-int',has_traffic_filtering=True,id=48ba3111-f22a-4a29-8183-ccd94efa9086,network=Network(5ee2626f-3d55-44da-a731-761059adfa85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48ba3111-f2') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:22:23 user nova-compute[74840]: DEBUG nova.objects.instance [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lazy-loading 'pci_devices' on Instance uuid 832a6445-84ee-43a8-a5bc-a07670602912 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:22:23 user nova-compute[74840]: DEBUG nova.objects.base [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Object Instance<832a6445-84ee-43a8-a5bc-a07670602912> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:22:23 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:22:23 user nova-compute[74840]:   <uuid>832a6445-84ee-43a8-a5bc-a07670602912</uuid>
Nov 08 12:22:23 user nova-compute[74840]:   <name>instance-0000001a</name>
Nov 08 12:22:23 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:22:23 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:22:23 user nova-compute[74840]:   <metadata>
Nov 08 12:22:23 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:22:23 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:22:23 user nova-compute[74840]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-859288350</nova:name>
Nov 08 12:22:23 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:22:22</nova:creationTime>
Nov 08 12:22:23 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:22:23 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:22:23 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:22:23 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:22:23 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:22:23 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:22:23 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:22:23 user nova-compute[74840]:       <nova:owner>
Nov 08 12:22:23 user nova-compute[74840]:         <nova:user uuid="6d4a3286c7d64d59b8ce2e4456db9cc2">tempest-ServerRescueNegativeTestJSON-1814868989-project-member</nova:user>
Nov 08 12:22:23 user nova-compute[74840]:         <nova:project uuid="457d61e0588847528ef3dd42a6146599">tempest-ServerRescueNegativeTestJSON-1814868989</nova:project>
Nov 08 12:22:23 user nova-compute[74840]:       </nova:owner>
Nov 08 12:22:23 user nova-compute[74840]:       <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:22:23 user nova-compute[74840]:       <nova:ports>
Nov 08 12:22:23 user nova-compute[74840]:         <nova:port uuid="48ba3111-f22a-4a29-8183-ccd94efa9086">
Nov 08 12:22:23 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 12:22:23 user nova-compute[74840]:         </nova:port>
Nov 08 12:22:23 user nova-compute[74840]:       </nova:ports>
Nov 08 12:22:23 user nova-compute[74840]:     </nova:instance>
Nov 08 12:22:23 user nova-compute[74840]:   </metadata>
Nov 08 12:22:23 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:22:23 user nova-compute[74840]:     <system>
Nov 08 12:22:23 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:22:23 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:22:23 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:22:23 user nova-compute[74840]:       <entry name="serial">832a6445-84ee-43a8-a5bc-a07670602912</entry>
Nov 08 12:22:23 user nova-compute[74840]:       <entry name="uuid">832a6445-84ee-43a8-a5bc-a07670602912</entry>
Nov 08 12:22:23 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:22:23 user nova-compute[74840]:     </system>
Nov 08 12:22:23 user nova-compute[74840]:   </sysinfo>
Nov 08 12:22:23 user nova-compute[74840]:   <os>
Nov 08 12:22:23 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:22:23 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:22:23 user nova-compute[74840]:   </os>
Nov 08 12:22:23 user nova-compute[74840]:   <features>
Nov 08 12:22:23 user nova-compute[74840]:     <acpi/>
Nov 08 12:22:23 user nova-compute[74840]:     <apic/>
Nov 08 12:22:23 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:22:23 user nova-compute[74840]:   </features>
Nov 08 12:22:23 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:22:23 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:22:23 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:22:23 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:22:23 user nova-compute[74840]:   </clock>
Nov 08 12:22:23 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:22:23 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:22:23 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:22:23 user nova-compute[74840]:   </cpu>
Nov 08 12:22:23 user nova-compute[74840]:   <devices>
Nov 08 12:22:23 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:22:23 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:22:23 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue"/>
Nov 08 12:22:23 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:22:23 user nova-compute[74840]:     </disk>
Nov 08 12:22:23 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:22:23 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:22:23 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk"/>
Nov 08 12:22:23 user nova-compute[74840]:       <target dev="vdb" bus="virtio"/>
Nov 08 12:22:23 user nova-compute[74840]:     </disk>
Nov 08 12:22:23 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:22:23 user nova-compute[74840]:       <mac address="fa:16:3e:83:fc:39"/>
Nov 08 12:22:23 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:22:23 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:22:23 user nova-compute[74840]:       <target dev="tap48ba3111-f2"/>
Nov 08 12:22:23 user nova-compute[74840]:     </interface>
Nov 08 12:22:23 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:22:23 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/console.log" append="off"/>
Nov 08 12:22:23 user nova-compute[74840]:     </serial>
Nov 08 12:22:23 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:22:23 user nova-compute[74840]:     <video>
Nov 08 12:22:23 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:22:23 user nova-compute[74840]:     </video>
Nov 08 12:22:23 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:22:23 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:22:23 user nova-compute[74840]:     </rng>
Nov 08 12:22:23 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:22:23 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:22:23 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:22:23 user nova-compute[74840]:     </memballoon>
Nov 08 12:22:23 user nova-compute[74840]:   </devices>
Nov 08 12:22:23 user nova-compute[74840]: </domain>
Nov 08 12:22:23 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:22:23 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Instance destroyed successfully.
Nov 08 12:22:23 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:22:23 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:22:23 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] No VIF found with MAC fa:16:3e:83:fc:39, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:22:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:23 user nova-compute[74840]: DEBUG nova.compute.manager [req-333bbb84-2c2a-4234-9fe4-00290b84bea4 req-94633712-f92c-45ab-9b19-4c93736d5a4c service nova] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Received event network-vif-unplugged-48ba3111-f22a-4a29-8183-ccd94efa9086 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:22:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-333bbb84-2c2a-4234-9fe4-00290b84bea4 req-94633712-f92c-45ab-9b19-4c93736d5a4c service nova] Acquiring lock "832a6445-84ee-43a8-a5bc-a07670602912-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:22:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-333bbb84-2c2a-4234-9fe4-00290b84bea4 req-94633712-f92c-45ab-9b19-4c93736d5a4c service nova] Lock "832a6445-84ee-43a8-a5bc-a07670602912-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:22:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-333bbb84-2c2a-4234-9fe4-00290b84bea4 req-94633712-f92c-45ab-9b19-4c93736d5a4c service nova] Lock "832a6445-84ee-43a8-a5bc-a07670602912-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:22:23 user nova-compute[74840]: DEBUG nova.compute.manager [req-333bbb84-2c2a-4234-9fe4-00290b84bea4 req-94633712-f92c-45ab-9b19-4c93736d5a4c service nova] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] No waiting events found dispatching network-vif-unplugged-48ba3111-f22a-4a29-8183-ccd94efa9086 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:22:23 user nova-compute[74840]: WARNING nova.compute.manager [req-333bbb84-2c2a-4234-9fe4-00290b84bea4 req-94633712-f92c-45ab-9b19-4c93736d5a4c service nova] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Received unexpected event network-vif-unplugged-48ba3111-f22a-4a29-8183-ccd94efa9086 for instance with vm_state active and task_state rescuing.
Nov 08 12:22:23 user nova-compute[74840]: DEBUG nova.compute.manager [req-333bbb84-2c2a-4234-9fe4-00290b84bea4 req-94633712-f92c-45ab-9b19-4c93736d5a4c service nova] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Received event network-vif-plugged-48ba3111-f22a-4a29-8183-ccd94efa9086 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:22:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-333bbb84-2c2a-4234-9fe4-00290b84bea4 req-94633712-f92c-45ab-9b19-4c93736d5a4c service nova] Acquiring lock "832a6445-84ee-43a8-a5bc-a07670602912-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:22:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-333bbb84-2c2a-4234-9fe4-00290b84bea4 req-94633712-f92c-45ab-9b19-4c93736d5a4c service nova] Lock "832a6445-84ee-43a8-a5bc-a07670602912-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:22:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-333bbb84-2c2a-4234-9fe4-00290b84bea4 req-94633712-f92c-45ab-9b19-4c93736d5a4c service nova] Lock "832a6445-84ee-43a8-a5bc-a07670602912-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:22:23 user nova-compute[74840]: DEBUG nova.compute.manager [req-333bbb84-2c2a-4234-9fe4-00290b84bea4 req-94633712-f92c-45ab-9b19-4c93736d5a4c service nova] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] No waiting events found dispatching network-vif-plugged-48ba3111-f22a-4a29-8183-ccd94efa9086 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:22:23 user nova-compute[74840]: WARNING nova.compute.manager [req-333bbb84-2c2a-4234-9fe4-00290b84bea4 req-94633712-f92c-45ab-9b19-4c93736d5a4c service nova] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Received unexpected event network-vif-plugged-48ba3111-f22a-4a29-8183-ccd94efa9086 for instance with vm_state active and task_state rescuing.
Nov 08 12:22:23 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-7af99f47-c6fa-431f-a23b-7d7225f0cf25 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:22:23 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-7af99f47-c6fa-431f-a23b-7d7225f0cf25 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] No BDM found with device name hda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:22:23 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-7af99f47-c6fa-431f-a23b-7d7225f0cf25 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] No VIF found with MAC fa:16:3e:56:38:57, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:22:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-7af99f47-c6fa-431f-a23b-7d7225f0cf25 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Lock "83c035a0-880b-4170-98bc-b18cae712cfa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 32.342s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:22:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:25 user nova-compute[74840]: DEBUG nova.compute.manager [req-70b9bf1e-5d8b-4e18-bb6e-e14ed4975786 req-27347550-94e5-4515-aa3b-1564d29ab610 service nova] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Received event network-vif-plugged-48ba3111-f22a-4a29-8183-ccd94efa9086 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:22:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-70b9bf1e-5d8b-4e18-bb6e-e14ed4975786 req-27347550-94e5-4515-aa3b-1564d29ab610 service nova] Acquiring lock "832a6445-84ee-43a8-a5bc-a07670602912-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:22:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-70b9bf1e-5d8b-4e18-bb6e-e14ed4975786 req-27347550-94e5-4515-aa3b-1564d29ab610 service nova] Lock "832a6445-84ee-43a8-a5bc-a07670602912-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:22:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-70b9bf1e-5d8b-4e18-bb6e-e14ed4975786 req-27347550-94e5-4515-aa3b-1564d29ab610 service nova] Lock "832a6445-84ee-43a8-a5bc-a07670602912-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:22:25 user nova-compute[74840]: DEBUG nova.compute.manager [req-70b9bf1e-5d8b-4e18-bb6e-e14ed4975786 req-27347550-94e5-4515-aa3b-1564d29ab610 service nova] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] No waiting events found dispatching network-vif-plugged-48ba3111-f22a-4a29-8183-ccd94efa9086 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:22:25 user nova-compute[74840]: WARNING nova.compute.manager [req-70b9bf1e-5d8b-4e18-bb6e-e14ed4975786 req-27347550-94e5-4515-aa3b-1564d29ab610 service nova] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Received unexpected event network-vif-plugged-48ba3111-f22a-4a29-8183-ccd94efa9086 for instance with vm_state active and task_state rescuing.
Nov 08 12:22:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b8bd9368-0ee0-4d69-80f8-eaa5ccba0dd8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Acquiring lock "83c035a0-880b-4170-98bc-b18cae712cfa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:22:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b8bd9368-0ee0-4d69-80f8-eaa5ccba0dd8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Lock "83c035a0-880b-4170-98bc-b18cae712cfa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:22:25 user nova-compute[74840]: INFO nova.compute.manager [None req-b8bd9368-0ee0-4d69-80f8-eaa5ccba0dd8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Detaching volume cb04a72b-24aa-47ec-90ec-7e71b7ec321e
Nov 08 12:22:25 user nova-compute[74840]: INFO nova.virt.block_device [None req-b8bd9368-0ee0-4d69-80f8-eaa5ccba0dd8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Attempting to driver detach volume cb04a72b-24aa-47ec-90ec-7e71b7ec321e from mountpoint /dev/vdb
Nov 08 12:22:25 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b8bd9368-0ee0-4d69-80f8-eaa5ccba0dd8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Attempting to detach device vdb from instance 83c035a0-880b-4170-98bc-b18cae712cfa from the persistent domain config. {{(pid=74840) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 12:22:25 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-b8bd9368-0ee0-4d69-80f8-eaa5ccba0dd8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 12:22:25 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:22:25 user nova-compute[74840]:   <source dev="/dev/sdb"/>
Nov 08 12:22:25 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:22:25 user nova-compute[74840]:   <serial>cb04a72b-24aa-47ec-90ec-7e71b7ec321e</serial>
Nov 08 12:22:25 user nova-compute[74840]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 08 12:22:25 user nova-compute[74840]: </disk>
Nov 08 12:22:25 user nova-compute[74840]:  {{(pid=74840) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 12:22:25 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-b8bd9368-0ee0-4d69-80f8-eaa5ccba0dd8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Successfully detached device vdb from instance 83c035a0-880b-4170-98bc-b18cae712cfa from the persistent domain config.
Nov 08 12:22:25 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b8bd9368-0ee0-4d69-80f8-eaa5ccba0dd8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 83c035a0-880b-4170-98bc-b18cae712cfa from the live domain config. {{(pid=74840) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 12:22:25 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-b8bd9368-0ee0-4d69-80f8-eaa5ccba0dd8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 12:22:25 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:22:25 user nova-compute[74840]:   <source dev="/dev/sdb"/>
Nov 08 12:22:25 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:22:25 user nova-compute[74840]:   <serial>cb04a72b-24aa-47ec-90ec-7e71b7ec321e</serial>
Nov 08 12:22:25 user nova-compute[74840]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 08 12:22:25 user nova-compute[74840]: </disk>
Nov 08 12:22:25 user nova-compute[74840]:  {{(pid=74840) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 12:22:26 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b8bd9368-0ee0-4d69-80f8-eaa5ccba0dd8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 83c035a0-880b-4170-98bc-b18cae712cfa {{(pid=74840) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 12:22:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:27 user nova-compute[74840]: DEBUG nova.compute.manager [None req-93e426a3-1307-46eb-8a68-cae3ffb67ae1 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:22:27 user nova-compute[74840]: DEBUG nova.compute.manager [req-ea835566-d06f-40c6-8302-6f0e86ed6b3f req-506e3f68-06b5-4e6e-a1fd-8f308c83a2f7 service nova] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Received event network-vif-plugged-48ba3111-f22a-4a29-8183-ccd94efa9086 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:22:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-ea835566-d06f-40c6-8302-6f0e86ed6b3f req-506e3f68-06b5-4e6e-a1fd-8f308c83a2f7 service nova] Acquiring lock "832a6445-84ee-43a8-a5bc-a07670602912-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:22:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-ea835566-d06f-40c6-8302-6f0e86ed6b3f req-506e3f68-06b5-4e6e-a1fd-8f308c83a2f7 service nova] Lock "832a6445-84ee-43a8-a5bc-a07670602912-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:22:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-ea835566-d06f-40c6-8302-6f0e86ed6b3f req-506e3f68-06b5-4e6e-a1fd-8f308c83a2f7 service nova] Lock "832a6445-84ee-43a8-a5bc-a07670602912-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:22:27 user nova-compute[74840]: DEBUG nova.compute.manager [req-ea835566-d06f-40c6-8302-6f0e86ed6b3f req-506e3f68-06b5-4e6e-a1fd-8f308c83a2f7 service nova] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] No waiting events found dispatching network-vif-plugged-48ba3111-f22a-4a29-8183-ccd94efa9086 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:22:27 user nova-compute[74840]: WARNING nova.compute.manager [req-ea835566-d06f-40c6-8302-6f0e86ed6b3f req-506e3f68-06b5-4e6e-a1fd-8f308c83a2f7 service nova] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Received unexpected event network-vif-plugged-48ba3111-f22a-4a29-8183-ccd94efa9086 for instance with vm_state active and task_state rescuing.
Nov 08 12:22:28 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34a89cbc-1dce-4b1d-bf9a-1053f542fb49 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Calling os-brick to attach iSCSI Volume {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a89cbc-1dce-4b1d-bf9a-1053f542fb49 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nNWQCIMD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:22:28 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-34a89cbc-1dce-4b1d-bf9a-1053f542fb49 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:22:28 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-34a89cbc-1dce-4b1d-bf9a-1053f542fb49 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-34a89cbc-1dce-4b1d-bf9a-1053f542fb49 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:22:28 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-34a89cbc-1dce-4b1d-bf9a-1053f542fb49 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:22:28 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-34a89cbc-1dce-4b1d-bf9a-1053f542fb49 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-34a89cbc-1dce-4b1d-bf9a-1053f542fb49 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:22:28 user nova-compute[74840]: INFO os_brick.initiator.connectors.iscsi [None req-34a89cbc-1dce-4b1d-bf9a-1053f542fb49 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 12:22:28 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e -p 172.16.0.220:3260 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8cf4e9-f549-4684-bcf0-3797df06eb6d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a89cbc-1dce-4b1d-bf9a-1053f542fb49 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 12:22:28 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e -p 172.16.0.220:3260 --interface default --op new {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8990b5c4-e4f4-4147-9d5d-43770d30ebe3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e] added\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a89cbc-1dce-4b1d-bf9a-1053f542fb49 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e] added
Nov 08 12:22:28 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a518d81d-e465-4f59-a3a7-73c0f3103324]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a89cbc-1dce-4b1d-bf9a-1053f542fb49 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2183cc1-a827-4c67-bab7-ea643b5c9c80]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a89cbc-1dce-4b1d-bf9a-1053f542fb49 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nNWQCIMD {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nNWQCIMD" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7404452a-308c-4522-9b84-78a3e64438fb]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a89cbc-1dce-4b1d-bf9a-1053f542fb49 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nNWQCIMD'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a336dcc-0348-4e96-a98f-d6b9294503c5]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a89cbc-1dce-4b1d-bf9a-1053f542fb49 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[122b4c1b-3c0a-40cb-a9bc-b855ab52538f]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a89cbc-1dce-4b1d-bf9a-1053f542fb49 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)
Nov 08 12:22:28 user nova-compute[74840]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 (non-flash)
Nov 08 12:22:28 user nova-compute[74840]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 (non-flash)
Nov 08 12:22:28 user nova-compute[74840]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:22:28 user nova-compute[74840]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)
Nov 08 12:22:28 user nova-compute[74840]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e (non-flash)
Nov 08 12:22:28 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a89cbc-1dce-4b1d-bf9a-1053f542fb49 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)
Nov 08 12:22:28 user nova-compute[74840]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 (non-flash)
Nov 08 12:22:28 user nova-compute[74840]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 (non-flash)
Nov 08 12:22:28 user nova-compute[74840]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:22:28 user nova-compute[74840]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)
Nov 08 12:22:28 user nova-compute[74840]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e (non-flash)
Nov 08 12:22:28 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e -p 172.16.0.220:3260 --login {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e -p 172.16.0.220:3260 --login" returned: 0 in 0.132s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5485b366-6ccc-4e27-8f3e-f3273268fc36]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a89cbc-1dce-4b1d-bf9a-1053f542fb49 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e, portal: 172.16.0.220,3260]
Nov 08 12:22:28 user nova-compute[74840]: Login to [iface: default, target: iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e, portal: 172.16.0.220,3260] successful.
Nov 08 12:22:28 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c36d5ba-0a36-4b79-a7c1-0dbb3d08a1c7]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a89cbc-1dce-4b1d-bf9a-1053f542fb49 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[0edea86e-f5bb-4f2c-8448-3f09362ac936]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a89cbc-1dce-4b1d-bf9a-1053f542fb49 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)
Nov 08 12:22:28 user nova-compute[74840]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 (non-flash)
Nov 08 12:22:28 user nova-compute[74840]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 (non-flash)
Nov 08 12:22:28 user nova-compute[74840]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:22:28 user nova-compute[74840]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)
Nov 08 12:22:28 user nova-compute[74840]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e (non-flash)
Nov 08 12:22:28 user nova-compute[74840]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e (non-flash)
Nov 08 12:22:28 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a89cbc-1dce-4b1d-bf9a-1053f542fb49 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)
Nov 08 12:22:28 user nova-compute[74840]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 (non-flash)
Nov 08 12:22:28 user nova-compute[74840]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 (non-flash)
Nov 08 12:22:28 user nova-compute[74840]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:22:28 user nova-compute[74840]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)
Nov 08 12:22:28 user nova-compute[74840]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e (non-flash)
Nov 08 12:22:28 user nova-compute[74840]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e (non-flash)
Nov 08 12:22:28 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-34a89cbc-1dce-4b1d-bf9a-1053f542fb49 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.402s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a89cbc-1dce-4b1d-bf9a-1053f542fb49 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Connected to 172.16.0.220:3260 {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-34a89cbc-1dce-4b1d-bf9a-1053f542fb49 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] HCTL ('39', '-', '-', 0) found on session 26 with lun 0 {{(pid=74840) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-34a89cbc-1dce-4b1d-bf9a-1053f542fb49 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74840) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.036s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b2bda0-349a-4d14-9e3e-314fbb221f81]: (4, ('- - 0', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-34a89cbc-1dce-4b1d-bf9a-1053f542fb49 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Searching for a device in session 26 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:22:28 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a89cbc-1dce-4b1d-bf9a-1053f542fb49 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nNWQCIMD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 12:22:29 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-34a89cbc-1dce-4b1d-bf9a-1053f542fb49 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.468s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:22:29 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a89cbc-1dce-4b1d-bf9a-1053f542fb49 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] <== connect_volume: return (1470ms) {'type': 'block', 'scsi_wwn': '26236323032306166', 'path': '/dev/sdh'} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:22:29 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34a89cbc-1dce-4b1d-bf9a-1053f542fb49 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236323032306166', 'path': '/dev/sdh'} {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 12:22:29 user nova-compute[74840]: DEBUG nova.objects.instance [None req-34a89cbc-1dce-4b1d-bf9a-1053f542fb49 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lazy-loading 'flavor' on Instance uuid 4f6c75c0-e820-47eb-be3e-51179b6df1a3 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:22:29 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-34a89cbc-1dce-4b1d-bf9a-1053f542fb49 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 12:22:29 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:22:29 user nova-compute[74840]:   <source dev="/dev/sdh"/>
Nov 08 12:22:29 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:22:29 user nova-compute[74840]:   <serial>0de9a650-fb67-477a-9c8a-471e27ed445e</serial>
Nov 08 12:22:29 user nova-compute[74840]: </disk>
Nov 08 12:22:29 user nova-compute[74840]:  {{(pid=74840) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 12:22:29 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:30 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-34a89cbc-1dce-4b1d-bf9a-1053f542fb49 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:22:30 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-34a89cbc-1dce-4b1d-bf9a-1053f542fb49 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:22:30 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-34a89cbc-1dce-4b1d-bf9a-1053f542fb49 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] No VIF found with MAC fa:16:3e:ed:7d:8e, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:22:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-34a89cbc-1dce-4b1d-bf9a-1053f542fb49 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "4f6c75c0-e820-47eb-be3e-51179b6df1a3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.742s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:22:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-090da051-3db3-44dc-8223-e0e873fb868a tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "4f6c75c0-e820-47eb-be3e-51179b6df1a3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:22:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-090da051-3db3-44dc-8223-e0e873fb868a tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "4f6c75c0-e820-47eb-be3e-51179b6df1a3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:22:31 user nova-compute[74840]: INFO nova.compute.manager [None req-090da051-3db3-44dc-8223-e0e873fb868a tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Detaching volume 0de9a650-fb67-477a-9c8a-471e27ed445e
Nov 08 12:22:31 user nova-compute[74840]: INFO nova.virt.block_device [None req-090da051-3db3-44dc-8223-e0e873fb868a tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Attempting to driver detach volume 0de9a650-fb67-477a-9c8a-471e27ed445e from mountpoint /dev/vdb
Nov 08 12:22:31 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-090da051-3db3-44dc-8223-e0e873fb868a tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Attempting to detach device vdb from instance 4f6c75c0-e820-47eb-be3e-51179b6df1a3 from the persistent domain config. {{(pid=74840) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 12:22:31 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-090da051-3db3-44dc-8223-e0e873fb868a tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 12:22:31 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:22:31 user nova-compute[74840]:   <source dev="/dev/sdh"/>
Nov 08 12:22:31 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:22:31 user nova-compute[74840]:   <serial>0de9a650-fb67-477a-9c8a-471e27ed445e</serial>
Nov 08 12:22:31 user nova-compute[74840]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 12:22:31 user nova-compute[74840]: </disk>
Nov 08 12:22:31 user nova-compute[74840]:  {{(pid=74840) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 12:22:31 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-090da051-3db3-44dc-8223-e0e873fb868a tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Successfully detached device vdb from instance 4f6c75c0-e820-47eb-be3e-51179b6df1a3 from the persistent domain config.
Nov 08 12:22:31 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-090da051-3db3-44dc-8223-e0e873fb868a tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4f6c75c0-e820-47eb-be3e-51179b6df1a3 from the live domain config. {{(pid=74840) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 12:22:31 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-090da051-3db3-44dc-8223-e0e873fb868a tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 12:22:31 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:22:31 user nova-compute[74840]:   <source dev="/dev/sdh"/>
Nov 08 12:22:31 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:22:31 user nova-compute[74840]:   <serial>0de9a650-fb67-477a-9c8a-471e27ed445e</serial>
Nov 08 12:22:31 user nova-compute[74840]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 12:22:31 user nova-compute[74840]: </disk>
Nov 08 12:22:31 user nova-compute[74840]:  {{(pid=74840) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 12:22:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-090da051-3db3-44dc-8223-e0e873fb868a tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4f6c75c0-e820-47eb-be3e-51179b6df1a3 {{(pid=74840) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 12:22:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:43 user nova-compute[74840]: DEBUG nova.compute.manager [req-3db62498-709b-40a8-b9c2-be15efb07d38 req-a9c0e895-0da0-4081-8928-615ed20b50d3 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received event network-changed-1fd72b39-7d31-4729-bef7-98f6a5246964 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:22:43 user nova-compute[74840]: DEBUG nova.compute.manager [req-3db62498-709b-40a8-b9c2-be15efb07d38 req-a9c0e895-0da0-4081-8928-615ed20b50d3 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Refreshing instance network info cache due to event network-changed-1fd72b39-7d31-4729-bef7-98f6a5246964. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:22:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3db62498-709b-40a8-b9c2-be15efb07d38 req-a9c0e895-0da0-4081-8928-615ed20b50d3 service nova] Acquiring lock "refresh_cache-4b9fe577-1503-4007-be51-2a714363f8c6" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:22:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3db62498-709b-40a8-b9c2-be15efb07d38 req-a9c0e895-0da0-4081-8928-615ed20b50d3 service nova] Acquired lock "refresh_cache-4b9fe577-1503-4007-be51-2a714363f8c6" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:22:43 user nova-compute[74840]: DEBUG nova.network.neutron [req-3db62498-709b-40a8-b9c2-be15efb07d38 req-a9c0e895-0da0-4081-8928-615ed20b50d3 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Refreshing network info cache for port 1fd72b39-7d31-4729-bef7-98f6a5246964 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:22:44 user nova-compute[74840]: DEBUG nova.network.neutron [req-3db62498-709b-40a8-b9c2-be15efb07d38 req-a9c0e895-0da0-4081-8928-615ed20b50d3 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Updated VIF entry in instance network info cache for port 1fd72b39-7d31-4729-bef7-98f6a5246964. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:22:44 user nova-compute[74840]: DEBUG nova.network.neutron [req-3db62498-709b-40a8-b9c2-be15efb07d38 req-a9c0e895-0da0-4081-8928-615ed20b50d3 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Updating instance_info_cache with network_info: [{"id": "1fd72b39-7d31-4729-bef7-98f6a5246964", "address": "fa:16:3e:07:9d:e6", "network": {"id": "3fcdf89c-266d-43c1-8ae8-705406698b75", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-157102173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd72b39-7d", "ovs_interfaceid": "1fd72b39-7d31-4729-bef7-98f6a5246964", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "87c651bf-a6e8-4290-bbdf-49746754ac54", "address": "fa:16:3e:77:a8:a1", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87c651bf-a6", "ovs_interfaceid": "87c651bf-a6e8-4290-bbdf-49746754ac54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bdec4773-148b-49d7-a461-3a6106fffff6", "address": "fa:16:3e:aa:64:51", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdec4773-14", "ovs_interfaceid": "bdec4773-148b-49d7-a461-3a6106fffff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "538b2412-4ee2-42a6-9cac-f97be4fc341e", "address": "fa:16:3e:d1:64:e8", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap538b2412-4e", "ovs_interfaceid": "538b2412-4ee2-42a6-9cac-f97be4fc341e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "afed888a-e688-452a-846f-4e9b398ff736", "address": "fa:16:3e:72:e8:99", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafed888a-e6", "ovs_interfaceid": "afed888a-e688-452a-846f-4e9b398ff736", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "20547543-4dc1-4158-bb9e-515cce88d3ef", "address": "fa:16:3e:c9:2d:ef", "network": {"id": "4a786612-4da0-47c3-94bb-2a73e6567310", "bridge": "br-int", "label": "tempest-device-tagging-net2-1454321418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20547543-4d", "ovs_interfaceid": "20547543-4dc1-4158-bb9e-515cce88d3ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "68377219-20e9-4c9f-b8c7-bcf0a798655e", "address": "fa:16:3e:24:1b:7e", "network": {"id": "4a786612-4da0-47c3-94bb-2a73e6567310", "bridge": "br-int", "label": "tempest-device-tagging-net2-1454321418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68377219-20", "ovs_interfaceid": "68377219-20e9-4c9f-b8c7-bcf0a798655e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:22:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3db62498-709b-40a8-b9c2-be15efb07d38 req-a9c0e895-0da0-4081-8928-615ed20b50d3 service nova] Releasing lock "refresh_cache-4b9fe577-1503-4007-be51-2a714363f8c6" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:22:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:46 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-b8bd9368-0ee0-4d69-80f8-eaa5ccba0dd8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 83c035a0-880b-4170-98bc-b18cae712cfa is timed out.
Nov 08 12:22:46 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-b8bd9368-0ee0-4d69-80f8-eaa5ccba0dd8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Successfully detached device vdb from instance 83c035a0-880b-4170-98bc-b18cae712cfa from the live domain config.
Nov 08 12:22:46 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8bd9368-0ee0-4d69-80f8-eaa5ccba0dd8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8bd9368-0ee0-4d69-80f8-eaa5ccba0dd8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AyejdHVh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:22:46 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-b8bd9368-0ee0-4d69-80f8-eaa5ccba0dd8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:22:46 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-b8bd9368-0ee0-4d69-80f8-eaa5ccba0dd8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-b8bd9368-0ee0-4d69-80f8-eaa5ccba0dd8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb7aa09-0052-4a91-ac97-98e9497203a9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:30a7200f-f7fe-4364-a423-eff9fbf273fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8bd9368-0ee0-4d69-80f8-eaa5ccba0dd8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 12:22:46 user nova-compute[74840]: No targets found.
Nov 08 12:22:46 user nova-compute[74840]: iSNS:
Nov 08 12:22:46 user nova-compute[74840]: No targets found.
Nov 08 12:22:46 user nova-compute[74840]: STATIC:
Nov 08 12:22:46 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1
Nov 08 12:22:46 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:22:46 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:22:46 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4
Nov 08 12:22:46 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:22:46 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:22:46 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578
Nov 08 12:22:46 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:22:46 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:22:46 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e
Nov 08 12:22:46 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:22:46 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:22:46 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc
Nov 08 12:22:46 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:22:46 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:22:46 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e
Nov 08 12:22:46 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:22:46 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:22:46 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7
Nov 08 12:22:46 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:22:46 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:22:46 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:30a7200f-f7fe-4364-a423-eff9fbf273fc
Nov 08 12:22:46 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:22:46 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:22:46 user nova-compute[74840]: FIRMWARE:
Nov 08 12:22:46 user nova-compute[74840]: No targets found.
Nov 08 12:22:46 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8bd9368-0ee0-4d69-80f8-eaa5ccba0dd8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 12:22:46 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 12:22:46 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8bd9368-0ee0-4d69-80f8-eaa5ccba0dd8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecad7887-909e-48b1-80a8-6493b20f359a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30a7200f-f7fe-4364-a423-eff9fbf273fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Acquiring lock "4b9fe577-1503-4007-be51-2a714363f8c6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Lock "4b9fe577-1503-4007-be51-2a714363f8c6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Acquiring lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:22:46 user nova-compute[74840]: INFO nova.compute.manager [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Terminating instance
Nov 08 12:22:46 user nova-compute[74840]: DEBUG nova.compute.manager [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Start destroying the instance on the hypervisor. {{(pid=74840) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[409427eb-0551-4d81-9eea-efbcd3e0a600]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a7200f-f7fe-4364-a423-eff9fbf273fc (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8bd9368-0ee0-4d69-80f8-eaa5ccba0dd8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)
Nov 08 12:22:46 user nova-compute[74840]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 (non-flash)
Nov 08 12:22:46 user nova-compute[74840]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 (non-flash)
Nov 08 12:22:46 user nova-compute[74840]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:22:46 user nova-compute[74840]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)
Nov 08 12:22:46 user nova-compute[74840]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e (non-flash)
Nov 08 12:22:46 user nova-compute[74840]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e (non-flash)
Nov 08 12:22:46 user nova-compute[74840]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a7200f-f7fe-4364-a423-eff9fbf273fc (non-flash)
Nov 08 12:22:46 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8bd9368-0ee0-4d69-80f8-eaa5ccba0dd8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)
Nov 08 12:22:46 user nova-compute[74840]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 (non-flash)
Nov 08 12:22:46 user nova-compute[74840]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 (non-flash)
Nov 08 12:22:46 user nova-compute[74840]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:22:46 user nova-compute[74840]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)
Nov 08 12:22:46 user nova-compute[74840]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e (non-flash)
Nov 08 12:22:46 user nova-compute[74840]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e (non-flash)
Nov 08 12:22:46 user nova-compute[74840]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a7200f-f7fe-4364-a423-eff9fbf273fc (non-flash)
Nov 08 12:22:46 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8bd9368-0ee0-4d69-80f8-eaa5ccba0dd8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7f4526b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e'): ({'sdb'}, set())}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-b8bd9368-0ee0-4d69-80f8-eaa5ccba0dd8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Removing single pathed devices sdb {{(pid=74840) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6d9b2b-7ce7-432b-b159-16e9104c63bd]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd153cd0-fae9-43eb-8378-1a3c5735a223]: (4, ('ok\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-b8bd9368-0ee0-4d69-80f8-eaa5ccba0dd8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Flushing IO for device /dev/sdb {{(pid=74840) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9938c57d-0176-4b79-9694-9c01f680dbcf]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-b8bd9368-0ee0-4d69-80f8-eaa5ccba0dd8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74840) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.063s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9a9c59-25ea-4d1d-bd7c-199f9336c41a]: (4, ('1', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-b8bd9368-0ee0-4d69-80f8-eaa5ccba0dd8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-b8bd9368-0ee0-4d69-80f8-eaa5ccba0dd8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] SCSI volumes sdb have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8bd9368-0ee0-4d69-80f8-eaa5ccba0dd8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e')] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b456330c-ff48-4d8b-b464-6e1dc932407e]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8bd9368-0ee0-4d69-80f8-eaa5ccba0dd8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e -p 172.16.0.220:3260 --logout {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e -p 172.16.0.220:3260 --logout" returned: 0 in 0.134s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d685df-8a2e-4fc3-81ee-7de54460e897]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8bd9368-0ee0-4d69-80f8-eaa5ccba0dd8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e, portal: 172.16.0.220,3260]
Nov 08 12:22:46 user nova-compute[74840]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e, portal: 172.16.0.220,3260] successful.
Nov 08 12:22:46 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e -p 172.16.0.220:3260 --op delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb04a72b-24aa-47ec-90ec-7e71b7ec321e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.057s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee67c794-80e9-4bfb-8092-d69d35ca822d]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8bd9368-0ee0-4d69-80f8-eaa5ccba0dd8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-b8bd9368-0ee0-4d69-80f8-eaa5ccba0dd8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.526s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8bd9368-0ee0-4d69-80f8-eaa5ccba0dd8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] <== disconnect_volume: return (527ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8bd9368-0ee0-4d69-80f8-eaa5ccba0dd8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:47 user nova-compute[74840]: DEBUG nova.compute.manager [req-bce8c889-973c-4523-8e55-c0f30f38984f req-3fb4fc6c-4891-40f8-bab9-738287af9b3d service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received event network-vif-unplugged-87c651bf-a6e8-4290-bbdf-49746754ac54 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:22:47 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-bce8c889-973c-4523-8e55-c0f30f38984f req-3fb4fc6c-4891-40f8-bab9-738287af9b3d service nova] Acquiring lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:22:47 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-bce8c889-973c-4523-8e55-c0f30f38984f req-3fb4fc6c-4891-40f8-bab9-738287af9b3d service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:22:47 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-bce8c889-973c-4523-8e55-c0f30f38984f req-3fb4fc6c-4891-40f8-bab9-738287af9b3d service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:22:47 user nova-compute[74840]: DEBUG nova.compute.manager [req-bce8c889-973c-4523-8e55-c0f30f38984f req-3fb4fc6c-4891-40f8-bab9-738287af9b3d service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] No waiting events found dispatching network-vif-unplugged-87c651bf-a6e8-4290-bbdf-49746754ac54 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:22:47 user nova-compute[74840]: DEBUG nova.compute.manager [req-bce8c889-973c-4523-8e55-c0f30f38984f req-3fb4fc6c-4891-40f8-bab9-738287af9b3d service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received event network-vif-unplugged-87c651bf-a6e8-4290-bbdf-49746754ac54 for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:22:47 user nova-compute[74840]: DEBUG nova.compute.manager [req-1600ce9c-326f-4161-b968-87f834d841e5 req-df31fc0c-a1d2-411b-a40b-57f2fe6271aa service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received event network-vif-unplugged-1fd72b39-7d31-4729-bef7-98f6a5246964 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:22:47 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-1600ce9c-326f-4161-b968-87f834d841e5 req-df31fc0c-a1d2-411b-a40b-57f2fe6271aa service nova] Acquiring lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:22:47 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-1600ce9c-326f-4161-b968-87f834d841e5 req-df31fc0c-a1d2-411b-a40b-57f2fe6271aa service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:22:47 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-1600ce9c-326f-4161-b968-87f834d841e5 req-df31fc0c-a1d2-411b-a40b-57f2fe6271aa service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:22:47 user nova-compute[74840]: DEBUG nova.compute.manager [req-1600ce9c-326f-4161-b968-87f834d841e5 req-df31fc0c-a1d2-411b-a40b-57f2fe6271aa service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] No waiting events found dispatching network-vif-unplugged-1fd72b39-7d31-4729-bef7-98f6a5246964 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:22:47 user nova-compute[74840]: DEBUG nova.compute.manager [req-1600ce9c-326f-4161-b968-87f834d841e5 req-df31fc0c-a1d2-411b-a40b-57f2fe6271aa service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received event network-vif-unplugged-1fd72b39-7d31-4729-bef7-98f6a5246964 for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:22:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:47 user nova-compute[74840]: DEBUG nova.compute.manager [req-93f8739f-49bc-469a-97f0-203d7b8dbe85 req-3eb21944-4eb3-4ff5-b346-88ecd69fb7f2 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received event network-vif-unplugged-bdec4773-148b-49d7-a461-3a6106fffff6 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:22:47 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-93f8739f-49bc-469a-97f0-203d7b8dbe85 req-3eb21944-4eb3-4ff5-b346-88ecd69fb7f2 service nova] Acquiring lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:22:47 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-93f8739f-49bc-469a-97f0-203d7b8dbe85 req-3eb21944-4eb3-4ff5-b346-88ecd69fb7f2 service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:22:47 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-93f8739f-49bc-469a-97f0-203d7b8dbe85 req-3eb21944-4eb3-4ff5-b346-88ecd69fb7f2 service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:22:47 user nova-compute[74840]: DEBUG nova.compute.manager [req-93f8739f-49bc-469a-97f0-203d7b8dbe85 req-3eb21944-4eb3-4ff5-b346-88ecd69fb7f2 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] No waiting events found dispatching network-vif-unplugged-bdec4773-148b-49d7-a461-3a6106fffff6 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:22:47 user nova-compute[74840]: DEBUG nova.compute.manager [req-93f8739f-49bc-469a-97f0-203d7b8dbe85 req-3eb21944-4eb3-4ff5-b346-88ecd69fb7f2 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received event network-vif-unplugged-bdec4773-148b-49d7-a461-3a6106fffff6 for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:22:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:48 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:48 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:48 user nova-compute[74840]: DEBUG nova.objects.instance [None req-b8bd9368-0ee0-4d69-80f8-eaa5ccba0dd8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Lazy-loading 'flavor' on Instance uuid 83c035a0-880b-4170-98bc-b18cae712cfa {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:22:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b8bd9368-0ee0-4d69-80f8-eaa5ccba0dd8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Lock "83c035a0-880b-4170-98bc-b18cae712cfa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.734s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:22:49 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Instance destroyed successfully.
Nov 08 12:22:49 user nova-compute[74840]: DEBUG nova.objects.instance [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Lazy-loading 'resources' on Instance uuid 4b9fe577-1503-4007-be51-2a714363f8c6 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:19:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-466514081',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-466514081',id=21,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJ9ewnswCin9d0ksrvZPetSoHSWVhALZkDxKTDnNCu1Z50OR8n+Idiz9tDLM+PSL/w10zzvauInz3PdSFJX20TTSB0Hgr43GdvUa1dg0TRW5OrJcMq9AnrhvGJBs502eQ==',key_name='tempest-keypair-385572257',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:21:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54e6bce6148d4a0296ece1b35a2db93d',ramdisk_id='',reservation_id='r-e5b9kv2x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1224547504',owner_user_name='tempest-TaggedBootDevicesTest_v242-1224547504-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:21:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1eab1412fcbe44c89af927d874068e53',uuid=4b9fe577-1503-4007-be51-2a714363f8c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1fd72b39-7d31-4729-bef7-98f6a5246964", "address": "fa:16:3e:07:9d:e6", "network": {"id": "3fcdf89c-266d-43c1-8ae8-705406698b75", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-157102173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd72b39-7d", "ovs_interfaceid": "1fd72b39-7d31-4729-bef7-98f6a5246964", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Converting VIF {"id": "1fd72b39-7d31-4729-bef7-98f6a5246964", "address": "fa:16:3e:07:9d:e6", "network": {"id": "3fcdf89c-266d-43c1-8ae8-705406698b75", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-157102173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd72b39-7d", "ovs_interfaceid": "1fd72b39-7d31-4729-bef7-98f6a5246964", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:9d:e6,bridge_name='br-int',has_traffic_filtering=True,id=1fd72b39-7d31-4729-bef7-98f6a5246964,network=Network(3fcdf89c-266d-43c1-8ae8-705406698b75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fd72b39-7d') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG os_vif [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:9d:e6,bridge_name='br-int',has_traffic_filtering=True,id=1fd72b39-7d31-4729-bef7-98f6a5246964,network=Network(3fcdf89c-266d-43c1-8ae8-705406698b75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fd72b39-7d') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1fd72b39-7d, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-98ab1211-bce0-4b73-a3f5-48ec0570c5c8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Acquiring lock "interface-83c035a0-880b-4170-98bc-b18cae712cfa-0ce328c3-b755-4d90-b0af-f4b2beef1bec" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-98ab1211-bce0-4b73-a3f5-48ec0570c5c8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Lock "interface-83c035a0-880b-4170-98bc-b18cae712cfa-0ce328c3-b755-4d90-b0af-f4b2beef1bec" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG nova.compute.manager [req-442ecbf3-e7b7-4143-98f3-cd8ed15fb771 req-be5f6070-62b9-4ff5-b968-3ec7f4130d3a service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received event network-vif-plugged-87c651bf-a6e8-4290-bbdf-49746754ac54 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-442ecbf3-e7b7-4143-98f3-cd8ed15fb771 req-be5f6070-62b9-4ff5-b968-3ec7f4130d3a service nova] Acquiring lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-442ecbf3-e7b7-4143-98f3-cd8ed15fb771 req-be5f6070-62b9-4ff5-b968-3ec7f4130d3a service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-442ecbf3-e7b7-4143-98f3-cd8ed15fb771 req-be5f6070-62b9-4ff5-b968-3ec7f4130d3a service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG nova.compute.manager [req-442ecbf3-e7b7-4143-98f3-cd8ed15fb771 req-be5f6070-62b9-4ff5-b968-3ec7f4130d3a service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] No waiting events found dispatching network-vif-plugged-87c651bf-a6e8-4290-bbdf-49746754ac54 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:22:49 user nova-compute[74840]: WARNING nova.compute.manager [req-442ecbf3-e7b7-4143-98f3-cd8ed15fb771 req-be5f6070-62b9-4ff5-b968-3ec7f4130d3a service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received unexpected event network-vif-plugged-87c651bf-a6e8-4290-bbdf-49746754ac54 for instance with vm_state active and task_state deleting.
Nov 08 12:22:49 user nova-compute[74840]: DEBUG nova.compute.manager [req-442ecbf3-e7b7-4143-98f3-cd8ed15fb771 req-be5f6070-62b9-4ff5-b968-3ec7f4130d3a service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received event network-vif-unplugged-538b2412-4ee2-42a6-9cac-f97be4fc341e {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-442ecbf3-e7b7-4143-98f3-cd8ed15fb771 req-be5f6070-62b9-4ff5-b968-3ec7f4130d3a service nova] Acquiring lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-442ecbf3-e7b7-4143-98f3-cd8ed15fb771 req-be5f6070-62b9-4ff5-b968-3ec7f4130d3a service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-442ecbf3-e7b7-4143-98f3-cd8ed15fb771 req-be5f6070-62b9-4ff5-b968-3ec7f4130d3a service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG nova.compute.manager [req-442ecbf3-e7b7-4143-98f3-cd8ed15fb771 req-be5f6070-62b9-4ff5-b968-3ec7f4130d3a service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] No waiting events found dispatching network-vif-unplugged-538b2412-4ee2-42a6-9cac-f97be4fc341e {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG nova.compute.manager [req-442ecbf3-e7b7-4143-98f3-cd8ed15fb771 req-be5f6070-62b9-4ff5-b968-3ec7f4130d3a service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received event network-vif-unplugged-538b2412-4ee2-42a6-9cac-f97be4fc341e for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG nova.compute.manager [req-442ecbf3-e7b7-4143-98f3-cd8ed15fb771 req-be5f6070-62b9-4ff5-b968-3ec7f4130d3a service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received event network-vif-plugged-538b2412-4ee2-42a6-9cac-f97be4fc341e {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-442ecbf3-e7b7-4143-98f3-cd8ed15fb771 req-be5f6070-62b9-4ff5-b968-3ec7f4130d3a service nova] Acquiring lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-442ecbf3-e7b7-4143-98f3-cd8ed15fb771 req-be5f6070-62b9-4ff5-b968-3ec7f4130d3a service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-442ecbf3-e7b7-4143-98f3-cd8ed15fb771 req-be5f6070-62b9-4ff5-b968-3ec7f4130d3a service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG nova.compute.manager [req-442ecbf3-e7b7-4143-98f3-cd8ed15fb771 req-be5f6070-62b9-4ff5-b968-3ec7f4130d3a service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] No waiting events found dispatching network-vif-plugged-538b2412-4ee2-42a6-9cac-f97be4fc341e {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:22:49 user nova-compute[74840]: WARNING nova.compute.manager [req-442ecbf3-e7b7-4143-98f3-cd8ed15fb771 req-be5f6070-62b9-4ff5-b968-3ec7f4130d3a service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received unexpected event network-vif-plugged-538b2412-4ee2-42a6-9cac-f97be4fc341e for instance with vm_state active and task_state deleting.
Nov 08 12:22:49 user nova-compute[74840]: DEBUG nova.compute.manager [req-2cc853dc-2e08-4071-ba95-0b65892dc65d req-1ec5fd61-c490-4606-a991-72241cd08435 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received event network-vif-plugged-1fd72b39-7d31-4729-bef7-98f6a5246964 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2cc853dc-2e08-4071-ba95-0b65892dc65d req-1ec5fd61-c490-4606-a991-72241cd08435 service nova] Acquiring lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2cc853dc-2e08-4071-ba95-0b65892dc65d req-1ec5fd61-c490-4606-a991-72241cd08435 service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2cc853dc-2e08-4071-ba95-0b65892dc65d req-1ec5fd61-c490-4606-a991-72241cd08435 service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG nova.compute.manager [req-2cc853dc-2e08-4071-ba95-0b65892dc65d req-1ec5fd61-c490-4606-a991-72241cd08435 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] No waiting events found dispatching network-vif-plugged-1fd72b39-7d31-4729-bef7-98f6a5246964 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:22:49 user nova-compute[74840]: WARNING nova.compute.manager [req-2cc853dc-2e08-4071-ba95-0b65892dc65d req-1ec5fd61-c490-4606-a991-72241cd08435 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received unexpected event network-vif-plugged-1fd72b39-7d31-4729-bef7-98f6a5246964 for instance with vm_state active and task_state deleting.
Nov 08 12:22:49 user nova-compute[74840]: DEBUG nova.compute.manager [req-2cc853dc-2e08-4071-ba95-0b65892dc65d req-1ec5fd61-c490-4606-a991-72241cd08435 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received event network-vif-unplugged-afed888a-e688-452a-846f-4e9b398ff736 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2cc853dc-2e08-4071-ba95-0b65892dc65d req-1ec5fd61-c490-4606-a991-72241cd08435 service nova] Acquiring lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2cc853dc-2e08-4071-ba95-0b65892dc65d req-1ec5fd61-c490-4606-a991-72241cd08435 service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2cc853dc-2e08-4071-ba95-0b65892dc65d req-1ec5fd61-c490-4606-a991-72241cd08435 service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG nova.compute.manager [req-2cc853dc-2e08-4071-ba95-0b65892dc65d req-1ec5fd61-c490-4606-a991-72241cd08435 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] No waiting events found dispatching network-vif-unplugged-afed888a-e688-452a-846f-4e9b398ff736 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG nova.compute.manager [req-2cc853dc-2e08-4071-ba95-0b65892dc65d req-1ec5fd61-c490-4606-a991-72241cd08435 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received event network-vif-unplugged-afed888a-e688-452a-846f-4e9b398ff736 for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG nova.compute.manager [req-2cc853dc-2e08-4071-ba95-0b65892dc65d req-1ec5fd61-c490-4606-a991-72241cd08435 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received event network-vif-plugged-afed888a-e688-452a-846f-4e9b398ff736 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2cc853dc-2e08-4071-ba95-0b65892dc65d req-1ec5fd61-c490-4606-a991-72241cd08435 service nova] Acquiring lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2cc853dc-2e08-4071-ba95-0b65892dc65d req-1ec5fd61-c490-4606-a991-72241cd08435 service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2cc853dc-2e08-4071-ba95-0b65892dc65d req-1ec5fd61-c490-4606-a991-72241cd08435 service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG nova.compute.manager [req-2cc853dc-2e08-4071-ba95-0b65892dc65d req-1ec5fd61-c490-4606-a991-72241cd08435 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] No waiting events found dispatching network-vif-plugged-afed888a-e688-452a-846f-4e9b398ff736 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:22:49 user nova-compute[74840]: WARNING nova.compute.manager [req-2cc853dc-2e08-4071-ba95-0b65892dc65d req-1ec5fd61-c490-4606-a991-72241cd08435 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received unexpected event network-vif-plugged-afed888a-e688-452a-846f-4e9b398ff736 for instance with vm_state active and task_state deleting.
Nov 08 12:22:49 user nova-compute[74840]: DEBUG nova.compute.manager [req-2cc853dc-2e08-4071-ba95-0b65892dc65d req-1ec5fd61-c490-4606-a991-72241cd08435 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received event network-vif-unplugged-20547543-4dc1-4158-bb9e-515cce88d3ef {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2cc853dc-2e08-4071-ba95-0b65892dc65d req-1ec5fd61-c490-4606-a991-72241cd08435 service nova] Acquiring lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2cc853dc-2e08-4071-ba95-0b65892dc65d req-1ec5fd61-c490-4606-a991-72241cd08435 service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2cc853dc-2e08-4071-ba95-0b65892dc65d req-1ec5fd61-c490-4606-a991-72241cd08435 service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG nova.compute.manager [req-2cc853dc-2e08-4071-ba95-0b65892dc65d req-1ec5fd61-c490-4606-a991-72241cd08435 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] No waiting events found dispatching network-vif-unplugged-20547543-4dc1-4158-bb9e-515cce88d3ef {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG nova.compute.manager [req-2cc853dc-2e08-4071-ba95-0b65892dc65d req-1ec5fd61-c490-4606-a991-72241cd08435 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received event network-vif-unplugged-20547543-4dc1-4158-bb9e-515cce88d3ef for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG nova.compute.manager [req-2cc853dc-2e08-4071-ba95-0b65892dc65d req-1ec5fd61-c490-4606-a991-72241cd08435 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received event network-vif-plugged-20547543-4dc1-4158-bb9e-515cce88d3ef {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2cc853dc-2e08-4071-ba95-0b65892dc65d req-1ec5fd61-c490-4606-a991-72241cd08435 service nova] Acquiring lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2cc853dc-2e08-4071-ba95-0b65892dc65d req-1ec5fd61-c490-4606-a991-72241cd08435 service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2cc853dc-2e08-4071-ba95-0b65892dc65d req-1ec5fd61-c490-4606-a991-72241cd08435 service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG nova.compute.manager [req-2cc853dc-2e08-4071-ba95-0b65892dc65d req-1ec5fd61-c490-4606-a991-72241cd08435 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] No waiting events found dispatching network-vif-plugged-20547543-4dc1-4158-bb9e-515cce88d3ef {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:22:49 user nova-compute[74840]: WARNING nova.compute.manager [req-2cc853dc-2e08-4071-ba95-0b65892dc65d req-1ec5fd61-c490-4606-a991-72241cd08435 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received unexpected event network-vif-plugged-20547543-4dc1-4158-bb9e-515cce88d3ef for instance with vm_state active and task_state deleting.
Nov 08 12:22:49 user nova-compute[74840]: DEBUG nova.objects.instance [None req-98ab1211-bce0-4b73-a3f5-48ec0570c5c8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Lazy-loading 'flavor' on Instance uuid 83c035a0-880b-4170-98bc-b18cae712cfa {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fcca6a0a-a643-42e4-8e07-02a5b45ea2c2) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-98ab1211-bce0-4b73-a3f5-48ec0570c5c8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:19:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1248482414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1248482414',id=22,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE08F5Vdqafx8ionT0o99nYONzOMoa/3pOusA/wlvX3fSXRcA+RhI/2hy/w+tkl5A+C6lKye9AkVRPFr99hJwoo+GJvdV7gC/UTzKzbtU6DDZO8zP9SCuNQkk2JKp43yVA==',key_name='tempest-keypair-1343265406',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:20:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c8bdf3f4296441799bd44bd993d3111',ramdisk_id='',reservation_id='r-wyshdnxz',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-807651925',owner_user_name='tempest-TaggedAttachmentsTest-807651925-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:20:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe87f6d61cea4243a123420baf15279a',uuid=83c035a0-880b-4170-98bc-b18cae712cfa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ce328c3-b755-4d90-b0af-f4b2beef1bec", "address": "fa:16:3e:17:9b:c8", "network": {"id": "93688dc9-a647-4983-a0e4-f187716ca66e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1203286658", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8c8bdf3f4296441799bd44bd993d3111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ce328c3-b7", "ovs_interfaceid": "0ce328c3-b755-4d90-b0af-f4b2beef1bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-98ab1211-bce0-4b73-a3f5-48ec0570c5c8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Converting VIF {"id": "0ce328c3-b755-4d90-b0af-f4b2beef1bec", "address": "fa:16:3e:17:9b:c8", "network": {"id": "93688dc9-a647-4983-a0e4-f187716ca66e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1203286658", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8c8bdf3f4296441799bd44bd993d3111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ce328c3-b7", "ovs_interfaceid": "0ce328c3-b755-4d90-b0af-f4b2beef1bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-98ab1211-bce0-4b73-a3f5-48ec0570c5c8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:9b:c8,bridge_name='br-int',has_traffic_filtering=True,id=0ce328c3-b755-4d90-b0af-f4b2beef1bec,network=Network(93688dc9-a647-4983-a0e4-f187716ca66e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ce328c3-b7') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-98ab1211-bce0-4b73-a3f5-48ec0570c5c8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:17:9b:c8"/><model type="virtio"/><mtu size="1442"/><target dev="tap0ce328c3-b7"/></interface> {{(pid=74840) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-98ab1211-bce0-4b73-a3f5-48ec0570c5c8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:17:9b:c8"/><model type="virtio"/><mtu size="1442"/><target dev="tap0ce328c3-b7"/></interface> {{(pid=74840) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-98ab1211-bce0-4b73-a3f5-48ec0570c5c8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Attempting to detach device tap0ce328c3-b7 from instance 83c035a0-880b-4170-98bc-b18cae712cfa from the persistent domain config. {{(pid=74840) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-98ab1211-bce0-4b73-a3f5-48ec0570c5c8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] detach device xml: <interface type="ethernet">
Nov 08 12:22:49 user nova-compute[74840]:   <mac address="fa:16:3e:17:9b:c8"/>
Nov 08 12:22:49 user nova-compute[74840]:   <model type="virtio"/>
Nov 08 12:22:49 user nova-compute[74840]:   <mtu size="1442"/>
Nov 08 12:22:49 user nova-compute[74840]:   <target dev="tap0ce328c3-b7"/>
Nov 08 12:22:49 user nova-compute[74840]: </interface>
Nov 08 12:22:49 user nova-compute[74840]:  {{(pid=74840) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-98ab1211-bce0-4b73-a3f5-48ec0570c5c8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:17:9b:c8"/><model type="virtio"/><mtu size="1442"/><target dev="tap0ce328c3-b7"/></interface> {{(pid=74840) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:49 user nova-compute[74840]: INFO os_vif [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:9d:e6,bridge_name='br-int',has_traffic_filtering=True,id=1fd72b39-7d31-4729-bef7-98f6a5246964,network=Network(3fcdf89c-266d-43c1-8ae8-705406698b75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fd72b39-7d')
Nov 08 12:22:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:19:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-466514081',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-466514081',id=21,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJ9ewnswCin9d0ksrvZPetSoHSWVhALZkDxKTDnNCu1Z50OR8n+Idiz9tDLM+PSL/w10zzvauInz3PdSFJX20TTSB0Hgr43GdvUa1dg0TRW5OrJcMq9AnrhvGJBs502eQ==',key_name='tempest-keypair-385572257',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:21:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54e6bce6148d4a0296ece1b35a2db93d',ramdisk_id='',reservation_id='r-e5b9kv2x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1224547504',owner_user_name='tempest-TaggedBootDevicesTest_v242-1224547504-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:21:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1eab1412fcbe44c89af927d874068e53',uuid=4b9fe577-1503-4007-be51-2a714363f8c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87c651bf-a6e8-4290-bbdf-49746754ac54", "address": "fa:16:3e:77:a8:a1", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87c651bf-a6", "ovs_interfaceid": "87c651bf-a6e8-4290-bbdf-49746754ac54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Converting VIF {"id": "87c651bf-a6e8-4290-bbdf-49746754ac54", "address": "fa:16:3e:77:a8:a1", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87c651bf-a6", "ovs_interfaceid": "87c651bf-a6e8-4290-bbdf-49746754ac54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:a8:a1,bridge_name='br-int',has_traffic_filtering=True,id=87c651bf-a6e8-4290-bbdf-49746754ac54,network=Network(9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap87c651bf-a6') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG os_vif [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:a8:a1,bridge_name='br-int',has_traffic_filtering=True,id=87c651bf-a6e8-4290-bbdf-49746754ac54,network=Network(9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap87c651bf-a6') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-98ab1211-bce0-4b73-a3f5-48ec0570c5c8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:17:9b:c8"/><model type="virtio"/><mtu size="1442"/><target dev="tap0ce328c3-b7"/></interface>not found in domain: <domain type='kvm' id='24'>
Nov 08 12:22:49 user nova-compute[74840]:   <name>instance-00000016</name>
Nov 08 12:22:49 user nova-compute[74840]:   <uuid>83c035a0-880b-4170-98bc-b18cae712cfa</uuid>
Nov 08 12:22:49 user nova-compute[74840]:   <metadata>
Nov 08 12:22:49 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:22:49 user nova-compute[74840]:   <nova:package version="0.0.0"/>
Nov 08 12:22:49 user nova-compute[74840]:   <nova:name>tempest-device-tagging-server-1248482414</nova:name>
Nov 08 12:22:49 user nova-compute[74840]:   <nova:creationTime>2023-11-08 12:21:50</nova:creationTime>
Nov 08 12:22:49 user nova-compute[74840]:   <nova:flavor name="m1.tiny">
Nov 08 12:22:49 user nova-compute[74840]:     <nova:memory>512</nova:memory>
Nov 08 12:22:49 user nova-compute[74840]:     <nova:disk>1</nova:disk>
Nov 08 12:22:49 user nova-compute[74840]:     <nova:swap>0</nova:swap>
Nov 08 12:22:49 user nova-compute[74840]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:22:49 user nova-compute[74840]:     <nova:vcpus>1</nova:vcpus>
Nov 08 12:22:49 user nova-compute[74840]:   </nova:flavor>
Nov 08 12:22:49 user nova-compute[74840]:   <nova:owner>
Nov 08 12:22:49 user nova-compute[74840]:     <nova:user uuid="fe87f6d61cea4243a123420baf15279a">tempest-TaggedAttachmentsTest-807651925-project-member</nova:user>
Nov 08 12:22:49 user nova-compute[74840]:     <nova:project uuid="8c8bdf3f4296441799bd44bd993d3111">tempest-TaggedAttachmentsTest-807651925</nova:project>
Nov 08 12:22:49 user nova-compute[74840]:   </nova:owner>
Nov 08 12:22:49 user nova-compute[74840]:   <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:22:49 user nova-compute[74840]:   <nova:ports>
Nov 08 12:22:49 user nova-compute[74840]:     <nova:port uuid="75ded381-268f-487c-bf3b-1aad4d3909ae">
Nov 08 12:22:49 user nova-compute[74840]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 08 12:22:49 user nova-compute[74840]:     </nova:port>
Nov 08 12:22:49 user nova-compute[74840]:     <nova:port uuid="0ce328c3-b755-4d90-b0af-f4b2beef1bec">
Nov 08 12:22:49 user nova-compute[74840]:       <nova:ip type="fixed" address="10.10.10.232" ipVersion="4"/>
Nov 08 12:22:49 user nova-compute[74840]:     </nova:port>
Nov 08 12:22:49 user nova-compute[74840]:   </nova:ports>
Nov 08 12:22:49 user nova-compute[74840]: </nova:instance>
Nov 08 12:22:49 user nova-compute[74840]:   </metadata>
Nov 08 12:22:49 user nova-compute[74840]:   <memory unit='KiB'>524288</memory>
Nov 08 12:22:49 user nova-compute[74840]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 08 12:22:49 user nova-compute[74840]:   <vcpu placement='static'>1</vcpu>
Nov 08 12:22:49 user nova-compute[74840]:   <resource>
Nov 08 12:22:49 user nova-compute[74840]:     <partition>/machine</partition>
Nov 08 12:22:49 user nova-compute[74840]:   </resource>
Nov 08 12:22:49 user nova-compute[74840]:   <sysinfo type='smbios'>
Nov 08 12:22:49 user nova-compute[74840]:     <system>
Nov 08 12:22:49 user nova-compute[74840]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 08 12:22:49 user nova-compute[74840]:       <entry name='product'>OpenStack Nova</entry>
Nov 08 12:22:49 user nova-compute[74840]:       <entry name='version'>0.0.0</entry>
Nov 08 12:22:49 user nova-compute[74840]:       <entry name='serial'>83c035a0-880b-4170-98bc-b18cae712cfa</entry>
Nov 08 12:22:49 user nova-compute[74840]:       <entry name='uuid'>83c035a0-880b-4170-98bc-b18cae712cfa</entry>
Nov 08 12:22:49 user nova-compute[74840]:       <entry name='family'>Virtual Machine</entry>
Nov 08 12:22:49 user nova-compute[74840]:     </system>
Nov 08 12:22:49 user nova-compute[74840]:   </sysinfo>
Nov 08 12:22:49 user nova-compute[74840]:   <os>
Nov 08 12:22:49 user nova-compute[74840]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 08 12:22:49 user nova-compute[74840]:     <boot dev='hd'/>
Nov 08 12:22:49 user nova-compute[74840]:     <smbios mode='sysinfo'/>
Nov 08 12:22:49 user nova-compute[74840]:   </os>
Nov 08 12:22:49 user nova-compute[74840]:   <features>
Nov 08 12:22:49 user nova-compute[74840]:     <acpi/>
Nov 08 12:22:49 user nova-compute[74840]:     <apic/>
Nov 08 12:22:49 user nova-compute[74840]:     <vmcoreinfo state='on'/>
Nov 08 12:22:49 user nova-compute[74840]:   </features>
Nov 08 12:22:49 user nova-compute[74840]:   <cpu mode='custom' match='exact' check='full'>
Nov 08 12:22:49 user nova-compute[74840]:     <model fallback='forbid'>Nehalem</model>
Nov 08 12:22:49 user nova-compute[74840]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 08 12:22:49 user nova-compute[74840]:     <feature policy='require' name='vme'/>
Nov 08 12:22:49 user nova-compute[74840]:     <feature policy='require' name='x2apic'/>
Nov 08 12:22:49 user nova-compute[74840]:     <feature policy='require' name='hypervisor'/>
Nov 08 12:22:49 user nova-compute[74840]:   </cpu>
Nov 08 12:22:49 user nova-compute[74840]:   <clock offset='utc'>
Nov 08 12:22:49 user nova-compute[74840]:     <timer name='pit' tickpolicy='delay'/>
Nov 08 12:22:49 user nova-compute[74840]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 08 12:22:49 user nova-compute[74840]:     <timer name='hpet' present='no'/>
Nov 08 12:22:49 user nova-compute[74840]:   </clock>
Nov 08 12:22:49 user nova-compute[74840]:   <on_poweroff>destroy</on_poweroff>
Nov 08 12:22:49 user nova-compute[74840]:   <on_reboot>restart</on_reboot>
Nov 08 12:22:49 user nova-compute[74840]:   <on_crash>destroy</on_crash>
Nov 08 12:22:49 user nova-compute[74840]:   <devices>
Nov 08 12:22:49 user nova-compute[74840]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 08 12:22:49 user nova-compute[74840]:     <disk type='file' device='disk'>
Nov 08 12:22:49 user nova-compute[74840]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 08 12:22:49 user nova-compute[74840]:       <source file='/opt/stack/data/nova/instances/83c035a0-880b-4170-98bc-b18cae712cfa/disk' index='2'/>
Nov 08 12:22:49 user nova-compute[74840]:       <backingStore type='file' index='3'>
Nov 08 12:22:49 user nova-compute[74840]:         <format type='raw'/>
Nov 08 12:22:49 user nova-compute[74840]:         <source file='/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6'/>
Nov 08 12:22:49 user nova-compute[74840]:         <backingStore/>
Nov 08 12:22:49 user nova-compute[74840]:       </backingStore>
Nov 08 12:22:49 user nova-compute[74840]:       <target dev='vda' bus='virtio'/>
Nov 08 12:22:49 user nova-compute[74840]:       <alias name='virtio-disk0'/>
Nov 08 12:22:49 user nova-compute[74840]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 08 12:22:49 user nova-compute[74840]:     </disk>
Nov 08 12:22:49 user nova-compute[74840]:     <disk type='file' device='cdrom'>
Nov 08 12:22:49 user nova-compute[74840]:       <driver name='qemu' type='raw' cache='none'/>
Nov 08 12:22:49 user nova-compute[74840]:       <source file='/opt/stack/data/nova/instances/83c035a0-880b-4170-98bc-b18cae712cfa/disk.config' index='1'/>
Nov 08 12:22:49 user nova-compute[74840]:       <backingStore/>
Nov 08 12:22:49 user nova-compute[74840]:       <target dev='hda' bus='ide'/>
Nov 08 12:22:49 user nova-compute[74840]:       <readonly/>
Nov 08 12:22:49 user nova-compute[74840]:       <alias name='ide0-0-0'/>
Nov 08 12:22:49 user nova-compute[74840]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 08 12:22:49 user nova-compute[74840]:     </disk>
Nov 08 12:22:49 user nova-compute[74840]:     <controller type='usb' index='0' model='none'>
Nov 08 12:22:49 user nova-compute[74840]:       <alias name='usb'/>
Nov 08 12:22:49 user nova-compute[74840]:     </controller>
Nov 08 12:22:49 user nova-compute[74840]:     <controller type='pci' index='0' model='pci-root'>
Nov 08 12:22:49 user nova-compute[74840]:       <alias name='pci.0'/>
Nov 08 12:22:49 user nova-compute[74840]:     </controller>
Nov 08 12:22:49 user nova-compute[74840]:     <controller type='ide' index='0'>
Nov 08 12:22:49 user nova-compute[74840]:       <alias name='ide'/>
Nov 08 12:22:49 user nova-compute[74840]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 08 12:22:49 user nova-compute[74840]:     </controller>
Nov 08 12:22:49 user nova-compute[74840]:     <interface type='ethernet'>
Nov 08 12:22:49 user nova-compute[74840]:       <mac address='fa:16:3e:56:38:57'/>
Nov 08 12:22:49 user nova-compute[74840]:       <target dev='tap75ded381-26'/>
Nov 08 12:22:49 user nova-compute[74840]:       <model type='virtio'/>
Nov 08 12:22:49 user nova-compute[74840]:       <mtu size='1442'/>
Nov 08 12:22:49 user nova-compute[74840]:       <alias name='net0'/>
Nov 08 12:22:49 user nova-compute[74840]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 08 12:22:49 user nova-compute[74840]:     </interface>
Nov 08 12:22:49 user nova-compute[74840]:     <interface type='ethernet'>
Nov 08 12:22:49 user nova-compute[74840]:       <mac address='fa:16:3e:17:9b:c8'/>
Nov 08 12:22:49 user nova-compute[74840]:       <target dev='tap0ce328c3-b7'/>
Nov 08 12:22:49 user nova-compute[74840]:       <model type='virtio'/>
Nov 08 12:22:49 user nova-compute[74840]:       <mtu size='1442'/>
Nov 08 12:22:49 user nova-compute[74840]:       <alias name='net1'/>
Nov 08 12:22:49 user nova-compute[74840]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 08 12:22:49 user nova-compute[74840]:     </interface>
Nov 08 12:22:49 user nova-compute[74840]:     <serial type='pty'>
Nov 08 12:22:49 user nova-compute[74840]:       <source path='/dev/pts/0'/>
Nov 08 12:22:49 user nova-compute[74840]:       <log file='/opt/stack/data/nova/instances/83c035a0-880b-4170-98bc-b18cae712cfa/console.log' append='off'/>
Nov 08 12:22:49 user nova-compute[74840]:       <target type='isa-serial' port='0'>
Nov 08 12:22:49 user nova-compute[74840]:         <model name='isa-serial'/>
Nov 08 12:22:49 user nova-compute[74840]:       </target>
Nov 08 12:22:49 user nova-compute[74840]:       <alias name='serial0'/>
Nov 08 12:22:49 user nova-compute[74840]:     </serial>
Nov 08 12:22:49 user nova-compute[74840]:     <console type='pty' tty='/dev/pts/0'>
Nov 08 12:22:49 user nova-compute[74840]:       <source path='/dev/pts/0'/>
Nov 08 12:22:49 user nova-compute[74840]:       <log file='/opt/stack/data/nova/instances/83c035a0-880b-4170-98bc-b18cae712cfa/console.log' append='off'/>
Nov 08 12:22:49 user nova-compute[74840]:       <target type='serial' port='0'/>
Nov 08 12:22:49 user nova-compute[74840]:       <alias name='serial0'/>
Nov 08 12:22:49 user nova-compute[74840]:     </console>
Nov 08 12:22:49 user nova-compute[74840]:     <input type='mouse' bus='ps2'>
Nov 08 12:22:49 user nova-compute[74840]:       <alias name='input0'/>
Nov 08 12:22:49 user nova-compute[74840]:     </input>
Nov 08 12:22:49 user nova-compute[74840]:     <input type='keyboard' bus='ps2'>
Nov 08 12:22:49 user nova-compute[74840]:       <alias name='input1'/>
Nov 08 12:22:49 user nova-compute[74840]:     </input>
Nov 08 12:22:49 user nova-compute[74840]:     <graphics type='vnc' port='5900' autoport='yes' listen='0.0.0.0'>
Nov 08 12:22:49 user nova-compute[74840]:       <listen type='address' address='0.0.0.0'/>
Nov 08 12:22:49 user nova-compute[74840]:     </graphics>
Nov 08 12:22:49 user nova-compute[74840]:     <audio id='1' type='none'/>
Nov 08 12:22:49 user nova-compute[74840]:     <video>
Nov 08 12:22:49 user nova-compute[74840]:       <model type='virtio' heads='1' primary='yes'/>
Nov 08 12:22:49 user nova-compute[74840]:       <alias name='video0'/>
Nov 08 12:22:49 user nova-compute[74840]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 08 12:22:49 user nova-compute[74840]:     </video>
Nov 08 12:22:49 user nova-compute[74840]:     <memballoon model='virtio'>
Nov 08 12:22:49 user nova-compute[74840]:       <stats period='10'/>
Nov 08 12:22:49 user nova-compute[74840]:       <alias name='balloon0'/>
Nov 08 12:22:49 user nova-compute[74840]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 08 12:22:49 user nova-compute[74840]:     </memballoon>
Nov 08 12:22:49 user nova-compute[74840]:     <rng model='virtio'>
Nov 08 12:22:49 user nova-compute[74840]:       <backend model='random'>/dev/urandom</backend>
Nov 08 12:22:49 user nova-compute[74840]:       <alias name='rng0'/>
Nov 08 12:22:49 user nova-compute[74840]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 08 12:22:49 user nova-compute[74840]:     </rng>
Nov 08 12:22:49 user nova-compute[74840]:   </devices>
Nov 08 12:22:49 user nova-compute[74840]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 08 12:22:49 user nova-compute[74840]:     <label>libvirt-83c035a0-880b-4170-98bc-b18cae712cfa</label>
Nov 08 12:22:49 user nova-compute[74840]:     <imagelabel>libvirt-83c035a0-880b-4170-98bc-b18cae712cfa</imagelabel>
Nov 08 12:22:49 user nova-compute[74840]:   </seclabel>
Nov 08 12:22:49 user nova-compute[74840]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 08 12:22:49 user nova-compute[74840]:     <label>+64055:+108</label>
Nov 08 12:22:49 user nova-compute[74840]:     <imagelabel>+64055:+108</imagelabel>
Nov 08 12:22:49 user nova-compute[74840]:   </seclabel>
Nov 08 12:22:49 user nova-compute[74840]: </domain>
Nov 08 12:22:49 user nova-compute[74840]:  {{(pid=74840) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 08 12:22:49 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-98ab1211-bce0-4b73-a3f5-48ec0570c5c8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Successfully detached device tap0ce328c3-b7 from instance 83c035a0-880b-4170-98bc-b18cae712cfa from the persistent domain config.
Nov 08 12:22:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-98ab1211-bce0-4b73-a3f5-48ec0570c5c8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] (1/8): Attempting to detach device tap0ce328c3-b7 with device alias net1 from instance 83c035a0-880b-4170-98bc-b18cae712cfa from the live domain config. {{(pid=74840) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-98ab1211-bce0-4b73-a3f5-48ec0570c5c8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] detach device xml: <interface type="ethernet">
Nov 08 12:22:49 user nova-compute[74840]:   <mac address="fa:16:3e:17:9b:c8"/>
Nov 08 12:22:49 user nova-compute[74840]:   <model type="virtio"/>
Nov 08 12:22:49 user nova-compute[74840]:   <mtu size="1442"/>
Nov 08 12:22:49 user nova-compute[74840]:   <target dev="tap0ce328c3-b7"/>
Nov 08 12:22:49 user nova-compute[74840]: </interface>
Nov 08 12:22:49 user nova-compute[74840]:  {{(pid=74840) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap87c651bf-a6, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=08611cb3-46b2-4376-b435-4adac6057eb6) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG nova.compute.manager [req-3ee50996-8179-48ae-87ec-9c5fa443a3f4 req-81b78c99-d5db-4542-8e3d-5beaa45a8adf service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received event network-vif-plugged-bdec4773-148b-49d7-a461-3a6106fffff6 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3ee50996-8179-48ae-87ec-9c5fa443a3f4 req-81b78c99-d5db-4542-8e3d-5beaa45a8adf service nova] Acquiring lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3ee50996-8179-48ae-87ec-9c5fa443a3f4 req-81b78c99-d5db-4542-8e3d-5beaa45a8adf service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3ee50996-8179-48ae-87ec-9c5fa443a3f4 req-81b78c99-d5db-4542-8e3d-5beaa45a8adf service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG nova.compute.manager [req-3ee50996-8179-48ae-87ec-9c5fa443a3f4 req-81b78c99-d5db-4542-8e3d-5beaa45a8adf service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] No waiting events found dispatching network-vif-plugged-bdec4773-148b-49d7-a461-3a6106fffff6 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:22:49 user nova-compute[74840]: WARNING nova.compute.manager [req-3ee50996-8179-48ae-87ec-9c5fa443a3f4 req-81b78c99-d5db-4542-8e3d-5beaa45a8adf service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received unexpected event network-vif-plugged-bdec4773-148b-49d7-a461-3a6106fffff6 for instance with vm_state active and task_state deleting.
Nov 08 12:22:49 user nova-compute[74840]: DEBUG nova.compute.manager [req-3ee50996-8179-48ae-87ec-9c5fa443a3f4 req-81b78c99-d5db-4542-8e3d-5beaa45a8adf service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received event network-vif-unplugged-68377219-20e9-4c9f-b8c7-bcf0a798655e {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3ee50996-8179-48ae-87ec-9c5fa443a3f4 req-81b78c99-d5db-4542-8e3d-5beaa45a8adf service nova] Acquiring lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3ee50996-8179-48ae-87ec-9c5fa443a3f4 req-81b78c99-d5db-4542-8e3d-5beaa45a8adf service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3ee50996-8179-48ae-87ec-9c5fa443a3f4 req-81b78c99-d5db-4542-8e3d-5beaa45a8adf service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG nova.compute.manager [req-3ee50996-8179-48ae-87ec-9c5fa443a3f4 req-81b78c99-d5db-4542-8e3d-5beaa45a8adf service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] No waiting events found dispatching network-vif-unplugged-68377219-20e9-4c9f-b8c7-bcf0a798655e {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG nova.compute.manager [req-3ee50996-8179-48ae-87ec-9c5fa443a3f4 req-81b78c99-d5db-4542-8e3d-5beaa45a8adf service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received event network-vif-unplugged-68377219-20e9-4c9f-b8c7-bcf0a798655e for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG nova.compute.manager [req-3ee50996-8179-48ae-87ec-9c5fa443a3f4 req-81b78c99-d5db-4542-8e3d-5beaa45a8adf service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received event network-vif-plugged-68377219-20e9-4c9f-b8c7-bcf0a798655e {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3ee50996-8179-48ae-87ec-9c5fa443a3f4 req-81b78c99-d5db-4542-8e3d-5beaa45a8adf service nova] Acquiring lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3ee50996-8179-48ae-87ec-9c5fa443a3f4 req-81b78c99-d5db-4542-8e3d-5beaa45a8adf service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3ee50996-8179-48ae-87ec-9c5fa443a3f4 req-81b78c99-d5db-4542-8e3d-5beaa45a8adf service nova] Lock "4b9fe577-1503-4007-be51-2a714363f8c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG nova.compute.manager [req-3ee50996-8179-48ae-87ec-9c5fa443a3f4 req-81b78c99-d5db-4542-8e3d-5beaa45a8adf service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] No waiting events found dispatching network-vif-plugged-68377219-20e9-4c9f-b8c7-bcf0a798655e {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:22:49 user nova-compute[74840]: WARNING nova.compute.manager [req-3ee50996-8179-48ae-87ec-9c5fa443a3f4 req-81b78c99-d5db-4542-8e3d-5beaa45a8adf service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received unexpected event network-vif-plugged-68377219-20e9-4c9f-b8c7-bcf0a798655e for instance with vm_state active and task_state deleting.
Nov 08 12:22:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:49 user nova-compute[74840]: INFO os_vif [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:a8:a1,bridge_name='br-int',has_traffic_filtering=True,id=87c651bf-a6e8-4290-bbdf-49746754ac54,network=Network(9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap87c651bf-a6')
Nov 08 12:22:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:19:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-466514081',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-466514081',id=21,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJ9ewnswCin9d0ksrvZPetSoHSWVhALZkDxKTDnNCu1Z50OR8n+Idiz9tDLM+PSL/w10zzvauInz3PdSFJX20TTSB0Hgr43GdvUa1dg0TRW5OrJcMq9AnrhvGJBs502eQ==',key_name='tempest-keypair-385572257',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:21:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54e6bce6148d4a0296ece1b35a2db93d',ramdisk_id='',reservation_id='r-e5b9kv2x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1224547504',owner_user_name='tempest-TaggedBootDevicesTest_v242-1224547504-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:21:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1eab1412fcbe44c89af927d874068e53',uuid=4b9fe577-1503-4007-be51-2a714363f8c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bdec4773-148b-49d7-a461-3a6106fffff6", "address": "fa:16:3e:aa:64:51", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdec4773-14", "ovs_interfaceid": "bdec4773-148b-49d7-a461-3a6106fffff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Converting VIF {"id": "bdec4773-148b-49d7-a461-3a6106fffff6", "address": "fa:16:3e:aa:64:51", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdec4773-14", "ovs_interfaceid": "bdec4773-148b-49d7-a461-3a6106fffff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:64:51,bridge_name='br-int',has_traffic_filtering=True,id=bdec4773-148b-49d7-a461-3a6106fffff6,network=Network(9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbdec4773-14') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG os_vif [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:64:51,bridge_name='br-int',has_traffic_filtering=True,id=bdec4773-148b-49d7-a461-3a6106fffff6,network=Network(9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbdec4773-14') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbdec4773-14, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=933b845a-cc4e-451b-b0a6-6e44b503eecd) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:49 user nova-compute[74840]: INFO os_vif [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:64:51,bridge_name='br-int',has_traffic_filtering=True,id=bdec4773-148b-49d7-a461-3a6106fffff6,network=Network(9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbdec4773-14')
Nov 08 12:22:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:19:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-466514081',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-466514081',id=21,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJ9ewnswCin9d0ksrvZPetSoHSWVhALZkDxKTDnNCu1Z50OR8n+Idiz9tDLM+PSL/w10zzvauInz3PdSFJX20TTSB0Hgr43GdvUa1dg0TRW5OrJcMq9AnrhvGJBs502eQ==',key_name='tempest-keypair-385572257',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:21:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54e6bce6148d4a0296ece1b35a2db93d',ramdisk_id='',reservation_id='r-e5b9kv2x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1224547504',owner_user_name='tempest-TaggedBootDevicesTest_v242-1224547504-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:21:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1eab1412fcbe44c89af927d874068e53',uuid=4b9fe577-1503-4007-be51-2a714363f8c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "538b2412-4ee2-42a6-9cac-f97be4fc341e", "address": "fa:16:3e:d1:64:e8", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap538b2412-4e", "ovs_interfaceid": "538b2412-4ee2-42a6-9cac-f97be4fc341e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Converting VIF {"id": "538b2412-4ee2-42a6-9cac-f97be4fc341e", "address": "fa:16:3e:d1:64:e8", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap538b2412-4e", "ovs_interfaceid": "538b2412-4ee2-42a6-9cac-f97be4fc341e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:64:e8,bridge_name='br-int',has_traffic_filtering=True,id=538b2412-4ee2-42a6-9cac-f97be4fc341e,network=Network(9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap538b2412-4e') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG os_vif [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:64:e8,bridge_name='br-int',has_traffic_filtering=True,id=538b2412-4ee2-42a6-9cac-f97be4fc341e,network=Network(9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap538b2412-4e') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap538b2412-4e, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-98ab1211-bce0-4b73-a3f5-48ec0570c5c8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Start waiting for the detach event from libvirt for device tap0ce328c3-b7 with device alias net1 for instance 83c035a0-880b-4170-98bc-b18cae712cfa {{(pid=74840) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fdb71d99-8001-4ef1-a395-b8241c88062f) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:22:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:50 user nova-compute[74840]: INFO os_vif [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:64:e8,bridge_name='br-int',has_traffic_filtering=True,id=538b2412-4ee2-42a6-9cac-f97be4fc341e,network=Network(9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap538b2412-4e')
Nov 08 12:22:50 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:19:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-466514081',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-466514081',id=21,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJ9ewnswCin9d0ksrvZPetSoHSWVhALZkDxKTDnNCu1Z50OR8n+Idiz9tDLM+PSL/w10zzvauInz3PdSFJX20TTSB0Hgr43GdvUa1dg0TRW5OrJcMq9AnrhvGJBs502eQ==',key_name='tempest-keypair-385572257',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:21:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54e6bce6148d4a0296ece1b35a2db93d',ramdisk_id='',reservation_id='r-e5b9kv2x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1224547504',owner_user_name='tempest-TaggedBootDevicesTest_v242-1224547504-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:21:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1eab1412fcbe44c89af927d874068e53',uuid=4b9fe577-1503-4007-be51-2a714363f8c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "afed888a-e688-452a-846f-4e9b398ff736", "address": "fa:16:3e:72:e8:99", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafed888a-e6", "ovs_interfaceid": "afed888a-e688-452a-846f-4e9b398ff736", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Converting VIF {"id": "afed888a-e688-452a-846f-4e9b398ff736", "address": "fa:16:3e:72:e8:99", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafed888a-e6", "ovs_interfaceid": "afed888a-e688-452a-846f-4e9b398ff736", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:e8:99,bridge_name='br-int',has_traffic_filtering=True,id=afed888a-e688-452a-846f-4e9b398ff736,network=Network(9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafed888a-e6') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG os_vif [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:e8:99,bridge_name='br-int',has_traffic_filtering=True,id=afed888a-e688-452a-846f-4e9b398ff736,network=Network(9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafed888a-e6') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapafed888a-e6, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=03cebdac-d95a-4c3c-b910-6adc8e53d1fb) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:50 user nova-compute[74840]: INFO os_vif [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:e8:99,bridge_name='br-int',has_traffic_filtering=True,id=afed888a-e688-452a-846f-4e9b398ff736,network=Network(9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafed888a-e6')
Nov 08 12:22:50 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:19:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-466514081',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-466514081',id=21,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJ9ewnswCin9d0ksrvZPetSoHSWVhALZkDxKTDnNCu1Z50OR8n+Idiz9tDLM+PSL/w10zzvauInz3PdSFJX20TTSB0Hgr43GdvUa1dg0TRW5OrJcMq9AnrhvGJBs502eQ==',key_name='tempest-keypair-385572257',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:21:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54e6bce6148d4a0296ece1b35a2db93d',ramdisk_id='',reservation_id='r-e5b9kv2x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1224547504',owner_user_name='tempest-TaggedBootDevicesTest_v242-1224547504-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:21:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1eab1412fcbe44c89af927d874068e53',uuid=4b9fe577-1503-4007-be51-2a714363f8c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "20547543-4dc1-4158-bb9e-515cce88d3ef", "address": "fa:16:3e:c9:2d:ef", "network": {"id": "4a786612-4da0-47c3-94bb-2a73e6567310", "bridge": "br-int", "label": "tempest-device-tagging-net2-1454321418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20547543-4d", "ovs_interfaceid": "20547543-4dc1-4158-bb9e-515cce88d3ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Converting VIF {"id": "20547543-4dc1-4158-bb9e-515cce88d3ef", "address": "fa:16:3e:c9:2d:ef", "network": {"id": "4a786612-4da0-47c3-94bb-2a73e6567310", "bridge": "br-int", "label": "tempest-device-tagging-net2-1454321418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20547543-4d", "ovs_interfaceid": "20547543-4dc1-4158-bb9e-515cce88d3ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:2d:ef,bridge_name='br-int',has_traffic_filtering=True,id=20547543-4dc1-4158-bb9e-515cce88d3ef,network=Network(4a786612-4da0-47c3-94bb-2a73e6567310),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20547543-4d') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG os_vif [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:2d:ef,bridge_name='br-int',has_traffic_filtering=True,id=20547543-4dc1-4158-bb9e-515cce88d3ef,network=Network(4a786612-4da0-47c3-94bb-2a73e6567310),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20547543-4d') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap20547543-4d, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ca253e76-20d7-439f-b384-807443b3f54e) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:50 user nova-compute[74840]: INFO os_vif [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:2d:ef,bridge_name='br-int',has_traffic_filtering=True,id=20547543-4dc1-4158-bb9e-515cce88d3ef,network=Network(4a786612-4da0-47c3-94bb-2a73e6567310),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20547543-4d')
Nov 08 12:22:50 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:19:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-466514081',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-466514081',id=21,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJ9ewnswCin9d0ksrvZPetSoHSWVhALZkDxKTDnNCu1Z50OR8n+Idiz9tDLM+PSL/w10zzvauInz3PdSFJX20TTSB0Hgr43GdvUa1dg0TRW5OrJcMq9AnrhvGJBs502eQ==',key_name='tempest-keypair-385572257',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:21:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54e6bce6148d4a0296ece1b35a2db93d',ramdisk_id='',reservation_id='r-e5b9kv2x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1224547504',owner_user_name='tempest-TaggedBootDevicesTest_v242-1224547504-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:21:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1eab1412fcbe44c89af927d874068e53',uuid=4b9fe577-1503-4007-be51-2a714363f8c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68377219-20e9-4c9f-b8c7-bcf0a798655e", "address": "fa:16:3e:24:1b:7e", "network": {"id": "4a786612-4da0-47c3-94bb-2a73e6567310", "bridge": "br-int", "label": "tempest-device-tagging-net2-1454321418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68377219-20", "ovs_interfaceid": "68377219-20e9-4c9f-b8c7-bcf0a798655e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Converting VIF {"id": "68377219-20e9-4c9f-b8c7-bcf0a798655e", "address": "fa:16:3e:24:1b:7e", "network": {"id": "4a786612-4da0-47c3-94bb-2a73e6567310", "bridge": "br-int", "label": "tempest-device-tagging-net2-1454321418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68377219-20", "ovs_interfaceid": "68377219-20e9-4c9f-b8c7-bcf0a798655e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:1b:7e,bridge_name='br-int',has_traffic_filtering=True,id=68377219-20e9-4c9f-b8c7-bcf0a798655e,network=Network(4a786612-4da0-47c3-94bb-2a73e6567310),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68377219-20') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG os_vif [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:1b:7e,bridge_name='br-int',has_traffic_filtering=True,id=68377219-20e9-4c9f-b8c7-bcf0a798655e,network=Network(4a786612-4da0-47c3-94bb-2a73e6567310),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68377219-20') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap68377219-20, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=92643742-af81-4096-a1f4-3cef74c3fbaf) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:50 user nova-compute[74840]: INFO os_vif [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:1b:7e,bridge_name='br-int',has_traffic_filtering=True,id=68377219-20e9-4c9f-b8c7-bcf0a798655e,network=Network(4a786612-4da0-47c3-94bb-2a73e6567310),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68377219-20')
Nov 08 12:22:50 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JQtxDMqH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:22:50 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:22:50 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3bec72-e70d-4dff-b8cf-90523afa01f8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:30a7200f-f7fe-4364-a423-eff9fbf273fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 12:22:50 user nova-compute[74840]: No targets found.
Nov 08 12:22:50 user nova-compute[74840]: iSNS:
Nov 08 12:22:50 user nova-compute[74840]: No targets found.
Nov 08 12:22:50 user nova-compute[74840]: STATIC:
Nov 08 12:22:50 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1
Nov 08 12:22:50 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:22:50 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:22:50 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4
Nov 08 12:22:50 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:22:50 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:22:50 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578
Nov 08 12:22:50 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:22:50 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:22:50 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc
Nov 08 12:22:50 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:22:50 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:22:50 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e
Nov 08 12:22:50 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:22:50 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:22:50 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7
Nov 08 12:22:50 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:22:50 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:22:50 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:30a7200f-f7fe-4364-a423-eff9fbf273fc
Nov 08 12:22:50 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:22:50 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:22:50 user nova-compute[74840]: FIRMWARE:
Nov 08 12:22:50 user nova-compute[74840]: No targets found.
Nov 08 12:22:50 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 12:22:50 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 12:22:50 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[97814db1-a1a5-4d29-a425-2083d0c5804d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30a7200f-f7fe-4364-a423-eff9fbf273fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[151f76fd-dfdd-4be0-8f82-17bfd06b0dc7]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a7200f-f7fe-4364-a423-eff9fbf273fc (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)
Nov 08 12:22:50 user nova-compute[74840]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 (non-flash)
Nov 08 12:22:50 user nova-compute[74840]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 (non-flash)
Nov 08 12:22:50 user nova-compute[74840]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:22:50 user nova-compute[74840]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)
Nov 08 12:22:50 user nova-compute[74840]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e (non-flash)
Nov 08 12:22:50 user nova-compute[74840]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a7200f-f7fe-4364-a423-eff9fbf273fc (non-flash)
Nov 08 12:22:50 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)
Nov 08 12:22:50 user nova-compute[74840]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 (non-flash)
Nov 08 12:22:50 user nova-compute[74840]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 (non-flash)
Nov 08 12:22:50 user nova-compute[74840]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:22:50 user nova-compute[74840]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)
Nov 08 12:22:50 user nova-compute[74840]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e (non-flash)
Nov 08 12:22:50 user nova-compute[74840]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a7200f-f7fe-4364-a423-eff9fbf273fc (non-flash)
Nov 08 12:22:50 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7f412b010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7'): ({'sde'}, set())}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Removing single pathed devices sde {{(pid=74840) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ee6b9e-a12e-47b8-be62-0de942d82b9f]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.049s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[34191ce8-2323-4ca7-8f9c-d0479b7be3c0]: (4, ('ok\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Flushing IO for device /dev/sde {{(pid=74840) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a347edae-f804-4868-8fcb-c6317e3dc5d7]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74840) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3c5603-ae1e-4ff9-8aaf-d18f06f01ee5]: (4, ('1', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] SCSI volumes sde have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7')] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.088s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f60bb9-cf81-462d-80c0-0ce297bfa678]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 -p 172.16.0.220:3260 --logout {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.146s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f78db8b-3812-4db2-9a79-93f3a05d1890]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7, portal: 172.16.0.220,3260]
Nov 08 12:22:50 user nova-compute[74840]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7, portal: 172.16.0.220,3260] successful.
Nov 08 12:22:50 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 -p 172.16.0.220:3260 --op delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1778abb2-81cd-4a05-8063-b6ea529685a7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.048s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c80e3d3-3f94-4d1b-8778-d3fb931300a3]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.558s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] <== disconnect_volume: return (559ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZJyeiAtw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:22:50 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:22:50 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.063s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f909427-9151-40a4-86d9-dd632c826804]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:30a7200f-f7fe-4364-a423-eff9fbf273fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 12:22:50 user nova-compute[74840]: No targets found.
Nov 08 12:22:50 user nova-compute[74840]: iSNS:
Nov 08 12:22:50 user nova-compute[74840]: No targets found.
Nov 08 12:22:50 user nova-compute[74840]: STATIC:
Nov 08 12:22:50 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1
Nov 08 12:22:50 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:22:50 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:22:50 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4
Nov 08 12:22:50 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:22:50 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:22:50 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578
Nov 08 12:22:50 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:22:50 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:22:50 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc
Nov 08 12:22:50 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:22:50 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:22:50 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e
Nov 08 12:22:50 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:22:50 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:22:50 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:30a7200f-f7fe-4364-a423-eff9fbf273fc
Nov 08 12:22:50 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:22:50 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:22:50 user nova-compute[74840]: FIRMWARE:
Nov 08 12:22:50 user nova-compute[74840]: No targets found.
Nov 08 12:22:50 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 12:22:50 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 12:22:50 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 12:22:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.036s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:51 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[0062f335-c76f-42e9-beb0-8ab9bfd30f4f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30a7200f-f7fe-4364-a423-eff9fbf273fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.110s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:51 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[98384859-b1aa-43e1-bc49-4a5e8298d75e]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a7200f-f7fe-4364-a423-eff9fbf273fc (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:51 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)
Nov 08 12:22:51 user nova-compute[74840]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 (non-flash)
Nov 08 12:22:51 user nova-compute[74840]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:22:51 user nova-compute[74840]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)
Nov 08 12:22:51 user nova-compute[74840]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e (non-flash)
Nov 08 12:22:51 user nova-compute[74840]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a7200f-f7fe-4364-a423-eff9fbf273fc (non-flash)
Nov 08 12:22:51 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:22:51 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 (non-flash)
Nov 08 12:22:51 user nova-compute[74840]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 (non-flash)
Nov 08 12:22:51 user nova-compute[74840]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:22:51 user nova-compute[74840]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)
Nov 08 12:22:51 user nova-compute[74840]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e (non-flash)
Nov 08 12:22:51 user nova-compute[74840]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a7200f-f7fe-4364-a423-eff9fbf273fc (non-flash)
Nov 08 12:22:51 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:22:51 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7f412b010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578'): ({'sdc'}, set())}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 12:22:51 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Removing single pathed devices sdc {{(pid=74840) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 12:22:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:51 user nova-compute[74840]: DEBUG nova.compute.manager [req-3cc291a5-3685-4927-a30f-b8363a9a05c9 req-1de721c0-bbb1-4e3b-a933-f9dd4eb3ae54 service nova] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Received event network-vif-unplugged-0ce328c3-b755-4d90-b0af-f4b2beef1bec {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:22:51 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3cc291a5-3685-4927-a30f-b8363a9a05c9 req-1de721c0-bbb1-4e3b-a933-f9dd4eb3ae54 service nova] Acquiring lock "83c035a0-880b-4170-98bc-b18cae712cfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:22:51 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3cc291a5-3685-4927-a30f-b8363a9a05c9 req-1de721c0-bbb1-4e3b-a933-f9dd4eb3ae54 service nova] Lock "83c035a0-880b-4170-98bc-b18cae712cfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:22:51 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3cc291a5-3685-4927-a30f-b8363a9a05c9 req-1de721c0-bbb1-4e3b-a933-f9dd4eb3ae54 service nova] Lock "83c035a0-880b-4170-98bc-b18cae712cfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:22:51 user nova-compute[74840]: DEBUG nova.compute.manager [req-3cc291a5-3685-4927-a30f-b8363a9a05c9 req-1de721c0-bbb1-4e3b-a933-f9dd4eb3ae54 service nova] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] No waiting events found dispatching network-vif-unplugged-0ce328c3-b755-4d90-b0af-f4b2beef1bec {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:22:51 user nova-compute[74840]: WARNING nova.compute.manager [req-3cc291a5-3685-4927-a30f-b8363a9a05c9 req-1de721c0-bbb1-4e3b-a933-f9dd4eb3ae54 service nova] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Received unexpected event network-vif-unplugged-0ce328c3-b755-4d90-b0af-f4b2beef1bec for instance with vm_state active and task_state None.
Nov 08 12:22:51 user nova-compute[74840]: DEBUG nova.compute.manager [req-3cc291a5-3685-4927-a30f-b8363a9a05c9 req-1de721c0-bbb1-4e3b-a933-f9dd4eb3ae54 service nova] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Received event network-vif-plugged-0ce328c3-b755-4d90-b0af-f4b2beef1bec {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:22:51 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3cc291a5-3685-4927-a30f-b8363a9a05c9 req-1de721c0-bbb1-4e3b-a933-f9dd4eb3ae54 service nova] Acquiring lock "83c035a0-880b-4170-98bc-b18cae712cfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:22:51 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3cc291a5-3685-4927-a30f-b8363a9a05c9 req-1de721c0-bbb1-4e3b-a933-f9dd4eb3ae54 service nova] Lock "83c035a0-880b-4170-98bc-b18cae712cfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:22:51 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3cc291a5-3685-4927-a30f-b8363a9a05c9 req-1de721c0-bbb1-4e3b-a933-f9dd4eb3ae54 service nova] Lock "83c035a0-880b-4170-98bc-b18cae712cfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:22:51 user nova-compute[74840]: DEBUG nova.compute.manager [req-3cc291a5-3685-4927-a30f-b8363a9a05c9 req-1de721c0-bbb1-4e3b-a933-f9dd4eb3ae54 service nova] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] No waiting events found dispatching network-vif-plugged-0ce328c3-b755-4d90-b0af-f4b2beef1bec {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:22:51 user nova-compute[74840]: WARNING nova.compute.manager [req-3cc291a5-3685-4927-a30f-b8363a9a05c9 req-1de721c0-bbb1-4e3b-a933-f9dd4eb3ae54 service nova] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Received unexpected event network-vif-plugged-0ce328c3-b755-4d90-b0af-f4b2beef1bec for instance with vm_state active and task_state None.
Nov 08 12:22:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.095s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:51 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b5b84e-f502-4d5c-af22-8d7fd6f3265c]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.064s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:51 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5974f32d-d20f-4173-8e23-d9de3d690c40]: (4, ('ok\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:51 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Flushing IO for device /dev/sdc {{(pid=74840) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 12:22:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.135s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:51 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7b47cf-e01f-4a5a-8716-c57676534c96]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:51 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74840) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 12:22:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:51 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.196s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:51 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8620e641-6c8f-4971-81ac-585d338b7409]: (4, ('1', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:51 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 12:22:51 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] SCSI volumes sdc have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 12:22:51 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578')] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 12:22:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:51 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:22:51 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:22:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.097s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:51 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06abc93-c8aa-40e7-8f78-66ef810e0519]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:51 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:22:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 -p 172.16.0.220:3260 --logout {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 -p 172.16.0.220:3260 --logout" returned: 0 in 0.106s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:51 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b32950-f2a4-4e51-8c8a-450e944c4c8f]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:51 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578, portal: 172.16.0.220,3260]
Nov 08 12:22:51 user nova-compute[74840]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578, portal: 172.16.0.220,3260] successful.
Nov 08 12:22:51 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:22:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 -p 172.16.0.220:3260 --op delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6c66458-63dd-40c6-b1d8-b2cc87cb5578 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.085s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[915b4c9b-0fb2-4004-b576-e074dab5f7a8]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 1.119s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] <== disconnect_volume: return (1120ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IHKjeFBk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:22:52 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:22:52 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2ecae4-db23-4a1f-bd69-969c61c1392e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:30a7200f-f7fe-4364-a423-eff9fbf273fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 12:22:52 user nova-compute[74840]: No targets found.
Nov 08 12:22:52 user nova-compute[74840]: iSNS:
Nov 08 12:22:52 user nova-compute[74840]: No targets found.
Nov 08 12:22:52 user nova-compute[74840]: STATIC:
Nov 08 12:22:52 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1
Nov 08 12:22:52 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:22:52 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:22:52 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4
Nov 08 12:22:52 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:22:52 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:22:52 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc
Nov 08 12:22:52 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:22:52 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:22:52 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e
Nov 08 12:22:52 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:22:52 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:22:52 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:30a7200f-f7fe-4364-a423-eff9fbf273fc
Nov 08 12:22:52 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:22:52 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:22:52 user nova-compute[74840]: FIRMWARE:
Nov 08 12:22:52 user nova-compute[74840]: No targets found.
Nov 08 12:22:52 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 12:22:52 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 12:22:52 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[85196f48-41bd-4804-8084-591fffd41edc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30a7200f-f7fe-4364-a423-eff9fbf273fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c231a0b-998f-44f2-a9e4-c2e135566b50]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a7200f-f7fe-4364-a423-eff9fbf273fc (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 (non-flash)
Nov 08 12:22:52 user nova-compute[74840]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:22:52 user nova-compute[74840]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)
Nov 08 12:22:52 user nova-compute[74840]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e (non-flash)
Nov 08 12:22:52 user nova-compute[74840]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a7200f-f7fe-4364-a423-eff9fbf273fc (non-flash)
Nov 08 12:22:52 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 (non-flash)
Nov 08 12:22:52 user nova-compute[74840]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:22:52 user nova-compute[74840]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)
Nov 08 12:22:52 user nova-compute[74840]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e (non-flash)
Nov 08 12:22:52 user nova-compute[74840]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a7200f-f7fe-4364-a423-eff9fbf273fc (non-flash)
Nov 08 12:22:52 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7f412b010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1'): ({'sdd'}, set())}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Removing single pathed devices sdd {{(pid=74840) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:52 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-090da051-3db3-44dc-8223-e0e873fb868a tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4f6c75c0-e820-47eb-be3e-51179b6df1a3 is timed out.
Nov 08 12:22:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccbce86b-36f8-415e-9b7e-d23b7d3da4ff]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09d79d6-5fd2-4459-987c-1b98e35b6d50]: (4, ('ok\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Flushing IO for device /dev/sdd {{(pid=74840) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:52 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-090da051-3db3-44dc-8223-e0e873fb868a tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Successfully detached device vdb from instance 4f6c75c0-e820-47eb-be3e-51179b6df1a3 from the live domain config.
Nov 08 12:22:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.043s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f484f6ef-8fc5-4c9f-bf0f-7af1ff1c7953]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74840) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-090da051-3db3-44dc-8223-e0e873fb868a tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-090da051-3db3-44dc-8223-e0e873fb868a tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nNWQCIMD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:22:52 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-090da051-3db3-44dc-8223-e0e873fb868a tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:22:52 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-090da051-3db3-44dc-8223-e0e873fb868a tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.232s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93e4bee-d8b6-4973-b63b-bc5829b8ec38]: (4, ('1', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] SCSI volumes sdd have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1')] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.091s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad058b81-3ef6-4db6-83af-06b2eb422bf0]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 -p 172.16.0.220:3260 --logout {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Rebuilding the list of instances to heal {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Skipping network cache update for instance because it is being deleted. {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "refresh_cache-d3e8efc6-7146-46ef-8433-380d7e69120c" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquired lock "refresh_cache-d3e8efc6-7146-46ef-8433-380d7e69120c" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Forcefully refreshing network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG nova.objects.instance [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lazy-loading 'info_cache' on Instance uuid d3e8efc6-7146-46ef-8433-380d7e69120c {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.229s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[074838a1-07a4-4774-9582-0f2b99f193b3]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1, portal: 172.16.0.220,3260]
Nov 08 12:22:52 user nova-compute[74840]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1, portal: 172.16.0.220,3260] successful.
Nov 08 12:22:52 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:22:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 -p 172.16.0.220:3260 --op delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7ad280d-7a9d-414d-ad87-3c0daed99fa1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.164s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb946e18-2e38-4458-a962-f69561b297e2]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.990s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] <== disconnect_volume: return (991ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 12:22:53 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Deleting instance files /opt/stack/data/nova/instances/4b9fe577-1503-4007-be51-2a714363f8c6_del
Nov 08 12:22:53 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Deletion of /opt/stack/data/nova/instances/4b9fe577-1503-4007-be51-2a714363f8c6_del complete
Nov 08 12:22:53 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-090da051-3db3-44dc-8223-e0e873fb868a tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.755s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.061s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[65cd57c9-fe64-49dd-91d2-40a05b44d9f6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:30a7200f-f7fe-4364-a423-eff9fbf273fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-090da051-3db3-44dc-8223-e0e873fb868a tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 12:22:53 user nova-compute[74840]: No targets found.
Nov 08 12:22:53 user nova-compute[74840]: iSNS:
Nov 08 12:22:53 user nova-compute[74840]: No targets found.
Nov 08 12:22:53 user nova-compute[74840]: STATIC:
Nov 08 12:22:53 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4
Nov 08 12:22:53 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:22:53 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:22:53 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc
Nov 08 12:22:53 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:22:53 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:22:53 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e
Nov 08 12:22:53 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:22:53 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:22:53 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:30a7200f-f7fe-4364-a423-eff9fbf273fc
Nov 08 12:22:53 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:22:53 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:22:53 user nova-compute[74840]: FIRMWARE:
Nov 08 12:22:53 user nova-compute[74840]: No targets found.
Nov 08 12:22:53 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-090da051-3db3-44dc-8223-e0e873fb868a tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 12:22:53 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 12:22:53 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-090da051-3db3-44dc-8223-e0e873fb868a tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aac3e4e-a8d7-4bb7-b356-5b443183bca3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30a7200f-f7fe-4364-a423-eff9fbf273fc\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.054s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[483016e2-76c5-46bf-9bce-dfbc220187f4]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a7200f-f7fe-4364-a423-eff9fbf273fc (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-090da051-3db3-44dc-8223-e0e873fb868a tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:22:53 user nova-compute[74840]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)
Nov 08 12:22:53 user nova-compute[74840]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e (non-flash)
Nov 08 12:22:53 user nova-compute[74840]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a7200f-f7fe-4364-a423-eff9fbf273fc (non-flash)
Nov 08 12:22:53 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-090da051-3db3-44dc-8223-e0e873fb868a tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:22:53 user nova-compute[74840]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)
Nov 08 12:22:53 user nova-compute[74840]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e (non-flash)
Nov 08 12:22:53 user nova-compute[74840]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a7200f-f7fe-4364-a423-eff9fbf273fc (non-flash)
Nov 08 12:22:53 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-090da051-3db3-44dc-8223-e0e873fb868a tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7f4232680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e'): ({'sdh'}, set())}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-090da051-3db3-44dc-8223-e0e873fb868a tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Removing single pathed devices sdh {{(pid=74840) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.090s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d942677-5f4a-4ed8-900a-3e1291414259]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.029s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[db226a49-a6c9-4093-b43c-97e62a1a4aad]: (4, ('ok\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-090da051-3db3-44dc-8223-e0e873fb868a tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Flushing IO for device /dev/sdh {{(pid=74840) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.046s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e1bcd9-0752-4930-b36e-b24538d15203]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-090da051-3db3-44dc-8223-e0e873fb868a tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74840) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:53 user nova-compute[74840]: INFO nova.compute.manager [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Took 7.03 seconds to destroy the instance on the hypervisor.
Nov 08 12:22:53 user nova-compute[74840]: DEBUG oslo.service.loopingcall [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74840) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG nova.compute.manager [-] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Deallocating network for instance {{(pid=74840) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] deallocate_for_instance() {{(pid=74840) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.051s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d444661a-b44b-46a2-90f4-97922d13e4be]: (4, ('1', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-090da051-3db3-44dc-8223-e0e873fb868a tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-090da051-3db3-44dc-8223-e0e873fb868a tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] SCSI volumes sdh have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-090da051-3db3-44dc-8223-e0e873fb868a tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e')] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a175a2d1-5b5c-4481-b251-2c54f4a840cc]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-090da051-3db3-44dc-8223-e0e873fb868a tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e -p 172.16.0.220:3260 --logout {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea12b8f-e96d-4d8a-80f3-5ca0521cd12a]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-090da051-3db3-44dc-8223-e0e873fb868a tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e, portal: 172.16.0.220,3260]
Nov 08 12:22:53 user nova-compute[74840]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e, portal: 172.16.0.220,3260] successful.
Nov 08 12:22:53 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e -p 172.16.0.220:3260 --op delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0de9a650-fb67-477a-9c8a-471e27ed445e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8277d8-69fd-42a7-94de-61b766cac584]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-090da051-3db3-44dc-8223-e0e873fb868a tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-090da051-3db3-44dc-8223-e0e873fb868a tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.575s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-090da051-3db3-44dc-8223-e0e873fb868a tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] <== disconnect_volume: return (1330ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:22:53 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-090da051-3db3-44dc-8223-e0e873fb868a tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 12:22:54 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Updating instance_info_cache with network_info: [{"id": "5c942bb3-846b-4319-961f-42aed0e55bdf", "address": "fa:16:3e:29:6a:cd", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c942bb3-84", "ovs_interfaceid": "5c942bb3-846b-4319-961f-42aed0e55bdf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:22:54 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Releasing lock "refresh_cache-d3e8efc6-7146-46ef-8433-380d7e69120c" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:22:54 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Updated the network info_cache for instance {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 12:22:54 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:22:54 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:22:54 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:22:55 user nova-compute[74840]: DEBUG nova.objects.instance [None req-090da051-3db3-44dc-8223-e0e873fb868a tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lazy-loading 'flavor' on Instance uuid 4f6c75c0-e820-47eb-be3e-51179b6df1a3 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:22:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-090da051-3db3-44dc-8223-e0e873fb868a tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "4f6c75c0-e820-47eb-be3e-51179b6df1a3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.732s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:22:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:55 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:22:56 user nova-compute[74840]: DEBUG nova.compute.manager [req-9643a009-c78c-46bc-bbe2-6bb5504d04e5 req-e0d94482-165d-4908-9506-4d28ee1103a6 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received event network-vif-deleted-68377219-20e9-4c9f-b8c7-bcf0a798655e {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:22:56 user nova-compute[74840]: INFO nova.compute.manager [req-9643a009-c78c-46bc-bbe2-6bb5504d04e5 req-e0d94482-165d-4908-9506-4d28ee1103a6 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Neutron deleted interface 68377219-20e9-4c9f-b8c7-bcf0a798655e; detaching it from the instance and deleting it from the info cache
Nov 08 12:22:56 user nova-compute[74840]: DEBUG nova.network.neutron [req-9643a009-c78c-46bc-bbe2-6bb5504d04e5 req-e0d94482-165d-4908-9506-4d28ee1103a6 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Updating instance_info_cache with network_info: [{"id": "1fd72b39-7d31-4729-bef7-98f6a5246964", "address": "fa:16:3e:07:9d:e6", "network": {"id": "3fcdf89c-266d-43c1-8ae8-705406698b75", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-157102173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd72b39-7d", "ovs_interfaceid": "1fd72b39-7d31-4729-bef7-98f6a5246964", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "87c651bf-a6e8-4290-bbdf-49746754ac54", "address": "fa:16:3e:77:a8:a1", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87c651bf-a6", "ovs_interfaceid": "87c651bf-a6e8-4290-bbdf-49746754ac54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bdec4773-148b-49d7-a461-3a6106fffff6", "address": "fa:16:3e:aa:64:51", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdec4773-14", "ovs_interfaceid": "bdec4773-148b-49d7-a461-3a6106fffff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "538b2412-4ee2-42a6-9cac-f97be4fc341e", "address": "fa:16:3e:d1:64:e8", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap538b2412-4e", "ovs_interfaceid": "538b2412-4ee2-42a6-9cac-f97be4fc341e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "afed888a-e688-452a-846f-4e9b398ff736", "address": "fa:16:3e:72:e8:99", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafed888a-e6", "ovs_interfaceid": "afed888a-e688-452a-846f-4e9b398ff736", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "20547543-4dc1-4158-bb9e-515cce88d3ef", "address": "fa:16:3e:c9:2d:ef", "network": {"id": "4a786612-4da0-47c3-94bb-2a73e6567310", "bridge": "br-int", "label": "tempest-device-tagging-net2-1454321418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20547543-4d", "ovs_interfaceid": "20547543-4dc1-4158-bb9e-515cce88d3ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:22:56 user nova-compute[74840]: DEBUG nova.compute.manager [req-9643a009-c78c-46bc-bbe2-6bb5504d04e5 req-e0d94482-165d-4908-9506-4d28ee1103a6 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Detach interface failed, port_id=68377219-20e9-4c9f-b8c7-bcf0a798655e, reason: Instance 4b9fe577-1503-4007-be51-2a714363f8c6 could not be found. {{(pid=74840) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 12:22:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:22:56 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:22:57 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:22:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:22:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:22:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:22:57 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:22:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f6c75c0-e820-47eb-be3e-51179b6df1a3/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f6c75c0-e820-47eb-be3e-51179b6df1a3/disk --force-share --output=json" returned: 0 in 0.427s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f6c75c0-e820-47eb-be3e-51179b6df1a3/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:58 user nova-compute[74840]: DEBUG nova.compute.manager [req-13459fba-8546-414f-8c76-9287a4f57fe8 req-6866c5b8-6174-46b3-a904-c8b0414de875 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received event network-vif-deleted-538b2412-4ee2-42a6-9cac-f97be4fc341e {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:22:58 user nova-compute[74840]: INFO nova.compute.manager [req-13459fba-8546-414f-8c76-9287a4f57fe8 req-6866c5b8-6174-46b3-a904-c8b0414de875 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Neutron deleted interface 538b2412-4ee2-42a6-9cac-f97be4fc341e; detaching it from the instance and deleting it from the info cache
Nov 08 12:22:58 user nova-compute[74840]: DEBUG nova.network.neutron [req-13459fba-8546-414f-8c76-9287a4f57fe8 req-6866c5b8-6174-46b3-a904-c8b0414de875 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Updating instance_info_cache with network_info: [{"id": "1fd72b39-7d31-4729-bef7-98f6a5246964", "address": "fa:16:3e:07:9d:e6", "network": {"id": "3fcdf89c-266d-43c1-8ae8-705406698b75", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-157102173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd72b39-7d", "ovs_interfaceid": "1fd72b39-7d31-4729-bef7-98f6a5246964", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "87c651bf-a6e8-4290-bbdf-49746754ac54", "address": "fa:16:3e:77:a8:a1", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87c651bf-a6", "ovs_interfaceid": "87c651bf-a6e8-4290-bbdf-49746754ac54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bdec4773-148b-49d7-a461-3a6106fffff6", "address": "fa:16:3e:aa:64:51", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdec4773-14", "ovs_interfaceid": "bdec4773-148b-49d7-a461-3a6106fffff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "afed888a-e688-452a-846f-4e9b398ff736", "address": "fa:16:3e:72:e8:99", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafed888a-e6", "ovs_interfaceid": "afed888a-e688-452a-846f-4e9b398ff736", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "20547543-4dc1-4158-bb9e-515cce88d3ef", "address": "fa:16:3e:c9:2d:ef", "network": {"id": "4a786612-4da0-47c3-94bb-2a73e6567310", "bridge": "br-int", "label": "tempest-device-tagging-net2-1454321418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20547543-4d", "ovs_interfaceid": "20547543-4dc1-4158-bb9e-515cce88d3ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:22:58 user nova-compute[74840]: DEBUG nova.compute.manager [req-13459fba-8546-414f-8c76-9287a4f57fe8 req-6866c5b8-6174-46b3-a904-c8b0414de875 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Detach interface failed, port_id=538b2412-4ee2-42a6-9cac-f97be4fc341e, reason: Instance 4b9fe577-1503-4007-be51-2a714363f8c6 could not be found. {{(pid=74840) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 12:22:58 user nova-compute[74840]: DEBUG nova.compute.manager [req-13459fba-8546-414f-8c76-9287a4f57fe8 req-6866c5b8-6174-46b3-a904-c8b0414de875 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received event network-vif-deleted-afed888a-e688-452a-846f-4e9b398ff736 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:22:58 user nova-compute[74840]: INFO nova.compute.manager [req-13459fba-8546-414f-8c76-9287a4f57fe8 req-6866c5b8-6174-46b3-a904-c8b0414de875 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Neutron deleted interface afed888a-e688-452a-846f-4e9b398ff736; detaching it from the instance and deleting it from the info cache
Nov 08 12:22:58 user nova-compute[74840]: DEBUG nova.network.neutron [req-13459fba-8546-414f-8c76-9287a4f57fe8 req-6866c5b8-6174-46b3-a904-c8b0414de875 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Updating instance_info_cache with network_info: [{"id": "1fd72b39-7d31-4729-bef7-98f6a5246964", "address": "fa:16:3e:07:9d:e6", "network": {"id": "3fcdf89c-266d-43c1-8ae8-705406698b75", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-157102173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd72b39-7d", "ovs_interfaceid": "1fd72b39-7d31-4729-bef7-98f6a5246964", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "87c651bf-a6e8-4290-bbdf-49746754ac54", "address": "fa:16:3e:77:a8:a1", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87c651bf-a6", "ovs_interfaceid": "87c651bf-a6e8-4290-bbdf-49746754ac54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bdec4773-148b-49d7-a461-3a6106fffff6", "address": "fa:16:3e:aa:64:51", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdec4773-14", "ovs_interfaceid": "bdec4773-148b-49d7-a461-3a6106fffff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "20547543-4dc1-4158-bb9e-515cce88d3ef", "address": "fa:16:3e:c9:2d:ef", "network": {"id": "4a786612-4da0-47c3-94bb-2a73e6567310", "bridge": "br-int", "label": "tempest-device-tagging-net2-1454321418", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20547543-4d", "ovs_interfaceid": "20547543-4dc1-4158-bb9e-515cce88d3ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:22:58 user nova-compute[74840]: DEBUG nova.compute.manager [req-13459fba-8546-414f-8c76-9287a4f57fe8 req-6866c5b8-6174-46b3-a904-c8b0414de875 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Detach interface failed, port_id=afed888a-e688-452a-846f-4e9b398ff736, reason: Instance 4b9fe577-1503-4007-be51-2a714363f8c6 could not be found. {{(pid=74840) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 12:22:58 user nova-compute[74840]: DEBUG nova.compute.manager [req-13459fba-8546-414f-8c76-9287a4f57fe8 req-6866c5b8-6174-46b3-a904-c8b0414de875 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received event network-vif-deleted-20547543-4dc1-4158-bb9e-515cce88d3ef {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:22:58 user nova-compute[74840]: INFO nova.compute.manager [req-13459fba-8546-414f-8c76-9287a4f57fe8 req-6866c5b8-6174-46b3-a904-c8b0414de875 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Neutron deleted interface 20547543-4dc1-4158-bb9e-515cce88d3ef; detaching it from the instance and deleting it from the info cache
Nov 08 12:22:58 user nova-compute[74840]: DEBUG nova.network.neutron [req-13459fba-8546-414f-8c76-9287a4f57fe8 req-6866c5b8-6174-46b3-a904-c8b0414de875 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Updating instance_info_cache with network_info: [{"id": "1fd72b39-7d31-4729-bef7-98f6a5246964", "address": "fa:16:3e:07:9d:e6", "network": {"id": "3fcdf89c-266d-43c1-8ae8-705406698b75", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-157102173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fd72b39-7d", "ovs_interfaceid": "1fd72b39-7d31-4729-bef7-98f6a5246964", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "87c651bf-a6e8-4290-bbdf-49746754ac54", "address": "fa:16:3e:77:a8:a1", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87c651bf-a6", "ovs_interfaceid": "87c651bf-a6e8-4290-bbdf-49746754ac54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bdec4773-148b-49d7-a461-3a6106fffff6", "address": "fa:16:3e:aa:64:51", "network": {"id": "9982ae7f-0a0b-4bb9-8166-95dcf2d8eb69", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434181133", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "54e6bce6148d4a0296ece1b35a2db93d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdec4773-14", "ovs_interfaceid": "bdec4773-148b-49d7-a461-3a6106fffff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:22:58 user nova-compute[74840]: DEBUG nova.compute.manager [req-13459fba-8546-414f-8c76-9287a4f57fe8 req-6866c5b8-6174-46b3-a904-c8b0414de875 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Detach interface failed, port_id=20547543-4dc1-4158-bb9e-515cce88d3ef, reason: Instance 4b9fe577-1503-4007-be51-2a714363f8c6 could not be found. {{(pid=74840) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 12:22:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f6c75c0-e820-47eb-be3e-51179b6df1a3/disk --force-share --output=json" returned: 0 in 0.293s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:58 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:22:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:58 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:22:58 user nova-compute[74840]: INFO nova.compute.manager [-] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Took 5.38 seconds to deallocate network for instance.
Nov 08 12:22:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json" returned: 0 in 0.277s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:22:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json" returned: 0 in 0.327s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:22:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:23:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:23:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:23:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:23:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83c035a0-880b-4170-98bc-b18cae712cfa/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:23:00 user nova-compute[74840]: DEBUG nova.compute.manager [req-48466924-efcc-44a3-a1d9-69a248c1c36e req-b769d70e-c5fc-42c7-bf07-0cd7c3fa6331 service nova] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Received event network-vif-deleted-1fd72b39-7d31-4729-bef7-98f6a5246964 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:23:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83c035a0-880b-4170-98bc-b18cae712cfa/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:23:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83c035a0-880b-4170-98bc-b18cae712cfa/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:23:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83c035a0-880b-4170-98bc-b18cae712cfa/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:23:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:23:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:23:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:23:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:23:01 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:23:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:01 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:23:01 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:23:01 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=7821MB free_disk=24.49590301513672GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:23:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:23:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:23:02 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance d3e8efc6-7146-46ef-8433-380d7e69120c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:23:02 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 4b9fe577-1503-4007-be51-2a714363f8c6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:23:02 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 83c035a0-880b-4170-98bc-b18cae712cfa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:23:02 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 4f6c75c0-e820-47eb-be3e-51179b6df1a3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:23:02 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance ffe50042-29bf-4ef3-a148-8698bc75233b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:23:02 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 8b7c490e-4c78-4e07-bc8a-3be2328963d7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:23:02 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 832a6445-84ee-43a8-a5bc-a07670602912 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:23:02 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 4ce94f9d-be90-4b82-bc83-6777d2c871a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:23:02 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:23:02 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:23:02 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:23:02 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:23:02 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:23:02 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.532s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:23:03 user nova-compute[74840]: INFO nova.compute.manager [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] [instance: 4b9fe577-1503-4007-be51-2a714363f8c6] Took 4.25 seconds to detach 3 volumes for instance.
Nov 08 12:23:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:23:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:23:03 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:23:03 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:23:03 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:23:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.342s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:23:03 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Deleted allocations for instance 4b9fe577-1503-4007-be51-2a714363f8c6
Nov 08 12:23:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4524eec7-9a25-45e7-be73-0ea5e341621d tempest-TaggedBootDevicesTest_v242-1224547504 tempest-TaggedBootDevicesTest_v242-1224547504-project-member] Lock "4b9fe577-1503-4007-be51-2a714363f8c6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 17.292s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:23:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:08 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:23:09 user nova-compute[74840]: INFO nova.compute.manager [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Rescuing
Nov 08 12:23:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquiring lock "refresh_cache-ffe50042-29bf-4ef3-a148-8698bc75233b" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:23:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquired lock "refresh_cache-ffe50042-29bf-4ef3-a148-8698bc75233b" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:23:09 user nova-compute[74840]: DEBUG nova.network.neutron [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:23:09 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-98ab1211-bce0-4b73-a3f5-48ec0570c5c8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Waiting for libvirt event about the detach of device tap0ce328c3-b7 with device alias net1 from instance 83c035a0-880b-4170-98bc-b18cae712cfa is timed out.
Nov 08 12:23:09 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-98ab1211-bce0-4b73-a3f5-48ec0570c5c8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:17:9b:c8"/><model type="virtio"/><mtu size="1442"/><target dev="tap0ce328c3-b7"/></interface> {{(pid=74840) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 08 12:23:09 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-98ab1211-bce0-4b73-a3f5-48ec0570c5c8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:17:9b:c8"/><model type="virtio"/><mtu size="1442"/><target dev="tap0ce328c3-b7"/></interface>not found in domain: <domain type='kvm' id='24'>
Nov 08 12:23:09 user nova-compute[74840]:   <name>instance-00000016</name>
Nov 08 12:23:09 user nova-compute[74840]:   <uuid>83c035a0-880b-4170-98bc-b18cae712cfa</uuid>
Nov 08 12:23:09 user nova-compute[74840]:   <metadata>
Nov 08 12:23:09 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:23:09 user nova-compute[74840]:   <nova:package version="0.0.0"/>
Nov 08 12:23:09 user nova-compute[74840]:   <nova:name>tempest-device-tagging-server-1248482414</nova:name>
Nov 08 12:23:09 user nova-compute[74840]:   <nova:creationTime>2023-11-08 12:21:50</nova:creationTime>
Nov 08 12:23:09 user nova-compute[74840]:   <nova:flavor name="m1.tiny">
Nov 08 12:23:09 user nova-compute[74840]:     <nova:memory>512</nova:memory>
Nov 08 12:23:09 user nova-compute[74840]:     <nova:disk>1</nova:disk>
Nov 08 12:23:09 user nova-compute[74840]:     <nova:swap>0</nova:swap>
Nov 08 12:23:09 user nova-compute[74840]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:23:09 user nova-compute[74840]:     <nova:vcpus>1</nova:vcpus>
Nov 08 12:23:09 user nova-compute[74840]:   </nova:flavor>
Nov 08 12:23:09 user nova-compute[74840]:   <nova:owner>
Nov 08 12:23:09 user nova-compute[74840]:     <nova:user uuid="fe87f6d61cea4243a123420baf15279a">tempest-TaggedAttachmentsTest-807651925-project-member</nova:user>
Nov 08 12:23:09 user nova-compute[74840]:     <nova:project uuid="8c8bdf3f4296441799bd44bd993d3111">tempest-TaggedAttachmentsTest-807651925</nova:project>
Nov 08 12:23:09 user nova-compute[74840]:   </nova:owner>
Nov 08 12:23:09 user nova-compute[74840]:   <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:23:09 user nova-compute[74840]:   <nova:ports>
Nov 08 12:23:09 user nova-compute[74840]:     <nova:port uuid="75ded381-268f-487c-bf3b-1aad4d3909ae">
Nov 08 12:23:09 user nova-compute[74840]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 08 12:23:09 user nova-compute[74840]:     </nova:port>
Nov 08 12:23:09 user nova-compute[74840]:     <nova:port uuid="0ce328c3-b755-4d90-b0af-f4b2beef1bec">
Nov 08 12:23:09 user nova-compute[74840]:       <nova:ip type="fixed" address="10.10.10.232" ipVersion="4"/>
Nov 08 12:23:09 user nova-compute[74840]:     </nova:port>
Nov 08 12:23:09 user nova-compute[74840]:   </nova:ports>
Nov 08 12:23:09 user nova-compute[74840]: </nova:instance>
Nov 08 12:23:09 user nova-compute[74840]:   </metadata>
Nov 08 12:23:09 user nova-compute[74840]:   <memory unit='KiB'>524288</memory>
Nov 08 12:23:09 user nova-compute[74840]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 08 12:23:09 user nova-compute[74840]:   <vcpu placement='static'>1</vcpu>
Nov 08 12:23:09 user nova-compute[74840]:   <resource>
Nov 08 12:23:09 user nova-compute[74840]:     <partition>/machine</partition>
Nov 08 12:23:09 user nova-compute[74840]:   </resource>
Nov 08 12:23:09 user nova-compute[74840]:   <sysinfo type='smbios'>
Nov 08 12:23:09 user nova-compute[74840]:     <system>
Nov 08 12:23:09 user nova-compute[74840]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 08 12:23:09 user nova-compute[74840]:       <entry name='product'>OpenStack Nova</entry>
Nov 08 12:23:09 user nova-compute[74840]:       <entry name='version'>0.0.0</entry>
Nov 08 12:23:09 user nova-compute[74840]:       <entry name='serial'>83c035a0-880b-4170-98bc-b18cae712cfa</entry>
Nov 08 12:23:09 user nova-compute[74840]:       <entry name='uuid'>83c035a0-880b-4170-98bc-b18cae712cfa</entry>
Nov 08 12:23:09 user nova-compute[74840]:       <entry name='family'>Virtual Machine</entry>
Nov 08 12:23:09 user nova-compute[74840]:     </system>
Nov 08 12:23:09 user nova-compute[74840]:   </sysinfo>
Nov 08 12:23:09 user nova-compute[74840]:   <os>
Nov 08 12:23:09 user nova-compute[74840]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 08 12:23:09 user nova-compute[74840]:     <boot dev='hd'/>
Nov 08 12:23:09 user nova-compute[74840]:     <smbios mode='sysinfo'/>
Nov 08 12:23:09 user nova-compute[74840]:   </os>
Nov 08 12:23:09 user nova-compute[74840]:   <features>
Nov 08 12:23:09 user nova-compute[74840]:     <acpi/>
Nov 08 12:23:09 user nova-compute[74840]:     <apic/>
Nov 08 12:23:09 user nova-compute[74840]:     <vmcoreinfo state='on'/>
Nov 08 12:23:09 user nova-compute[74840]:   </features>
Nov 08 12:23:09 user nova-compute[74840]:   <cpu mode='custom' match='exact' check='full'>
Nov 08 12:23:09 user nova-compute[74840]:     <model fallback='forbid'>Nehalem</model>
Nov 08 12:23:09 user nova-compute[74840]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 08 12:23:09 user nova-compute[74840]:     <feature policy='require' name='vme'/>
Nov 08 12:23:09 user nova-compute[74840]:     <feature policy='require' name='x2apic'/>
Nov 08 12:23:09 user nova-compute[74840]:     <feature policy='require' name='hypervisor'/>
Nov 08 12:23:09 user nova-compute[74840]:   </cpu>
Nov 08 12:23:09 user nova-compute[74840]:   <clock offset='utc'>
Nov 08 12:23:09 user nova-compute[74840]:     <timer name='pit' tickpolicy='delay'/>
Nov 08 12:23:09 user nova-compute[74840]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 08 12:23:09 user nova-compute[74840]:     <timer name='hpet' present='no'/>
Nov 08 12:23:09 user nova-compute[74840]:   </clock>
Nov 08 12:23:09 user nova-compute[74840]:   <on_poweroff>destroy</on_poweroff>
Nov 08 12:23:09 user nova-compute[74840]:   <on_reboot>restart</on_reboot>
Nov 08 12:23:09 user nova-compute[74840]:   <on_crash>destroy</on_crash>
Nov 08 12:23:09 user nova-compute[74840]:   <devices>
Nov 08 12:23:09 user nova-compute[74840]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 08 12:23:09 user nova-compute[74840]:     <disk type='file' device='disk'>
Nov 08 12:23:09 user nova-compute[74840]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 08 12:23:09 user nova-compute[74840]:       <source file='/opt/stack/data/nova/instances/83c035a0-880b-4170-98bc-b18cae712cfa/disk' index='2'/>
Nov 08 12:23:09 user nova-compute[74840]:       <backingStore type='file' index='3'>
Nov 08 12:23:09 user nova-compute[74840]:         <format type='raw'/>
Nov 08 12:23:09 user nova-compute[74840]:         <source file='/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6'/>
Nov 08 12:23:09 user nova-compute[74840]:         <backingStore/>
Nov 08 12:23:09 user nova-compute[74840]:       </backingStore>
Nov 08 12:23:09 user nova-compute[74840]:       <target dev='vda' bus='virtio'/>
Nov 08 12:23:09 user nova-compute[74840]:       <alias name='virtio-disk0'/>
Nov 08 12:23:09 user nova-compute[74840]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 08 12:23:09 user nova-compute[74840]:     </disk>
Nov 08 12:23:09 user nova-compute[74840]:     <disk type='file' device='cdrom'>
Nov 08 12:23:09 user nova-compute[74840]:       <driver name='qemu' type='raw' cache='none'/>
Nov 08 12:23:09 user nova-compute[74840]:       <source file='/opt/stack/data/nova/instances/83c035a0-880b-4170-98bc-b18cae712cfa/disk.config' index='1'/>
Nov 08 12:23:09 user nova-compute[74840]:       <backingStore/>
Nov 08 12:23:09 user nova-compute[74840]:       <target dev='hda' bus='ide'/>
Nov 08 12:23:09 user nova-compute[74840]:       <readonly/>
Nov 08 12:23:09 user nova-compute[74840]:       <alias name='ide0-0-0'/>
Nov 08 12:23:09 user nova-compute[74840]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 08 12:23:09 user nova-compute[74840]:     </disk>
Nov 08 12:23:09 user nova-compute[74840]:     <controller type='usb' index='0' model='none'>
Nov 08 12:23:09 user nova-compute[74840]:       <alias name='usb'/>
Nov 08 12:23:09 user nova-compute[74840]:     </controller>
Nov 08 12:23:09 user nova-compute[74840]:     <controller type='pci' index='0' model='pci-root'>
Nov 08 12:23:09 user nova-compute[74840]:       <alias name='pci.0'/>
Nov 08 12:23:09 user nova-compute[74840]:     </controller>
Nov 08 12:23:09 user nova-compute[74840]:     <controller type='ide' index='0'>
Nov 08 12:23:09 user nova-compute[74840]:       <alias name='ide'/>
Nov 08 12:23:09 user nova-compute[74840]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 08 12:23:09 user nova-compute[74840]:     </controller>
Nov 08 12:23:09 user nova-compute[74840]:     <interface type='ethernet'>
Nov 08 12:23:09 user nova-compute[74840]:       <mac address='fa:16:3e:56:38:57'/>
Nov 08 12:23:09 user nova-compute[74840]:       <target dev='tap75ded381-26'/>
Nov 08 12:23:09 user nova-compute[74840]:       <model type='virtio'/>
Nov 08 12:23:09 user nova-compute[74840]:       <mtu size='1442'/>
Nov 08 12:23:09 user nova-compute[74840]:       <alias name='net0'/>
Nov 08 12:23:09 user nova-compute[74840]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 08 12:23:09 user nova-compute[74840]:     </interface>
Nov 08 12:23:09 user nova-compute[74840]:     <serial type='pty'>
Nov 08 12:23:09 user nova-compute[74840]:       <source path='/dev/pts/0'/>
Nov 08 12:23:09 user nova-compute[74840]:       <log file='/opt/stack/data/nova/instances/83c035a0-880b-4170-98bc-b18cae712cfa/console.log' append='off'/>
Nov 08 12:23:09 user nova-compute[74840]:       <target type='isa-serial' port='0'>
Nov 08 12:23:09 user nova-compute[74840]:         <model name='isa-serial'/>
Nov 08 12:23:09 user nova-compute[74840]:       </target>
Nov 08 12:23:09 user nova-compute[74840]:       <alias name='serial0'/>
Nov 08 12:23:09 user nova-compute[74840]:     </serial>
Nov 08 12:23:09 user nova-compute[74840]:     <console type='pty' tty='/dev/pts/0'>
Nov 08 12:23:09 user nova-compute[74840]:       <source path='/dev/pts/0'/>
Nov 08 12:23:09 user nova-compute[74840]:       <log file='/opt/stack/data/nova/instances/83c035a0-880b-4170-98bc-b18cae712cfa/console.log' append='off'/>
Nov 08 12:23:09 user nova-compute[74840]:       <target type='serial' port='0'/>
Nov 08 12:23:09 user nova-compute[74840]:       <alias name='serial0'/>
Nov 08 12:23:09 user nova-compute[74840]:     </console>
Nov 08 12:23:09 user nova-compute[74840]:     <input type='mouse' bus='ps2'>
Nov 08 12:23:09 user nova-compute[74840]:       <alias name='input0'/>
Nov 08 12:23:09 user nova-compute[74840]:     </input>
Nov 08 12:23:09 user nova-compute[74840]:     <input type='keyboard' bus='ps2'>
Nov 08 12:23:09 user nova-compute[74840]:       <alias name='input1'/>
Nov 08 12:23:09 user nova-compute[74840]:     </input>
Nov 08 12:23:09 user nova-compute[74840]:     <graphics type='vnc' port='5900' autoport='yes' listen='0.0.0.0'>
Nov 08 12:23:09 user nova-compute[74840]:       <listen type='address' address='0.0.0.0'/>
Nov 08 12:23:09 user nova-compute[74840]:     </graphics>
Nov 08 12:23:09 user nova-compute[74840]:     <audio id='1' type='none'/>
Nov 08 12:23:09 user nova-compute[74840]:     <video>
Nov 08 12:23:09 user nova-compute[74840]:       <model type='virtio' heads='1' primary='yes'/>
Nov 08 12:23:09 user nova-compute[74840]:       <alias name='video0'/>
Nov 08 12:23:09 user nova-compute[74840]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 08 12:23:09 user nova-compute[74840]:     </video>
Nov 08 12:23:09 user nova-compute[74840]:     <memballoon model='virtio'>
Nov 08 12:23:09 user nova-compute[74840]:       <stats period='10'/>
Nov 08 12:23:09 user nova-compute[74840]:       <alias name='balloon0'/>
Nov 08 12:23:09 user nova-compute[74840]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 08 12:23:09 user nova-compute[74840]:     </memballoon>
Nov 08 12:23:09 user nova-compute[74840]:     <rng model='virtio'>
Nov 08 12:23:09 user nova-compute[74840]:       <backend model='random'>/dev/urandom</backend>
Nov 08 12:23:09 user nova-compute[74840]:       <alias name='rng0'/>
Nov 08 12:23:09 user nova-compute[74840]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 08 12:23:09 user nova-compute[74840]:     </rng>
Nov 08 12:23:09 user nova-compute[74840]:   </devices>
Nov 08 12:23:09 user nova-compute[74840]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 08 12:23:09 user nova-compute[74840]:     <label>libvirt-83c035a0-880b-4170-98bc-b18cae712cfa</label>
Nov 08 12:23:09 user nova-compute[74840]:     <imagelabel>libvirt-83c035a0-880b-4170-98bc-b18cae712cfa</imagelabel>
Nov 08 12:23:09 user nova-compute[74840]:   </seclabel>
Nov 08 12:23:09 user nova-compute[74840]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 08 12:23:09 user nova-compute[74840]:     <label>+64055:+108</label>
Nov 08 12:23:09 user nova-compute[74840]:     <imagelabel>+64055:+108</imagelabel>
Nov 08 12:23:09 user nova-compute[74840]:   </seclabel>
Nov 08 12:23:09 user nova-compute[74840]: </domain>
Nov 08 12:23:09 user nova-compute[74840]:  {{(pid=74840) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 08 12:23:09 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-98ab1211-bce0-4b73-a3f5-48ec0570c5c8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Successfully detached device tap0ce328c3-b7 from instance 83c035a0-880b-4170-98bc-b18cae712cfa from the live domain config.
Nov 08 12:23:09 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-98ab1211-bce0-4b73-a3f5-48ec0570c5c8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:19:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1248482414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1248482414',id=22,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE08F5Vdqafx8ionT0o99nYONzOMoa/3pOusA/wlvX3fSXRcA+RhI/2hy/w+tkl5A+C6lKye9AkVRPFr99hJwoo+GJvdV7gC/UTzKzbtU6DDZO8zP9SCuNQkk2JKp43yVA==',key_name='tempest-keypair-1343265406',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:20:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c8bdf3f4296441799bd44bd993d3111',ramdisk_id='',reservation_id='r-wyshdnxz',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-807651925',owner_user_name='tempest-TaggedAttachmentsTest-807651925-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:20:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe87f6d61cea4243a123420baf15279a',uuid=83c035a0-880b-4170-98bc-b18cae712cfa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ce328c3-b755-4d90-b0af-f4b2beef1bec", "address": "fa:16:3e:17:9b:c8", "network": {"id": "93688dc9-a647-4983-a0e4-f187716ca66e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1203286658", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8c8bdf3f4296441799bd44bd993d3111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ce328c3-b7", "ovs_interfaceid": "0ce328c3-b755-4d90-b0af-f4b2beef1bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:23:09 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-98ab1211-bce0-4b73-a3f5-48ec0570c5c8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Converting VIF {"id": "0ce328c3-b755-4d90-b0af-f4b2beef1bec", "address": "fa:16:3e:17:9b:c8", "network": {"id": "93688dc9-a647-4983-a0e4-f187716ca66e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1203286658", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8c8bdf3f4296441799bd44bd993d3111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ce328c3-b7", "ovs_interfaceid": "0ce328c3-b755-4d90-b0af-f4b2beef1bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:23:09 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-98ab1211-bce0-4b73-a3f5-48ec0570c5c8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:9b:c8,bridge_name='br-int',has_traffic_filtering=True,id=0ce328c3-b755-4d90-b0af-f4b2beef1bec,network=Network(93688dc9-a647-4983-a0e4-f187716ca66e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ce328c3-b7') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:23:09 user nova-compute[74840]: DEBUG os_vif [None req-98ab1211-bce0-4b73-a3f5-48ec0570c5c8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:9b:c8,bridge_name='br-int',has_traffic_filtering=True,id=0ce328c3-b755-4d90-b0af-f4b2beef1bec,network=Network(93688dc9-a647-4983-a0e4-f187716ca66e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ce328c3-b7') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:23:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ce328c3-b7, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:23:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:23:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8902844b-aad8-4fd5-9f62-98d9f07b62ec) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:23:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:23:09 user nova-compute[74840]: INFO os_vif [None req-98ab1211-bce0-4b73-a3f5-48ec0570c5c8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:9b:c8,bridge_name='br-int',has_traffic_filtering=True,id=0ce328c3-b755-4d90-b0af-f4b2beef1bec,network=Network(93688dc9-a647-4983-a0e4-f187716ca66e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ce328c3-b7')
Nov 08 12:23:09 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-98ab1211-bce0-4b73-a3f5-48ec0570c5c8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:23:09 user nova-compute[74840]:   <nova:package version="0.0.0"/>
Nov 08 12:23:09 user nova-compute[74840]:   <nova:name>tempest-device-tagging-server-1248482414</nova:name>
Nov 08 12:23:09 user nova-compute[74840]:   <nova:creationTime>2023-11-08 12:23:09</nova:creationTime>
Nov 08 12:23:09 user nova-compute[74840]:   <nova:flavor name="m1.tiny">
Nov 08 12:23:09 user nova-compute[74840]:     <nova:memory>512</nova:memory>
Nov 08 12:23:09 user nova-compute[74840]:     <nova:disk>1</nova:disk>
Nov 08 12:23:09 user nova-compute[74840]:     <nova:swap>0</nova:swap>
Nov 08 12:23:09 user nova-compute[74840]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:23:09 user nova-compute[74840]:     <nova:vcpus>1</nova:vcpus>
Nov 08 12:23:09 user nova-compute[74840]:   </nova:flavor>
Nov 08 12:23:09 user nova-compute[74840]:   <nova:owner>
Nov 08 12:23:09 user nova-compute[74840]:     <nova:user uuid="fe87f6d61cea4243a123420baf15279a">tempest-TaggedAttachmentsTest-807651925-project-member</nova:user>
Nov 08 12:23:09 user nova-compute[74840]:     <nova:project uuid="8c8bdf3f4296441799bd44bd993d3111">tempest-TaggedAttachmentsTest-807651925</nova:project>
Nov 08 12:23:09 user nova-compute[74840]:   </nova:owner>
Nov 08 12:23:09 user nova-compute[74840]:   <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:23:09 user nova-compute[74840]:   <nova:ports>
Nov 08 12:23:09 user nova-compute[74840]:     <nova:port uuid="75ded381-268f-487c-bf3b-1aad4d3909ae">
Nov 08 12:23:09 user nova-compute[74840]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 08 12:23:09 user nova-compute[74840]:     </nova:port>
Nov 08 12:23:09 user nova-compute[74840]:   </nova:ports>
Nov 08 12:23:09 user nova-compute[74840]: </nova:instance>
Nov 08 12:23:09 user nova-compute[74840]:  {{(pid=74840) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 08 12:23:10 user nova-compute[74840]: DEBUG nova.network.neutron [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Updating instance_info_cache with network_info: [{"id": "6169b221-7840-4cfb-ba25-e34a95b35e77", "address": "fa:16:3e:b0:6a:c2", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6169b221-78", "ovs_interfaceid": "6169b221-7840-4cfb-ba25-e34a95b35e77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:23:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Releasing lock "refresh_cache-ffe50042-29bf-4ef3-a148-8698bc75233b" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:23:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-98ab1211-bce0-4b73-a3f5-48ec0570c5c8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Acquiring lock "refresh_cache-83c035a0-880b-4170-98bc-b18cae712cfa" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:23:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-98ab1211-bce0-4b73-a3f5-48ec0570c5c8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Acquired lock "refresh_cache-83c035a0-880b-4170-98bc-b18cae712cfa" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:23:10 user nova-compute[74840]: DEBUG nova.network.neutron [None req-98ab1211-bce0-4b73-a3f5-48ec0570c5c8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:23:10 user nova-compute[74840]: DEBUG nova.compute.manager [req-7dee722c-b367-414a-b370-a68b40ac8715 req-47d8e042-ad7c-449b-a593-a88371746f03 service nova] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Received event network-vif-deleted-0ce328c3-b755-4d90-b0af-f4b2beef1bec {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:23:10 user nova-compute[74840]: INFO nova.compute.manager [req-7dee722c-b367-414a-b370-a68b40ac8715 req-47d8e042-ad7c-449b-a593-a88371746f03 service nova] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Neutron deleted interface 0ce328c3-b755-4d90-b0af-f4b2beef1bec; detaching it from the instance and deleting it from the info cache
Nov 08 12:23:10 user nova-compute[74840]: DEBUG nova.network.neutron [req-7dee722c-b367-414a-b370-a68b40ac8715 req-47d8e042-ad7c-449b-a593-a88371746f03 service nova] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Updating instance_info_cache with network_info: [{"id": "75ded381-268f-487c-bf3b-1aad4d3909ae", "address": "fa:16:3e:56:38:57", "network": {"id": "22514061-e390-4fd9-943b-0dedf57a323e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1978465085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c8bdf3f4296441799bd44bd993d3111", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75ded381-26", "ovs_interfaceid": "75ded381-268f-487c-bf3b-1aad4d3909ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:23:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:10 user nova-compute[74840]: DEBUG nova.objects.instance [req-7dee722c-b367-414a-b370-a68b40ac8715 req-47d8e042-ad7c-449b-a593-a88371746f03 service nova] Lazy-loading 'system_metadata' on Instance uuid 83c035a0-880b-4170-98bc-b18cae712cfa {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:23:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:10 user nova-compute[74840]: DEBUG nova.objects.instance [req-7dee722c-b367-414a-b370-a68b40ac8715 req-47d8e042-ad7c-449b-a593-a88371746f03 service nova] Lazy-loading 'flavor' on Instance uuid 83c035a0-880b-4170-98bc-b18cae712cfa {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:23:10 user nova-compute[74840]: DEBUG nova.objects.base [req-7dee722c-b367-414a-b370-a68b40ac8715 req-47d8e042-ad7c-449b-a593-a88371746f03 service nova] Object Instance<83c035a0-880b-4170-98bc-b18cae712cfa> lazy-loaded attributes: system_metadata,flavor {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:23:10 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [req-7dee722c-b367-414a-b370-a68b40ac8715 req-47d8e042-ad7c-449b-a593-a88371746f03 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:19:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1248482414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1248482414',id=22,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE08F5Vdqafx8ionT0o99nYONzOMoa/3pOusA/wlvX3fSXRcA+RhI/2hy/w+tkl5A+C6lKye9AkVRPFr99hJwoo+GJvdV7gC/UTzKzbtU6DDZO8zP9SCuNQkk2JKp43yVA==',key_name='tempest-keypair-1343265406',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:20:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c8bdf3f4296441799bd44bd993d3111',ramdisk_id='',reservation_id='r-wyshdnxz',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-807651925',owner_user_name='tempest-TaggedAttachmentsTest-807651925-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:20:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe87f6d61cea4243a123420baf15279a',uuid=83c035a0-880b-4170-98bc-b18cae712cfa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ce328c3-b755-4d90-b0af-f4b2beef1bec", "address": "fa:16:3e:17:9b:c8", "network": {"id": "93688dc9-a647-4983-a0e4-f187716ca66e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1203286658", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8c8bdf3f4296441799bd44bd993d3111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ce328c3-b7", "ovs_interfaceid": "0ce328c3-b755-4d90-b0af-f4b2beef1bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:23:10 user nova-compute[74840]: DEBUG nova.network.os_vif_util [req-7dee722c-b367-414a-b370-a68b40ac8715 req-47d8e042-ad7c-449b-a593-a88371746f03 service nova] Converting VIF {"id": "0ce328c3-b755-4d90-b0af-f4b2beef1bec", "address": "fa:16:3e:17:9b:c8", "network": {"id": "93688dc9-a647-4983-a0e4-f187716ca66e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1203286658", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8c8bdf3f4296441799bd44bd993d3111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ce328c3-b7", "ovs_interfaceid": "0ce328c3-b755-4d90-b0af-f4b2beef1bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:23:10 user nova-compute[74840]: DEBUG nova.network.os_vif_util [req-7dee722c-b367-414a-b370-a68b40ac8715 req-47d8e042-ad7c-449b-a593-a88371746f03 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:9b:c8,bridge_name='br-int',has_traffic_filtering=True,id=0ce328c3-b755-4d90-b0af-f4b2beef1bec,network=Network(93688dc9-a647-4983-a0e4-f187716ca66e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ce328c3-b7') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:23:10 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [req-7dee722c-b367-414a-b370-a68b40ac8715 req-47d8e042-ad7c-449b-a593-a88371746f03 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:17:9b:c8"/><model type="virtio"/><mtu size="1442"/><target dev="tap0ce328c3-b7"/></interface> {{(pid=74840) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 08 12:23:10 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [req-7dee722c-b367-414a-b370-a68b40ac8715 req-47d8e042-ad7c-449b-a593-a88371746f03 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:17:9b:c8"/><model type="virtio"/><mtu size="1442"/><target dev="tap0ce328c3-b7"/></interface>not found in domain: <domain type='kvm' id='24'>
Nov 08 12:23:10 user nova-compute[74840]:   <name>instance-00000016</name>
Nov 08 12:23:10 user nova-compute[74840]:   <uuid>83c035a0-880b-4170-98bc-b18cae712cfa</uuid>
Nov 08 12:23:10 user nova-compute[74840]:   <metadata>
Nov 08 12:23:10 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:23:10 user nova-compute[74840]:   <nova:package version="0.0.0"/>
Nov 08 12:23:10 user nova-compute[74840]:   <nova:name>tempest-device-tagging-server-1248482414</nova:name>
Nov 08 12:23:10 user nova-compute[74840]:   <nova:creationTime>2023-11-08 12:23:09</nova:creationTime>
Nov 08 12:23:10 user nova-compute[74840]:   <nova:flavor name="m1.tiny">
Nov 08 12:23:10 user nova-compute[74840]:     <nova:memory>512</nova:memory>
Nov 08 12:23:10 user nova-compute[74840]:     <nova:disk>1</nova:disk>
Nov 08 12:23:10 user nova-compute[74840]:     <nova:swap>0</nova:swap>
Nov 08 12:23:10 user nova-compute[74840]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:23:10 user nova-compute[74840]:     <nova:vcpus>1</nova:vcpus>
Nov 08 12:23:10 user nova-compute[74840]:   </nova:flavor>
Nov 08 12:23:10 user nova-compute[74840]:   <nova:owner>
Nov 08 12:23:10 user nova-compute[74840]:     <nova:user uuid="fe87f6d61cea4243a123420baf15279a">tempest-TaggedAttachmentsTest-807651925-project-member</nova:user>
Nov 08 12:23:10 user nova-compute[74840]:     <nova:project uuid="8c8bdf3f4296441799bd44bd993d3111">tempest-TaggedAttachmentsTest-807651925</nova:project>
Nov 08 12:23:10 user nova-compute[74840]:   </nova:owner>
Nov 08 12:23:10 user nova-compute[74840]:   <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:23:10 user nova-compute[74840]:   <nova:ports>
Nov 08 12:23:10 user nova-compute[74840]:     <nova:port uuid="75ded381-268f-487c-bf3b-1aad4d3909ae">
Nov 08 12:23:10 user nova-compute[74840]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 08 12:23:10 user nova-compute[74840]:     </nova:port>
Nov 08 12:23:10 user nova-compute[74840]:   </nova:ports>
Nov 08 12:23:10 user nova-compute[74840]: </nova:instance>
Nov 08 12:23:10 user nova-compute[74840]:   </metadata>
Nov 08 12:23:10 user nova-compute[74840]:   <memory unit='KiB'>524288</memory>
Nov 08 12:23:10 user nova-compute[74840]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 08 12:23:10 user nova-compute[74840]:   <vcpu placement='static'>1</vcpu>
Nov 08 12:23:10 user nova-compute[74840]:   <resource>
Nov 08 12:23:10 user nova-compute[74840]:     <partition>/machine</partition>
Nov 08 12:23:10 user nova-compute[74840]:   </resource>
Nov 08 12:23:10 user nova-compute[74840]:   <sysinfo type='smbios'>
Nov 08 12:23:10 user nova-compute[74840]:     <system>
Nov 08 12:23:10 user nova-compute[74840]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 08 12:23:10 user nova-compute[74840]:       <entry name='product'>OpenStack Nova</entry>
Nov 08 12:23:10 user nova-compute[74840]:       <entry name='version'>0.0.0</entry>
Nov 08 12:23:10 user nova-compute[74840]:       <entry name='serial'>83c035a0-880b-4170-98bc-b18cae712cfa</entry>
Nov 08 12:23:10 user nova-compute[74840]:       <entry name='uuid'>83c035a0-880b-4170-98bc-b18cae712cfa</entry>
Nov 08 12:23:10 user nova-compute[74840]:       <entry name='family'>Virtual Machine</entry>
Nov 08 12:23:10 user nova-compute[74840]:     </system>
Nov 08 12:23:10 user nova-compute[74840]:   </sysinfo>
Nov 08 12:23:10 user nova-compute[74840]:   <os>
Nov 08 12:23:10 user nova-compute[74840]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 08 12:23:10 user nova-compute[74840]:     <boot dev='hd'/>
Nov 08 12:23:10 user nova-compute[74840]:     <smbios mode='sysinfo'/>
Nov 08 12:23:10 user nova-compute[74840]:   </os>
Nov 08 12:23:10 user nova-compute[74840]:   <features>
Nov 08 12:23:10 user nova-compute[74840]:     <acpi/>
Nov 08 12:23:10 user nova-compute[74840]:     <apic/>
Nov 08 12:23:10 user nova-compute[74840]:     <vmcoreinfo state='on'/>
Nov 08 12:23:10 user nova-compute[74840]:   </features>
Nov 08 12:23:10 user nova-compute[74840]:   <cpu mode='custom' match='exact' check='full'>
Nov 08 12:23:10 user nova-compute[74840]:     <model fallback='forbid'>Nehalem</model>
Nov 08 12:23:10 user nova-compute[74840]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 08 12:23:10 user nova-compute[74840]:     <feature policy='require' name='vme'/>
Nov 08 12:23:10 user nova-compute[74840]:     <feature policy='require' name='x2apic'/>
Nov 08 12:23:10 user nova-compute[74840]:     <feature policy='require' name='hypervisor'/>
Nov 08 12:23:10 user nova-compute[74840]:   </cpu>
Nov 08 12:23:10 user nova-compute[74840]:   <clock offset='utc'>
Nov 08 12:23:10 user nova-compute[74840]:     <timer name='pit' tickpolicy='delay'/>
Nov 08 12:23:10 user nova-compute[74840]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 08 12:23:10 user nova-compute[74840]:     <timer name='hpet' present='no'/>
Nov 08 12:23:10 user nova-compute[74840]:   </clock>
Nov 08 12:23:10 user nova-compute[74840]:   <on_poweroff>destroy</on_poweroff>
Nov 08 12:23:10 user nova-compute[74840]:   <on_reboot>restart</on_reboot>
Nov 08 12:23:10 user nova-compute[74840]:   <on_crash>destroy</on_crash>
Nov 08 12:23:10 user nova-compute[74840]:   <devices>
Nov 08 12:23:10 user nova-compute[74840]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 08 12:23:10 user nova-compute[74840]:     <disk type='file' device='disk'>
Nov 08 12:23:10 user nova-compute[74840]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 08 12:23:10 user nova-compute[74840]:       <source file='/opt/stack/data/nova/instances/83c035a0-880b-4170-98bc-b18cae712cfa/disk' index='2'/>
Nov 08 12:23:10 user nova-compute[74840]:       <backingStore type='file' index='3'>
Nov 08 12:23:10 user nova-compute[74840]:         <format type='raw'/>
Nov 08 12:23:10 user nova-compute[74840]:         <source file='/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6'/>
Nov 08 12:23:10 user nova-compute[74840]:         <backingStore/>
Nov 08 12:23:10 user nova-compute[74840]:       </backingStore>
Nov 08 12:23:10 user nova-compute[74840]:       <target dev='vda' bus='virtio'/>
Nov 08 12:23:10 user nova-compute[74840]:       <alias name='virtio-disk0'/>
Nov 08 12:23:10 user nova-compute[74840]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 08 12:23:10 user nova-compute[74840]:     </disk>
Nov 08 12:23:10 user nova-compute[74840]:     <disk type='file' device='cdrom'>
Nov 08 12:23:10 user nova-compute[74840]:       <driver name='qemu' type='raw' cache='none'/>
Nov 08 12:23:10 user nova-compute[74840]:       <source file='/opt/stack/data/nova/instances/83c035a0-880b-4170-98bc-b18cae712cfa/disk.config' index='1'/>
Nov 08 12:23:10 user nova-compute[74840]:       <backingStore/>
Nov 08 12:23:10 user nova-compute[74840]:       <target dev='hda' bus='ide'/>
Nov 08 12:23:10 user nova-compute[74840]:       <readonly/>
Nov 08 12:23:10 user nova-compute[74840]:       <alias name='ide0-0-0'/>
Nov 08 12:23:10 user nova-compute[74840]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 08 12:23:10 user nova-compute[74840]:     </disk>
Nov 08 12:23:10 user nova-compute[74840]:     <controller type='usb' index='0' model='none'>
Nov 08 12:23:10 user nova-compute[74840]:       <alias name='usb'/>
Nov 08 12:23:10 user nova-compute[74840]:     </controller>
Nov 08 12:23:10 user nova-compute[74840]:     <controller type='pci' index='0' model='pci-root'>
Nov 08 12:23:10 user nova-compute[74840]:       <alias name='pci.0'/>
Nov 08 12:23:10 user nova-compute[74840]:     </controller>
Nov 08 12:23:10 user nova-compute[74840]:     <controller type='ide' index='0'>
Nov 08 12:23:10 user nova-compute[74840]:       <alias name='ide'/>
Nov 08 12:23:10 user nova-compute[74840]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 08 12:23:10 user nova-compute[74840]:     </controller>
Nov 08 12:23:10 user nova-compute[74840]:     <interface type='ethernet'>
Nov 08 12:23:10 user nova-compute[74840]:       <mac address='fa:16:3e:56:38:57'/>
Nov 08 12:23:10 user nova-compute[74840]:       <target dev='tap75ded381-26'/>
Nov 08 12:23:10 user nova-compute[74840]:       <model type='virtio'/>
Nov 08 12:23:10 user nova-compute[74840]:       <mtu size='1442'/>
Nov 08 12:23:10 user nova-compute[74840]:       <alias name='net0'/>
Nov 08 12:23:10 user nova-compute[74840]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 08 12:23:10 user nova-compute[74840]:     </interface>
Nov 08 12:23:10 user nova-compute[74840]:     <serial type='pty'>
Nov 08 12:23:10 user nova-compute[74840]:       <source path='/dev/pts/0'/>
Nov 08 12:23:10 user nova-compute[74840]:       <log file='/opt/stack/data/nova/instances/83c035a0-880b-4170-98bc-b18cae712cfa/console.log' append='off'/>
Nov 08 12:23:10 user nova-compute[74840]:       <target type='isa-serial' port='0'>
Nov 08 12:23:10 user nova-compute[74840]:         <model name='isa-serial'/>
Nov 08 12:23:10 user nova-compute[74840]:       </target>
Nov 08 12:23:10 user nova-compute[74840]:       <alias name='serial0'/>
Nov 08 12:23:10 user nova-compute[74840]:     </serial>
Nov 08 12:23:10 user nova-compute[74840]:     <console type='pty' tty='/dev/pts/0'>
Nov 08 12:23:10 user nova-compute[74840]:       <source path='/dev/pts/0'/>
Nov 08 12:23:10 user nova-compute[74840]:       <log file='/opt/stack/data/nova/instances/83c035a0-880b-4170-98bc-b18cae712cfa/console.log' append='off'/>
Nov 08 12:23:10 user nova-compute[74840]:       <target type='serial' port='0'/>
Nov 08 12:23:10 user nova-compute[74840]:       <alias name='serial0'/>
Nov 08 12:23:10 user nova-compute[74840]:     </console>
Nov 08 12:23:10 user nova-compute[74840]:     <input type='mouse' bus='ps2'>
Nov 08 12:23:10 user nova-compute[74840]:       <alias name='input0'/>
Nov 08 12:23:10 user nova-compute[74840]:     </input>
Nov 08 12:23:10 user nova-compute[74840]:     <input type='keyboard' bus='ps2'>
Nov 08 12:23:10 user nova-compute[74840]:       <alias name='input1'/>
Nov 08 12:23:10 user nova-compute[74840]:     </input>
Nov 08 12:23:10 user nova-compute[74840]:     <graphics type='vnc' port='5900' autoport='yes' listen='0.0.0.0'>
Nov 08 12:23:10 user nova-compute[74840]:       <listen type='address' address='0.0.0.0'/>
Nov 08 12:23:10 user nova-compute[74840]:     </graphics>
Nov 08 12:23:10 user nova-compute[74840]:     <audio id='1' type='none'/>
Nov 08 12:23:10 user nova-compute[74840]:     <video>
Nov 08 12:23:10 user nova-compute[74840]:       <model type='virtio' heads='1' primary='yes'/>
Nov 08 12:23:10 user nova-compute[74840]:       <alias name='video0'/>
Nov 08 12:23:10 user nova-compute[74840]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 08 12:23:10 user nova-compute[74840]:     </video>
Nov 08 12:23:10 user nova-compute[74840]:     <memballoon model='virtio'>
Nov 08 12:23:10 user nova-compute[74840]:       <stats period='10'/>
Nov 08 12:23:10 user nova-compute[74840]:       <alias name='balloon0'/>
Nov 08 12:23:10 user nova-compute[74840]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 08 12:23:10 user nova-compute[74840]:     </memballoon>
Nov 08 12:23:10 user nova-compute[74840]:     <rng model='virtio'>
Nov 08 12:23:10 user nova-compute[74840]:       <backend model='random'>/dev/urandom</backend>
Nov 08 12:23:10 user nova-compute[74840]:       <alias name='rng0'/>
Nov 08 12:23:10 user nova-compute[74840]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 08 12:23:10 user nova-compute[74840]:     </rng>
Nov 08 12:23:10 user nova-compute[74840]:   </devices>
Nov 08 12:23:10 user nova-compute[74840]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 08 12:23:10 user nova-compute[74840]:     <label>libvirt-83c035a0-880b-4170-98bc-b18cae712cfa</label>
Nov 08 12:23:10 user nova-compute[74840]:     <imagelabel>libvirt-83c035a0-880b-4170-98bc-b18cae712cfa</imagelabel>
Nov 08 12:23:10 user nova-compute[74840]:   </seclabel>
Nov 08 12:23:10 user nova-compute[74840]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 08 12:23:10 user nova-compute[74840]:     <label>+64055:+108</label>
Nov 08 12:23:10 user nova-compute[74840]:     <imagelabel>+64055:+108</imagelabel>
Nov 08 12:23:10 user nova-compute[74840]:   </seclabel>
Nov 08 12:23:10 user nova-compute[74840]: </domain>
Nov 08 12:23:10 user nova-compute[74840]:  {{(pid=74840) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 08 12:23:10 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [req-7dee722c-b367-414a-b370-a68b40ac8715 req-47d8e042-ad7c-449b-a593-a88371746f03 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:17:9b:c8"/><model type="virtio"/><mtu size="1442"/><target dev="tap0ce328c3-b7"/></interface> {{(pid=74840) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 08 12:23:10 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [req-7dee722c-b367-414a-b370-a68b40ac8715 req-47d8e042-ad7c-449b-a593-a88371746f03 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:17:9b:c8"/><model type="virtio"/><mtu size="1442"/><target dev="tap0ce328c3-b7"/></interface>not found in domain: <domain type='kvm' id='24'>
Nov 08 12:23:10 user nova-compute[74840]:   <name>instance-00000016</name>
Nov 08 12:23:10 user nova-compute[74840]:   <uuid>83c035a0-880b-4170-98bc-b18cae712cfa</uuid>
Nov 08 12:23:10 user nova-compute[74840]:   <metadata>
Nov 08 12:23:10 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:23:10 user nova-compute[74840]:   <nova:package version="0.0.0"/>
Nov 08 12:23:10 user nova-compute[74840]:   <nova:name>tempest-device-tagging-server-1248482414</nova:name>
Nov 08 12:23:10 user nova-compute[74840]:   <nova:creationTime>2023-11-08 12:23:09</nova:creationTime>
Nov 08 12:23:10 user nova-compute[74840]:   <nova:flavor name="m1.tiny">
Nov 08 12:23:10 user nova-compute[74840]:     <nova:memory>512</nova:memory>
Nov 08 12:23:10 user nova-compute[74840]:     <nova:disk>1</nova:disk>
Nov 08 12:23:10 user nova-compute[74840]:     <nova:swap>0</nova:swap>
Nov 08 12:23:10 user nova-compute[74840]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:23:10 user nova-compute[74840]:     <nova:vcpus>1</nova:vcpus>
Nov 08 12:23:10 user nova-compute[74840]:   </nova:flavor>
Nov 08 12:23:10 user nova-compute[74840]:   <nova:owner>
Nov 08 12:23:10 user nova-compute[74840]:     <nova:user uuid="fe87f6d61cea4243a123420baf15279a">tempest-TaggedAttachmentsTest-807651925-project-member</nova:user>
Nov 08 12:23:10 user nova-compute[74840]:     <nova:project uuid="8c8bdf3f4296441799bd44bd993d3111">tempest-TaggedAttachmentsTest-807651925</nova:project>
Nov 08 12:23:10 user nova-compute[74840]:   </nova:owner>
Nov 08 12:23:10 user nova-compute[74840]:   <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:23:10 user nova-compute[74840]:   <nova:ports>
Nov 08 12:23:10 user nova-compute[74840]:     <nova:port uuid="75ded381-268f-487c-bf3b-1aad4d3909ae">
Nov 08 12:23:10 user nova-compute[74840]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 08 12:23:10 user nova-compute[74840]:     </nova:port>
Nov 08 12:23:10 user nova-compute[74840]:   </nova:ports>
Nov 08 12:23:10 user nova-compute[74840]: </nova:instance>
Nov 08 12:23:10 user nova-compute[74840]:   </metadata>
Nov 08 12:23:10 user nova-compute[74840]:   <memory unit='KiB'>524288</memory>
Nov 08 12:23:10 user nova-compute[74840]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 08 12:23:10 user nova-compute[74840]:   <vcpu placement='static'>1</vcpu>
Nov 08 12:23:10 user nova-compute[74840]:   <resource>
Nov 08 12:23:10 user nova-compute[74840]:     <partition>/machine</partition>
Nov 08 12:23:10 user nova-compute[74840]:   </resource>
Nov 08 12:23:10 user nova-compute[74840]:   <sysinfo type='smbios'>
Nov 08 12:23:10 user nova-compute[74840]:     <system>
Nov 08 12:23:10 user nova-compute[74840]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 08 12:23:10 user nova-compute[74840]:       <entry name='product'>OpenStack Nova</entry>
Nov 08 12:23:10 user nova-compute[74840]:       <entry name='version'>0.0.0</entry>
Nov 08 12:23:10 user nova-compute[74840]:       <entry name='serial'>83c035a0-880b-4170-98bc-b18cae712cfa</entry>
Nov 08 12:23:10 user nova-compute[74840]:       <entry name='uuid'>83c035a0-880b-4170-98bc-b18cae712cfa</entry>
Nov 08 12:23:10 user nova-compute[74840]:       <entry name='family'>Virtual Machine</entry>
Nov 08 12:23:10 user nova-compute[74840]:     </system>
Nov 08 12:23:10 user nova-compute[74840]:   </sysinfo>
Nov 08 12:23:10 user nova-compute[74840]:   <os>
Nov 08 12:23:10 user nova-compute[74840]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 08 12:23:10 user nova-compute[74840]:     <boot dev='hd'/>
Nov 08 12:23:10 user nova-compute[74840]:     <smbios mode='sysinfo'/>
Nov 08 12:23:10 user nova-compute[74840]:   </os>
Nov 08 12:23:10 user nova-compute[74840]:   <features>
Nov 08 12:23:10 user nova-compute[74840]:     <acpi/>
Nov 08 12:23:10 user nova-compute[74840]:     <apic/>
Nov 08 12:23:10 user nova-compute[74840]:     <vmcoreinfo state='on'/>
Nov 08 12:23:10 user nova-compute[74840]:   </features>
Nov 08 12:23:10 user nova-compute[74840]:   <cpu mode='custom' match='exact' check='full'>
Nov 08 12:23:10 user nova-compute[74840]:     <model fallback='forbid'>Nehalem</model>
Nov 08 12:23:10 user nova-compute[74840]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 08 12:23:10 user nova-compute[74840]:     <feature policy='require' name='vme'/>
Nov 08 12:23:10 user nova-compute[74840]:     <feature policy='require' name='x2apic'/>
Nov 08 12:23:10 user nova-compute[74840]:     <feature policy='require' name='hypervisor'/>
Nov 08 12:23:10 user nova-compute[74840]:   </cpu>
Nov 08 12:23:10 user nova-compute[74840]:   <clock offset='utc'>
Nov 08 12:23:10 user nova-compute[74840]:     <timer name='pit' tickpolicy='delay'/>
Nov 08 12:23:10 user nova-compute[74840]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 08 12:23:10 user nova-compute[74840]:     <timer name='hpet' present='no'/>
Nov 08 12:23:10 user nova-compute[74840]:   </clock>
Nov 08 12:23:10 user nova-compute[74840]:   <on_poweroff>destroy</on_poweroff>
Nov 08 12:23:10 user nova-compute[74840]:   <on_reboot>restart</on_reboot>
Nov 08 12:23:10 user nova-compute[74840]:   <on_crash>destroy</on_crash>
Nov 08 12:23:10 user nova-compute[74840]:   <devices>
Nov 08 12:23:10 user nova-compute[74840]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 08 12:23:10 user nova-compute[74840]:     <disk type='file' device='disk'>
Nov 08 12:23:10 user nova-compute[74840]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 08 12:23:10 user nova-compute[74840]:       <source file='/opt/stack/data/nova/instances/83c035a0-880b-4170-98bc-b18cae712cfa/disk' index='2'/>
Nov 08 12:23:10 user nova-compute[74840]:       <backingStore type='file' index='3'>
Nov 08 12:23:10 user nova-compute[74840]:         <format type='raw'/>
Nov 08 12:23:10 user nova-compute[74840]:         <source file='/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6'/>
Nov 08 12:23:10 user nova-compute[74840]:         <backingStore/>
Nov 08 12:23:10 user nova-compute[74840]:       </backingStore>
Nov 08 12:23:10 user nova-compute[74840]:       <target dev='vda' bus='virtio'/>
Nov 08 12:23:10 user nova-compute[74840]:       <alias name='virtio-disk0'/>
Nov 08 12:23:10 user nova-compute[74840]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 08 12:23:10 user nova-compute[74840]:     </disk>
Nov 08 12:23:10 user nova-compute[74840]:     <disk type='file' device='cdrom'>
Nov 08 12:23:10 user nova-compute[74840]:       <driver name='qemu' type='raw' cache='none'/>
Nov 08 12:23:10 user nova-compute[74840]:       <source file='/opt/stack/data/nova/instances/83c035a0-880b-4170-98bc-b18cae712cfa/disk.config' index='1'/>
Nov 08 12:23:10 user nova-compute[74840]:       <backingStore/>
Nov 08 12:23:10 user nova-compute[74840]:       <target dev='hda' bus='ide'/>
Nov 08 12:23:10 user nova-compute[74840]:       <readonly/>
Nov 08 12:23:10 user nova-compute[74840]:       <alias name='ide0-0-0'/>
Nov 08 12:23:10 user nova-compute[74840]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 08 12:23:10 user nova-compute[74840]:     </disk>
Nov 08 12:23:10 user nova-compute[74840]:     <controller type='usb' index='0' model='none'>
Nov 08 12:23:10 user nova-compute[74840]:       <alias name='usb'/>
Nov 08 12:23:10 user nova-compute[74840]:     </controller>
Nov 08 12:23:10 user nova-compute[74840]:     <controller type='pci' index='0' model='pci-root'>
Nov 08 12:23:10 user nova-compute[74840]:       <alias name='pci.0'/>
Nov 08 12:23:10 user nova-compute[74840]:     </controller>
Nov 08 12:23:10 user nova-compute[74840]:     <controller type='ide' index='0'>
Nov 08 12:23:10 user nova-compute[74840]:       <alias name='ide'/>
Nov 08 12:23:10 user nova-compute[74840]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 08 12:23:10 user nova-compute[74840]:     </controller>
Nov 08 12:23:10 user nova-compute[74840]:     <interface type='ethernet'>
Nov 08 12:23:10 user nova-compute[74840]:       <mac address='fa:16:3e:56:38:57'/>
Nov 08 12:23:10 user nova-compute[74840]:       <target dev='tap75ded381-26'/>
Nov 08 12:23:10 user nova-compute[74840]:       <model type='virtio'/>
Nov 08 12:23:10 user nova-compute[74840]:       <mtu size='1442'/>
Nov 08 12:23:10 user nova-compute[74840]:       <alias name='net0'/>
Nov 08 12:23:10 user nova-compute[74840]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 08 12:23:10 user nova-compute[74840]:     </interface>
Nov 08 12:23:10 user nova-compute[74840]:     <serial type='pty'>
Nov 08 12:23:10 user nova-compute[74840]:       <source path='/dev/pts/0'/>
Nov 08 12:23:10 user nova-compute[74840]:       <log file='/opt/stack/data/nova/instances/83c035a0-880b-4170-98bc-b18cae712cfa/console.log' append='off'/>
Nov 08 12:23:10 user nova-compute[74840]:       <target type='isa-serial' port='0'>
Nov 08 12:23:10 user nova-compute[74840]:         <model name='isa-serial'/>
Nov 08 12:23:10 user nova-compute[74840]:       </target>
Nov 08 12:23:10 user nova-compute[74840]:       <alias name='serial0'/>
Nov 08 12:23:10 user nova-compute[74840]:     </serial>
Nov 08 12:23:10 user nova-compute[74840]:     <console type='pty' tty='/dev/pts/0'>
Nov 08 12:23:10 user nova-compute[74840]:       <source path='/dev/pts/0'/>
Nov 08 12:23:10 user nova-compute[74840]:       <log file='/opt/stack/data/nova/instances/83c035a0-880b-4170-98bc-b18cae712cfa/console.log' append='off'/>
Nov 08 12:23:10 user nova-compute[74840]:       <target type='serial' port='0'/>
Nov 08 12:23:10 user nova-compute[74840]:       <alias name='serial0'/>
Nov 08 12:23:10 user nova-compute[74840]:     </console>
Nov 08 12:23:10 user nova-compute[74840]:     <input type='mouse' bus='ps2'>
Nov 08 12:23:10 user nova-compute[74840]:       <alias name='input0'/>
Nov 08 12:23:10 user nova-compute[74840]:     </input>
Nov 08 12:23:10 user nova-compute[74840]:     <input type='keyboard' bus='ps2'>
Nov 08 12:23:10 user nova-compute[74840]:       <alias name='input1'/>
Nov 08 12:23:10 user nova-compute[74840]:     </input>
Nov 08 12:23:10 user nova-compute[74840]:     <graphics type='vnc' port='5900' autoport='yes' listen='0.0.0.0'>
Nov 08 12:23:10 user nova-compute[74840]:       <listen type='address' address='0.0.0.0'/>
Nov 08 12:23:10 user nova-compute[74840]:     </graphics>
Nov 08 12:23:10 user nova-compute[74840]:     <audio id='1' type='none'/>
Nov 08 12:23:10 user nova-compute[74840]:     <video>
Nov 08 12:23:10 user nova-compute[74840]:       <model type='virtio' heads='1' primary='yes'/>
Nov 08 12:23:10 user nova-compute[74840]:       <alias name='video0'/>
Nov 08 12:23:10 user nova-compute[74840]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 08 12:23:10 user nova-compute[74840]:     </video>
Nov 08 12:23:10 user nova-compute[74840]:     <memballoon model='virtio'>
Nov 08 12:23:10 user nova-compute[74840]:       <stats period='10'/>
Nov 08 12:23:10 user nova-compute[74840]:       <alias name='balloon0'/>
Nov 08 12:23:10 user nova-compute[74840]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 08 12:23:10 user nova-compute[74840]:     </memballoon>
Nov 08 12:23:10 user nova-compute[74840]:     <rng model='virtio'>
Nov 08 12:23:10 user nova-compute[74840]:       <backend model='random'>/dev/urandom</backend>
Nov 08 12:23:10 user nova-compute[74840]:       <alias name='rng0'/>
Nov 08 12:23:10 user nova-compute[74840]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 08 12:23:10 user nova-compute[74840]:     </rng>
Nov 08 12:23:10 user nova-compute[74840]:   </devices>
Nov 08 12:23:10 user nova-compute[74840]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 08 12:23:10 user nova-compute[74840]:     <label>libvirt-83c035a0-880b-4170-98bc-b18cae712cfa</label>
Nov 08 12:23:10 user nova-compute[74840]:     <imagelabel>libvirt-83c035a0-880b-4170-98bc-b18cae712cfa</imagelabel>
Nov 08 12:23:10 user nova-compute[74840]:   </seclabel>
Nov 08 12:23:10 user nova-compute[74840]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 08 12:23:10 user nova-compute[74840]:     <label>+64055:+108</label>
Nov 08 12:23:10 user nova-compute[74840]:     <imagelabel>+64055:+108</imagelabel>
Nov 08 12:23:10 user nova-compute[74840]:   </seclabel>
Nov 08 12:23:10 user nova-compute[74840]: </domain>
Nov 08 12:23:10 user nova-compute[74840]:  {{(pid=74840) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 08 12:23:10 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [req-7dee722c-b367-414a-b370-a68b40ac8715 req-47d8e042-ad7c-449b-a593-a88371746f03 service nova] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Detaching interface fa:16:3e:17:9b:c8 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap0ce328c3-b7' not found.
Nov 08 12:23:10 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [req-7dee722c-b367-414a-b370-a68b40ac8715 req-47d8e042-ad7c-449b-a593-a88371746f03 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:19:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1248482414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1248482414',id=22,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE08F5Vdqafx8ionT0o99nYONzOMoa/3pOusA/wlvX3fSXRcA+RhI/2hy/w+tkl5A+C6lKye9AkVRPFr99hJwoo+GJvdV7gC/UTzKzbtU6DDZO8zP9SCuNQkk2JKp43yVA==',key_name='tempest-keypair-1343265406',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:20:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c8bdf3f4296441799bd44bd993d3111',ramdisk_id='',reservation_id='r-wyshdnxz',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-807651925',owner_user_name='tempest-TaggedAttachmentsTest-807651925-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:20:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe87f6d61cea4243a123420baf15279a',uuid=83c035a0-880b-4170-98bc-b18cae712cfa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ce328c3-b755-4d90-b0af-f4b2beef1bec", "address": "fa:16:3e:17:9b:c8", "network": {"id": "93688dc9-a647-4983-a0e4-f187716ca66e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1203286658", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8c8bdf3f4296441799bd44bd993d3111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ce328c3-b7", "ovs_interfaceid": "0ce328c3-b755-4d90-b0af-f4b2beef1bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:23:10 user nova-compute[74840]: DEBUG nova.network.os_vif_util [req-7dee722c-b367-414a-b370-a68b40ac8715 req-47d8e042-ad7c-449b-a593-a88371746f03 service nova] Converting VIF {"id": "0ce328c3-b755-4d90-b0af-f4b2beef1bec", "address": "fa:16:3e:17:9b:c8", "network": {"id": "93688dc9-a647-4983-a0e4-f187716ca66e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1203286658", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8c8bdf3f4296441799bd44bd993d3111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ce328c3-b7", "ovs_interfaceid": "0ce328c3-b755-4d90-b0af-f4b2beef1bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:23:10 user nova-compute[74840]: DEBUG nova.network.os_vif_util [req-7dee722c-b367-414a-b370-a68b40ac8715 req-47d8e042-ad7c-449b-a593-a88371746f03 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:9b:c8,bridge_name='br-int',has_traffic_filtering=True,id=0ce328c3-b755-4d90-b0af-f4b2beef1bec,network=Network(93688dc9-a647-4983-a0e4-f187716ca66e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ce328c3-b7') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:23:10 user nova-compute[74840]: DEBUG os_vif [req-7dee722c-b367-414a-b370-a68b40ac8715 req-47d8e042-ad7c-449b-a593-a88371746f03 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:9b:c8,bridge_name='br-int',has_traffic_filtering=True,id=0ce328c3-b755-4d90-b0af-f4b2beef1bec,network=Network(93688dc9-a647-4983-a0e4-f187716ca66e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ce328c3-b7') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:23:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ce328c3-b7, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:23:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:23:10 user nova-compute[74840]: INFO os_vif [req-7dee722c-b367-414a-b370-a68b40ac8715 req-47d8e042-ad7c-449b-a593-a88371746f03 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:9b:c8,bridge_name='br-int',has_traffic_filtering=True,id=0ce328c3-b755-4d90-b0af-f4b2beef1bec,network=Network(93688dc9-a647-4983-a0e4-f187716ca66e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ce328c3-b7')
Nov 08 12:23:10 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [req-7dee722c-b367-414a-b370-a68b40ac8715 req-47d8e042-ad7c-449b-a593-a88371746f03 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:23:10 user nova-compute[74840]:   <nova:package version="0.0.0"/>
Nov 08 12:23:10 user nova-compute[74840]:   <nova:name>tempest-device-tagging-server-1248482414</nova:name>
Nov 08 12:23:10 user nova-compute[74840]:   <nova:creationTime>2023-11-08 12:23:10</nova:creationTime>
Nov 08 12:23:10 user nova-compute[74840]:   <nova:flavor name="m1.tiny">
Nov 08 12:23:10 user nova-compute[74840]:     <nova:memory>512</nova:memory>
Nov 08 12:23:10 user nova-compute[74840]:     <nova:disk>1</nova:disk>
Nov 08 12:23:10 user nova-compute[74840]:     <nova:swap>0</nova:swap>
Nov 08 12:23:10 user nova-compute[74840]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:23:10 user nova-compute[74840]:     <nova:vcpus>1</nova:vcpus>
Nov 08 12:23:10 user nova-compute[74840]:   </nova:flavor>
Nov 08 12:23:10 user nova-compute[74840]:   <nova:owner>
Nov 08 12:23:10 user nova-compute[74840]:     <nova:user uuid="fe87f6d61cea4243a123420baf15279a">tempest-TaggedAttachmentsTest-807651925-project-member</nova:user>
Nov 08 12:23:10 user nova-compute[74840]:     <nova:project uuid="8c8bdf3f4296441799bd44bd993d3111">tempest-TaggedAttachmentsTest-807651925</nova:project>
Nov 08 12:23:10 user nova-compute[74840]:   </nova:owner>
Nov 08 12:23:10 user nova-compute[74840]:   <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:23:10 user nova-compute[74840]:   <nova:ports>
Nov 08 12:23:10 user nova-compute[74840]:     <nova:port uuid="75ded381-268f-487c-bf3b-1aad4d3909ae">
Nov 08 12:23:10 user nova-compute[74840]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 08 12:23:10 user nova-compute[74840]:     </nova:port>
Nov 08 12:23:10 user nova-compute[74840]:   </nova:ports>
Nov 08 12:23:10 user nova-compute[74840]: </nova:instance>
Nov 08 12:23:10 user nova-compute[74840]:  {{(pid=74840) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 08 12:23:10 user nova-compute[74840]: DEBUG nova.compute.manager [req-c0b9f08a-aa40-49ed-abe4-55f54a6e2189 req-0ab9b90f-db55-4e70-936e-df646d58c8e4 service nova] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Received event network-vif-unplugged-6169b221-7840-4cfb-ba25-e34a95b35e77 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:23:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-c0b9f08a-aa40-49ed-abe4-55f54a6e2189 req-0ab9b90f-db55-4e70-936e-df646d58c8e4 service nova] Acquiring lock "ffe50042-29bf-4ef3-a148-8698bc75233b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:23:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-c0b9f08a-aa40-49ed-abe4-55f54a6e2189 req-0ab9b90f-db55-4e70-936e-df646d58c8e4 service nova] Lock "ffe50042-29bf-4ef3-a148-8698bc75233b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:23:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-c0b9f08a-aa40-49ed-abe4-55f54a6e2189 req-0ab9b90f-db55-4e70-936e-df646d58c8e4 service nova] Lock "ffe50042-29bf-4ef3-a148-8698bc75233b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:23:10 user nova-compute[74840]: DEBUG nova.compute.manager [req-c0b9f08a-aa40-49ed-abe4-55f54a6e2189 req-0ab9b90f-db55-4e70-936e-df646d58c8e4 service nova] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] No waiting events found dispatching network-vif-unplugged-6169b221-7840-4cfb-ba25-e34a95b35e77 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:23:10 user nova-compute[74840]: WARNING nova.compute.manager [req-c0b9f08a-aa40-49ed-abe4-55f54a6e2189 req-0ab9b90f-db55-4e70-936e-df646d58c8e4 service nova] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Received unexpected event network-vif-unplugged-6169b221-7840-4cfb-ba25-e34a95b35e77 for instance with vm_state active and task_state rescuing.
Nov 08 12:23:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:11 user nova-compute[74840]: INFO nova.network.neutron [None req-98ab1211-bce0-4b73-a3f5-48ec0570c5c8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Port 0ce328c3-b755-4d90-b0af-f4b2beef1bec from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Nov 08 12:23:11 user nova-compute[74840]: DEBUG nova.network.neutron [None req-98ab1211-bce0-4b73-a3f5-48ec0570c5c8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Updating instance_info_cache with network_info: [{"id": "75ded381-268f-487c-bf3b-1aad4d3909ae", "address": "fa:16:3e:56:38:57", "network": {"id": "22514061-e390-4fd9-943b-0dedf57a323e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1978465085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c8bdf3f4296441799bd44bd993d3111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75ded381-26", "ovs_interfaceid": "75ded381-268f-487c-bf3b-1aad4d3909ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:23:11 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-98ab1211-bce0-4b73-a3f5-48ec0570c5c8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Releasing lock "refresh_cache-83c035a0-880b-4170-98bc-b18cae712cfa" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:23:11 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-98ab1211-bce0-4b73-a3f5-48ec0570c5c8 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Lock "interface-83c035a0-880b-4170-98bc-b18cae712cfa-0ce328c3-b755-4d90-b0af-f4b2beef1bec" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 22.154s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:23:11 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Instance destroyed successfully.
Nov 08 12:23:11 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Attempting a stable device rescue
Nov 08 12:23:11 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74840) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 12:23:11 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Instance directory exists: not creating {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 12:23:11 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Creating image(s)
Nov 08 12:23:11 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquiring lock "/opt/stack/data/nova/instances/ffe50042-29bf-4ef3-a148-8698bc75233b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:23:11 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "/opt/stack/data/nova/instances/ffe50042-29bf-4ef3-a148-8698bc75233b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:23:11 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "/opt/stack/data/nova/instances/ffe50042-29bf-4ef3-a148-8698bc75233b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:23:11 user nova-compute[74840]: DEBUG nova.objects.instance [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lazy-loading 'trusted_certs' on Instance uuid ffe50042-29bf-4ef3-a148-8698bc75233b {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:23:11 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquiring lock "495389a74bf56faf938cfeb6e8c534d27a149955" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:23:11 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "495389a74bf56faf938cfeb6e8c534d27a149955" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:23:12 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/495389a74bf56faf938cfeb6e8c534d27a149955.part --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:23:12 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/495389a74bf56faf938cfeb6e8c534d27a149955.part --force-share --output=json" returned: 0 in 0.193s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:23:12 user nova-compute[74840]: DEBUG nova.virt.images [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] 2857daaa-10c6-473f-acd8-64dea91147ee was qcow2, converting to raw {{(pid=74840) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 12:23:12 user nova-compute[74840]: DEBUG nova.privsep.utils [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74840) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 12:23:12 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/495389a74bf56faf938cfeb6e8c534d27a149955.part /opt/stack/data/nova/instances/_base/495389a74bf56faf938cfeb6e8c534d27a149955.converted {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:23:12 user nova-compute[74840]: DEBUG nova.compute.manager [req-0209686c-8504-466f-8c04-9ac78d5bf88b req-56d432c3-86df-4ca2-84f5-45b32671c989 service nova] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Received event network-vif-plugged-6169b221-7840-4cfb-ba25-e34a95b35e77 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:23:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0209686c-8504-466f-8c04-9ac78d5bf88b req-56d432c3-86df-4ca2-84f5-45b32671c989 service nova] Acquiring lock "ffe50042-29bf-4ef3-a148-8698bc75233b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:23:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0209686c-8504-466f-8c04-9ac78d5bf88b req-56d432c3-86df-4ca2-84f5-45b32671c989 service nova] Lock "ffe50042-29bf-4ef3-a148-8698bc75233b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:23:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0209686c-8504-466f-8c04-9ac78d5bf88b req-56d432c3-86df-4ca2-84f5-45b32671c989 service nova] Lock "ffe50042-29bf-4ef3-a148-8698bc75233b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:23:12 user nova-compute[74840]: DEBUG nova.compute.manager [req-0209686c-8504-466f-8c04-9ac78d5bf88b req-56d432c3-86df-4ca2-84f5-45b32671c989 service nova] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] No waiting events found dispatching network-vif-plugged-6169b221-7840-4cfb-ba25-e34a95b35e77 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:23:12 user nova-compute[74840]: WARNING nova.compute.manager [req-0209686c-8504-466f-8c04-9ac78d5bf88b req-56d432c3-86df-4ca2-84f5-45b32671c989 service nova] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Received unexpected event network-vif-plugged-6169b221-7840-4cfb-ba25-e34a95b35e77 for instance with vm_state active and task_state rescuing.
Nov 08 12:23:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/495389a74bf56faf938cfeb6e8c534d27a149955.part /opt/stack/data/nova/instances/_base/495389a74bf56faf938cfeb6e8c534d27a149955.converted" returned: 0 in 0.290s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/495389a74bf56faf938cfeb6e8c534d27a149955.converted --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/495389a74bf56faf938cfeb6e8c534d27a149955.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "495389a74bf56faf938cfeb6e8c534d27a149955" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.688s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquiring lock "495389a74bf56faf938cfeb6e8c534d27a149955" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "495389a74bf56faf938cfeb6e8c534d27a149955" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/495389a74bf56faf938cfeb6e8c534d27a149955 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/495389a74bf56faf938cfeb6e8c534d27a149955 --force-share --output=json" returned: 0 in 0.184s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/495389a74bf56faf938cfeb6e8c534d27a149955,backing_fmt=raw /opt/stack/data/nova/instances/ffe50042-29bf-4ef3-a148-8698bc75233b/disk.rescue {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/495389a74bf56faf938cfeb6e8c534d27a149955,backing_fmt=raw /opt/stack/data/nova/instances/ffe50042-29bf-4ef3-a148-8698bc75233b/disk.rescue" returned: 0 in 0.054s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "495389a74bf56faf938cfeb6e8c534d27a149955" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG nova.objects.instance [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lazy-loading 'migration_context' on Instance uuid ffe50042-29bf-4ef3-a148-8698bc75233b {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG nova.objects.base [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Object Instance<ffe50042-29bf-4ef3-a148-8698bc75233b> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Created local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Start _get_guest_xml network_info=[{"id": "6169b221-7840-4cfb-ba25-e34a95b35e77", "address": "fa:16:3e:b0:6a:c2", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "vif_mac": "fa:16:3e:b0:6a:c2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6169b221-78", "ovs_interfaceid": "6169b221-7840-4cfb-ba25-e34a95b35e77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '2857daaa-10c6-473f-acd8-64dea91147ee', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '92fd702c-1735-45b7-895c-6c10b7feb235', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'veKSyoaB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'ffe50042-29bf-4ef3-a148-8698bc75233b', 'attached_at': '', 'detached_at': '', 'volume_id': '10d90d99-351a-48a3-8ad3-37a2bbbc76a4', 'serial': '10d90d99-351a-48a3-8ad3-37a2bbbc76a4'}, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG nova.objects.instance [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lazy-loading 'resources' on Instance uuid ffe50042-29bf-4ef3-a148-8698bc75233b {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG nova.objects.base [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Object Instance<ffe50042-29bf-4ef3-a148-8698bc75233b> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG nova.objects.instance [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lazy-loading 'numa_topology' on Instance uuid ffe50042-29bf-4ef3-a148-8698bc75233b {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG nova.objects.base [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Object Instance<ffe50042-29bf-4ef3-a148-8698bc75233b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:23:13 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:23:13 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:23:13 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG nova.objects.instance [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lazy-loading 'vcpu_model' on Instance uuid ffe50042-29bf-4ef3-a148-8698bc75233b {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG nova.objects.base [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Object Instance<ffe50042-29bf-4ef3-a148-8698bc75233b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Calling os-brick to attach iSCSI Volume {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'veKSyoaB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:23:13 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:23:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:23:13 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:23:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:23:13 user nova-compute[74840]: INFO os_brick.initiator.connectors.iscsi [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 12:23:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 -p 172.16.0.220:3260 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36b3eb0-0099-470b-a79b-1c20fa209cf2]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = veKSyoaB\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 08 12:23:13 user nova-compute[74840]: node.name = iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4
Nov 08 12:23:13 user nova-compute[74840]: node.tpgt = -1
Nov 08 12:23:13 user nova-compute[74840]: node.startup = automatic
Nov 08 12:23:13 user nova-compute[74840]: node.leading_login = No
Nov 08 12:23:13 user nova-compute[74840]: iface.iscsi_ifacename = default
Nov 08 12:23:13 user nova-compute[74840]: iface.net_ifacename = <empty>
Nov 08 12:23:13 user nova-compute[74840]: iface.ipaddress = <empty>
Nov 08 12:23:13 user nova-compute[74840]: iface.prefix_len = 0
Nov 08 12:23:13 user nova-compute[74840]: iface.hwaddress = <empty>
Nov 08 12:23:13 user nova-compute[74840]: iface.transport_name = tcp
Nov 08 12:23:13 user nova-compute[74840]: iface.initiatorname = <empty>
Nov 08 12:23:13 user nova-compute[74840]: iface.state = <empty>
Nov 08 12:23:13 user nova-compute[74840]: iface.vlan_id = 0
Nov 08 12:23:13 user nova-compute[74840]: iface.vlan_priority = 0
Nov 08 12:23:13 user nova-compute[74840]: iface.vlan_state = <empty>
Nov 08 12:23:13 user nova-compute[74840]: iface.iface_num = 0
Nov 08 12:23:13 user nova-compute[74840]: iface.mtu = 0
Nov 08 12:23:13 user nova-compute[74840]: iface.port = 0
Nov 08 12:23:13 user nova-compute[74840]: iface.bootproto = <empty>
Nov 08 12:23:13 user nova-compute[74840]: iface.subnet_mask = <empty>
Nov 08 12:23:13 user nova-compute[74840]: iface.gateway = <empty>
Nov 08 12:23:13 user nova-compute[74840]: iface.dhcp_alt_client_id_state = <empty>
Nov 08 12:23:13 user nova-compute[74840]: iface.dhcp_alt_client_id = <empty>
Nov 08 12:23:13 user nova-compute[74840]: iface.dhcp_dns = <empty>
Nov 08 12:23:13 user nova-compute[74840]: iface.dhcp_learn_iqn = <empty>
Nov 08 12:23:13 user nova-compute[74840]: iface.dhcp_req_vendor_id_state = <empty>
Nov 08 12:23:13 user nova-compute[74840]: iface.dhcp_vendor_id_state = <empty>
Nov 08 12:23:13 user nova-compute[74840]: iface.dhcp_vendor_id = <empty>
Nov 08 12:23:13 user nova-compute[74840]: iface.dhcp_slp_da = <empty>
Nov 08 12:23:13 user nova-compute[74840]: iface.fragmentation = <empty>
Nov 08 12:23:13 user nova-compute[74840]: iface.gratuitous_arp = <empty>
Nov 08 12:23:13 user nova-compute[74840]: iface.incoming_forwarding = <empty>
Nov 08 12:23:13 user nova-compute[74840]: iface.tos_state = <empty>
Nov 08 12:23:13 user nova-compute[74840]: iface.tos = 0
Nov 08 12:23:13 user nova-compute[74840]: iface.ttl = 0
Nov 08 12:23:13 user nova-compute[74840]: iface.delayed_ack = <empty>
Nov 08 12:23:13 user nova-compute[74840]: iface.tcp_nagle = <empty>
Nov 08 12:23:13 user nova-compute[74840]: iface.tcp_wsf_state = <empty>
Nov 08 12:23:13 user nova-compute[74840]: iface.tcp_wsf = 0
Nov 08 12:23:13 user nova-compute[74840]: iface.tcp_timer_scale = 0
Nov 08 12:23:13 user nova-compute[74840]: iface.tcp_timestamp = <empty>
Nov 08 12:23:13 user nova-compute[74840]: iface.redirect = <empty>
Nov 08 12:23:13 user nova-compute[74840]: iface.def_task_mgmt_timeout = 0
Nov 08 12:23:13 user nova-compute[74840]: iface.header_digest = <empty>
Nov 08 12:23:13 user nova-compute[74840]: iface.data_digest = <empty>
Nov 08 12:23:13 user nova-compute[74840]: iface.immediate_data = <empty>
Nov 08 12:23:13 user nova-compute[74840]: iface.initial_r2t = <empty>
Nov 08 12:23:13 user nova-compute[74840]: iface.data_seq_inorder = <empty>
Nov 08 12:23:13 user nova-compute[74840]: iface.data_pdu_inorder = <empty>
Nov 08 12:23:13 user nova-compute[74840]: iface.erl = 0
Nov 08 12:23:13 user nova-compute[74840]: iface.max_receive_data_len = 0
Nov 08 12:23:13 user nova-compute[74840]: iface.first_burst_len = 0
Nov 08 12:23:13 user nova-compute[74840]: iface.max_outstanding_r2t = 0
Nov 08 12:23:13 user nova-compute[74840]: iface.max_burst_len = 0
Nov 08 12:23:13 user nova-compute[74840]: iface.chap_auth = <empty>
Nov 08 12:23:13 user nova-compute[74840]: iface.bidi_chap = <empty>
Nov 08 12:23:13 user nova-compute[74840]: iface.strict_login_compliance = <empty>
Nov 08 12:23:13 user nova-compute[74840]: iface.discovery_auth = <empty>
Nov 08 12:23:13 user nova-compute[74840]: iface.discovery_logout = <empty>
Nov 08 12:23:13 user nova-compute[74840]: node.discovery_address = <empty>
Nov 08 12:23:13 user nova-compute[74840]: node.discovery_port = 0
Nov 08 12:23:13 user nova-compute[74840]: node.discovery_type = static
Nov 08 12:23:13 user nova-compute[74840]: node.session.initial_cmdsn = 0
Nov 08 12:23:13 user nova-compute[74840]: node.session.initial_login_retry_max = 8
Nov 08 12:23:13 user nova-compute[74840]: node.session.xmit_thread_priority = -20
Nov 08 12:23:13 user nova-compute[74840]: node.session.cmds_max = 128
Nov 08 12:23:13 user nova-compute[74840]: node.session.queue_depth = 32
Nov 08 12:23:13 user nova-compute[74840]: node.session.nr_sessions = 1
Nov 08 12:23:13 user nova-compute[74840]: node.session.auth.authmethod = CHAP
Nov 08 12:23:13 user nova-compute[74840]: node.session.auth.username = veKSyoaB
Nov 08 12:23:13 user nova-compute[74840]: node.session.auth.password = ***
Nov 08 12:23:13 user nova-compute[74840]: node.session.auth.username_in = <empty>
Nov 08 12:23:13 user nova-compute[74840]: node.session.auth.password_in = <empty>
Nov 08 12:23:13 user nova-compute[74840]: node.session.auth.chap_algs = MD5
Nov 08 12:23:13 user nova-compute[74840]: node.session.timeo.replacement_timeout = 120
Nov 08 12:23:13 user nova-compute[74840]: node.session.err_timeo.abort_timeout = 15
Nov 08 12:23:13 user nova-compute[74840]: node.session.err_timeo.lu_reset_timeout = 30
Nov 08 12:23:13 user nova-compute[74840]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 08 12:23:13 user nova-compute[74840]: node.session.err_timeo.host_reset_timeout = 60
Nov 08 12:23:13 user nova-compute[74840]: node.session.iscsi.FastAbort = Yes
Nov 08 12:23:13 user nova-compute[74840]: node.session.iscsi.InitialR2T = No
Nov 08 12:23:13 user nova-compute[74840]: node.session.iscsi.ImmediateData = Yes
Nov 08 12:23:13 user nova-compute[74840]: node.session.iscsi.FirstBurstLength = 262144
Nov 08 12:23:13 user nova-compute[74840]: node.session.iscsi.MaxBurstLength = 16776192
Nov 08 12:23:13 user nova-compute[74840]: node.session.iscsi.DefaultTime2Retain = 0
Nov 08 12:23:13 user nova-compute[74840]: node.session.iscsi.DefaultTime2Wait = 2
Nov 08 12:23:13 user nova-compute[74840]: node.session.iscsi.MaxConnections = 1
Nov 08 12:23:13 user nova-compute[74840]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 08 12:23:13 user nova-compute[74840]: node.session.iscsi.ERL = 0
Nov 08 12:23:13 user nova-compute[74840]: node.session.scan = manual
Nov 08 12:23:13 user nova-compute[74840]: node.session.reopen_max = 0
Nov 08 12:23:13 user nova-compute[74840]: node.conn[0].address = 172.16.0.220
Nov 08 12:23:13 user nova-compute[74840]: node.conn[0].port = 3260
Nov 08 12:23:13 user nova-compute[74840]: node.conn[0].startup = manual
Nov 08 12:23:13 user nova-compute[74840]: node.conn[0].tcp.window_size = 524288
Nov 08 12:23:13 user nova-compute[74840]: node.conn[0].tcp.type_of_service = 0
Nov 08 12:23:13 user nova-compute[74840]: node.conn[0].timeo.logout_timeout = 15
Nov 08 12:23:13 user nova-compute[74840]: node.conn[0].timeo.login_timeout = 15
Nov 08 12:23:13 user nova-compute[74840]: node.conn[0].timeo.auth_timeout = 45
Nov 08 12:23:13 user nova-compute[74840]: node.conn[0].timeo.noop_out_interval = 5
Nov 08 12:23:13 user nova-compute[74840]: node.conn[0].timeo.noop_out_timeout = 5
Nov 08 12:23:13 user nova-compute[74840]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 08 12:23:13 user nova-compute[74840]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 08 12:23:13 user nova-compute[74840]: node.conn[0].iscsi.HeaderDigest = None
Nov 08 12:23:13 user nova-compute[74840]: node.conn[0].iscsi.DataDigest = None
Nov 08 12:23:13 user nova-compute[74840]: node.conn[0].iscsi.IFMarker = No
Nov 08 12:23:13 user nova-compute[74840]: node.conn[0].iscsi.OFMarker = No
Nov 08 12:23:13 user nova-compute[74840]: # END RECORD
Nov 08 12:23:13 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea580046-a93b-4191-919f-939d1a8fe8fd]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44bb34a-ab2f-42ee-bd91-c05194327a32]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v veKSyoaB {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v veKSyoaB" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b534f9-666b-4efb-bd22-77e94234cb8f]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'veKSyoaB'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e4a281-859e-48a7-96ee-eeac85024ee0]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23df89d-95a1-4ae5-86a8-0b732ba320f8]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:23:13 user nova-compute[74840]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)
Nov 08 12:23:13 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:23:13 user nova-compute[74840]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)
Nov 08 12:23:13 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.169s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Connected to 172.16.0.220:3260 {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] HCTL ('37', '0', '0', 0) found on session 23 with lun 0 {{(pid=74840) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=74840) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e330c802-549b-44d5-9226-3a9e31897232]: (4, ('0 0 0', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Searching for a device in session 23 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'veKSyoaB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.196s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] <== connect_volume: return (197ms) {'type': 'block', 'scsi_wwn': '23665353135643039', 'path': '/dev/sdf'} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665353135643039', 'path': '/dev/sdf'} {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:20:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1225300234',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1225300234',id=24,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:21:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72c97c47ab144ef3a8d5e9ee1ecc059e',ramdisk_id='',reservation_id='r-pfesogm8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-297593405',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:21:55Z,user_data=None,user_id='275e3d340c9d4d9e90b579e4bc0bfe0b',uuid=ffe50042-29bf-4ef3-a148-8698bc75233b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6169b221-7840-4cfb-ba25-e34a95b35e77", "address": "fa:16:3e:b0:6a:c2", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "vif_mac": "fa:16:3e:b0:6a:c2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6169b221-78", "ovs_interfaceid": "6169b221-7840-4cfb-ba25-e34a95b35e77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Converting VIF {"id": "6169b221-7840-4cfb-ba25-e34a95b35e77", "address": "fa:16:3e:b0:6a:c2", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "vif_mac": "fa:16:3e:b0:6a:c2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6169b221-78", "ovs_interfaceid": "6169b221-7840-4cfb-ba25-e34a95b35e77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:6a:c2,bridge_name='br-int',has_traffic_filtering=True,id=6169b221-7840-4cfb-ba25-e34a95b35e77,network=Network(8388eafb-b115-49c7-82cd-0d85d0ee12e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6169b221-78') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG nova.objects.instance [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lazy-loading 'pci_devices' on Instance uuid ffe50042-29bf-4ef3-a148-8698bc75233b {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG nova.objects.base [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Object Instance<ffe50042-29bf-4ef3-a148-8698bc75233b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:23:13 user nova-compute[74840]:   <uuid>ffe50042-29bf-4ef3-a148-8698bc75233b</uuid>
Nov 08 12:23:13 user nova-compute[74840]:   <name>instance-00000018</name>
Nov 08 12:23:13 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:23:13 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:23:13 user nova-compute[74840]:   <metadata>
Nov 08 12:23:13 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:23:13 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:23:13 user nova-compute[74840]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1225300234</nova:name>
Nov 08 12:23:13 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:23:13</nova:creationTime>
Nov 08 12:23:13 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:23:13 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:23:13 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:23:13 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:23:13 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:23:13 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:23:13 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:23:13 user nova-compute[74840]:       <nova:owner>
Nov 08 12:23:13 user nova-compute[74840]:         <nova:user uuid="275e3d340c9d4d9e90b579e4bc0bfe0b">tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member</nova:user>
Nov 08 12:23:13 user nova-compute[74840]:         <nova:project uuid="72c97c47ab144ef3a8d5e9ee1ecc059e">tempest-ServerBootFromVolumeStableRescueTest-297593405</nova:project>
Nov 08 12:23:13 user nova-compute[74840]:       </nova:owner>
Nov 08 12:23:13 user nova-compute[74840]:       <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:23:13 user nova-compute[74840]:       <nova:ports>
Nov 08 12:23:13 user nova-compute[74840]:         <nova:port uuid="6169b221-7840-4cfb-ba25-e34a95b35e77">
Nov 08 12:23:13 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 12:23:13 user nova-compute[74840]:         </nova:port>
Nov 08 12:23:13 user nova-compute[74840]:       </nova:ports>
Nov 08 12:23:13 user nova-compute[74840]:     </nova:instance>
Nov 08 12:23:13 user nova-compute[74840]:   </metadata>
Nov 08 12:23:13 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:23:13 user nova-compute[74840]:     <system>
Nov 08 12:23:13 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:23:13 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:23:13 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:23:13 user nova-compute[74840]:       <entry name="serial">ffe50042-29bf-4ef3-a148-8698bc75233b</entry>
Nov 08 12:23:13 user nova-compute[74840]:       <entry name="uuid">ffe50042-29bf-4ef3-a148-8698bc75233b</entry>
Nov 08 12:23:13 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:23:13 user nova-compute[74840]:     </system>
Nov 08 12:23:13 user nova-compute[74840]:   </sysinfo>
Nov 08 12:23:13 user nova-compute[74840]:   <os>
Nov 08 12:23:13 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:23:13 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:23:13 user nova-compute[74840]:   </os>
Nov 08 12:23:13 user nova-compute[74840]:   <features>
Nov 08 12:23:13 user nova-compute[74840]:     <acpi/>
Nov 08 12:23:13 user nova-compute[74840]:     <apic/>
Nov 08 12:23:13 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:23:13 user nova-compute[74840]:   </features>
Nov 08 12:23:13 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:23:13 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:23:13 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:23:13 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:23:13 user nova-compute[74840]:   </clock>
Nov 08 12:23:13 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:23:13 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:23:13 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:23:13 user nova-compute[74840]:   </cpu>
Nov 08 12:23:13 user nova-compute[74840]:   <devices>
Nov 08 12:23:13 user nova-compute[74840]:     <disk type="block" device="disk">
Nov 08 12:23:13 user nova-compute[74840]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:23:13 user nova-compute[74840]:       <source dev="/dev/sdf"/>
Nov 08 12:23:13 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:23:13 user nova-compute[74840]:       <serial>10d90d99-351a-48a3-8ad3-37a2bbbc76a4</serial>
Nov 08 12:23:13 user nova-compute[74840]:     </disk>
Nov 08 12:23:13 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:23:13 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:23:13 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/ffe50042-29bf-4ef3-a148-8698bc75233b/disk.rescue"/>
Nov 08 12:23:13 user nova-compute[74840]:       <target dev="vdb" bus="virtio"/>
Nov 08 12:23:13 user nova-compute[74840]:       <boot order="1"/>
Nov 08 12:23:13 user nova-compute[74840]:     </disk>
Nov 08 12:23:13 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:23:13 user nova-compute[74840]:       <mac address="fa:16:3e:b0:6a:c2"/>
Nov 08 12:23:13 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:23:13 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:23:13 user nova-compute[74840]:       <target dev="tap6169b221-78"/>
Nov 08 12:23:13 user nova-compute[74840]:     </interface>
Nov 08 12:23:13 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:23:13 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/ffe50042-29bf-4ef3-a148-8698bc75233b/console.log" append="off"/>
Nov 08 12:23:13 user nova-compute[74840]:     </serial>
Nov 08 12:23:13 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:23:13 user nova-compute[74840]:     <video>
Nov 08 12:23:13 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:23:13 user nova-compute[74840]:     </video>
Nov 08 12:23:13 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:23:13 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:23:13 user nova-compute[74840]:     </rng>
Nov 08 12:23:13 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:23:13 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:23:13 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:23:13 user nova-compute[74840]:     </memballoon>
Nov 08 12:23:13 user nova-compute[74840]:   </devices>
Nov 08 12:23:13 user nova-compute[74840]: </domain>
Nov 08 12:23:13 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:23:13 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Instance destroyed successfully.
Nov 08 12:23:13 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:23:13 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] No VIF found with MAC fa:16:3e:b0:6a:c2, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:23:14 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:15 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:15 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:15 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:15 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:15 user nova-compute[74840]: DEBUG nova.compute.manager [req-61341b08-3e24-4f41-9d40-421cba40555b req-97fddebe-7471-4f67-bcf0-6fe878cade48 service nova] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Received event network-vif-plugged-6169b221-7840-4cfb-ba25-e34a95b35e77 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:23:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-61341b08-3e24-4f41-9d40-421cba40555b req-97fddebe-7471-4f67-bcf0-6fe878cade48 service nova] Acquiring lock "ffe50042-29bf-4ef3-a148-8698bc75233b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:23:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-61341b08-3e24-4f41-9d40-421cba40555b req-97fddebe-7471-4f67-bcf0-6fe878cade48 service nova] Lock "ffe50042-29bf-4ef3-a148-8698bc75233b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:23:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-61341b08-3e24-4f41-9d40-421cba40555b req-97fddebe-7471-4f67-bcf0-6fe878cade48 service nova] Lock "ffe50042-29bf-4ef3-a148-8698bc75233b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:23:15 user nova-compute[74840]: DEBUG nova.compute.manager [req-61341b08-3e24-4f41-9d40-421cba40555b req-97fddebe-7471-4f67-bcf0-6fe878cade48 service nova] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] No waiting events found dispatching network-vif-plugged-6169b221-7840-4cfb-ba25-e34a95b35e77 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:23:15 user nova-compute[74840]: WARNING nova.compute.manager [req-61341b08-3e24-4f41-9d40-421cba40555b req-97fddebe-7471-4f67-bcf0-6fe878cade48 service nova] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Received unexpected event network-vif-plugged-6169b221-7840-4cfb-ba25-e34a95b35e77 for instance with vm_state active and task_state rescuing.
Nov 08 12:23:15 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:17 user nova-compute[74840]: DEBUG nova.compute.manager [req-3cb9ed16-c318-4a13-a9d0-05abbc5310ee req-5ea1aabe-8b30-4caa-a182-5a23dfc5e98d service nova] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Received event network-vif-plugged-6169b221-7840-4cfb-ba25-e34a95b35e77 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:23:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3cb9ed16-c318-4a13-a9d0-05abbc5310ee req-5ea1aabe-8b30-4caa-a182-5a23dfc5e98d service nova] Acquiring lock "ffe50042-29bf-4ef3-a148-8698bc75233b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:23:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3cb9ed16-c318-4a13-a9d0-05abbc5310ee req-5ea1aabe-8b30-4caa-a182-5a23dfc5e98d service nova] Lock "ffe50042-29bf-4ef3-a148-8698bc75233b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:23:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3cb9ed16-c318-4a13-a9d0-05abbc5310ee req-5ea1aabe-8b30-4caa-a182-5a23dfc5e98d service nova] Lock "ffe50042-29bf-4ef3-a148-8698bc75233b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:23:17 user nova-compute[74840]: DEBUG nova.compute.manager [req-3cb9ed16-c318-4a13-a9d0-05abbc5310ee req-5ea1aabe-8b30-4caa-a182-5a23dfc5e98d service nova] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] No waiting events found dispatching network-vif-plugged-6169b221-7840-4cfb-ba25-e34a95b35e77 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:23:17 user nova-compute[74840]: WARNING nova.compute.manager [req-3cb9ed16-c318-4a13-a9d0-05abbc5310ee req-5ea1aabe-8b30-4caa-a182-5a23dfc5e98d service nova] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Received unexpected event network-vif-plugged-6169b221-7840-4cfb-ba25-e34a95b35e77 for instance with vm_state active and task_state rescuing.
Nov 08 12:23:17 user nova-compute[74840]: DEBUG nova.compute.manager [None req-5acae1c8-09b8-4f29-be32-dc4ae246f3ff tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:23:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:20 user nova-compute[74840]: DEBUG nova.compute.manager [req-16e3ae77-bd36-46c8-9780-d58bd4f4e107 req-05016a31-9d0b-4dcd-bfc3-05ae4d40a1c6 service nova] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Received event network-changed-ab70d9c8-3258-4119-ac39-e681ca7011a5 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:23:20 user nova-compute[74840]: DEBUG nova.compute.manager [req-16e3ae77-bd36-46c8-9780-d58bd4f4e107 req-05016a31-9d0b-4dcd-bfc3-05ae4d40a1c6 service nova] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Refreshing instance network info cache due to event network-changed-ab70d9c8-3258-4119-ac39-e681ca7011a5. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:23:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-16e3ae77-bd36-46c8-9780-d58bd4f4e107 req-05016a31-9d0b-4dcd-bfc3-05ae4d40a1c6 service nova] Acquiring lock "refresh_cache-4ce94f9d-be90-4b82-bc83-6777d2c871a6" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:23:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-16e3ae77-bd36-46c8-9780-d58bd4f4e107 req-05016a31-9d0b-4dcd-bfc3-05ae4d40a1c6 service nova] Acquired lock "refresh_cache-4ce94f9d-be90-4b82-bc83-6777d2c871a6" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:23:20 user nova-compute[74840]: DEBUG nova.network.neutron [req-16e3ae77-bd36-46c8-9780-d58bd4f4e107 req-05016a31-9d0b-4dcd-bfc3-05ae4d40a1c6 service nova] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Refreshing network info cache for port ab70d9c8-3258-4119-ac39-e681ca7011a5 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:23:21 user nova-compute[74840]: DEBUG nova.network.neutron [req-16e3ae77-bd36-46c8-9780-d58bd4f4e107 req-05016a31-9d0b-4dcd-bfc3-05ae4d40a1c6 service nova] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Updated VIF entry in instance network info cache for port ab70d9c8-3258-4119-ac39-e681ca7011a5. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:23:21 user nova-compute[74840]: DEBUG nova.network.neutron [req-16e3ae77-bd36-46c8-9780-d58bd4f4e107 req-05016a31-9d0b-4dcd-bfc3-05ae4d40a1c6 service nova] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Updating instance_info_cache with network_info: [{"id": "ab70d9c8-3258-4119-ac39-e681ca7011a5", "address": "fa:16:3e:15:31:2f", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab70d9c8-32", "ovs_interfaceid": "ab70d9c8-3258-4119-ac39-e681ca7011a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:23:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-16e3ae77-bd36-46c8-9780-d58bd4f4e107 req-05016a31-9d0b-4dcd-bfc3-05ae4d40a1c6 service nova] Releasing lock "refresh_cache-4ce94f9d-be90-4b82-bc83-6777d2c871a6" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:23:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8c85bf16-4851-4679-a687-88416a33bfb0 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "4f6c75c0-e820-47eb-be3e-51179b6df1a3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:23:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8c85bf16-4851-4679-a687-88416a33bfb0 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "4f6c75c0-e820-47eb-be3e-51179b6df1a3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:23:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8c85bf16-4851-4679-a687-88416a33bfb0 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "4f6c75c0-e820-47eb-be3e-51179b6df1a3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:23:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8c85bf16-4851-4679-a687-88416a33bfb0 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "4f6c75c0-e820-47eb-be3e-51179b6df1a3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:23:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8c85bf16-4851-4679-a687-88416a33bfb0 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "4f6c75c0-e820-47eb-be3e-51179b6df1a3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:23:22 user nova-compute[74840]: INFO nova.compute.manager [None req-8c85bf16-4851-4679-a687-88416a33bfb0 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Terminating instance
Nov 08 12:23:22 user nova-compute[74840]: DEBUG nova.compute.manager [None req-8c85bf16-4851-4679-a687-88416a33bfb0 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Start destroying the instance on the hypervisor. {{(pid=74840) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 12:23:22 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:22 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:22 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:22 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:22 user nova-compute[74840]: DEBUG nova.compute.manager [req-d4c5c787-4640-4c4b-8c25-266932373239 req-8fd4c129-20f6-4d99-9064-9d99da423f33 service nova] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Received event network-vif-unplugged-2f320dfe-5946-496e-81e8-922587cc240b {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:23:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-d4c5c787-4640-4c4b-8c25-266932373239 req-8fd4c129-20f6-4d99-9064-9d99da423f33 service nova] Acquiring lock "4f6c75c0-e820-47eb-be3e-51179b6df1a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:23:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-d4c5c787-4640-4c4b-8c25-266932373239 req-8fd4c129-20f6-4d99-9064-9d99da423f33 service nova] Lock "4f6c75c0-e820-47eb-be3e-51179b6df1a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:23:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-d4c5c787-4640-4c4b-8c25-266932373239 req-8fd4c129-20f6-4d99-9064-9d99da423f33 service nova] Lock "4f6c75c0-e820-47eb-be3e-51179b6df1a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:23:22 user nova-compute[74840]: DEBUG nova.compute.manager [req-d4c5c787-4640-4c4b-8c25-266932373239 req-8fd4c129-20f6-4d99-9064-9d99da423f33 service nova] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] No waiting events found dispatching network-vif-unplugged-2f320dfe-5946-496e-81e8-922587cc240b {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:23:22 user nova-compute[74840]: DEBUG nova.compute.manager [req-d4c5c787-4640-4c4b-8c25-266932373239 req-8fd4c129-20f6-4d99-9064-9d99da423f33 service nova] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Received event network-vif-unplugged-2f320dfe-5946-496e-81e8-922587cc240b for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:23:22 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:22 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Instance destroyed successfully.
Nov 08 12:23:22 user nova-compute[74840]: DEBUG nova.objects.instance [None req-8c85bf16-4851-4679-a687-88416a33bfb0 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lazy-loading 'resources' on Instance uuid 4f6c75c0-e820-47eb-be3e-51179b6df1a3 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:23:23 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-8c85bf16-4851-4679-a687-88416a33bfb0 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:19:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-959394704',display_name='tempest-AttachVolumeNegativeTest-server-959394704',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-959394704',id=23,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAiadOEGIpof+u0WfpATxWsGryrSTrRf2i9G9993iMEUd2kCtbc/mKLObammRGOTVQJdLo5MwAP4V6v3eAfC4wfOCJX1O+E+dpMLOGAxDcpf2pE0Ot7IAaSgyXg++yPG3g==',key_name='tempest-keypair-1008695350',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:20:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ec082e08ddf4477a721e410fe944d10',ramdisk_id='',reservation_id='r-48ng4pro',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1526881991',owner_user_name='tempest-AttachVolumeNegativeTest-1526881991-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:20:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e172625e7f334a2b896b2738bbf49aa8',uuid=4f6c75c0-e820-47eb-be3e-51179b6df1a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f320dfe-5946-496e-81e8-922587cc240b", "address": "fa:16:3e:ed:7d:8e", "network": {"id": "381cad9f-376a-4335-95a4-4824aa0d7fad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1035058856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ec082e08ddf4477a721e410fe944d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f320dfe-59", "ovs_interfaceid": "2f320dfe-5946-496e-81e8-922587cc240b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:23:23 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-8c85bf16-4851-4679-a687-88416a33bfb0 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Converting VIF {"id": "2f320dfe-5946-496e-81e8-922587cc240b", "address": "fa:16:3e:ed:7d:8e", "network": {"id": "381cad9f-376a-4335-95a4-4824aa0d7fad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1035058856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ec082e08ddf4477a721e410fe944d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f320dfe-59", "ovs_interfaceid": "2f320dfe-5946-496e-81e8-922587cc240b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:23:23 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-8c85bf16-4851-4679-a687-88416a33bfb0 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:7d:8e,bridge_name='br-int',has_traffic_filtering=True,id=2f320dfe-5946-496e-81e8-922587cc240b,network=Network(381cad9f-376a-4335-95a4-4824aa0d7fad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f320dfe-59') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:23:23 user nova-compute[74840]: DEBUG os_vif [None req-8c85bf16-4851-4679-a687-88416a33bfb0 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:7d:8e,bridge_name='br-int',has_traffic_filtering=True,id=2f320dfe-5946-496e-81e8-922587cc240b,network=Network(381cad9f-376a-4335-95a4-4824aa0d7fad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f320dfe-59') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:23:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f320dfe-59, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:23:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:23:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a574c0c9-1349-4c2b-8804-8660dede5bb0) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:23:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:23:23 user nova-compute[74840]: INFO os_vif [None req-8c85bf16-4851-4679-a687-88416a33bfb0 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:7d:8e,bridge_name='br-int',has_traffic_filtering=True,id=2f320dfe-5946-496e-81e8-922587cc240b,network=Network(381cad9f-376a-4335-95a4-4824aa0d7fad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f320dfe-59')
Nov 08 12:23:23 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-8c85bf16-4851-4679-a687-88416a33bfb0 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Deleting instance files /opt/stack/data/nova/instances/4f6c75c0-e820-47eb-be3e-51179b6df1a3_del
Nov 08 12:23:23 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-8c85bf16-4851-4679-a687-88416a33bfb0 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Deletion of /opt/stack/data/nova/instances/4f6c75c0-e820-47eb-be3e-51179b6df1a3_del complete
Nov 08 12:23:23 user nova-compute[74840]: INFO nova.compute.manager [None req-8c85bf16-4851-4679-a687-88416a33bfb0 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 08 12:23:23 user nova-compute[74840]: DEBUG oslo.service.loopingcall [None req-8c85bf16-4851-4679-a687-88416a33bfb0 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74840) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 12:23:23 user nova-compute[74840]: DEBUG nova.compute.manager [-] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Deallocating network for instance {{(pid=74840) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 12:23:23 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] deallocate_for_instance() {{(pid=74840) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 12:23:24 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:23:24 user nova-compute[74840]: INFO nova.compute.manager [-] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Took 1.14 seconds to deallocate network for instance.
Nov 08 12:23:24 user nova-compute[74840]: DEBUG nova.compute.manager [req-a61c5ee6-040a-43f4-a1d2-9f6a47651509 req-26100f54-681d-4299-a0aa-d5a4cca03842 service nova] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Received event network-vif-deleted-2f320dfe-5946-496e-81e8-922587cc240b {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:23:24 user nova-compute[74840]: INFO nova.compute.manager [req-a61c5ee6-040a-43f4-a1d2-9f6a47651509 req-26100f54-681d-4299-a0aa-d5a4cca03842 service nova] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Neutron deleted interface 2f320dfe-5946-496e-81e8-922587cc240b; detaching it from the instance and deleting it from the info cache
Nov 08 12:23:24 user nova-compute[74840]: DEBUG nova.network.neutron [req-a61c5ee6-040a-43f4-a1d2-9f6a47651509 req-26100f54-681d-4299-a0aa-d5a4cca03842 service nova] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:23:24 user nova-compute[74840]: DEBUG nova.compute.manager [req-a61c5ee6-040a-43f4-a1d2-9f6a47651509 req-26100f54-681d-4299-a0aa-d5a4cca03842 service nova] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Detach interface failed, port_id=2f320dfe-5946-496e-81e8-922587cc240b, reason: Instance 4f6c75c0-e820-47eb-be3e-51179b6df1a3 could not be found. {{(pid=74840) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 12:23:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8c85bf16-4851-4679-a687-88416a33bfb0 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:23:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8c85bf16-4851-4679-a687-88416a33bfb0 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:23:24 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-8c85bf16-4851-4679-a687-88416a33bfb0 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:23:24 user nova-compute[74840]: DEBUG nova.compute.manager [req-4aa86bb4-2b89-44bc-99fd-dabc2f07b678 req-45e6e8a6-ea71-440f-b61d-1194f4d9f44e service nova] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Received event network-vif-plugged-2f320dfe-5946-496e-81e8-922587cc240b {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:23:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4aa86bb4-2b89-44bc-99fd-dabc2f07b678 req-45e6e8a6-ea71-440f-b61d-1194f4d9f44e service nova] Acquiring lock "4f6c75c0-e820-47eb-be3e-51179b6df1a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:23:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4aa86bb4-2b89-44bc-99fd-dabc2f07b678 req-45e6e8a6-ea71-440f-b61d-1194f4d9f44e service nova] Lock "4f6c75c0-e820-47eb-be3e-51179b6df1a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:23:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4aa86bb4-2b89-44bc-99fd-dabc2f07b678 req-45e6e8a6-ea71-440f-b61d-1194f4d9f44e service nova] Lock "4f6c75c0-e820-47eb-be3e-51179b6df1a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:23:24 user nova-compute[74840]: DEBUG nova.compute.manager [req-4aa86bb4-2b89-44bc-99fd-dabc2f07b678 req-45e6e8a6-ea71-440f-b61d-1194f4d9f44e service nova] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] No waiting events found dispatching network-vif-plugged-2f320dfe-5946-496e-81e8-922587cc240b {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:23:24 user nova-compute[74840]: WARNING nova.compute.manager [req-4aa86bb4-2b89-44bc-99fd-dabc2f07b678 req-45e6e8a6-ea71-440f-b61d-1194f4d9f44e service nova] [instance: 4f6c75c0-e820-47eb-be3e-51179b6df1a3] Received unexpected event network-vif-plugged-2f320dfe-5946-496e-81e8-922587cc240b for instance with vm_state deleted and task_state None.
Nov 08 12:23:24 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-8c85bf16-4851-4679-a687-88416a33bfb0 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:23:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8c85bf16-4851-4679-a687-88416a33bfb0 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:23:24 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-8c85bf16-4851-4679-a687-88416a33bfb0 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Deleted allocations for instance 4f6c75c0-e820-47eb-be3e-51179b6df1a3
Nov 08 12:23:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-8c85bf16-4851-4679-a687-88416a33bfb0 tempest-AttachVolumeNegativeTest-1526881991 tempest-AttachVolumeNegativeTest-1526881991-project-member] Lock "4f6c75c0-e820-47eb-be3e-51179b6df1a3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.814s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:23:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:28 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:28 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:30 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:38 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "ef956aaf-1793-44f9-b33a-7a1f22edf161" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:23:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "ef956aaf-1793-44f9-b33a-7a1f22edf161" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:23:39 user nova-compute[74840]: DEBUG nova.compute.manager [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Starting instance... {{(pid=74840) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 12:23:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:23:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:23:39 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:23:39 user nova-compute[74840]: INFO nova.compute.claims [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Claim successful on node user
Nov 08 12:23:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-85c74a6f-77c3-4412-966a-fd5134a38776 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Acquiring lock "83c035a0-880b-4170-98bc-b18cae712cfa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:23:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-85c74a6f-77c3-4412-966a-fd5134a38776 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Lock "83c035a0-880b-4170-98bc-b18cae712cfa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:23:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-85c74a6f-77c3-4412-966a-fd5134a38776 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Acquiring lock "83c035a0-880b-4170-98bc-b18cae712cfa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:23:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-85c74a6f-77c3-4412-966a-fd5134a38776 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Lock "83c035a0-880b-4170-98bc-b18cae712cfa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.003s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:23:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-85c74a6f-77c3-4412-966a-fd5134a38776 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Lock "83c035a0-880b-4170-98bc-b18cae712cfa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:23:40 user nova-compute[74840]: INFO nova.compute.manager [None req-85c74a6f-77c3-4412-966a-fd5134a38776 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Terminating instance
Nov 08 12:23:40 user nova-compute[74840]: DEBUG nova.compute.manager [None req-85c74a6f-77c3-4412-966a-fd5134a38776 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Start destroying the instance on the hypervisor. {{(pid=74840) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 12:23:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:40 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:23:40 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:23:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.769s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:23:40 user nova-compute[74840]: DEBUG nova.compute.manager [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Start building networks asynchronously for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 12:23:40 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 12:23:40 user nova-compute[74840]: DEBUG nova.compute.manager [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Allocating IP information in the background. {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 12:23:40 user nova-compute[74840]: DEBUG nova.network.neutron [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 12:23:40 user nova-compute[74840]: DEBUG nova.compute.manager [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Start building block device mappings for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 12:23:40 user nova-compute[74840]: INFO nova.virt.block_device [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Booting with volume snapshot 728afd4b-fc16-423e-ad5b-5f4b54024f7e at /dev/vda
Nov 08 12:23:40 user nova-compute[74840]: DEBUG nova.policy [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '794c0281e1bf48f79117efdc3907e661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1250106b55ae44b0b303849df7781ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 12:23:41 user nova-compute[74840]: DEBUG nova.compute.manager [req-ec8c33e9-541c-4076-a8f3-832580249627 req-dc545c36-473b-4931-9865-16a3aa4841a2 service nova] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Received event network-vif-unplugged-75ded381-268f-487c-bf3b-1aad4d3909ae {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:23:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-ec8c33e9-541c-4076-a8f3-832580249627 req-dc545c36-473b-4931-9865-16a3aa4841a2 service nova] Acquiring lock "83c035a0-880b-4170-98bc-b18cae712cfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:23:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-ec8c33e9-541c-4076-a8f3-832580249627 req-dc545c36-473b-4931-9865-16a3aa4841a2 service nova] Lock "83c035a0-880b-4170-98bc-b18cae712cfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:23:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-ec8c33e9-541c-4076-a8f3-832580249627 req-dc545c36-473b-4931-9865-16a3aa4841a2 service nova] Lock "83c035a0-880b-4170-98bc-b18cae712cfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:23:41 user nova-compute[74840]: DEBUG nova.compute.manager [req-ec8c33e9-541c-4076-a8f3-832580249627 req-dc545c36-473b-4931-9865-16a3aa4841a2 service nova] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] No waiting events found dispatching network-vif-unplugged-75ded381-268f-487c-bf3b-1aad4d3909ae {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:23:41 user nova-compute[74840]: DEBUG nova.compute.manager [req-ec8c33e9-541c-4076-a8f3-832580249627 req-dc545c36-473b-4931-9865-16a3aa4841a2 service nova] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Received event network-vif-unplugged-75ded381-268f-487c-bf3b-1aad4d3909ae for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:23:41 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Instance destroyed successfully.
Nov 08 12:23:41 user nova-compute[74840]: DEBUG nova.objects.instance [None req-85c74a6f-77c3-4412-966a-fd5134a38776 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Lazy-loading 'resources' on Instance uuid 83c035a0-880b-4170-98bc-b18cae712cfa {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:23:41 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-85c74a6f-77c3-4412-966a-fd5134a38776 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T12:19:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1248482414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1248482414',id=22,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE08F5Vdqafx8ionT0o99nYONzOMoa/3pOusA/wlvX3fSXRcA+RhI/2hy/w+tkl5A+C6lKye9AkVRPFr99hJwoo+GJvdV7gC/UTzKzbtU6DDZO8zP9SCuNQkk2JKp43yVA==',key_name='tempest-keypair-1343265406',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:20:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c8bdf3f4296441799bd44bd993d3111',ramdisk_id='',reservation_id='r-wyshdnxz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-807651925',owner_user_name='tempest-TaggedAttachmentsTest-807651925-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:20:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe87f6d61cea4243a123420baf15279a',uuid=83c035a0-880b-4170-98bc-b18cae712cfa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75ded381-268f-487c-bf3b-1aad4d3909ae", "address": "fa:16:3e:56:38:57", "network": {"id": "22514061-e390-4fd9-943b-0dedf57a323e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1978465085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c8bdf3f4296441799bd44bd993d3111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75ded381-26", "ovs_interfaceid": "75ded381-268f-487c-bf3b-1aad4d3909ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:23:41 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-85c74a6f-77c3-4412-966a-fd5134a38776 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Converting VIF {"id": "75ded381-268f-487c-bf3b-1aad4d3909ae", "address": "fa:16:3e:56:38:57", "network": {"id": "22514061-e390-4fd9-943b-0dedf57a323e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1978465085-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c8bdf3f4296441799bd44bd993d3111", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75ded381-26", "ovs_interfaceid": "75ded381-268f-487c-bf3b-1aad4d3909ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:23:41 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-85c74a6f-77c3-4412-966a-fd5134a38776 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:38:57,bridge_name='br-int',has_traffic_filtering=True,id=75ded381-268f-487c-bf3b-1aad4d3909ae,network=Network(22514061-e390-4fd9-943b-0dedf57a323e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75ded381-26') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:23:41 user nova-compute[74840]: DEBUG os_vif [None req-85c74a6f-77c3-4412-966a-fd5134a38776 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:38:57,bridge_name='br-int',has_traffic_filtering=True,id=75ded381-268f-487c-bf3b-1aad4d3909ae,network=Network(22514061-e390-4fd9-943b-0dedf57a323e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75ded381-26') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:23:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap75ded381-26, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:23:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:23:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6135742f-609c-46c8-9cb9-176fc3574890) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:23:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:41 user nova-compute[74840]: INFO os_vif [None req-85c74a6f-77c3-4412-966a-fd5134a38776 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:38:57,bridge_name='br-int',has_traffic_filtering=True,id=75ded381-268f-487c-bf3b-1aad4d3909ae,network=Network(22514061-e390-4fd9-943b-0dedf57a323e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75ded381-26')
Nov 08 12:23:41 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-85c74a6f-77c3-4412-966a-fd5134a38776 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Deleting instance files /opt/stack/data/nova/instances/83c035a0-880b-4170-98bc-b18cae712cfa_del
Nov 08 12:23:41 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-85c74a6f-77c3-4412-966a-fd5134a38776 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Deletion of /opt/stack/data/nova/instances/83c035a0-880b-4170-98bc-b18cae712cfa_del complete
Nov 08 12:23:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:41 user nova-compute[74840]: INFO nova.compute.manager [None req-85c74a6f-77c3-4412-966a-fd5134a38776 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 08 12:23:41 user nova-compute[74840]: DEBUG oslo.service.loopingcall [None req-85c74a6f-77c3-4412-966a-fd5134a38776 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74840) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 12:23:41 user nova-compute[74840]: DEBUG nova.compute.manager [-] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Deallocating network for instance {{(pid=74840) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 12:23:41 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] deallocate_for_instance() {{(pid=74840) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 12:23:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Acquiring lock "ff4622ff-b81c-40d3-92bf-bc30ef64b68f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:23:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Lock "ff4622ff-b81c-40d3-92bf-bc30ef64b68f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:23:41 user nova-compute[74840]: DEBUG nova.compute.manager [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Starting instance... {{(pid=74840) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 12:23:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:23:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:23:41 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:23:41 user nova-compute[74840]: INFO nova.compute.claims [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Claim successful on node user
Nov 08 12:23:42 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:23:42 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:23:42 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.739s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:23:42 user nova-compute[74840]: DEBUG nova.compute.manager [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Start building networks asynchronously for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 12:23:42 user nova-compute[74840]: DEBUG nova.compute.manager [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Allocating IP information in the background. {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 12:23:42 user nova-compute[74840]: DEBUG nova.network.neutron [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 12:23:42 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 12:23:42 user nova-compute[74840]: DEBUG nova.network.neutron [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Successfully created port: 7e99639a-a260-4090-b429-69c9b64861aa {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:23:42 user nova-compute[74840]: DEBUG nova.compute.manager [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Start building block device mappings for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 12:23:42 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:23:42 user nova-compute[74840]: INFO nova.compute.manager [-] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Took 1.22 seconds to deallocate network for instance.
Nov 08 12:23:42 user nova-compute[74840]: DEBUG nova.policy [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '082576ea38994b598fcdf92ade6f74b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18af32d3c92b465c92fddfee58d8ee19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 12:23:42 user nova-compute[74840]: DEBUG nova.compute.manager [req-3b05cc7b-df2e-4010-a45a-0df4999556f2 req-930ce177-8155-4800-ae3b-2b0092a47b9b service nova] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Received event network-vif-deleted-75ded381-268f-487c-bf3b-1aad4d3909ae {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:23:42 user nova-compute[74840]: DEBUG nova.compute.manager [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Start spawning the instance on the hypervisor. {{(pid=74840) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 12:23:42 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:23:42 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Creating image(s)
Nov 08 12:23:42 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Acquiring lock "/opt/stack/data/nova/instances/ff4622ff-b81c-40d3-92bf-bc30ef64b68f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:23:42 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Lock "/opt/stack/data/nova/instances/ff4622ff-b81c-40d3-92bf-bc30ef64b68f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:23:42 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Lock "/opt/stack/data/nova/instances/ff4622ff-b81c-40d3-92bf-bc30ef64b68f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:23:42 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:23:42 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-85c74a6f-77c3-4412-966a-fd5134a38776 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:23:42 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-85c74a6f-77c3-4412-966a-fd5134a38776 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:23:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.240s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:23:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Acquiring lock "5d26578eba85497f494c575690c4248f381a0fe6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:23:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:23:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:23:43 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-85c74a6f-77c3-4412-966a-fd5134a38776 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:23:43 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-85c74a6f-77c3-4412-966a-fd5134a38776 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:23:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.237s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:23:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/ff4622ff-b81c-40d3-92bf-bc30ef64b68f/disk 1073741824 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:23:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-85c74a6f-77c3-4412-966a-fd5134a38776 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.487s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:23:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/ff4622ff-b81c-40d3-92bf-bc30ef64b68f/disk 1073741824" returned: 0 in 0.075s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:23:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.320s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:23:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:23:43 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-85c74a6f-77c3-4412-966a-fd5134a38776 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Deleted allocations for instance 83c035a0-880b-4170-98bc-b18cae712cfa
Nov 08 12:23:43 user nova-compute[74840]: DEBUG nova.compute.manager [req-f6bf1bce-e8cc-4dab-b8d0-38f0a8b7ebe4 req-0971ecfd-f349-460a-825e-7771a4a7cf46 service nova] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Received event network-vif-plugged-75ded381-268f-487c-bf3b-1aad4d3909ae {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:23:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-f6bf1bce-e8cc-4dab-b8d0-38f0a8b7ebe4 req-0971ecfd-f349-460a-825e-7771a4a7cf46 service nova] Acquiring lock "83c035a0-880b-4170-98bc-b18cae712cfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:23:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-f6bf1bce-e8cc-4dab-b8d0-38f0a8b7ebe4 req-0971ecfd-f349-460a-825e-7771a4a7cf46 service nova] Lock "83c035a0-880b-4170-98bc-b18cae712cfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:23:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-f6bf1bce-e8cc-4dab-b8d0-38f0a8b7ebe4 req-0971ecfd-f349-460a-825e-7771a4a7cf46 service nova] Lock "83c035a0-880b-4170-98bc-b18cae712cfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:23:43 user nova-compute[74840]: DEBUG nova.compute.manager [req-f6bf1bce-e8cc-4dab-b8d0-38f0a8b7ebe4 req-0971ecfd-f349-460a-825e-7771a4a7cf46 service nova] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] No waiting events found dispatching network-vif-plugged-75ded381-268f-487c-bf3b-1aad4d3909ae {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:23:43 user nova-compute[74840]: WARNING nova.compute.manager [req-f6bf1bce-e8cc-4dab-b8d0-38f0a8b7ebe4 req-0971ecfd-f349-460a-825e-7771a4a7cf46 service nova] [instance: 83c035a0-880b-4170-98bc-b18cae712cfa] Received unexpected event network-vif-plugged-75ded381-268f-487c-bf3b-1aad4d3909ae for instance with vm_state deleted and task_state None.
Nov 08 12:23:43 user nova-compute[74840]: DEBUG nova.network.neutron [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Successfully updated port: 7e99639a-a260-4090-b429-69c9b64861aa {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:23:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "refresh_cache-ef956aaf-1793-44f9-b33a-7a1f22edf161" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:23:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquired lock "refresh_cache-ef956aaf-1793-44f9-b33a-7a1f22edf161" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:23:43 user nova-compute[74840]: DEBUG nova.network.neutron [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:23:43 user nova-compute[74840]: DEBUG nova.compute.manager [req-c8707c5b-da54-43f7-a5de-feae0640c449 req-9c64e232-f3c1-4438-994f-12f0fcbfc1ec service nova] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Received event network-changed-7e99639a-a260-4090-b429-69c9b64861aa {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:23:43 user nova-compute[74840]: DEBUG nova.compute.manager [req-c8707c5b-da54-43f7-a5de-feae0640c449 req-9c64e232-f3c1-4438-994f-12f0fcbfc1ec service nova] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Refreshing instance network info cache due to event network-changed-7e99639a-a260-4090-b429-69c9b64861aa. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:23:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-c8707c5b-da54-43f7-a5de-feae0640c449 req-9c64e232-f3c1-4438-994f-12f0fcbfc1ec service nova] Acquiring lock "refresh_cache-ef956aaf-1793-44f9-b33a-7a1f22edf161" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:23:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-85c74a6f-77c3-4412-966a-fd5134a38776 tempest-TaggedAttachmentsTest-807651925 tempest-TaggedAttachmentsTest-807651925-project-member] Lock "83c035a0-880b-4170-98bc-b18cae712cfa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.335s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:23:43 user nova-compute[74840]: DEBUG nova.network.neutron [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:23:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.244s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:23:43 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ff4622ff-b81c-40d3-92bf-bc30ef64b68f/disk. size=1073741824 {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 12:23:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4622ff-b81c-40d3-92bf-bc30ef64b68f/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:23:43 user nova-compute[74840]: DEBUG nova.network.neutron [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Successfully created port: c831f5ef-f115-4a26-9a02-227681561d9c {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:23:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4622ff-b81c-40d3-92bf-bc30ef64b68f/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:23:43 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Cannot resize image /opt/stack/data/nova/instances/ff4622ff-b81c-40d3-92bf-bc30ef64b68f/disk to a smaller size. {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 12:23:43 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Created local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 12:23:43 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Ensure instance console log exists: /opt/stack/data/nova/instances/ff4622ff-b81c-40d3-92bf-bc30ef64b68f/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:23:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:23:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:23:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:23:44 user nova-compute[74840]: DEBUG nova.network.neutron [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Updating instance_info_cache with network_info: [{"id": "7e99639a-a260-4090-b429-69c9b64861aa", "address": "fa:16:3e:bc:1e:ce", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e99639a-a2", "ovs_interfaceid": "7e99639a-a260-4090-b429-69c9b64861aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:23:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Releasing lock "refresh_cache-ef956aaf-1793-44f9-b33a-7a1f22edf161" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:23:44 user nova-compute[74840]: DEBUG nova.compute.manager [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Instance network_info: |[{"id": "7e99639a-a260-4090-b429-69c9b64861aa", "address": "fa:16:3e:bc:1e:ce", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e99639a-a2", "ovs_interfaceid": "7e99639a-a260-4090-b429-69c9b64861aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 12:23:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-c8707c5b-da54-43f7-a5de-feae0640c449 req-9c64e232-f3c1-4438-994f-12f0fcbfc1ec service nova] Acquired lock "refresh_cache-ef956aaf-1793-44f9-b33a-7a1f22edf161" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:23:44 user nova-compute[74840]: DEBUG nova.network.neutron [req-c8707c5b-da54-43f7-a5de-feae0640c449 req-9c64e232-f3c1-4438-994f-12f0fcbfc1ec service nova] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Refreshing network info cache for port 7e99639a-a260-4090-b429-69c9b64861aa {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:23:44 user nova-compute[74840]: DEBUG nova.network.neutron [req-c8707c5b-da54-43f7-a5de-feae0640c449 req-9c64e232-f3c1-4438-994f-12f0fcbfc1ec service nova] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Updated VIF entry in instance network info cache for port 7e99639a-a260-4090-b429-69c9b64861aa. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:23:44 user nova-compute[74840]: DEBUG nova.network.neutron [req-c8707c5b-da54-43f7-a5de-feae0640c449 req-9c64e232-f3c1-4438-994f-12f0fcbfc1ec service nova] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Updating instance_info_cache with network_info: [{"id": "7e99639a-a260-4090-b429-69c9b64861aa", "address": "fa:16:3e:bc:1e:ce", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e99639a-a2", "ovs_interfaceid": "7e99639a-a260-4090-b429-69c9b64861aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:23:44 user nova-compute[74840]: DEBUG nova.network.neutron [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Successfully updated port: c831f5ef-f115-4a26-9a02-227681561d9c {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:23:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-c8707c5b-da54-43f7-a5de-feae0640c449 req-9c64e232-f3c1-4438-994f-12f0fcbfc1ec service nova] Releasing lock "refresh_cache-ef956aaf-1793-44f9-b33a-7a1f22edf161" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:23:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Acquiring lock "refresh_cache-ff4622ff-b81c-40d3-92bf-bc30ef64b68f" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:23:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Acquired lock "refresh_cache-ff4622ff-b81c-40d3-92bf-bc30ef64b68f" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:23:44 user nova-compute[74840]: DEBUG nova.network.neutron [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:23:44 user nova-compute[74840]: DEBUG nova.network.neutron [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:23:45 user nova-compute[74840]: DEBUG nova.network.neutron [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Updating instance_info_cache with network_info: [{"id": "c831f5ef-f115-4a26-9a02-227681561d9c", "address": "fa:16:3e:dd:bf:19", "network": {"id": "e4de6ccf-60cb-4306-9865-a99d9d732446", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1640752753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18af32d3c92b465c92fddfee58d8ee19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc831f5ef-f1", "ovs_interfaceid": "c831f5ef-f115-4a26-9a02-227681561d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:23:45 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Releasing lock "refresh_cache-ff4622ff-b81c-40d3-92bf-bc30ef64b68f" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:23:45 user nova-compute[74840]: DEBUG nova.compute.manager [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Instance network_info: |[{"id": "c831f5ef-f115-4a26-9a02-227681561d9c", "address": "fa:16:3e:dd:bf:19", "network": {"id": "e4de6ccf-60cb-4306-9865-a99d9d732446", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1640752753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18af32d3c92b465c92fddfee58d8ee19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc831f5ef-f1", "ovs_interfaceid": "c831f5ef-f115-4a26-9a02-227681561d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 12:23:45 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Start _get_guest_xml network_info=[{"id": "c831f5ef-f115-4a26-9a02-227681561d9c", "address": "fa:16:3e:dd:bf:19", "network": {"id": "e4de6ccf-60cb-4306-9865-a99d9d732446", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1640752753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18af32d3c92b465c92fddfee58d8ee19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc831f5ef-f1", "ovs_interfaceid": "c831f5ef-f115-4a26-9a02-227681561d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'image_id': '4fa17706-d304-4117-a420-dab994c703dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:23:45 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:23:45 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:23:45 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:23:45 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:23:45 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:23:45 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:23:45 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:23:45 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:23:45 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:23:45 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:23:45 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:23:45 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:23:45 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:23:45 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:23:45 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:23:45 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:23:45 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:23:45 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:23:45 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:23:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1376701806',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1376701806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1376701',id=29,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGuNvvsEcRS49FUuutpKYu50zKliY9VVUoxzE+rpro9yRGfnXKXdSCNm1+eOZCf3J6FyWUi0TSDym3JOLZEi8O2Y9QeGw0Qi/7LTHEekE3YdIkryF8xwRXq886LYHLTCA==',key_name='tempest-keypair-1593576063',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18af32d3c92b465c92fddfee58d8ee19',ramdisk_id='',reservation_id='r-s9pp30n2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-795706254',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:23:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='082576ea38994b598fcdf92ade6f74b7',uuid=ff4622ff-b81c-40d3-92bf-bc30ef64b68f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c831f5ef-f115-4a26-9a02-227681561d9c", "address": "fa:16:3e:dd:bf:19", "network": {"id": "e4de6ccf-60cb-4306-9865-a99d9d732446", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1640752753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18af32d3c92b465c92fddfee58d8ee19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc831f5ef-f1", "ovs_interfaceid": "c831f5ef-f115-4a26-9a02-227681561d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:23:45 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Converting VIF {"id": "c831f5ef-f115-4a26-9a02-227681561d9c", "address": "fa:16:3e:dd:bf:19", "network": {"id": "e4de6ccf-60cb-4306-9865-a99d9d732446", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1640752753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18af32d3c92b465c92fddfee58d8ee19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc831f5ef-f1", "ovs_interfaceid": "c831f5ef-f115-4a26-9a02-227681561d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:23:45 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:bf:19,bridge_name='br-int',has_traffic_filtering=True,id=c831f5ef-f115-4a26-9a02-227681561d9c,network=Network(e4de6ccf-60cb-4306-9865-a99d9d732446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc831f5ef-f1') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:23:45 user nova-compute[74840]: DEBUG nova.objects.instance [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Lazy-loading 'pci_devices' on Instance uuid ff4622ff-b81c-40d3-92bf-bc30ef64b68f {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:23:45 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:23:45 user nova-compute[74840]:   <uuid>ff4622ff-b81c-40d3-92bf-bc30ef64b68f</uuid>
Nov 08 12:23:45 user nova-compute[74840]:   <name>instance-0000001d</name>
Nov 08 12:23:45 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:23:45 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:23:45 user nova-compute[74840]:   <metadata>
Nov 08 12:23:45 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:23:45 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:23:45 user nova-compute[74840]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1376701806</nova:name>
Nov 08 12:23:45 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:23:45</nova:creationTime>
Nov 08 12:23:45 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:23:45 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:23:45 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:23:45 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:23:45 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:23:45 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:23:45 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:23:45 user nova-compute[74840]:       <nova:owner>
Nov 08 12:23:45 user nova-compute[74840]:         <nova:user uuid="082576ea38994b598fcdf92ade6f74b7">tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member</nova:user>
Nov 08 12:23:45 user nova-compute[74840]:         <nova:project uuid="18af32d3c92b465c92fddfee58d8ee19">tempest-TestServerVolumeAttachScenarioOldVersion-795706254</nova:project>
Nov 08 12:23:45 user nova-compute[74840]:       </nova:owner>
Nov 08 12:23:45 user nova-compute[74840]:       <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:23:45 user nova-compute[74840]:       <nova:ports>
Nov 08 12:23:45 user nova-compute[74840]:         <nova:port uuid="c831f5ef-f115-4a26-9a02-227681561d9c">
Nov 08 12:23:45 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 12:23:45 user nova-compute[74840]:         </nova:port>
Nov 08 12:23:45 user nova-compute[74840]:       </nova:ports>
Nov 08 12:23:45 user nova-compute[74840]:     </nova:instance>
Nov 08 12:23:45 user nova-compute[74840]:   </metadata>
Nov 08 12:23:45 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:23:45 user nova-compute[74840]:     <system>
Nov 08 12:23:45 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:23:45 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:23:45 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:23:45 user nova-compute[74840]:       <entry name="serial">ff4622ff-b81c-40d3-92bf-bc30ef64b68f</entry>
Nov 08 12:23:45 user nova-compute[74840]:       <entry name="uuid">ff4622ff-b81c-40d3-92bf-bc30ef64b68f</entry>
Nov 08 12:23:45 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:23:45 user nova-compute[74840]:     </system>
Nov 08 12:23:45 user nova-compute[74840]:   </sysinfo>
Nov 08 12:23:45 user nova-compute[74840]:   <os>
Nov 08 12:23:45 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:23:45 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:23:45 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:23:45 user nova-compute[74840]:   </os>
Nov 08 12:23:45 user nova-compute[74840]:   <features>
Nov 08 12:23:45 user nova-compute[74840]:     <acpi/>
Nov 08 12:23:45 user nova-compute[74840]:     <apic/>
Nov 08 12:23:45 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:23:45 user nova-compute[74840]:   </features>
Nov 08 12:23:45 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:23:45 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:23:45 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:23:45 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:23:45 user nova-compute[74840]:   </clock>
Nov 08 12:23:45 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:23:45 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:23:45 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:23:45 user nova-compute[74840]:   </cpu>
Nov 08 12:23:45 user nova-compute[74840]:   <devices>
Nov 08 12:23:45 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:23:45 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:23:45 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/ff4622ff-b81c-40d3-92bf-bc30ef64b68f/disk"/>
Nov 08 12:23:45 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:23:45 user nova-compute[74840]:     </disk>
Nov 08 12:23:45 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:23:45 user nova-compute[74840]:       <mac address="fa:16:3e:dd:bf:19"/>
Nov 08 12:23:45 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:23:45 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:23:45 user nova-compute[74840]:       <target dev="tapc831f5ef-f1"/>
Nov 08 12:23:45 user nova-compute[74840]:     </interface>
Nov 08 12:23:45 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:23:45 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/ff4622ff-b81c-40d3-92bf-bc30ef64b68f/console.log" append="off"/>
Nov 08 12:23:45 user nova-compute[74840]:     </serial>
Nov 08 12:23:45 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:23:45 user nova-compute[74840]:     <video>
Nov 08 12:23:45 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:23:45 user nova-compute[74840]:     </video>
Nov 08 12:23:45 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:23:45 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:23:45 user nova-compute[74840]:     </rng>
Nov 08 12:23:45 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:23:45 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:23:45 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:23:45 user nova-compute[74840]:     </memballoon>
Nov 08 12:23:45 user nova-compute[74840]:   </devices>
Nov 08 12:23:45 user nova-compute[74840]: </domain>
Nov 08 12:23:45 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:23:45 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:23:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1376701806',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1376701806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1376701',id=29,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGuNvvsEcRS49FUuutpKYu50zKliY9VVUoxzE+rpro9yRGfnXKXdSCNm1+eOZCf3J6FyWUi0TSDym3JOLZEi8O2Y9QeGw0Qi/7LTHEekE3YdIkryF8xwRXq886LYHLTCA==',key_name='tempest-keypair-1593576063',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18af32d3c92b465c92fddfee58d8ee19',ramdisk_id='',reservation_id='r-s9pp30n2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-795706254',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:23:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='082576ea38994b598fcdf92ade6f74b7',uuid=ff4622ff-b81c-40d3-92bf-bc30ef64b68f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c831f5ef-f115-4a26-9a02-227681561d9c", "address": "fa:16:3e:dd:bf:19", "network": {"id": "e4de6ccf-60cb-4306-9865-a99d9d732446", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1640752753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18af32d3c92b465c92fddfee58d8ee19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc831f5ef-f1", "ovs_interfaceid": "c831f5ef-f115-4a26-9a02-227681561d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:23:45 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Converting VIF {"id": "c831f5ef-f115-4a26-9a02-227681561d9c", "address": "fa:16:3e:dd:bf:19", "network": {"id": "e4de6ccf-60cb-4306-9865-a99d9d732446", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1640752753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18af32d3c92b465c92fddfee58d8ee19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc831f5ef-f1", "ovs_interfaceid": "c831f5ef-f115-4a26-9a02-227681561d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:23:45 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:bf:19,bridge_name='br-int',has_traffic_filtering=True,id=c831f5ef-f115-4a26-9a02-227681561d9c,network=Network(e4de6ccf-60cb-4306-9865-a99d9d732446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc831f5ef-f1') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:23:45 user nova-compute[74840]: DEBUG os_vif [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:bf:19,bridge_name='br-int',has_traffic_filtering=True,id=c831f5ef-f115-4a26-9a02-227681561d9c,network=Network(e4de6ccf-60cb-4306-9865-a99d9d732446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc831f5ef-f1') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:23:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:23:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:23:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '31dfe2f8-c68d-53ea-8d0e-12f61a02caf3', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:23:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:23:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc831f5ef-f1, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:23:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc831f5ef-f1, col_values=(('qos', UUID('cb373d5c-2f8d-4153-be3d-ff7f59056170')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:23:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc831f5ef-f1, col_values=(('external_ids', {'iface-id': 'c831f5ef-f115-4a26-9a02-227681561d9c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:bf:19', 'vm-uuid': 'ff4622ff-b81c-40d3-92bf-bc30ef64b68f'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:23:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:23:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:45 user nova-compute[74840]: INFO os_vif [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:bf:19,bridge_name='br-int',has_traffic_filtering=True,id=c831f5ef-f115-4a26-9a02-227681561d9c,network=Network(e4de6ccf-60cb-4306-9865-a99d9d732446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc831f5ef-f1')
Nov 08 12:23:45 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:23:45 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] No VIF found with MAC fa:16:3e:dd:bf:19, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:23:45 user nova-compute[74840]: DEBUG nova.compute.manager [req-cfd78c13-731b-41b6-babb-f842c5aac8ea req-b4167282-edf9-471a-ab32-23d028d85804 service nova] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Received event network-changed-c831f5ef-f115-4a26-9a02-227681561d9c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:23:45 user nova-compute[74840]: DEBUG nova.compute.manager [req-cfd78c13-731b-41b6-babb-f842c5aac8ea req-b4167282-edf9-471a-ab32-23d028d85804 service nova] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Refreshing instance network info cache due to event network-changed-c831f5ef-f115-4a26-9a02-227681561d9c. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:23:45 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-cfd78c13-731b-41b6-babb-f842c5aac8ea req-b4167282-edf9-471a-ab32-23d028d85804 service nova] Acquiring lock "refresh_cache-ff4622ff-b81c-40d3-92bf-bc30ef64b68f" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:23:45 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-cfd78c13-731b-41b6-babb-f842c5aac8ea req-b4167282-edf9-471a-ab32-23d028d85804 service nova] Acquired lock "refresh_cache-ff4622ff-b81c-40d3-92bf-bc30ef64b68f" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:23:45 user nova-compute[74840]: DEBUG nova.network.neutron [req-cfd78c13-731b-41b6-babb-f842c5aac8ea req-b4167282-edf9-471a-ab32-23d028d85804 service nova] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Refreshing network info cache for port c831f5ef-f115-4a26-9a02-227681561d9c {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:23:46 user nova-compute[74840]: DEBUG nova.network.neutron [req-cfd78c13-731b-41b6-babb-f842c5aac8ea req-b4167282-edf9-471a-ab32-23d028d85804 service nova] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Updated VIF entry in instance network info cache for port c831f5ef-f115-4a26-9a02-227681561d9c. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:23:46 user nova-compute[74840]: DEBUG nova.network.neutron [req-cfd78c13-731b-41b6-babb-f842c5aac8ea req-b4167282-edf9-471a-ab32-23d028d85804 service nova] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Updating instance_info_cache with network_info: [{"id": "c831f5ef-f115-4a26-9a02-227681561d9c", "address": "fa:16:3e:dd:bf:19", "network": {"id": "e4de6ccf-60cb-4306-9865-a99d9d732446", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1640752753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18af32d3c92b465c92fddfee58d8ee19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc831f5ef-f1", "ovs_interfaceid": "c831f5ef-f115-4a26-9a02-227681561d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:23:46 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-cfd78c13-731b-41b6-babb-f842c5aac8ea req-b4167282-edf9-471a-ab32-23d028d85804 service nova] Releasing lock "refresh_cache-ff4622ff-b81c-40d3-92bf-bc30ef64b68f" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:23:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:47 user nova-compute[74840]: DEBUG nova.compute.manager [req-4597c8de-2230-4db2-a91d-8b0616608aa7 req-b0674f3b-d2d4-4b3c-af76-34a21c3a9db8 service nova] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Received event network-vif-plugged-c831f5ef-f115-4a26-9a02-227681561d9c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:23:47 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4597c8de-2230-4db2-a91d-8b0616608aa7 req-b0674f3b-d2d4-4b3c-af76-34a21c3a9db8 service nova] Acquiring lock "ff4622ff-b81c-40d3-92bf-bc30ef64b68f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:23:47 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4597c8de-2230-4db2-a91d-8b0616608aa7 req-b0674f3b-d2d4-4b3c-af76-34a21c3a9db8 service nova] Lock "ff4622ff-b81c-40d3-92bf-bc30ef64b68f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:23:47 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4597c8de-2230-4db2-a91d-8b0616608aa7 req-b0674f3b-d2d4-4b3c-af76-34a21c3a9db8 service nova] Lock "ff4622ff-b81c-40d3-92bf-bc30ef64b68f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:23:47 user nova-compute[74840]: DEBUG nova.compute.manager [req-4597c8de-2230-4db2-a91d-8b0616608aa7 req-b0674f3b-d2d4-4b3c-af76-34a21c3a9db8 service nova] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] No waiting events found dispatching network-vif-plugged-c831f5ef-f115-4a26-9a02-227681561d9c {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:23:47 user nova-compute[74840]: WARNING nova.compute.manager [req-4597c8de-2230-4db2-a91d-8b0616608aa7 req-b0674f3b-d2d4-4b3c-af76-34a21c3a9db8 service nova] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Received unexpected event network-vif-plugged-c831f5ef-f115-4a26-9a02-227681561d9c for instance with vm_state building and task_state spawning.
Nov 08 12:23:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:49 user nova-compute[74840]: DEBUG nova.compute.manager [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:23:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:23:49 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Instance spawned successfully.
Nov 08 12:23:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:23:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Found default for hw_cdrom_bus of ide {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:23:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Found default for hw_disk_bus of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:23:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:23:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:23:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Found default for hw_video_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:23:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Found default for hw_vif_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:23:49 user nova-compute[74840]: DEBUG nova.compute.manager [req-e545b40f-2464-4c07-832e-ed62390086df req-62647220-1bf3-4a2c-80f2-dc8fd986d485 service nova] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Received event network-vif-plugged-c831f5ef-f115-4a26-9a02-227681561d9c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:23:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e545b40f-2464-4c07-832e-ed62390086df req-62647220-1bf3-4a2c-80f2-dc8fd986d485 service nova] Acquiring lock "ff4622ff-b81c-40d3-92bf-bc30ef64b68f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:23:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e545b40f-2464-4c07-832e-ed62390086df req-62647220-1bf3-4a2c-80f2-dc8fd986d485 service nova] Lock "ff4622ff-b81c-40d3-92bf-bc30ef64b68f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:23:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e545b40f-2464-4c07-832e-ed62390086df req-62647220-1bf3-4a2c-80f2-dc8fd986d485 service nova] Lock "ff4622ff-b81c-40d3-92bf-bc30ef64b68f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:23:49 user nova-compute[74840]: DEBUG nova.compute.manager [req-e545b40f-2464-4c07-832e-ed62390086df req-62647220-1bf3-4a2c-80f2-dc8fd986d485 service nova] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] No waiting events found dispatching network-vif-plugged-c831f5ef-f115-4a26-9a02-227681561d9c {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:23:49 user nova-compute[74840]: WARNING nova.compute.manager [req-e545b40f-2464-4c07-832e-ed62390086df req-62647220-1bf3-4a2c-80f2-dc8fd986d485 service nova] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Received unexpected event network-vif-plugged-c831f5ef-f115-4a26-9a02-227681561d9c for instance with vm_state building and task_state spawning.
Nov 08 12:23:49 user nova-compute[74840]: INFO nova.compute.manager [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Took 6.61 seconds to spawn the instance on the hypervisor.
Nov 08 12:23:49 user nova-compute[74840]: DEBUG nova.compute.manager [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:23:49 user nova-compute[74840]: INFO nova.compute.manager [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Took 7.85 seconds to build instance.
Nov 08 12:23:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1a23f88f-0b9e-4cdd-b279-306b50ae293b tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Lock "ff4622ff-b81c-40d3-92bf-bc30ef64b68f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.971s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:23:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:51 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:51 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Acquiring lock "e6ea2c9a-81d4-4933-bff3-406aedd79031" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:23:51 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "e6ea2c9a-81d4-4933-bff3-406aedd79031" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:23:51 user nova-compute[74840]: DEBUG nova.compute.manager [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Starting instance... {{(pid=74840) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 12:23:51 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:23:51 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:23:51 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:23:51 user nova-compute[74840]: INFO nova.compute.claims [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Claim successful on node user
Nov 08 12:23:52 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:23:52 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:23:52 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.541s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:23:52 user nova-compute[74840]: DEBUG nova.compute.manager [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Start building networks asynchronously for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 12:23:52 user nova-compute[74840]: DEBUG nova.compute.manager [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Allocating IP information in the background. {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 12:23:52 user nova-compute[74840]: DEBUG nova.network.neutron [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 12:23:52 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 12:23:52 user nova-compute[74840]: DEBUG os_brick.utils [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:23:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:23:52 user nova-compute[74840]: DEBUG nova.compute.manager [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Start building block device mappings for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 12:23:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:23:52 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[86bd3d1e-0fd2-4b02-81cf-965cc5081c44]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c8228a11e03c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:23:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:23:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.028s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:23:52 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d1f869-3e3c-4e4d-a7e6-15f1660b0fd4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:23:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:23:52 user nova-compute[74840]: DEBUG nova.policy [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b5a96f2e0a304f278120312edb71d7ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a082f8090094f009393593fb26b445b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 12:23:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:23:52 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c71dfcd-3885-4a18-9853-ae5edb184362]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:23:52 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[383f7799-29a7-4686-9a25-ad3bee4e6f52]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:23:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Running cmd (subprocess): nvme version {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:23:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] 'nvme version' failed. Not Retrying. {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:23:52 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] nvme not present on system {{(pid=74840) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 12:23:52 user nova-compute[74840]: DEBUG nova.compute.manager [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Start spawning the instance on the hypervisor. {{(pid=74840) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 12:23:52 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:23:52 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Creating image(s)
Nov 08 12:23:52 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Acquiring lock "/opt/stack/data/nova/instances/e6ea2c9a-81d4-4933-bff3-406aedd79031/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:23:52 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "/opt/stack/data/nova/instances/e6ea2c9a-81d4-4933-bff3-406aedd79031/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:23:52 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "/opt/stack/data/nova/instances/e6ea2c9a-81d4-4933-bff3-406aedd79031/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:23:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:23:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:23:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:23:52 user nova-compute[74840]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 12:23:52 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a356bbb6-7567-4a85-acfc-78df280b8b6a]: (4, '') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:23:52 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:23:52 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74840) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 12:23:52 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 12:23:52 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] LIGHTOS: no hostnqn found. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 12:23:52 user nova-compute[74840]: DEBUG os_brick.utils [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] <== get_connector_properties: return (244ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c8228a11e03c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:23:52 user nova-compute[74840]: DEBUG nova.virt.block_device [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Updating existing volume attachment record: 04ef5923-e486-42e8-9b55-c2d65987984e {{(pid=74840) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 12:23:52 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:23:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.209s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:23:52 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Acquiring lock "5d26578eba85497f494c575690c4248f381a0fe6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:23:52 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:23:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:23:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.238s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:23:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/e6ea2c9a-81d4-4933-bff3-406aedd79031/disk 1073741824 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:23:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/e6ea2c9a-81d4-4933-bff3-406aedd79031/disk 1073741824" returned: 0 in 0.071s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:23:53 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.318s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:23:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:23:53 user nova-compute[74840]: DEBUG nova.network.neutron [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Successfully created port: 4f9932a0-5bfa-48bc-bd1f-5f61bf96803c {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:23:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.294s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:23:53 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e6ea2c9a-81d4-4933-bff3-406aedd79031/disk. size=1073741824 {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 12:23:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6ea2c9a-81d4-4933-bff3-406aedd79031/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:23:53 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:23:53 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:23:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6ea2c9a-81d4-4933-bff3-406aedd79031/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:23:53 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Cannot resize image /opt/stack/data/nova/instances/e6ea2c9a-81d4-4933-bff3-406aedd79031/disk to a smaller size. {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 12:23:53 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Created local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 12:23:53 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Ensure instance console log exists: /opt/stack/data/nova/instances/e6ea2c9a-81d4-4933-bff3-406aedd79031/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:23:53 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:23:53 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:23:53 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:23:53 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "refresh_cache-ffe50042-29bf-4ef3-a148-8698bc75233b" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:23:53 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquired lock "refresh_cache-ffe50042-29bf-4ef3-a148-8698bc75233b" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:23:53 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Forcefully refreshing network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 12:23:54 user nova-compute[74840]: DEBUG nova.network.neutron [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Successfully updated port: 4f9932a0-5bfa-48bc-bd1f-5f61bf96803c {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:23:54 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Acquiring lock "refresh_cache-e6ea2c9a-81d4-4933-bff3-406aedd79031" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:23:54 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Acquired lock "refresh_cache-e6ea2c9a-81d4-4933-bff3-406aedd79031" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:23:54 user nova-compute[74840]: DEBUG nova.network.neutron [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:23:54 user nova-compute[74840]: DEBUG nova.compute.manager [req-6212fbb3-9d48-448b-8393-3fd2850d5d4a req-1280eb0e-dfcb-4656-8414-282bd4b247bc service nova] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Received event network-changed-4f9932a0-5bfa-48bc-bd1f-5f61bf96803c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:23:54 user nova-compute[74840]: DEBUG nova.compute.manager [req-6212fbb3-9d48-448b-8393-3fd2850d5d4a req-1280eb0e-dfcb-4656-8414-282bd4b247bc service nova] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Refreshing instance network info cache due to event network-changed-4f9932a0-5bfa-48bc-bd1f-5f61bf96803c. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:23:54 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-6212fbb3-9d48-448b-8393-3fd2850d5d4a req-1280eb0e-dfcb-4656-8414-282bd4b247bc service nova] Acquiring lock "refresh_cache-e6ea2c9a-81d4-4933-bff3-406aedd79031" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:23:54 user nova-compute[74840]: DEBUG nova.network.neutron [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:23:54 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Updating instance_info_cache with network_info: [{"id": "6169b221-7840-4cfb-ba25-e34a95b35e77", "address": "fa:16:3e:b0:6a:c2", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6169b221-78", "ovs_interfaceid": "6169b221-7840-4cfb-ba25-e34a95b35e77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:23:54 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Releasing lock "refresh_cache-ffe50042-29bf-4ef3-a148-8698bc75233b" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:23:54 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Updated the network info_cache for instance {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 12:23:54 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:23:54 user nova-compute[74840]: DEBUG nova.network.neutron [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Updating instance_info_cache with network_info: [{"id": "4f9932a0-5bfa-48bc-bd1f-5f61bf96803c", "address": "fa:16:3e:0e:c1:c2", "network": {"id": "89a24eca-8c74-4e0e-b778-275f200927f0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1409559017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a082f8090094f009393593fb26b445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9932a0-5b", "ovs_interfaceid": "4f9932a0-5bfa-48bc-bd1f-5f61bf96803c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:23:54 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Releasing lock "refresh_cache-e6ea2c9a-81d4-4933-bff3-406aedd79031" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:23:54 user nova-compute[74840]: DEBUG nova.compute.manager [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Instance network_info: |[{"id": "4f9932a0-5bfa-48bc-bd1f-5f61bf96803c", "address": "fa:16:3e:0e:c1:c2", "network": {"id": "89a24eca-8c74-4e0e-b778-275f200927f0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1409559017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a082f8090094f009393593fb26b445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9932a0-5b", "ovs_interfaceid": "4f9932a0-5bfa-48bc-bd1f-5f61bf96803c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 12:23:54 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-6212fbb3-9d48-448b-8393-3fd2850d5d4a req-1280eb0e-dfcb-4656-8414-282bd4b247bc service nova] Acquired lock "refresh_cache-e6ea2c9a-81d4-4933-bff3-406aedd79031" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:23:54 user nova-compute[74840]: DEBUG nova.network.neutron [req-6212fbb3-9d48-448b-8393-3fd2850d5d4a req-1280eb0e-dfcb-4656-8414-282bd4b247bc service nova] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Refreshing network info cache for port 4f9932a0-5bfa-48bc-bd1f-5f61bf96803c {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:23:54 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Start _get_guest_xml network_info=[{"id": "4f9932a0-5bfa-48bc-bd1f-5f61bf96803c", "address": "fa:16:3e:0e:c1:c2", "network": {"id": "89a24eca-8c74-4e0e-b778-275f200927f0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1409559017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a082f8090094f009393593fb26b445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9932a0-5b", "ovs_interfaceid": "4f9932a0-5bfa-48bc-bd1f-5f61bf96803c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'image_id': '4fa17706-d304-4117-a420-dab994c703dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:23:54 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:23:54 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:23:54 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:23:54 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:23:54 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:23:54 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:23:54 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:23:54 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:23:54 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:23:54 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:23:54 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:23:54 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:23:54 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:23:54 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:23:54 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:23:54 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:23:54 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:23:54 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:23:54 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:23:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-91787869',display_name='tempest-VolumesSnapshotTestJSON-instance-91787869',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-91787869',id=30,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKT3Lt3eFS8NKNcfls5H0s+3K/dLsBsbYLM971M63Po9vga+q8A/tFpnnSpjt81BF15Bvbx86xynsH3JpiBFAaLK/R1P0/ALiFrse7mdr/TXPzlNHMTt2nbtnKaXbQaNpw==',key_name='tempest-keypair-542349603',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a082f8090094f009393593fb26b445b',ramdisk_id='',reservation_id='r-a2nmydxk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1995603553',owner_user_name='tempest-VolumesSnapshotTestJSON-1995603553-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:23:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5a96f2e0a304f278120312edb71d7ac',uuid=e6ea2c9a-81d4-4933-bff3-406aedd79031,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f9932a0-5bfa-48bc-bd1f-5f61bf96803c", "address": "fa:16:3e:0e:c1:c2", "network": {"id": "89a24eca-8c74-4e0e-b778-275f200927f0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1409559017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a082f8090094f009393593fb26b445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9932a0-5b", "ovs_interfaceid": "4f9932a0-5bfa-48bc-bd1f-5f61bf96803c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:23:54 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Converting VIF {"id": "4f9932a0-5bfa-48bc-bd1f-5f61bf96803c", "address": "fa:16:3e:0e:c1:c2", "network": {"id": "89a24eca-8c74-4e0e-b778-275f200927f0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1409559017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a082f8090094f009393593fb26b445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9932a0-5b", "ovs_interfaceid": "4f9932a0-5bfa-48bc-bd1f-5f61bf96803c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:23:54 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:c1:c2,bridge_name='br-int',has_traffic_filtering=True,id=4f9932a0-5bfa-48bc-bd1f-5f61bf96803c,network=Network(89a24eca-8c74-4e0e-b778-275f200927f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f9932a0-5b') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:23:54 user nova-compute[74840]: DEBUG nova.objects.instance [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lazy-loading 'pci_devices' on Instance uuid e6ea2c9a-81d4-4933-bff3-406aedd79031 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:23:55 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:23:55 user nova-compute[74840]:   <uuid>e6ea2c9a-81d4-4933-bff3-406aedd79031</uuid>
Nov 08 12:23:55 user nova-compute[74840]:   <name>instance-0000001e</name>
Nov 08 12:23:55 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:23:55 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:23:55 user nova-compute[74840]:   <metadata>
Nov 08 12:23:55 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:23:55 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:23:55 user nova-compute[74840]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-91787869</nova:name>
Nov 08 12:23:55 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:23:54</nova:creationTime>
Nov 08 12:23:55 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:23:55 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:23:55 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:23:55 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:23:55 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:23:55 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:23:55 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:23:55 user nova-compute[74840]:       <nova:owner>
Nov 08 12:23:55 user nova-compute[74840]:         <nova:user uuid="b5a96f2e0a304f278120312edb71d7ac">tempest-VolumesSnapshotTestJSON-1995603553-project-member</nova:user>
Nov 08 12:23:55 user nova-compute[74840]:         <nova:project uuid="9a082f8090094f009393593fb26b445b">tempest-VolumesSnapshotTestJSON-1995603553</nova:project>
Nov 08 12:23:55 user nova-compute[74840]:       </nova:owner>
Nov 08 12:23:55 user nova-compute[74840]:       <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:23:55 user nova-compute[74840]:       <nova:ports>
Nov 08 12:23:55 user nova-compute[74840]:         <nova:port uuid="4f9932a0-5bfa-48bc-bd1f-5f61bf96803c">
Nov 08 12:23:55 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 12:23:55 user nova-compute[74840]:         </nova:port>
Nov 08 12:23:55 user nova-compute[74840]:       </nova:ports>
Nov 08 12:23:55 user nova-compute[74840]:     </nova:instance>
Nov 08 12:23:55 user nova-compute[74840]:   </metadata>
Nov 08 12:23:55 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:23:55 user nova-compute[74840]:     <system>
Nov 08 12:23:55 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:23:55 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:23:55 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:23:55 user nova-compute[74840]:       <entry name="serial">e6ea2c9a-81d4-4933-bff3-406aedd79031</entry>
Nov 08 12:23:55 user nova-compute[74840]:       <entry name="uuid">e6ea2c9a-81d4-4933-bff3-406aedd79031</entry>
Nov 08 12:23:55 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:23:55 user nova-compute[74840]:     </system>
Nov 08 12:23:55 user nova-compute[74840]:   </sysinfo>
Nov 08 12:23:55 user nova-compute[74840]:   <os>
Nov 08 12:23:55 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:23:55 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:23:55 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:23:55 user nova-compute[74840]:   </os>
Nov 08 12:23:55 user nova-compute[74840]:   <features>
Nov 08 12:23:55 user nova-compute[74840]:     <acpi/>
Nov 08 12:23:55 user nova-compute[74840]:     <apic/>
Nov 08 12:23:55 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:23:55 user nova-compute[74840]:   </features>
Nov 08 12:23:55 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:23:55 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:23:55 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:23:55 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:23:55 user nova-compute[74840]:   </clock>
Nov 08 12:23:55 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:23:55 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:23:55 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:23:55 user nova-compute[74840]:   </cpu>
Nov 08 12:23:55 user nova-compute[74840]:   <devices>
Nov 08 12:23:55 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:23:55 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:23:55 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/e6ea2c9a-81d4-4933-bff3-406aedd79031/disk"/>
Nov 08 12:23:55 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:23:55 user nova-compute[74840]:     </disk>
Nov 08 12:23:55 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:23:55 user nova-compute[74840]:       <mac address="fa:16:3e:0e:c1:c2"/>
Nov 08 12:23:55 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:23:55 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:23:55 user nova-compute[74840]:       <target dev="tap4f9932a0-5b"/>
Nov 08 12:23:55 user nova-compute[74840]:     </interface>
Nov 08 12:23:55 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:23:55 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/e6ea2c9a-81d4-4933-bff3-406aedd79031/console.log" append="off"/>
Nov 08 12:23:55 user nova-compute[74840]:     </serial>
Nov 08 12:23:55 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:23:55 user nova-compute[74840]:     <video>
Nov 08 12:23:55 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:23:55 user nova-compute[74840]:     </video>
Nov 08 12:23:55 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:23:55 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:23:55 user nova-compute[74840]:     </rng>
Nov 08 12:23:55 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:23:55 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:23:55 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:23:55 user nova-compute[74840]:     </memballoon>
Nov 08 12:23:55 user nova-compute[74840]:   </devices>
Nov 08 12:23:55 user nova-compute[74840]: </domain>
Nov 08 12:23:55 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:23:55 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:23:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-91787869',display_name='tempest-VolumesSnapshotTestJSON-instance-91787869',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-91787869',id=30,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKT3Lt3eFS8NKNcfls5H0s+3K/dLsBsbYLM971M63Po9vga+q8A/tFpnnSpjt81BF15Bvbx86xynsH3JpiBFAaLK/R1P0/ALiFrse7mdr/TXPzlNHMTt2nbtnKaXbQaNpw==',key_name='tempest-keypair-542349603',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a082f8090094f009393593fb26b445b',ramdisk_id='',reservation_id='r-a2nmydxk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1995603553',owner_user_name='tempest-VolumesSnapshotTestJSON-1995603553-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:23:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5a96f2e0a304f278120312edb71d7ac',uuid=e6ea2c9a-81d4-4933-bff3-406aedd79031,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f9932a0-5bfa-48bc-bd1f-5f61bf96803c", "address": "fa:16:3e:0e:c1:c2", "network": {"id": "89a24eca-8c74-4e0e-b778-275f200927f0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1409559017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a082f8090094f009393593fb26b445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9932a0-5b", "ovs_interfaceid": "4f9932a0-5bfa-48bc-bd1f-5f61bf96803c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:23:55 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Converting VIF {"id": "4f9932a0-5bfa-48bc-bd1f-5f61bf96803c", "address": "fa:16:3e:0e:c1:c2", "network": {"id": "89a24eca-8c74-4e0e-b778-275f200927f0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1409559017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a082f8090094f009393593fb26b445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9932a0-5b", "ovs_interfaceid": "4f9932a0-5bfa-48bc-bd1f-5f61bf96803c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:23:55 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:c1:c2,bridge_name='br-int',has_traffic_filtering=True,id=4f9932a0-5bfa-48bc-bd1f-5f61bf96803c,network=Network(89a24eca-8c74-4e0e-b778-275f200927f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f9932a0-5b') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:23:55 user nova-compute[74840]: DEBUG os_vif [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:c1:c2,bridge_name='br-int',has_traffic_filtering=True,id=4f9932a0-5bfa-48bc-bd1f-5f61bf96803c,network=Network(89a24eca-8c74-4e0e-b778-275f200927f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f9932a0-5b') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:23:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:23:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:23:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '75b5ad3a-5bf7-5a50-96e0-ae0fdb2982e2', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:23:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:23:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f9932a0-5b, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:23:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4f9932a0-5b, col_values=(('qos', UUID('1d83a92d-33d5-4261-b7f3-b1a846f6e37c')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:23:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4f9932a0-5b, col_values=(('external_ids', {'iface-id': '4f9932a0-5bfa-48bc-bd1f-5f61bf96803c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:c1:c2', 'vm-uuid': 'e6ea2c9a-81d4-4933-bff3-406aedd79031'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:23:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:23:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:55 user nova-compute[74840]: INFO os_vif [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:c1:c2,bridge_name='br-int',has_traffic_filtering=True,id=4f9932a0-5bfa-48bc-bd1f-5f61bf96803c,network=Network(89a24eca-8c74-4e0e-b778-275f200927f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f9932a0-5b')
Nov 08 12:23:55 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:23:55 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] No VIF found with MAC fa:16:3e:0e:c1:c2, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:23:55 user nova-compute[74840]: DEBUG nova.network.neutron [req-6212fbb3-9d48-448b-8393-3fd2850d5d4a req-1280eb0e-dfcb-4656-8414-282bd4b247bc service nova] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Updated VIF entry in instance network info cache for port 4f9932a0-5bfa-48bc-bd1f-5f61bf96803c. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:23:55 user nova-compute[74840]: DEBUG nova.network.neutron [req-6212fbb3-9d48-448b-8393-3fd2850d5d4a req-1280eb0e-dfcb-4656-8414-282bd4b247bc service nova] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Updating instance_info_cache with network_info: [{"id": "4f9932a0-5bfa-48bc-bd1f-5f61bf96803c", "address": "fa:16:3e:0e:c1:c2", "network": {"id": "89a24eca-8c74-4e0e-b778-275f200927f0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1409559017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a082f8090094f009393593fb26b445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9932a0-5b", "ovs_interfaceid": "4f9932a0-5bfa-48bc-bd1f-5f61bf96803c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:23:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-6212fbb3-9d48-448b-8393-3fd2850d5d4a req-1280eb0e-dfcb-4656-8414-282bd4b247bc service nova] Releasing lock "refresh_cache-e6ea2c9a-81d4-4933-bff3-406aedd79031" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:23:55 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:23:55 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:23:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:56 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:23:57 user nova-compute[74840]: DEBUG nova.compute.manager [req-7d1f180c-ae16-4858-b4b4-6861fda59600 req-d45b8bb7-ad87-4f42-8034-9393ac61c456 service nova] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Received event network-vif-plugged-4f9932a0-5bfa-48bc-bd1f-5f61bf96803c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:23:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-7d1f180c-ae16-4858-b4b4-6861fda59600 req-d45b8bb7-ad87-4f42-8034-9393ac61c456 service nova] Acquiring lock "e6ea2c9a-81d4-4933-bff3-406aedd79031-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:23:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-7d1f180c-ae16-4858-b4b4-6861fda59600 req-d45b8bb7-ad87-4f42-8034-9393ac61c456 service nova] Lock "e6ea2c9a-81d4-4933-bff3-406aedd79031-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:23:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-7d1f180c-ae16-4858-b4b4-6861fda59600 req-d45b8bb7-ad87-4f42-8034-9393ac61c456 service nova] Lock "e6ea2c9a-81d4-4933-bff3-406aedd79031-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:23:57 user nova-compute[74840]: DEBUG nova.compute.manager [req-7d1f180c-ae16-4858-b4b4-6861fda59600 req-d45b8bb7-ad87-4f42-8034-9393ac61c456 service nova] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] No waiting events found dispatching network-vif-plugged-4f9932a0-5bfa-48bc-bd1f-5f61bf96803c {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:23:57 user nova-compute[74840]: WARNING nova.compute.manager [req-7d1f180c-ae16-4858-b4b4-6861fda59600 req-d45b8bb7-ad87-4f42-8034-9393ac61c456 service nova] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Received unexpected event network-vif-plugged-4f9932a0-5bfa-48bc-bd1f-5f61bf96803c for instance with vm_state building and task_state spawning.
Nov 08 12:23:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:23:57 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:23:59 user nova-compute[74840]: DEBUG nova.compute.manager [req-fd9e6f10-e0da-431d-8f4d-59c81e404700 req-a47633a6-1717-44b0-b94f-32259f66384e service nova] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Received event network-vif-plugged-4f9932a0-5bfa-48bc-bd1f-5f61bf96803c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:23:59 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-fd9e6f10-e0da-431d-8f4d-59c81e404700 req-a47633a6-1717-44b0-b94f-32259f66384e service nova] Acquiring lock "e6ea2c9a-81d4-4933-bff3-406aedd79031-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:23:59 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-fd9e6f10-e0da-431d-8f4d-59c81e404700 req-a47633a6-1717-44b0-b94f-32259f66384e service nova] Lock "e6ea2c9a-81d4-4933-bff3-406aedd79031-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:23:59 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-fd9e6f10-e0da-431d-8f4d-59c81e404700 req-a47633a6-1717-44b0-b94f-32259f66384e service nova] Lock "e6ea2c9a-81d4-4933-bff3-406aedd79031-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:23:59 user nova-compute[74840]: DEBUG nova.compute.manager [req-fd9e6f10-e0da-431d-8f4d-59c81e404700 req-a47633a6-1717-44b0-b94f-32259f66384e service nova] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] No waiting events found dispatching network-vif-plugged-4f9932a0-5bfa-48bc-bd1f-5f61bf96803c {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:23:59 user nova-compute[74840]: WARNING nova.compute.manager [req-fd9e6f10-e0da-431d-8f4d-59c81e404700 req-a47633a6-1717-44b0-b94f-32259f66384e service nova] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Received unexpected event network-vif-plugged-4f9932a0-5bfa-48bc-bd1f-5f61bf96803c for instance with vm_state building and task_state spawning.
Nov 08 12:23:59 user nova-compute[74840]: DEBUG nova.compute.manager [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:23:59 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:23:59 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Instance spawned successfully.
Nov 08 12:23:59 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:23:59 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Found default for hw_cdrom_bus of ide {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:23:59 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Found default for hw_disk_bus of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:23:59 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:23:59 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:23:59 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Found default for hw_video_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:23:59 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Found default for hw_vif_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:23:59 user nova-compute[74840]: INFO nova.compute.manager [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Took 6.56 seconds to spawn the instance on the hypervisor.
Nov 08 12:23:59 user nova-compute[74840]: DEBUG nova.compute.manager [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:23:59 user nova-compute[74840]: INFO nova.compute.manager [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Took 7.50 seconds to build instance.
Nov 08 12:23:59 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5c9b3058-d628-463d-a142-b56e384a70e1 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "e6ea2c9a-81d4-4933-bff3-406aedd79031" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.609s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:23:59 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:23:59 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:23:59 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:23:59 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:23:59 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:23:59 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:23:59 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:23:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6ea2c9a-81d4-4933-bff3-406aedd79031/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:24:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:24:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6ea2c9a-81d4-4933-bff3-406aedd79031/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:24:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6ea2c9a-81d4-4933-bff3-406aedd79031/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:24:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6ea2c9a-81d4-4933-bff3-406aedd79031/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:24:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:24:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:24:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:24:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:24:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:24:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json" returned: 0 in 0.266s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:24:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:24:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json" returned: 0 in 0.251s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:24:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:24:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:24:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:24:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:24:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:24:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4622ff-b81c-40d3-92bf-bc30ef64b68f/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:24:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4622ff-b81c-40d3-92bf-bc30ef64b68f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:24:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4622ff-b81c-40d3-92bf-bc30ef64b68f/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:24:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4622ff-b81c-40d3-92bf-bc30ef64b68f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:24:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:24:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:24:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:24:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:24:02 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:24:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe50042-29bf-4ef3-a148-8698bc75233b/disk.rescue --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:24:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe50042-29bf-4ef3-a148-8698bc75233b/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:24:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe50042-29bf-4ef3-a148-8698bc75233b/disk.rescue --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:24:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe50042-29bf-4ef3-a148-8698bc75233b/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:24:03 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:24:03 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:24:03 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=7864MB free_disk=25.192638397216797GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:24:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:24:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:24:03 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance d3e8efc6-7146-46ef-8433-380d7e69120c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:24:03 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance ffe50042-29bf-4ef3-a148-8698bc75233b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:24:03 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 8b7c490e-4c78-4e07-bc8a-3be2328963d7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:24:03 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 832a6445-84ee-43a8-a5bc-a07670602912 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:24:03 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 4ce94f9d-be90-4b82-bc83-6777d2c871a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:24:03 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance ef956aaf-1793-44f9-b33a-7a1f22edf161 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:24:03 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance ff4622ff-b81c-40d3-92bf-bc30ef64b68f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:24:03 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance e6ea2c9a-81d4-4933-bff3-406aedd79031 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:24:03 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:24:03 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:24:03 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:24:03 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:24:03 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:24:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.518s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:24:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:24:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:24:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:24:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:24:15 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:24:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG nova.compute.manager [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Start spawning the instance on the hypervisor. {{(pid=74840) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:24:18 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Creating image(s)
Nov 08 12:24:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Did not create local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Ensure instance console log exists: /opt/stack/data/nova/instances/ef956aaf-1793-44f9-b33a-7a1f22edf161/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Start _get_guest_xml network_info=[{"id": "7e99639a-a260-4090-b429-69c9b64861aa", "address": "fa:16:3e:bc:1e:ce", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e99639a-a2", "ovs_interfaceid": "7e99639a-a260-4090-b429-69c9b64861aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-08T12:23:23Z,direct_url=<?>,disk_format='qcow2',id=9c877475-eac3-42ed-a106-87f5d239424f,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-242464895',owner='1250106b55ae44b0b303849df7781ffb',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-08T12:23:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '04ef5923-e486-42e8-9b55-c2d65987984e', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:918bf9dc-84aa-4cef-b0db-c9de45d81229', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qvaFQBfV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ef956aaf-1793-44f9-b33a-7a1f22edf161', 'attached_at': '', 'detached_at': '', 'volume_id': '918bf9dc-84aa-4cef-b0db-c9de45d81229', 'serial': '918bf9dc-84aa-4cef-b0db-c9de45d81229'}, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:24:18 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:24:18 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:24:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-08T12:23:23Z,direct_url=<?>,disk_format='qcow2',id=9c877475-eac3-42ed-a106-87f5d239424f,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-242464895',owner='1250106b55ae44b0b303849df7781ffb',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-08T12:23:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Calling os-brick to attach iSCSI Volume {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:918bf9dc-84aa-4cef-b0db-c9de45d81229', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qvaFQBfV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:24:18 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:24:18 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:24:18 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:24:18 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:918bf9dc-84aa-4cef-b0db-c9de45d81229" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:918bf9dc-84aa-4cef-b0db-c9de45d81229" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:24:18 user nova-compute[74840]: INFO os_brick.initiator.connectors.iscsi [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 12:24:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:918bf9dc-84aa-4cef-b0db-c9de45d81229 -p 172.16.0.220:3260 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:918bf9dc-84aa-4cef-b0db-c9de45d81229 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9b5a78-fee4-4beb-98f8-437e2313e71e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 12:24:18 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:918bf9dc-84aa-4cef-b0db-c9de45d81229 -p 172.16.0.220:3260 --interface default --op new {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:918bf9dc-84aa-4cef-b0db-c9de45d81229 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb631de6-deb6-4cf2-a5e7-ce2889bd2edb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:918bf9dc-84aa-4cef-b0db-c9de45d81229] added\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:918bf9dc-84aa-4cef-b0db-c9de45d81229] added
Nov 08 12:24:18 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:918bf9dc-84aa-4cef-b0db-c9de45d81229 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:918bf9dc-84aa-4cef-b0db-c9de45d81229 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c400a6-3480-427e-af30-cf9debbe2bcf]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:918bf9dc-84aa-4cef-b0db-c9de45d81229 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:918bf9dc-84aa-4cef-b0db-c9de45d81229 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a578be8a-cd28-451d-a27d-fa2c34be91ce]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:918bf9dc-84aa-4cef-b0db-c9de45d81229 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qvaFQBfV {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:918bf9dc-84aa-4cef-b0db-c9de45d81229 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qvaFQBfV" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fec91cb-a783-49e9-b562-a9ca5adc7429]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qvaFQBfV'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:918bf9dc-84aa-4cef-b0db-c9de45d81229 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:918bf9dc-84aa-4cef-b0db-c9de45d81229 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ba7bff-1c5e-41eb-8231-d19b5bdace1c]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[26033bd0-d14f-4712-a0e7-51cb5dee709e]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:24:18 user nova-compute[74840]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)
Nov 08 12:24:18 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:24:18 user nova-compute[74840]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)
Nov 08 12:24:18 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:918bf9dc-84aa-4cef-b0db-c9de45d81229 -p 172.16.0.220:3260 --login {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:918bf9dc-84aa-4cef-b0db-c9de45d81229 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[589ecf19-da7e-4869-8fc1-6d9bb5d03c85]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:918bf9dc-84aa-4cef-b0db-c9de45d81229, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:918bf9dc-84aa-4cef-b0db-c9de45d81229, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:918bf9dc-84aa-4cef-b0db-c9de45d81229, portal: 172.16.0.220,3260]
Nov 08 12:24:18 user nova-compute[74840]: Login to [iface: default, target: iqn.2010-10.org.openstack:918bf9dc-84aa-4cef-b0db-c9de45d81229, portal: 172.16.0.220,3260] successful.
Nov 08 12:24:18 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:918bf9dc-84aa-4cef-b0db-c9de45d81229 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:918bf9dc-84aa-4cef-b0db-c9de45d81229 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f150715-ca48-4e2b-82ab-4c0783953011]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab31223e-894d-4aa0-a20d-e7e2ef06c137]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:918bf9dc-84aa-4cef-b0db-c9de45d81229 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:24:18 user nova-compute[74840]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)
Nov 08 12:24:18 user nova-compute[74840]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:918bf9dc-84aa-4cef-b0db-c9de45d81229 (non-flash)
Nov 08 12:24:18 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:24:18 user nova-compute[74840]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)
Nov 08 12:24:18 user nova-compute[74840]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:918bf9dc-84aa-4cef-b0db-c9de45d81229 (non-flash)
Nov 08 12:24:18 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:918bf9dc-84aa-4cef-b0db-c9de45d81229" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Connected to 172.16.0.220:3260 {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=74840) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74840) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 12:24:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:24:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.028s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:24:19 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[434994a3-53be-4d4d-a5cf-b93b34223017]: (4, ('- - 0', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:24:19 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:24:19 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:918bf9dc-84aa-4cef-b0db-c9de45d81229', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qvaFQBfV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 12:24:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:24:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '26363656465353939', 'path': '/dev/sdb'} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:24:20 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363656465353939', 'path': '/dev/sdb'} {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 12:24:20 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:23:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1593166171',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1593166171',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1593166171',id=28,image_ref='9c877475-eac3-42ed-a106-87f5d239424f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnarJi3BBSUAx+vGcpgxOuJLDpVZAbY4ptnKTLNHljIZwFBJFKOALs751B+mfvm80rYTA+Fl+SJ6NqNh7KeIRnz5YzNJI2j8dAsu4tgXLIddM5bhDr4EFvbIPZw55KhVQ==',key_name='tempest-keypair-554008802',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1250106b55ae44b0b303849df7781ffb',ramdisk_id='',reservation_id='r-6yvumx1p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-77780905',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-77780905-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-77780905',owner_user_name='tempest-TestVolumeBootPattern-77780905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:23:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='794c0281e1bf48f79117efdc3907e661',uuid=ef956aaf-1793-44f9-b33a-7a1f22edf161,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e99639a-a260-4090-b429-69c9b64861aa", "address": "fa:16:3e:bc:1e:ce", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e99639a-a2", "ovs_interfaceid": "7e99639a-a260-4090-b429-69c9b64861aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:24:20 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Converting VIF {"id": "7e99639a-a260-4090-b429-69c9b64861aa", "address": "fa:16:3e:bc:1e:ce", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e99639a-a2", "ovs_interfaceid": "7e99639a-a260-4090-b429-69c9b64861aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:24:20 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:1e:ce,bridge_name='br-int',has_traffic_filtering=True,id=7e99639a-a260-4090-b429-69c9b64861aa,network=Network(174da5e9-78cc-426f-87fb-1d3b23b8b459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e99639a-a2') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:24:20 user nova-compute[74840]: DEBUG nova.objects.instance [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lazy-loading 'pci_devices' on Instance uuid ef956aaf-1793-44f9-b33a-7a1f22edf161 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:24:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:24:20 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:24:20 user nova-compute[74840]:   <uuid>ef956aaf-1793-44f9-b33a-7a1f22edf161</uuid>
Nov 08 12:24:20 user nova-compute[74840]:   <name>instance-0000001c</name>
Nov 08 12:24:20 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:24:20 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:24:20 user nova-compute[74840]:   <metadata>
Nov 08 12:24:20 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:24:20 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:24:20 user nova-compute[74840]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1593166171</nova:name>
Nov 08 12:24:20 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:24:18</nova:creationTime>
Nov 08 12:24:20 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:24:20 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:24:20 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:24:20 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:24:20 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:24:20 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:24:20 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:24:20 user nova-compute[74840]:       <nova:owner>
Nov 08 12:24:20 user nova-compute[74840]:         <nova:user uuid="794c0281e1bf48f79117efdc3907e661">tempest-TestVolumeBootPattern-77780905-project-member</nova:user>
Nov 08 12:24:20 user nova-compute[74840]:         <nova:project uuid="1250106b55ae44b0b303849df7781ffb">tempest-TestVolumeBootPattern-77780905</nova:project>
Nov 08 12:24:20 user nova-compute[74840]:       </nova:owner>
Nov 08 12:24:20 user nova-compute[74840]:       <nova:root type="image" uuid="9c877475-eac3-42ed-a106-87f5d239424f"/>
Nov 08 12:24:20 user nova-compute[74840]:       <nova:ports>
Nov 08 12:24:20 user nova-compute[74840]:         <nova:port uuid="7e99639a-a260-4090-b429-69c9b64861aa">
Nov 08 12:24:20 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 12:24:20 user nova-compute[74840]:         </nova:port>
Nov 08 12:24:20 user nova-compute[74840]:       </nova:ports>
Nov 08 12:24:20 user nova-compute[74840]:     </nova:instance>
Nov 08 12:24:20 user nova-compute[74840]:   </metadata>
Nov 08 12:24:20 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:24:20 user nova-compute[74840]:     <system>
Nov 08 12:24:20 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:24:20 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:24:20 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:24:20 user nova-compute[74840]:       <entry name="serial">ef956aaf-1793-44f9-b33a-7a1f22edf161</entry>
Nov 08 12:24:20 user nova-compute[74840]:       <entry name="uuid">ef956aaf-1793-44f9-b33a-7a1f22edf161</entry>
Nov 08 12:24:20 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:24:20 user nova-compute[74840]:     </system>
Nov 08 12:24:20 user nova-compute[74840]:   </sysinfo>
Nov 08 12:24:20 user nova-compute[74840]:   <os>
Nov 08 12:24:20 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:24:20 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:24:20 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:24:20 user nova-compute[74840]:   </os>
Nov 08 12:24:20 user nova-compute[74840]:   <features>
Nov 08 12:24:20 user nova-compute[74840]:     <acpi/>
Nov 08 12:24:20 user nova-compute[74840]:     <apic/>
Nov 08 12:24:20 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:24:20 user nova-compute[74840]:   </features>
Nov 08 12:24:20 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:24:20 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:24:20 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:24:20 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:24:20 user nova-compute[74840]:   </clock>
Nov 08 12:24:20 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:24:20 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:24:20 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:24:20 user nova-compute[74840]:   </cpu>
Nov 08 12:24:20 user nova-compute[74840]:   <devices>
Nov 08 12:24:20 user nova-compute[74840]:     <disk type="block" device="disk">
Nov 08 12:24:20 user nova-compute[74840]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:24:20 user nova-compute[74840]:       <source dev="/dev/sdb"/>
Nov 08 12:24:20 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:24:20 user nova-compute[74840]:       <serial>918bf9dc-84aa-4cef-b0db-c9de45d81229</serial>
Nov 08 12:24:20 user nova-compute[74840]:     </disk>
Nov 08 12:24:20 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:24:20 user nova-compute[74840]:       <mac address="fa:16:3e:bc:1e:ce"/>
Nov 08 12:24:20 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:24:20 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:24:20 user nova-compute[74840]:       <target dev="tap7e99639a-a2"/>
Nov 08 12:24:20 user nova-compute[74840]:     </interface>
Nov 08 12:24:20 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:24:20 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/ef956aaf-1793-44f9-b33a-7a1f22edf161/console.log" append="off"/>
Nov 08 12:24:20 user nova-compute[74840]:     </serial>
Nov 08 12:24:20 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:24:20 user nova-compute[74840]:     <video>
Nov 08 12:24:20 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:24:20 user nova-compute[74840]:     </video>
Nov 08 12:24:20 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:24:20 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:24:20 user nova-compute[74840]:     </rng>
Nov 08 12:24:20 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:24:20 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:24:20 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:24:20 user nova-compute[74840]:     </memballoon>
Nov 08 12:24:20 user nova-compute[74840]:   </devices>
Nov 08 12:24:20 user nova-compute[74840]: </domain>
Nov 08 12:24:20 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:24:20 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:23:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1593166171',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1593166171',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1593166171',id=28,image_ref='9c877475-eac3-42ed-a106-87f5d239424f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnarJi3BBSUAx+vGcpgxOuJLDpVZAbY4ptnKTLNHljIZwFBJFKOALs751B+mfvm80rYTA+Fl+SJ6NqNh7KeIRnz5YzNJI2j8dAsu4tgXLIddM5bhDr4EFvbIPZw55KhVQ==',key_name='tempest-keypair-554008802',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1250106b55ae44b0b303849df7781ffb',ramdisk_id='',reservation_id='r-6yvumx1p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-77780905',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-77780905-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-77780905',owner_user_name='tempest-TestVolumeBootPattern-77780905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:23:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='794c0281e1bf48f79117efdc3907e661',uuid=ef956aaf-1793-44f9-b33a-7a1f22edf161,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e99639a-a260-4090-b429-69c9b64861aa", "address": "fa:16:3e:bc:1e:ce", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e99639a-a2", "ovs_interfaceid": "7e99639a-a260-4090-b429-69c9b64861aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:24:20 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Converting VIF {"id": "7e99639a-a260-4090-b429-69c9b64861aa", "address": "fa:16:3e:bc:1e:ce", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e99639a-a2", "ovs_interfaceid": "7e99639a-a260-4090-b429-69c9b64861aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:24:20 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:1e:ce,bridge_name='br-int',has_traffic_filtering=True,id=7e99639a-a260-4090-b429-69c9b64861aa,network=Network(174da5e9-78cc-426f-87fb-1d3b23b8b459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e99639a-a2') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:24:20 user nova-compute[74840]: DEBUG os_vif [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:1e:ce,bridge_name='br-int',has_traffic_filtering=True,id=7e99639a-a260-4090-b429-69c9b64861aa,network=Network(174da5e9-78cc-426f-87fb-1d3b23b8b459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e99639a-a2') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:24:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:24:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:24:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:24:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:24:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6a81cbe4-b477-5715-846d-fd949e064c9f', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:24:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:24:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:24:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:24:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e99639a-a2, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:24:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7e99639a-a2, col_values=(('qos', UUID('5bd41790-cda0-4be3-9aef-dbfa6b2aa7dd')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:24:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7e99639a-a2, col_values=(('external_ids', {'iface-id': '7e99639a-a260-4090-b429-69c9b64861aa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:1e:ce', 'vm-uuid': 'ef956aaf-1793-44f9-b33a-7a1f22edf161'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:24:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:24:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:24:20 user nova-compute[74840]: INFO os_vif [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:1e:ce,bridge_name='br-int',has_traffic_filtering=True,id=7e99639a-a260-4090-b429-69c9b64861aa,network=Network(174da5e9-78cc-426f-87fb-1d3b23b8b459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e99639a-a2')
Nov 08 12:24:20 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:24:20 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] No VIF found with MAC fa:16:3e:bc:1e:ce, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:24:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:24:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:24:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:24:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:24:21 user nova-compute[74840]: DEBUG nova.compute.manager [req-f8e23e95-f81d-4b56-b178-bc51b2f450fa req-b70dd19e-3408-416c-8c69-757986895917 service nova] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Received event network-vif-plugged-7e99639a-a260-4090-b429-69c9b64861aa {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:24:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-f8e23e95-f81d-4b56-b178-bc51b2f450fa req-b70dd19e-3408-416c-8c69-757986895917 service nova] Acquiring lock "ef956aaf-1793-44f9-b33a-7a1f22edf161-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:24:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-f8e23e95-f81d-4b56-b178-bc51b2f450fa req-b70dd19e-3408-416c-8c69-757986895917 service nova] Lock "ef956aaf-1793-44f9-b33a-7a1f22edf161-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:24:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-f8e23e95-f81d-4b56-b178-bc51b2f450fa req-b70dd19e-3408-416c-8c69-757986895917 service nova] Lock "ef956aaf-1793-44f9-b33a-7a1f22edf161-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:24:21 user nova-compute[74840]: DEBUG nova.compute.manager [req-f8e23e95-f81d-4b56-b178-bc51b2f450fa req-b70dd19e-3408-416c-8c69-757986895917 service nova] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] No waiting events found dispatching network-vif-plugged-7e99639a-a260-4090-b429-69c9b64861aa {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:24:21 user nova-compute[74840]: WARNING nova.compute.manager [req-f8e23e95-f81d-4b56-b178-bc51b2f450fa req-b70dd19e-3408-416c-8c69-757986895917 service nova] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Received unexpected event network-vif-plugged-7e99639a-a260-4090-b429-69c9b64861aa for instance with vm_state building and task_state spawning.
Nov 08 12:24:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:24:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:24:23 user nova-compute[74840]: DEBUG nova.compute.manager [req-9b6fcd78-52f1-41a0-921c-07687aa842b1 req-e661ff29-1a8a-4370-b9ee-e96a4b8eed42 service nova] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Received event network-vif-plugged-7e99639a-a260-4090-b429-69c9b64861aa {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:24:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9b6fcd78-52f1-41a0-921c-07687aa842b1 req-e661ff29-1a8a-4370-b9ee-e96a4b8eed42 service nova] Acquiring lock "ef956aaf-1793-44f9-b33a-7a1f22edf161-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:24:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9b6fcd78-52f1-41a0-921c-07687aa842b1 req-e661ff29-1a8a-4370-b9ee-e96a4b8eed42 service nova] Lock "ef956aaf-1793-44f9-b33a-7a1f22edf161-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:24:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9b6fcd78-52f1-41a0-921c-07687aa842b1 req-e661ff29-1a8a-4370-b9ee-e96a4b8eed42 service nova] Lock "ef956aaf-1793-44f9-b33a-7a1f22edf161-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:24:23 user nova-compute[74840]: DEBUG nova.compute.manager [req-9b6fcd78-52f1-41a0-921c-07687aa842b1 req-e661ff29-1a8a-4370-b9ee-e96a4b8eed42 service nova] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] No waiting events found dispatching network-vif-plugged-7e99639a-a260-4090-b429-69c9b64861aa {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:24:23 user nova-compute[74840]: WARNING nova.compute.manager [req-9b6fcd78-52f1-41a0-921c-07687aa842b1 req-e661ff29-1a8a-4370-b9ee-e96a4b8eed42 service nova] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Received unexpected event network-vif-plugged-7e99639a-a260-4090-b429-69c9b64861aa for instance with vm_state building and task_state spawning.
Nov 08 12:24:23 user nova-compute[74840]: DEBUG nova.compute.manager [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:24:23 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:24:23 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Instance spawned successfully.
Nov 08 12:24:23 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:24:23 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:24:23 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:24:23 user nova-compute[74840]: INFO nova.compute.manager [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Took 5.23 seconds to spawn the instance on the hypervisor.
Nov 08 12:24:23 user nova-compute[74840]: DEBUG nova.compute.manager [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:24:23 user nova-compute[74840]: INFO nova.compute.manager [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Took 44.06 seconds to build instance.
Nov 08 12:24:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f7cbcd3b-4b91-4a84-902a-60ab50e8fc0d tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "ef956aaf-1793-44f9-b33a-7a1f22edf161" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 44.206s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:24:25 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:24:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:24:30 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:24:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:24:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:24:38 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:24:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:24:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:24:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:24:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:24:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:24:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:24:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:24:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:24:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:24:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:24:51 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:24:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:24:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:24:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "10c42516-62ba-4aa9-bc5a-d94499bd6b65" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:24:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "10c42516-62ba-4aa9-bc5a-d94499bd6b65" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:24:56 user nova-compute[74840]: DEBUG nova.compute.manager [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Starting instance... {{(pid=74840) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 12:24:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:24:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:24:56 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:24:56 user nova-compute[74840]: INFO nova.compute.claims [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Claim successful on node user
Nov 08 12:24:56 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:24:56 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:24:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.437s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:24:56 user nova-compute[74840]: DEBUG nova.compute.manager [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Start building networks asynchronously for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 12:24:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:24:56 user nova-compute[74840]: DEBUG nova.compute.manager [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Allocating IP information in the background. {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 12:24:56 user nova-compute[74840]: DEBUG nova.network.neutron [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 12:24:56 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 12:24:56 user nova-compute[74840]: DEBUG nova.compute.manager [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Start building block device mappings for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 12:24:56 user nova-compute[74840]: DEBUG nova.policy [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9a49f88cb74c47bdb9a35883adbae454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e47ef156b3649839ff728eaf23121da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 12:24:56 user nova-compute[74840]: DEBUG nova.compute.manager [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Start spawning the instance on the hypervisor. {{(pid=74840) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 12:24:56 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:24:56 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Creating image(s)
Nov 08 12:24:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "/opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:24:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "/opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:24:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "/opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:24:56 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:24:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.190s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:24:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "5d26578eba85497f494c575690c4248f381a0fe6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:24:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:24:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:24:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.268s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:24:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk 1073741824 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:24:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk 1073741824" returned: 0 in 0.055s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:24:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.334s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:24:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:24:57 user nova-compute[74840]: DEBUG nova.network.neutron [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Successfully created port: 7cf349fa-e382-4526-af9d-f60a53d870cb {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:24:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.195s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:24:57 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Checking if we can resize image /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk. size=1073741824 {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 12:24:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:24:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:24:57 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Cannot resize image /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk to a smaller size. {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 12:24:57 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Created local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 12:24:57 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Ensure instance console log exists: /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:24:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:24:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:24:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:24:57 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:24:57 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:24:57 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "refresh_cache-8b7c490e-4c78-4e07-bc8a-3be2328963d7" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquired lock "refresh_cache-8b7c490e-4c78-4e07-bc8a-3be2328963d7" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Forcefully refreshing network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG nova.network.neutron [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Successfully updated port: 7cf349fa-e382-4526-af9d-f60a53d870cb {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "refresh_cache-10c42516-62ba-4aa9-bc5a-d94499bd6b65" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquired lock "refresh_cache-10c42516-62ba-4aa9-bc5a-d94499bd6b65" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG nova.network.neutron [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG nova.network.neutron [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG nova.compute.manager [req-20def6c5-257f-4e86-ada2-32fb3dd4fc4e req-476212c4-cf08-40bb-b11b-1efe8060c2d5 service nova] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Received event network-changed-7cf349fa-e382-4526-af9d-f60a53d870cb {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG nova.compute.manager [req-20def6c5-257f-4e86-ada2-32fb3dd4fc4e req-476212c4-cf08-40bb-b11b-1efe8060c2d5 service nova] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Refreshing instance network info cache due to event network-changed-7cf349fa-e382-4526-af9d-f60a53d870cb. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-20def6c5-257f-4e86-ada2-32fb3dd4fc4e req-476212c4-cf08-40bb-b11b-1efe8060c2d5 service nova] Acquiring lock "refresh_cache-10c42516-62ba-4aa9-bc5a-d94499bd6b65" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Updating instance_info_cache with network_info: [{"id": "d9df071e-c4f0-4c80-9d63-3a41c849dca5", "address": "fa:16:3e:32:c4:9b", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9df071e-c4", "ovs_interfaceid": "d9df071e-c4f0-4c80-9d63-3a41c849dca5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Releasing lock "refresh_cache-8b7c490e-4c78-4e07-bc8a-3be2328963d7" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Updated the network info_cache for instance {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG nova.network.neutron [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Updating instance_info_cache with network_info: [{"id": "7cf349fa-e382-4526-af9d-f60a53d870cb", "address": "fa:16:3e:97:67:76", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cf349fa-e3", "ovs_interfaceid": "7cf349fa-e382-4526-af9d-f60a53d870cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Releasing lock "refresh_cache-10c42516-62ba-4aa9-bc5a-d94499bd6b65" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG nova.compute.manager [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Instance network_info: |[{"id": "7cf349fa-e382-4526-af9d-f60a53d870cb", "address": "fa:16:3e:97:67:76", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cf349fa-e3", "ovs_interfaceid": "7cf349fa-e382-4526-af9d-f60a53d870cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-20def6c5-257f-4e86-ada2-32fb3dd4fc4e req-476212c4-cf08-40bb-b11b-1efe8060c2d5 service nova] Acquired lock "refresh_cache-10c42516-62ba-4aa9-bc5a-d94499bd6b65" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG nova.network.neutron [req-20def6c5-257f-4e86-ada2-32fb3dd4fc4e req-476212c4-cf08-40bb-b11b-1efe8060c2d5 service nova] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Refreshing network info cache for port 7cf349fa-e382-4526-af9d-f60a53d870cb {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Start _get_guest_xml network_info=[{"id": "7cf349fa-e382-4526-af9d-f60a53d870cb", "address": "fa:16:3e:97:67:76", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cf349fa-e3", "ovs_interfaceid": "7cf349fa-e382-4526-af9d-f60a53d870cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'image_id': '4fa17706-d304-4117-a420-dab994c703dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:24:58 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:24:58 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:24:58 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:24:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1092983192',display_name='tempest-ServerActionsTestOtherA-server-1092983192',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1092983192',id=31,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAmkFC6dPojPaRdPJh94q0/wuvRVxh1HPsrsmItydl0iUnCu6UdbkD5pi9CgzgYpLamuUC6eRZK4fPtOQ5ReX7Sfuo5mKd9gSajCUuWaRBqISYVRzAbikSahnbP3hsO0g==',key_name='tempest-keypair-428361338',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e47ef156b3649839ff728eaf23121da',ramdisk_id='',reservation_id='r-jd81dz6r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-401855506',owner_user_name='tempest-ServerActionsTestOtherA-401855506-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:24:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a49f88cb74c47bdb9a35883adbae454',uuid=10c42516-62ba-4aa9-bc5a-d94499bd6b65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cf349fa-e382-4526-af9d-f60a53d870cb", "address": "fa:16:3e:97:67:76", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cf349fa-e3", "ovs_interfaceid": "7cf349fa-e382-4526-af9d-f60a53d870cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Converting VIF {"id": "7cf349fa-e382-4526-af9d-f60a53d870cb", "address": "fa:16:3e:97:67:76", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cf349fa-e3", "ovs_interfaceid": "7cf349fa-e382-4526-af9d-f60a53d870cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:67:76,bridge_name='br-int',has_traffic_filtering=True,id=7cf349fa-e382-4526-af9d-f60a53d870cb,network=Network(e92448c4-9bc0-424b-a07f-a398ac46fada),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cf349fa-e3') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG nova.objects.instance [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lazy-loading 'pci_devices' on Instance uuid 10c42516-62ba-4aa9-bc5a-d94499bd6b65 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:24:58 user nova-compute[74840]:   <uuid>10c42516-62ba-4aa9-bc5a-d94499bd6b65</uuid>
Nov 08 12:24:58 user nova-compute[74840]:   <name>instance-0000001f</name>
Nov 08 12:24:58 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:24:58 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:24:58 user nova-compute[74840]:   <metadata>
Nov 08 12:24:58 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:24:58 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:24:58 user nova-compute[74840]:       <nova:name>tempest-ServerActionsTestOtherA-server-1092983192</nova:name>
Nov 08 12:24:58 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:24:58</nova:creationTime>
Nov 08 12:24:58 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:24:58 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:24:58 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:24:58 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:24:58 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:24:58 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:24:58 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:24:58 user nova-compute[74840]:       <nova:owner>
Nov 08 12:24:58 user nova-compute[74840]:         <nova:user uuid="9a49f88cb74c47bdb9a35883adbae454">tempest-ServerActionsTestOtherA-401855506-project-member</nova:user>
Nov 08 12:24:58 user nova-compute[74840]:         <nova:project uuid="5e47ef156b3649839ff728eaf23121da">tempest-ServerActionsTestOtherA-401855506</nova:project>
Nov 08 12:24:58 user nova-compute[74840]:       </nova:owner>
Nov 08 12:24:58 user nova-compute[74840]:       <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:24:58 user nova-compute[74840]:       <nova:ports>
Nov 08 12:24:58 user nova-compute[74840]:         <nova:port uuid="7cf349fa-e382-4526-af9d-f60a53d870cb">
Nov 08 12:24:58 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 08 12:24:58 user nova-compute[74840]:         </nova:port>
Nov 08 12:24:58 user nova-compute[74840]:       </nova:ports>
Nov 08 12:24:58 user nova-compute[74840]:     </nova:instance>
Nov 08 12:24:58 user nova-compute[74840]:   </metadata>
Nov 08 12:24:58 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:24:58 user nova-compute[74840]:     <system>
Nov 08 12:24:58 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:24:58 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:24:58 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:24:58 user nova-compute[74840]:       <entry name="serial">10c42516-62ba-4aa9-bc5a-d94499bd6b65</entry>
Nov 08 12:24:58 user nova-compute[74840]:       <entry name="uuid">10c42516-62ba-4aa9-bc5a-d94499bd6b65</entry>
Nov 08 12:24:58 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:24:58 user nova-compute[74840]:     </system>
Nov 08 12:24:58 user nova-compute[74840]:   </sysinfo>
Nov 08 12:24:58 user nova-compute[74840]:   <os>
Nov 08 12:24:58 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:24:58 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:24:58 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:24:58 user nova-compute[74840]:   </os>
Nov 08 12:24:58 user nova-compute[74840]:   <features>
Nov 08 12:24:58 user nova-compute[74840]:     <acpi/>
Nov 08 12:24:58 user nova-compute[74840]:     <apic/>
Nov 08 12:24:58 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:24:58 user nova-compute[74840]:   </features>
Nov 08 12:24:58 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:24:58 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:24:58 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:24:58 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:24:58 user nova-compute[74840]:   </clock>
Nov 08 12:24:58 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:24:58 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:24:58 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:24:58 user nova-compute[74840]:   </cpu>
Nov 08 12:24:58 user nova-compute[74840]:   <devices>
Nov 08 12:24:58 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:24:58 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:24:58 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk"/>
Nov 08 12:24:58 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:24:58 user nova-compute[74840]:     </disk>
Nov 08 12:24:58 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:24:58 user nova-compute[74840]:       <mac address="fa:16:3e:97:67:76"/>
Nov 08 12:24:58 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:24:58 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:24:58 user nova-compute[74840]:       <target dev="tap7cf349fa-e3"/>
Nov 08 12:24:58 user nova-compute[74840]:     </interface>
Nov 08 12:24:58 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:24:58 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/console.log" append="off"/>
Nov 08 12:24:58 user nova-compute[74840]:     </serial>
Nov 08 12:24:58 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:24:58 user nova-compute[74840]:     <video>
Nov 08 12:24:58 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:24:58 user nova-compute[74840]:     </video>
Nov 08 12:24:58 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:24:58 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:24:58 user nova-compute[74840]:     </rng>
Nov 08 12:24:58 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:24:58 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:24:58 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:24:58 user nova-compute[74840]:     </memballoon>
Nov 08 12:24:58 user nova-compute[74840]:   </devices>
Nov 08 12:24:58 user nova-compute[74840]: </domain>
Nov 08 12:24:58 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:24:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1092983192',display_name='tempest-ServerActionsTestOtherA-server-1092983192',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1092983192',id=31,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAmkFC6dPojPaRdPJh94q0/wuvRVxh1HPsrsmItydl0iUnCu6UdbkD5pi9CgzgYpLamuUC6eRZK4fPtOQ5ReX7Sfuo5mKd9gSajCUuWaRBqISYVRzAbikSahnbP3hsO0g==',key_name='tempest-keypair-428361338',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e47ef156b3649839ff728eaf23121da',ramdisk_id='',reservation_id='r-jd81dz6r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-401855506',owner_user_name='tempest-ServerActionsTestOtherA-401855506-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:24:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a49f88cb74c47bdb9a35883adbae454',uuid=10c42516-62ba-4aa9-bc5a-d94499bd6b65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cf349fa-e382-4526-af9d-f60a53d870cb", "address": "fa:16:3e:97:67:76", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cf349fa-e3", "ovs_interfaceid": "7cf349fa-e382-4526-af9d-f60a53d870cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Converting VIF {"id": "7cf349fa-e382-4526-af9d-f60a53d870cb", "address": "fa:16:3e:97:67:76", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cf349fa-e3", "ovs_interfaceid": "7cf349fa-e382-4526-af9d-f60a53d870cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:67:76,bridge_name='br-int',has_traffic_filtering=True,id=7cf349fa-e382-4526-af9d-f60a53d870cb,network=Network(e92448c4-9bc0-424b-a07f-a398ac46fada),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cf349fa-e3') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG os_vif [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:67:76,bridge_name='br-int',has_traffic_filtering=True,id=7cf349fa-e382-4526-af9d-f60a53d870cb,network=Network(e92448c4-9bc0-424b-a07f-a398ac46fada),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cf349fa-e3') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6834acf0-9ad4-5cdc-8683-7d852d2f700f', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7cf349fa-e3, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7cf349fa-e3, col_values=(('qos', UUID('a2a2f901-b53a-4561-a3b8-dd8af374e17e')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7cf349fa-e3, col_values=(('external_ids', {'iface-id': '7cf349fa-e382-4526-af9d-f60a53d870cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:67:76', 'vm-uuid': '10c42516-62ba-4aa9-bc5a-d94499bd6b65'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:24:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:24:58 user nova-compute[74840]: INFO os_vif [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:67:76,bridge_name='br-int',has_traffic_filtering=True,id=7cf349fa-e382-4526-af9d-f60a53d870cb,network=Network(e92448c4-9bc0-424b-a07f-a398ac46fada),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cf349fa-e3')
Nov 08 12:24:59 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:24:59 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] No VIF found with MAC fa:16:3e:97:67:76, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:24:59 user nova-compute[74840]: DEBUG nova.network.neutron [req-20def6c5-257f-4e86-ada2-32fb3dd4fc4e req-476212c4-cf08-40bb-b11b-1efe8060c2d5 service nova] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Updated VIF entry in instance network info cache for port 7cf349fa-e382-4526-af9d-f60a53d870cb. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:24:59 user nova-compute[74840]: DEBUG nova.network.neutron [req-20def6c5-257f-4e86-ada2-32fb3dd4fc4e req-476212c4-cf08-40bb-b11b-1efe8060c2d5 service nova] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Updating instance_info_cache with network_info: [{"id": "7cf349fa-e382-4526-af9d-f60a53d870cb", "address": "fa:16:3e:97:67:76", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cf349fa-e3", "ovs_interfaceid": "7cf349fa-e382-4526-af9d-f60a53d870cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:24:59 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-20def6c5-257f-4e86-ada2-32fb3dd4fc4e req-476212c4-cf08-40bb-b11b-1efe8060c2d5 service nova] Releasing lock "refresh_cache-10c42516-62ba-4aa9-bc5a-d94499bd6b65" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:25:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:00 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:25:00 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:25:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:25:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:25:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:25:00 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:25:00 user nova-compute[74840]: INFO nova.compute.manager [None req-17da9f15-8dcd-4bfa-b3e5-2adf7d1a8941 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Unrescuing
Nov 08 12:25:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-17da9f15-8dcd-4bfa-b3e5-2adf7d1a8941 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquiring lock "refresh_cache-ffe50042-29bf-4ef3-a148-8698bc75233b" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:25:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-17da9f15-8dcd-4bfa-b3e5-2adf7d1a8941 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquired lock "refresh_cache-ffe50042-29bf-4ef3-a148-8698bc75233b" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:25:00 user nova-compute[74840]: DEBUG nova.network.neutron [None req-17da9f15-8dcd-4bfa-b3e5-2adf7d1a8941 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:25:00 user nova-compute[74840]: DEBUG nova.compute.manager [req-ca6a9181-d2d8-42c0-bab9-e5af0870cb02 req-18733203-43b1-4b18-86aa-f1504353e739 service nova] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Received event network-vif-plugged-7cf349fa-e382-4526-af9d-f60a53d870cb {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:25:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-ca6a9181-d2d8-42c0-bab9-e5af0870cb02 req-18733203-43b1-4b18-86aa-f1504353e739 service nova] Acquiring lock "10c42516-62ba-4aa9-bc5a-d94499bd6b65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:25:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-ca6a9181-d2d8-42c0-bab9-e5af0870cb02 req-18733203-43b1-4b18-86aa-f1504353e739 service nova] Lock "10c42516-62ba-4aa9-bc5a-d94499bd6b65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:25:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-ca6a9181-d2d8-42c0-bab9-e5af0870cb02 req-18733203-43b1-4b18-86aa-f1504353e739 service nova] Lock "10c42516-62ba-4aa9-bc5a-d94499bd6b65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:25:00 user nova-compute[74840]: DEBUG nova.compute.manager [req-ca6a9181-d2d8-42c0-bab9-e5af0870cb02 req-18733203-43b1-4b18-86aa-f1504353e739 service nova] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] No waiting events found dispatching network-vif-plugged-7cf349fa-e382-4526-af9d-f60a53d870cb {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:25:00 user nova-compute[74840]: WARNING nova.compute.manager [req-ca6a9181-d2d8-42c0-bab9-e5af0870cb02 req-18733203-43b1-4b18-86aa-f1504353e739 service nova] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Received unexpected event network-vif-plugged-7cf349fa-e382-4526-af9d-f60a53d870cb for instance with vm_state building and task_state spawning.
Nov 08 12:25:01 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:25:01 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:25:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6ea2c9a-81d4-4933-bff3-406aedd79031/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:25:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6ea2c9a-81d4-4933-bff3-406aedd79031/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:25:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6ea2c9a-81d4-4933-bff3-406aedd79031/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:25:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6ea2c9a-81d4-4933-bff3-406aedd79031/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:25:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:25:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:01 user nova-compute[74840]: DEBUG nova.network.neutron [None req-17da9f15-8dcd-4bfa-b3e5-2adf7d1a8941 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Updating instance_info_cache with network_info: [{"id": "6169b221-7840-4cfb-ba25-e34a95b35e77", "address": "fa:16:3e:b0:6a:c2", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6169b221-78", "ovs_interfaceid": "6169b221-7840-4cfb-ba25-e34a95b35e77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:25:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-17da9f15-8dcd-4bfa-b3e5-2adf7d1a8941 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Releasing lock "refresh_cache-ffe50042-29bf-4ef3-a148-8698bc75233b" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:25:01 user nova-compute[74840]: DEBUG nova.objects.instance [None req-17da9f15-8dcd-4bfa-b3e5-2adf7d1a8941 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lazy-loading 'flavor' on Instance uuid ffe50042-29bf-4ef3-a148-8698bc75233b {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:25:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:25:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:25:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:25:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:25:02 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:02 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:25:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:25:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:25:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:25:02 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Instance destroyed successfully.
Nov 08 12:25:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:25:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:25:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:25:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4622ff-b81c-40d3-92bf-bc30ef64b68f/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:25:02 user nova-compute[74840]: DEBUG nova.compute.manager [req-20eaa567-dd61-4b84-b7cd-40e57271d3c9 req-f15aeeb3-2c85-4c5b-8200-8314cfc52e59 service nova] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Received event network-vif-plugged-7cf349fa-e382-4526-af9d-f60a53d870cb {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:25:02 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-20eaa567-dd61-4b84-b7cd-40e57271d3c9 req-f15aeeb3-2c85-4c5b-8200-8314cfc52e59 service nova] Acquiring lock "10c42516-62ba-4aa9-bc5a-d94499bd6b65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:25:02 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-20eaa567-dd61-4b84-b7cd-40e57271d3c9 req-f15aeeb3-2c85-4c5b-8200-8314cfc52e59 service nova] Lock "10c42516-62ba-4aa9-bc5a-d94499bd6b65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:25:02 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-20eaa567-dd61-4b84-b7cd-40e57271d3c9 req-f15aeeb3-2c85-4c5b-8200-8314cfc52e59 service nova] Lock "10c42516-62ba-4aa9-bc5a-d94499bd6b65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:25:02 user nova-compute[74840]: DEBUG nova.compute.manager [req-20eaa567-dd61-4b84-b7cd-40e57271d3c9 req-f15aeeb3-2c85-4c5b-8200-8314cfc52e59 service nova] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] No waiting events found dispatching network-vif-plugged-7cf349fa-e382-4526-af9d-f60a53d870cb {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:25:02 user nova-compute[74840]: WARNING nova.compute.manager [req-20eaa567-dd61-4b84-b7cd-40e57271d3c9 req-f15aeeb3-2c85-4c5b-8200-8314cfc52e59 service nova] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Received unexpected event network-vif-plugged-7cf349fa-e382-4526-af9d-f60a53d870cb for instance with vm_state building and task_state spawning.
Nov 08 12:25:02 user nova-compute[74840]: DEBUG nova.compute.manager [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:25:02 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:25:02 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Instance spawned successfully.
Nov 08 12:25:02 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:25:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Found default for hw_cdrom_bus of ide {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:25:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Found default for hw_disk_bus of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:25:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:25:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:25:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Found default for hw_video_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:25:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Found default for hw_vif_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:25:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4622ff-b81c-40d3-92bf-bc30ef64b68f/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:25:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4622ff-b81c-40d3-92bf-bc30ef64b68f/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:25:03 user nova-compute[74840]: INFO nova.compute.manager [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Took 6.23 seconds to spawn the instance on the hypervisor.
Nov 08 12:25:03 user nova-compute[74840]: DEBUG nova.compute.manager [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:25:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4622ff-b81c-40d3-92bf-bc30ef64b68f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:25:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:25:03 user nova-compute[74840]: INFO nova.compute.manager [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Took 7.13 seconds to build instance.
Nov 08 12:25:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4ed882b6-7dbd-43b8-a936-2f173b3c6bbc tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "10c42516-62ba-4aa9-bc5a-d94499bd6b65" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.275s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:25:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:25:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:25:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:25:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:25:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:25:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Acquiring lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:25:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:25:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:25:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:03 user nova-compute[74840]: DEBUG nova.compute.manager [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Starting instance... {{(pid=74840) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 12:25:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:25:04 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:25:04 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:25:04 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:25:04 user nova-compute[74840]: INFO nova.compute.claims [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Claim successful on node user
Nov 08 12:25:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:04 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:25:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:06 user nova-compute[74840]: DEBUG nova.compute.manager [None req-17da9f15-8dcd-4bfa-b3e5-2adf7d1a8941 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:25:06 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:25:06 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:25:06 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=7698MB free_disk=25.115703582763672GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:25:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:25:07 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:25:07 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:25:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.961s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:25:07 user nova-compute[74840]: DEBUG nova.compute.manager [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Start building networks asynchronously for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 12:25:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.293s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:25:07 user nova-compute[74840]: DEBUG nova.compute.manager [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Allocating IP information in the background. {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 12:25:07 user nova-compute[74840]: DEBUG nova.network.neutron [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 12:25:07 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 12:25:07 user nova-compute[74840]: DEBUG nova.compute.manager [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Start building block device mappings for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 12:25:07 user nova-compute[74840]: DEBUG nova.policy [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'afc4e8483a1f4e08b3f81a9b9323be84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a05cda834445fb94e71f6cac02f198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 12:25:07 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance d3e8efc6-7146-46ef-8433-380d7e69120c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:25:07 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance ffe50042-29bf-4ef3-a148-8698bc75233b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:25:07 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 8b7c490e-4c78-4e07-bc8a-3be2328963d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:25:07 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 832a6445-84ee-43a8-a5bc-a07670602912 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:25:07 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 4ce94f9d-be90-4b82-bc83-6777d2c871a6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:25:07 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance ef956aaf-1793-44f9-b33a-7a1f22edf161 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:25:07 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance ff4622ff-b81c-40d3-92bf-bc30ef64b68f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:25:07 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance e6ea2c9a-81d4-4933-bff3-406aedd79031 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:25:07 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 10c42516-62ba-4aa9-bc5a-d94499bd6b65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:25:07 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 4dcf7b89-a5ca-47ab-a4c9-878f53086de1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:25:07 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:25:07 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:25:07 user nova-compute[74840]: DEBUG nova.compute.manager [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Start spawning the instance on the hypervisor. {{(pid=74840) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 12:25:07 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:25:07 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Creating image(s)
Nov 08 12:25:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Acquiring lock "/opt/stack/data/nova/instances/4dcf7b89-a5ca-47ab-a4c9-878f53086de1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:25:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "/opt/stack/data/nova/instances/4dcf7b89-a5ca-47ab-a4c9-878f53086de1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:25:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "/opt/stack/data/nova/instances/4dcf7b89-a5ca-47ab-a4c9-878f53086de1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:25:07 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:25:07 user nova-compute[74840]: DEBUG nova.compute.manager [req-b9f6f6e7-4cbd-4e1e-9a82-a476b0c31dc7 req-bff0c25f-0af6-4874-b507-57bf683f2594 service nova] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Received event network-vif-unplugged-6169b221-7840-4cfb-ba25-e34a95b35e77 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:25:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-b9f6f6e7-4cbd-4e1e-9a82-a476b0c31dc7 req-bff0c25f-0af6-4874-b507-57bf683f2594 service nova] Acquiring lock "ffe50042-29bf-4ef3-a148-8698bc75233b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:25:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-b9f6f6e7-4cbd-4e1e-9a82-a476b0c31dc7 req-bff0c25f-0af6-4874-b507-57bf683f2594 service nova] Lock "ffe50042-29bf-4ef3-a148-8698bc75233b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:25:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-b9f6f6e7-4cbd-4e1e-9a82-a476b0c31dc7 req-bff0c25f-0af6-4874-b507-57bf683f2594 service nova] Lock "ffe50042-29bf-4ef3-a148-8698bc75233b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:25:07 user nova-compute[74840]: DEBUG nova.compute.manager [req-b9f6f6e7-4cbd-4e1e-9a82-a476b0c31dc7 req-bff0c25f-0af6-4874-b507-57bf683f2594 service nova] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] No waiting events found dispatching network-vif-unplugged-6169b221-7840-4cfb-ba25-e34a95b35e77 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:25:07 user nova-compute[74840]: WARNING nova.compute.manager [req-b9f6f6e7-4cbd-4e1e-9a82-a476b0c31dc7 req-bff0c25f-0af6-4874-b507-57bf683f2594 service nova] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Received unexpected event network-vif-unplugged-6169b221-7840-4cfb-ba25-e34a95b35e77 for instance with vm_state active and task_state None.
Nov 08 12:25:07 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.240s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:25:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Acquiring lock "5d26578eba85497f494c575690c4248f381a0fe6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:25:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:25:07 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:25:07 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:25:07 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:25:07 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:25:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.735s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:25:07 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:25:07 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74840) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 12:25:07 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:25:07 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.256s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:25:07 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/4dcf7b89-a5ca-47ab-a4c9-878f53086de1/disk 1073741824 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:25:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/4dcf7b89-a5ca-47ab-a4c9-878f53086de1/disk 1073741824" returned: 0 in 0.052s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:25:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.316s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:25:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:25:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.241s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:25:08 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4dcf7b89-a5ca-47ab-a4c9-878f53086de1/disk. size=1073741824 {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 12:25:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcf7b89-a5ca-47ab-a4c9-878f53086de1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:25:08 user nova-compute[74840]: DEBUG nova.network.neutron [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Successfully created port: f0b1fa9b-7ace-4c3b-af97-f62a085e0076 {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:25:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcf7b89-a5ca-47ab-a4c9-878f53086de1/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:25:08 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Cannot resize image /opt/stack/data/nova/instances/4dcf7b89-a5ca-47ab-a4c9-878f53086de1/disk to a smaller size. {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 12:25:08 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Created local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 12:25:08 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Ensure instance console log exists: /opt/stack/data/nova/instances/4dcf7b89-a5ca-47ab-a4c9-878f53086de1/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:25:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:25:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:25:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:25:08 user nova-compute[74840]: DEBUG nova.network.neutron [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Successfully updated port: f0b1fa9b-7ace-4c3b-af97-f62a085e0076 {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:25:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Acquiring lock "refresh_cache-4dcf7b89-a5ca-47ab-a4c9-878f53086de1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:25:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Acquired lock "refresh_cache-4dcf7b89-a5ca-47ab-a4c9-878f53086de1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:25:08 user nova-compute[74840]: DEBUG nova.network.neutron [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:25:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG nova.compute.manager [req-3ba69330-4e0e-4fc6-945c-35bdc4c7fbe0 req-d9a01b34-4d00-4039-a742-62fc9312261d service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Received event network-changed-f0b1fa9b-7ace-4c3b-af97-f62a085e0076 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG nova.compute.manager [req-3ba69330-4e0e-4fc6-945c-35bdc4c7fbe0 req-d9a01b34-4d00-4039-a742-62fc9312261d service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Refreshing instance network info cache due to event network-changed-f0b1fa9b-7ace-4c3b-af97-f62a085e0076. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3ba69330-4e0e-4fc6-945c-35bdc4c7fbe0 req-d9a01b34-4d00-4039-a742-62fc9312261d service nova] Acquiring lock "refresh_cache-4dcf7b89-a5ca-47ab-a4c9-878f53086de1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG nova.network.neutron [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG nova.network.neutron [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Updating instance_info_cache with network_info: [{"id": "f0b1fa9b-7ace-4c3b-af97-f62a085e0076", "address": "fa:16:3e:56:2a:9f", "network": {"id": "918d8aed-1f09-4cfb-9c7f-48f002ad6ba3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-927886396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a05cda834445fb94e71f6cac02f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b1fa9b-7a", "ovs_interfaceid": "f0b1fa9b-7ace-4c3b-af97-f62a085e0076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Releasing lock "refresh_cache-4dcf7b89-a5ca-47ab-a4c9-878f53086de1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG nova.compute.manager [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Instance network_info: |[{"id": "f0b1fa9b-7ace-4c3b-af97-f62a085e0076", "address": "fa:16:3e:56:2a:9f", "network": {"id": "918d8aed-1f09-4cfb-9c7f-48f002ad6ba3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-927886396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a05cda834445fb94e71f6cac02f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b1fa9b-7a", "ovs_interfaceid": "f0b1fa9b-7ace-4c3b-af97-f62a085e0076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3ba69330-4e0e-4fc6-945c-35bdc4c7fbe0 req-d9a01b34-4d00-4039-a742-62fc9312261d service nova] Acquired lock "refresh_cache-4dcf7b89-a5ca-47ab-a4c9-878f53086de1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG nova.network.neutron [req-3ba69330-4e0e-4fc6-945c-35bdc4c7fbe0 req-d9a01b34-4d00-4039-a742-62fc9312261d service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Refreshing network info cache for port f0b1fa9b-7ace-4c3b-af97-f62a085e0076 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Start _get_guest_xml network_info=[{"id": "f0b1fa9b-7ace-4c3b-af97-f62a085e0076", "address": "fa:16:3e:56:2a:9f", "network": {"id": "918d8aed-1f09-4cfb-9c7f-48f002ad6ba3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-927886396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a05cda834445fb94e71f6cac02f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b1fa9b-7a", "ovs_interfaceid": "f0b1fa9b-7ace-4c3b-af97-f62a085e0076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'image_id': '4fa17706-d304-4117-a420-dab994c703dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:25:09 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:25:09 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:25:09 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:25:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-391869052',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-391869052',id=32,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrGy7EpmCBYTbWiiHXAUW34ziKvgVFQxqUXholjrggD3zzCzFnJaLmcpIi16aC0dgaBENrhZl/DCndvcoRIFslJq5F6SEzu3+3GzYY2+JpNAzefU+twGFUUtMYhD5mdUw==',key_name='tempest-keypair-1869051926',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93a05cda834445fb94e71f6cac02f198',ramdisk_id='',reservation_id='r-ovc6od6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1958698266',owner_user_name='tempest-AttachVolumeShelveTestJSON-1958698266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:25:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='afc4e8483a1f4e08b3f81a9b9323be84',uuid=4dcf7b89-a5ca-47ab-a4c9-878f53086de1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0b1fa9b-7ace-4c3b-af97-f62a085e0076", "address": "fa:16:3e:56:2a:9f", "network": {"id": "918d8aed-1f09-4cfb-9c7f-48f002ad6ba3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-927886396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a05cda834445fb94e71f6cac02f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b1fa9b-7a", "ovs_interfaceid": "f0b1fa9b-7ace-4c3b-af97-f62a085e0076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Converting VIF {"id": "f0b1fa9b-7ace-4c3b-af97-f62a085e0076", "address": "fa:16:3e:56:2a:9f", "network": {"id": "918d8aed-1f09-4cfb-9c7f-48f002ad6ba3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-927886396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a05cda834445fb94e71f6cac02f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b1fa9b-7a", "ovs_interfaceid": "f0b1fa9b-7ace-4c3b-af97-f62a085e0076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:2a:9f,bridge_name='br-int',has_traffic_filtering=True,id=f0b1fa9b-7ace-4c3b-af97-f62a085e0076,network=Network(918d8aed-1f09-4cfb-9c7f-48f002ad6ba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b1fa9b-7a') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG nova.objects.instance [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lazy-loading 'pci_devices' on Instance uuid 4dcf7b89-a5ca-47ab-a4c9-878f53086de1 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:25:09 user nova-compute[74840]:   <uuid>4dcf7b89-a5ca-47ab-a4c9-878f53086de1</uuid>
Nov 08 12:25:09 user nova-compute[74840]:   <name>instance-00000020</name>
Nov 08 12:25:09 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:25:09 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:25:09 user nova-compute[74840]:   <metadata>
Nov 08 12:25:09 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:25:09 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:25:09 user nova-compute[74840]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-391869052</nova:name>
Nov 08 12:25:09 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:25:09</nova:creationTime>
Nov 08 12:25:09 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:25:09 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:25:09 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:25:09 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:25:09 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:25:09 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:25:09 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:25:09 user nova-compute[74840]:       <nova:owner>
Nov 08 12:25:09 user nova-compute[74840]:         <nova:user uuid="afc4e8483a1f4e08b3f81a9b9323be84">tempest-AttachVolumeShelveTestJSON-1958698266-project-member</nova:user>
Nov 08 12:25:09 user nova-compute[74840]:         <nova:project uuid="93a05cda834445fb94e71f6cac02f198">tempest-AttachVolumeShelveTestJSON-1958698266</nova:project>
Nov 08 12:25:09 user nova-compute[74840]:       </nova:owner>
Nov 08 12:25:09 user nova-compute[74840]:       <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:25:09 user nova-compute[74840]:       <nova:ports>
Nov 08 12:25:09 user nova-compute[74840]:         <nova:port uuid="f0b1fa9b-7ace-4c3b-af97-f62a085e0076">
Nov 08 12:25:09 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 08 12:25:09 user nova-compute[74840]:         </nova:port>
Nov 08 12:25:09 user nova-compute[74840]:       </nova:ports>
Nov 08 12:25:09 user nova-compute[74840]:     </nova:instance>
Nov 08 12:25:09 user nova-compute[74840]:   </metadata>
Nov 08 12:25:09 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:25:09 user nova-compute[74840]:     <system>
Nov 08 12:25:09 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:25:09 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:25:09 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:25:09 user nova-compute[74840]:       <entry name="serial">4dcf7b89-a5ca-47ab-a4c9-878f53086de1</entry>
Nov 08 12:25:09 user nova-compute[74840]:       <entry name="uuid">4dcf7b89-a5ca-47ab-a4c9-878f53086de1</entry>
Nov 08 12:25:09 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:25:09 user nova-compute[74840]:     </system>
Nov 08 12:25:09 user nova-compute[74840]:   </sysinfo>
Nov 08 12:25:09 user nova-compute[74840]:   <os>
Nov 08 12:25:09 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:25:09 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:25:09 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:25:09 user nova-compute[74840]:   </os>
Nov 08 12:25:09 user nova-compute[74840]:   <features>
Nov 08 12:25:09 user nova-compute[74840]:     <acpi/>
Nov 08 12:25:09 user nova-compute[74840]:     <apic/>
Nov 08 12:25:09 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:25:09 user nova-compute[74840]:   </features>
Nov 08 12:25:09 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:25:09 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:25:09 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:25:09 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:25:09 user nova-compute[74840]:   </clock>
Nov 08 12:25:09 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:25:09 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:25:09 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:25:09 user nova-compute[74840]:   </cpu>
Nov 08 12:25:09 user nova-compute[74840]:   <devices>
Nov 08 12:25:09 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:25:09 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:25:09 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/4dcf7b89-a5ca-47ab-a4c9-878f53086de1/disk"/>
Nov 08 12:25:09 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:25:09 user nova-compute[74840]:     </disk>
Nov 08 12:25:09 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:25:09 user nova-compute[74840]:       <mac address="fa:16:3e:56:2a:9f"/>
Nov 08 12:25:09 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:25:09 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:25:09 user nova-compute[74840]:       <target dev="tapf0b1fa9b-7a"/>
Nov 08 12:25:09 user nova-compute[74840]:     </interface>
Nov 08 12:25:09 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:25:09 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/4dcf7b89-a5ca-47ab-a4c9-878f53086de1/console.log" append="off"/>
Nov 08 12:25:09 user nova-compute[74840]:     </serial>
Nov 08 12:25:09 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:25:09 user nova-compute[74840]:     <video>
Nov 08 12:25:09 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:25:09 user nova-compute[74840]:     </video>
Nov 08 12:25:09 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:25:09 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:25:09 user nova-compute[74840]:     </rng>
Nov 08 12:25:09 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:25:09 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:25:09 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:25:09 user nova-compute[74840]:     </memballoon>
Nov 08 12:25:09 user nova-compute[74840]:   </devices>
Nov 08 12:25:09 user nova-compute[74840]: </domain>
Nov 08 12:25:09 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:25:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-391869052',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-391869052',id=32,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrGy7EpmCBYTbWiiHXAUW34ziKvgVFQxqUXholjrggD3zzCzFnJaLmcpIi16aC0dgaBENrhZl/DCndvcoRIFslJq5F6SEzu3+3GzYY2+JpNAzefU+twGFUUtMYhD5mdUw==',key_name='tempest-keypair-1869051926',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93a05cda834445fb94e71f6cac02f198',ramdisk_id='',reservation_id='r-ovc6od6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1958698266',owner_user_name='tempest-AttachVolumeShelveTestJSON-1958698266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:25:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='afc4e8483a1f4e08b3f81a9b9323be84',uuid=4dcf7b89-a5ca-47ab-a4c9-878f53086de1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0b1fa9b-7ace-4c3b-af97-f62a085e0076", "address": "fa:16:3e:56:2a:9f", "network": {"id": "918d8aed-1f09-4cfb-9c7f-48f002ad6ba3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-927886396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a05cda834445fb94e71f6cac02f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b1fa9b-7a", "ovs_interfaceid": "f0b1fa9b-7ace-4c3b-af97-f62a085e0076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Converting VIF {"id": "f0b1fa9b-7ace-4c3b-af97-f62a085e0076", "address": "fa:16:3e:56:2a:9f", "network": {"id": "918d8aed-1f09-4cfb-9c7f-48f002ad6ba3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-927886396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a05cda834445fb94e71f6cac02f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b1fa9b-7a", "ovs_interfaceid": "f0b1fa9b-7ace-4c3b-af97-f62a085e0076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:2a:9f,bridge_name='br-int',has_traffic_filtering=True,id=f0b1fa9b-7ace-4c3b-af97-f62a085e0076,network=Network(918d8aed-1f09-4cfb-9c7f-48f002ad6ba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b1fa9b-7a') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG os_vif [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:2a:9f,bridge_name='br-int',has_traffic_filtering=True,id=f0b1fa9b-7ace-4c3b-af97-f62a085e0076,network=Network(918d8aed-1f09-4cfb-9c7f-48f002ad6ba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b1fa9b-7a') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4a20c944-8920-5dbe-a285-42570b3055d5', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0b1fa9b-7a, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf0b1fa9b-7a, col_values=(('qos', UUID('cea8495f-4094-4511-9915-41b697b2db7c')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf0b1fa9b-7a, col_values=(('external_ids', {'iface-id': 'f0b1fa9b-7ace-4c3b-af97-f62a085e0076', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:2a:9f', 'vm-uuid': '4dcf7b89-a5ca-47ab-a4c9-878f53086de1'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:09 user nova-compute[74840]: INFO os_vif [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:2a:9f,bridge_name='br-int',has_traffic_filtering=True,id=f0b1fa9b-7ace-4c3b-af97-f62a085e0076,network=Network(918d8aed-1f09-4cfb-9c7f-48f002ad6ba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b1fa9b-7a')
Nov 08 12:25:09 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] No VIF found with MAC fa:16:3e:56:2a:9f, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG nova.compute.manager [req-1413a476-5f82-4424-ba04-67f97cd76b87 req-ccb0ec9a-2cce-4ea1-b751-0fe89fbe19c4 service nova] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Received event network-vif-plugged-6169b221-7840-4cfb-ba25-e34a95b35e77 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-1413a476-5f82-4424-ba04-67f97cd76b87 req-ccb0ec9a-2cce-4ea1-b751-0fe89fbe19c4 service nova] Acquiring lock "ffe50042-29bf-4ef3-a148-8698bc75233b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-1413a476-5f82-4424-ba04-67f97cd76b87 req-ccb0ec9a-2cce-4ea1-b751-0fe89fbe19c4 service nova] Lock "ffe50042-29bf-4ef3-a148-8698bc75233b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-1413a476-5f82-4424-ba04-67f97cd76b87 req-ccb0ec9a-2cce-4ea1-b751-0fe89fbe19c4 service nova] Lock "ffe50042-29bf-4ef3-a148-8698bc75233b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG nova.compute.manager [req-1413a476-5f82-4424-ba04-67f97cd76b87 req-ccb0ec9a-2cce-4ea1-b751-0fe89fbe19c4 service nova] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] No waiting events found dispatching network-vif-plugged-6169b221-7840-4cfb-ba25-e34a95b35e77 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:25:09 user nova-compute[74840]: WARNING nova.compute.manager [req-1413a476-5f82-4424-ba04-67f97cd76b87 req-ccb0ec9a-2cce-4ea1-b751-0fe89fbe19c4 service nova] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Received unexpected event network-vif-plugged-6169b221-7840-4cfb-ba25-e34a95b35e77 for instance with vm_state active and task_state None.
Nov 08 12:25:09 user nova-compute[74840]: DEBUG nova.compute.manager [req-1413a476-5f82-4424-ba04-67f97cd76b87 req-ccb0ec9a-2cce-4ea1-b751-0fe89fbe19c4 service nova] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Received event network-vif-plugged-6169b221-7840-4cfb-ba25-e34a95b35e77 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-1413a476-5f82-4424-ba04-67f97cd76b87 req-ccb0ec9a-2cce-4ea1-b751-0fe89fbe19c4 service nova] Acquiring lock "ffe50042-29bf-4ef3-a148-8698bc75233b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-1413a476-5f82-4424-ba04-67f97cd76b87 req-ccb0ec9a-2cce-4ea1-b751-0fe89fbe19c4 service nova] Lock "ffe50042-29bf-4ef3-a148-8698bc75233b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-1413a476-5f82-4424-ba04-67f97cd76b87 req-ccb0ec9a-2cce-4ea1-b751-0fe89fbe19c4 service nova] Lock "ffe50042-29bf-4ef3-a148-8698bc75233b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG nova.compute.manager [req-1413a476-5f82-4424-ba04-67f97cd76b87 req-ccb0ec9a-2cce-4ea1-b751-0fe89fbe19c4 service nova] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] No waiting events found dispatching network-vif-plugged-6169b221-7840-4cfb-ba25-e34a95b35e77 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:25:09 user nova-compute[74840]: WARNING nova.compute.manager [req-1413a476-5f82-4424-ba04-67f97cd76b87 req-ccb0ec9a-2cce-4ea1-b751-0fe89fbe19c4 service nova] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Received unexpected event network-vif-plugged-6169b221-7840-4cfb-ba25-e34a95b35e77 for instance with vm_state active and task_state None.
Nov 08 12:25:09 user nova-compute[74840]: DEBUG nova.compute.manager [req-1413a476-5f82-4424-ba04-67f97cd76b87 req-ccb0ec9a-2cce-4ea1-b751-0fe89fbe19c4 service nova] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Received event network-vif-plugged-6169b221-7840-4cfb-ba25-e34a95b35e77 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-1413a476-5f82-4424-ba04-67f97cd76b87 req-ccb0ec9a-2cce-4ea1-b751-0fe89fbe19c4 service nova] Acquiring lock "ffe50042-29bf-4ef3-a148-8698bc75233b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-1413a476-5f82-4424-ba04-67f97cd76b87 req-ccb0ec9a-2cce-4ea1-b751-0fe89fbe19c4 service nova] Lock "ffe50042-29bf-4ef3-a148-8698bc75233b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-1413a476-5f82-4424-ba04-67f97cd76b87 req-ccb0ec9a-2cce-4ea1-b751-0fe89fbe19c4 service nova] Lock "ffe50042-29bf-4ef3-a148-8698bc75233b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG nova.compute.manager [req-1413a476-5f82-4424-ba04-67f97cd76b87 req-ccb0ec9a-2cce-4ea1-b751-0fe89fbe19c4 service nova] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] No waiting events found dispatching network-vif-plugged-6169b221-7840-4cfb-ba25-e34a95b35e77 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:25:09 user nova-compute[74840]: WARNING nova.compute.manager [req-1413a476-5f82-4424-ba04-67f97cd76b87 req-ccb0ec9a-2cce-4ea1-b751-0fe89fbe19c4 service nova] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Received unexpected event network-vif-plugged-6169b221-7840-4cfb-ba25-e34a95b35e77 for instance with vm_state active and task_state None.
Nov 08 12:25:09 user nova-compute[74840]: DEBUG nova.network.neutron [req-3ba69330-4e0e-4fc6-945c-35bdc4c7fbe0 req-d9a01b34-4d00-4039-a742-62fc9312261d service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Updated VIF entry in instance network info cache for port f0b1fa9b-7ace-4c3b-af97-f62a085e0076. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG nova.network.neutron [req-3ba69330-4e0e-4fc6-945c-35bdc4c7fbe0 req-d9a01b34-4d00-4039-a742-62fc9312261d service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Updating instance_info_cache with network_info: [{"id": "f0b1fa9b-7ace-4c3b-af97-f62a085e0076", "address": "fa:16:3e:56:2a:9f", "network": {"id": "918d8aed-1f09-4cfb-9c7f-48f002ad6ba3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-927886396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a05cda834445fb94e71f6cac02f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b1fa9b-7a", "ovs_interfaceid": "f0b1fa9b-7ace-4c3b-af97-f62a085e0076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:25:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3ba69330-4e0e-4fc6-945c-35bdc4c7fbe0 req-d9a01b34-4d00-4039-a742-62fc9312261d service nova] Releasing lock "refresh_cache-4dcf7b89-a5ca-47ab-a4c9-878f53086de1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:25:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:11 user nova-compute[74840]: DEBUG nova.compute.manager [req-f4c15adc-01f5-4a5e-a317-a215afb0d2f4 req-ba64b69f-a722-481c-84fb-82738ddb0958 service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Received event network-vif-plugged-f0b1fa9b-7ace-4c3b-af97-f62a085e0076 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:25:11 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-f4c15adc-01f5-4a5e-a317-a215afb0d2f4 req-ba64b69f-a722-481c-84fb-82738ddb0958 service nova] Acquiring lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:25:11 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-f4c15adc-01f5-4a5e-a317-a215afb0d2f4 req-ba64b69f-a722-481c-84fb-82738ddb0958 service nova] Lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:25:11 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-f4c15adc-01f5-4a5e-a317-a215afb0d2f4 req-ba64b69f-a722-481c-84fb-82738ddb0958 service nova] Lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:25:11 user nova-compute[74840]: DEBUG nova.compute.manager [req-f4c15adc-01f5-4a5e-a317-a215afb0d2f4 req-ba64b69f-a722-481c-84fb-82738ddb0958 service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] No waiting events found dispatching network-vif-plugged-f0b1fa9b-7ace-4c3b-af97-f62a085e0076 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:25:11 user nova-compute[74840]: WARNING nova.compute.manager [req-f4c15adc-01f5-4a5e-a317-a215afb0d2f4 req-ba64b69f-a722-481c-84fb-82738ddb0958 service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Received unexpected event network-vif-plugged-f0b1fa9b-7ace-4c3b-af97-f62a085e0076 for instance with vm_state building and task_state spawning.
Nov 08 12:25:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:13 user nova-compute[74840]: DEBUG nova.compute.manager [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:25:13 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:25:13 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Instance spawned successfully.
Nov 08 12:25:13 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:25:13 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Found default for hw_cdrom_bus of ide {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:25:13 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Found default for hw_disk_bus of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:25:13 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:25:13 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:25:13 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Found default for hw_video_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:25:13 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Found default for hw_vif_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:25:13 user nova-compute[74840]: DEBUG nova.compute.manager [req-6e6e8f0f-e7f1-4b4d-a0ea-954bd3d737b6 req-0844a150-4269-48dd-8850-b876b809d158 service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Received event network-vif-plugged-f0b1fa9b-7ace-4c3b-af97-f62a085e0076 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:25:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-6e6e8f0f-e7f1-4b4d-a0ea-954bd3d737b6 req-0844a150-4269-48dd-8850-b876b809d158 service nova] Acquiring lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:25:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-6e6e8f0f-e7f1-4b4d-a0ea-954bd3d737b6 req-0844a150-4269-48dd-8850-b876b809d158 service nova] Lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:25:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-6e6e8f0f-e7f1-4b4d-a0ea-954bd3d737b6 req-0844a150-4269-48dd-8850-b876b809d158 service nova] Lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:25:13 user nova-compute[74840]: DEBUG nova.compute.manager [req-6e6e8f0f-e7f1-4b4d-a0ea-954bd3d737b6 req-0844a150-4269-48dd-8850-b876b809d158 service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] No waiting events found dispatching network-vif-plugged-f0b1fa9b-7ace-4c3b-af97-f62a085e0076 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:25:13 user nova-compute[74840]: WARNING nova.compute.manager [req-6e6e8f0f-e7f1-4b4d-a0ea-954bd3d737b6 req-0844a150-4269-48dd-8850-b876b809d158 service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Received unexpected event network-vif-plugged-f0b1fa9b-7ace-4c3b-af97-f62a085e0076 for instance with vm_state building and task_state spawning.
Nov 08 12:25:13 user nova-compute[74840]: INFO nova.compute.manager [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Took 5.96 seconds to spawn the instance on the hypervisor.
Nov 08 12:25:13 user nova-compute[74840]: DEBUG nova.compute.manager [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:25:13 user nova-compute[74840]: INFO nova.compute.manager [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Took 9.41 seconds to build instance.
Nov 08 12:25:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-92e60f32-e46b-49a3-ae28-c7eb052353e3 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.637s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:25:14 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:15 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:25:15 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:25:15 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Triggering sync for uuid d3e8efc6-7146-46ef-8433-380d7e69120c {{(pid=74840) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 12:25:15 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Triggering sync for uuid ffe50042-29bf-4ef3-a148-8698bc75233b {{(pid=74840) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 12:25:15 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Triggering sync for uuid 8b7c490e-4c78-4e07-bc8a-3be2328963d7 {{(pid=74840) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 12:25:15 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Triggering sync for uuid 832a6445-84ee-43a8-a5bc-a07670602912 {{(pid=74840) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 12:25:15 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Triggering sync for uuid 4ce94f9d-be90-4b82-bc83-6777d2c871a6 {{(pid=74840) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 12:25:15 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Triggering sync for uuid ef956aaf-1793-44f9-b33a-7a1f22edf161 {{(pid=74840) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 12:25:15 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Triggering sync for uuid ff4622ff-b81c-40d3-92bf-bc30ef64b68f {{(pid=74840) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 12:25:15 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Triggering sync for uuid e6ea2c9a-81d4-4933-bff3-406aedd79031 {{(pid=74840) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 12:25:15 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Triggering sync for uuid 10c42516-62ba-4aa9-bc5a-d94499bd6b65 {{(pid=74840) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 12:25:15 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Triggering sync for uuid 4dcf7b89-a5ca-47ab-a4c9-878f53086de1 {{(pid=74840) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 12:25:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "d3e8efc6-7146-46ef-8433-380d7e69120c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:25:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "d3e8efc6-7146-46ef-8433-380d7e69120c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:25:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "ffe50042-29bf-4ef3-a148-8698bc75233b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:25:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "ffe50042-29bf-4ef3-a148-8698bc75233b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:25:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "8b7c490e-4c78-4e07-bc8a-3be2328963d7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:25:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "8b7c490e-4c78-4e07-bc8a-3be2328963d7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:25:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "832a6445-84ee-43a8-a5bc-a07670602912" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:25:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "832a6445-84ee-43a8-a5bc-a07670602912" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:25:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "4ce94f9d-be90-4b82-bc83-6777d2c871a6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:25:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "4ce94f9d-be90-4b82-bc83-6777d2c871a6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:25:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "ef956aaf-1793-44f9-b33a-7a1f22edf161" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:25:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "ef956aaf-1793-44f9-b33a-7a1f22edf161" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:25:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "ff4622ff-b81c-40d3-92bf-bc30ef64b68f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:25:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "ff4622ff-b81c-40d3-92bf-bc30ef64b68f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:25:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "e6ea2c9a-81d4-4933-bff3-406aedd79031" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:25:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "e6ea2c9a-81d4-4933-bff3-406aedd79031" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:25:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "10c42516-62ba-4aa9-bc5a-d94499bd6b65" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:25:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "10c42516-62ba-4aa9-bc5a-d94499bd6b65" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:25:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:25:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:25:15 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:25:15 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Cleaning up deleted instances {{(pid=74840) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 12:25:15 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] There are 0 instances to clean {{(pid=74840) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 12:25:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "d3e8efc6-7146-46ef-8433-380d7e69120c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:25:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "ffe50042-29bf-4ef3-a148-8698bc75233b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:25:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "8b7c490e-4c78-4e07-bc8a-3be2328963d7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:25:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "832a6445-84ee-43a8-a5bc-a07670602912" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:25:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "4ce94f9d-be90-4b82-bc83-6777d2c871a6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:25:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "ef956aaf-1793-44f9-b33a-7a1f22edf161" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.093s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:25:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "ff4622ff-b81c-40d3-92bf-bc30ef64b68f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.102s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:25:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "e6ea2c9a-81d4-4933-bff3-406aedd79031" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.107s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:25:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "10c42516-62ba-4aa9-bc5a-d94499bd6b65" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.117s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:25:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.121s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:25:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:22 user nova-compute[74840]: INFO nova.compute.manager [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Rescuing
Nov 08 12:25:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Acquiring lock "refresh_cache-8b7c490e-4c78-4e07-bc8a-3be2328963d7" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:25:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Acquired lock "refresh_cache-8b7c490e-4c78-4e07-bc8a-3be2328963d7" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:25:22 user nova-compute[74840]: DEBUG nova.network.neutron [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:25:23 user nova-compute[74840]: DEBUG nova.network.neutron [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Updating instance_info_cache with network_info: [{"id": "d9df071e-c4f0-4c80-9d63-3a41c849dca5", "address": "fa:16:3e:32:c4:9b", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9df071e-c4", "ovs_interfaceid": "d9df071e-c4f0-4c80-9d63-3a41c849dca5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:25:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Releasing lock "refresh_cache-8b7c490e-4c78-4e07-bc8a-3be2328963d7" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:25:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:23 user nova-compute[74840]: DEBUG nova.compute.manager [req-5bfd8c96-a1b4-41df-b123-72ab0dd7d7ad req-45fcc280-bbfc-4f85-bc0e-a887a2d6191e service nova] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Received event network-vif-unplugged-d9df071e-c4f0-4c80-9d63-3a41c849dca5 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:25:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-5bfd8c96-a1b4-41df-b123-72ab0dd7d7ad req-45fcc280-bbfc-4f85-bc0e-a887a2d6191e service nova] Acquiring lock "8b7c490e-4c78-4e07-bc8a-3be2328963d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:25:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-5bfd8c96-a1b4-41df-b123-72ab0dd7d7ad req-45fcc280-bbfc-4f85-bc0e-a887a2d6191e service nova] Lock "8b7c490e-4c78-4e07-bc8a-3be2328963d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:25:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-5bfd8c96-a1b4-41df-b123-72ab0dd7d7ad req-45fcc280-bbfc-4f85-bc0e-a887a2d6191e service nova] Lock "8b7c490e-4c78-4e07-bc8a-3be2328963d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:25:23 user nova-compute[74840]: DEBUG nova.compute.manager [req-5bfd8c96-a1b4-41df-b123-72ab0dd7d7ad req-45fcc280-bbfc-4f85-bc0e-a887a2d6191e service nova] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] No waiting events found dispatching network-vif-unplugged-d9df071e-c4f0-4c80-9d63-3a41c849dca5 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:25:23 user nova-compute[74840]: WARNING nova.compute.manager [req-5bfd8c96-a1b4-41df-b123-72ab0dd7d7ad req-45fcc280-bbfc-4f85-bc0e-a887a2d6191e service nova] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Received unexpected event network-vif-unplugged-d9df071e-c4f0-4c80-9d63-3a41c849dca5 for instance with vm_state active and task_state rescuing.
Nov 08 12:25:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:24 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Instance destroyed successfully.
Nov 08 12:25:24 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Attempting rescue
Nov 08 12:25:24 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74840) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 12:25:24 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Instance directory exists: not creating {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 12:25:24 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Creating image(s)
Nov 08 12:25:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Acquiring lock "/opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:25:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "/opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:25:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "/opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:25:24 user nova-compute[74840]: DEBUG nova.objects.instance [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8b7c490e-4c78-4e07-bc8a-3be2328963d7 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:25:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Acquiring lock "5d26578eba85497f494c575690c4248f381a0fe6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:25:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:25:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:25:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.173s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:25:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk.rescue {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:25:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk.rescue" returned: 0 in 0.049s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:25:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:25:24 user nova-compute[74840]: DEBUG nova.objects.instance [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lazy-loading 'migration_context' on Instance uuid 8b7c490e-4c78-4e07-bc8a-3be2328963d7 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:25:24 user nova-compute[74840]: DEBUG nova.objects.base [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Object Instance<8b7c490e-4c78-4e07-bc8a-3be2328963d7> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:25:24 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Created local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 12:25:24 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Start _get_guest_xml network_info=[{"id": "d9df071e-c4f0-4c80-9d63-3a41c849dca5", "address": "fa:16:3e:32:c4:9b", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "vif_mac": "fa:16:3e:32:c4:9b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9df071e-c4", "ovs_interfaceid": "d9df071e-c4f0-4c80-9d63-3a41c849dca5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '4fa17706-d304-4117-a420-dab994c703dc', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:25:24 user nova-compute[74840]: DEBUG nova.objects.instance [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lazy-loading 'resources' on Instance uuid 8b7c490e-4c78-4e07-bc8a-3be2328963d7 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:25:24 user nova-compute[74840]: DEBUG nova.objects.base [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Object Instance<8b7c490e-4c78-4e07-bc8a-3be2328963d7> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:25:24 user nova-compute[74840]: DEBUG nova.objects.instance [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lazy-loading 'numa_topology' on Instance uuid 8b7c490e-4c78-4e07-bc8a-3be2328963d7 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:25:24 user nova-compute[74840]: DEBUG nova.objects.base [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Object Instance<8b7c490e-4c78-4e07-bc8a-3be2328963d7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:25:24 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:25:24 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:25:24 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:25:24 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:25:24 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:25:24 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:25:24 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:25:24 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:25:24 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:25:24 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:25:24 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:25:24 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:25:24 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:25:24 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:25:24 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:25:24 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:25:24 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:25:24 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:25:24 user nova-compute[74840]: DEBUG nova.objects.instance [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8b7c490e-4c78-4e07-bc8a-3be2328963d7 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:25:24 user nova-compute[74840]: DEBUG nova.objects.base [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Object Instance<8b7c490e-4c78-4e07-bc8a-3be2328963d7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:25:24 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:20:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1812155088',display_name='tempest-ServerRescueNegativeTestJSON-server-1812155088',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1812155088',id=25,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:20:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='457d61e0588847528ef3dd42a6146599',ramdisk_id='',reservation_id='r-gqzxr43e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1814868989',owner_user_name='tempest-ServerRescueNegativeTestJSON-1814868989-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:20:38Z,user_data=None,user_id='6d4a3286c7d64d59b8ce2e4456db9cc2',uuid=8b7c490e-4c78-4e07-bc8a-3be2328963d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9df071e-c4f0-4c80-9d63-3a41c849dca5", "address": "fa:16:3e:32:c4:9b", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "vif_mac": "fa:16:3e:32:c4:9b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9df071e-c4", "ovs_interfaceid": "d9df071e-c4f0-4c80-9d63-3a41c849dca5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:25:24 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Converting VIF {"id": "d9df071e-c4f0-4c80-9d63-3a41c849dca5", "address": "fa:16:3e:32:c4:9b", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "vif_mac": "fa:16:3e:32:c4:9b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9df071e-c4", "ovs_interfaceid": "d9df071e-c4f0-4c80-9d63-3a41c849dca5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:25:24 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:c4:9b,bridge_name='br-int',has_traffic_filtering=True,id=d9df071e-c4f0-4c80-9d63-3a41c849dca5,network=Network(5ee2626f-3d55-44da-a731-761059adfa85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9df071e-c4') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:25:24 user nova-compute[74840]: DEBUG nova.objects.instance [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lazy-loading 'pci_devices' on Instance uuid 8b7c490e-4c78-4e07-bc8a-3be2328963d7 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:25:24 user nova-compute[74840]: DEBUG nova.objects.base [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Object Instance<8b7c490e-4c78-4e07-bc8a-3be2328963d7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:25:24 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:25:24 user nova-compute[74840]:   <uuid>8b7c490e-4c78-4e07-bc8a-3be2328963d7</uuid>
Nov 08 12:25:24 user nova-compute[74840]:   <name>instance-00000019</name>
Nov 08 12:25:24 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:25:24 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:25:24 user nova-compute[74840]:   <metadata>
Nov 08 12:25:24 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:25:24 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:25:24 user nova-compute[74840]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1812155088</nova:name>
Nov 08 12:25:24 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:25:24</nova:creationTime>
Nov 08 12:25:24 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:25:24 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:25:24 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:25:24 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:25:24 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:25:24 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:25:24 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:25:24 user nova-compute[74840]:       <nova:owner>
Nov 08 12:25:24 user nova-compute[74840]:         <nova:user uuid="6d4a3286c7d64d59b8ce2e4456db9cc2">tempest-ServerRescueNegativeTestJSON-1814868989-project-member</nova:user>
Nov 08 12:25:24 user nova-compute[74840]:         <nova:project uuid="457d61e0588847528ef3dd42a6146599">tempest-ServerRescueNegativeTestJSON-1814868989</nova:project>
Nov 08 12:25:24 user nova-compute[74840]:       </nova:owner>
Nov 08 12:25:24 user nova-compute[74840]:       <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:25:24 user nova-compute[74840]:       <nova:ports>
Nov 08 12:25:24 user nova-compute[74840]:         <nova:port uuid="d9df071e-c4f0-4c80-9d63-3a41c849dca5">
Nov 08 12:25:24 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 12:25:24 user nova-compute[74840]:         </nova:port>
Nov 08 12:25:24 user nova-compute[74840]:       </nova:ports>
Nov 08 12:25:24 user nova-compute[74840]:     </nova:instance>
Nov 08 12:25:24 user nova-compute[74840]:   </metadata>
Nov 08 12:25:24 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:25:24 user nova-compute[74840]:     <system>
Nov 08 12:25:24 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:25:24 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:25:24 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:25:24 user nova-compute[74840]:       <entry name="serial">8b7c490e-4c78-4e07-bc8a-3be2328963d7</entry>
Nov 08 12:25:24 user nova-compute[74840]:       <entry name="uuid">8b7c490e-4c78-4e07-bc8a-3be2328963d7</entry>
Nov 08 12:25:24 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:25:24 user nova-compute[74840]:     </system>
Nov 08 12:25:24 user nova-compute[74840]:   </sysinfo>
Nov 08 12:25:24 user nova-compute[74840]:   <os>
Nov 08 12:25:24 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:25:24 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:25:24 user nova-compute[74840]:   </os>
Nov 08 12:25:24 user nova-compute[74840]:   <features>
Nov 08 12:25:24 user nova-compute[74840]:     <acpi/>
Nov 08 12:25:24 user nova-compute[74840]:     <apic/>
Nov 08 12:25:24 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:25:24 user nova-compute[74840]:   </features>
Nov 08 12:25:24 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:25:24 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:25:24 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:25:24 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:25:24 user nova-compute[74840]:   </clock>
Nov 08 12:25:24 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:25:24 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:25:24 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:25:24 user nova-compute[74840]:   </cpu>
Nov 08 12:25:24 user nova-compute[74840]:   <devices>
Nov 08 12:25:24 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:25:24 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:25:24 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk.rescue"/>
Nov 08 12:25:24 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:25:24 user nova-compute[74840]:     </disk>
Nov 08 12:25:24 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:25:24 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:25:24 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk"/>
Nov 08 12:25:24 user nova-compute[74840]:       <target dev="vdb" bus="virtio"/>
Nov 08 12:25:24 user nova-compute[74840]:     </disk>
Nov 08 12:25:24 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:25:24 user nova-compute[74840]:       <mac address="fa:16:3e:32:c4:9b"/>
Nov 08 12:25:24 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:25:24 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:25:24 user nova-compute[74840]:       <target dev="tapd9df071e-c4"/>
Nov 08 12:25:24 user nova-compute[74840]:     </interface>
Nov 08 12:25:24 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:25:24 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/console.log" append="off"/>
Nov 08 12:25:24 user nova-compute[74840]:     </serial>
Nov 08 12:25:24 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:25:24 user nova-compute[74840]:     <video>
Nov 08 12:25:24 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:25:24 user nova-compute[74840]:     </video>
Nov 08 12:25:24 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:25:24 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:25:24 user nova-compute[74840]:     </rng>
Nov 08 12:25:24 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:25:24 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:25:24 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:25:24 user nova-compute[74840]:     </memballoon>
Nov 08 12:25:24 user nova-compute[74840]:   </devices>
Nov 08 12:25:24 user nova-compute[74840]: </domain>
Nov 08 12:25:24 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:25:24 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Instance destroyed successfully.
Nov 08 12:25:24 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:25:24 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:25:24 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] No VIF found with MAC fa:16:3e:32:c4:9b, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:25:25 user nova-compute[74840]: DEBUG nova.compute.manager [req-dbd75cd1-0a02-43dc-b4f1-58cc5c894d76 req-4f599e63-85e9-4533-a9f4-5da2060da69a service nova] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Received event network-vif-plugged-d9df071e-c4f0-4c80-9d63-3a41c849dca5 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:25:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-dbd75cd1-0a02-43dc-b4f1-58cc5c894d76 req-4f599e63-85e9-4533-a9f4-5da2060da69a service nova] Acquiring lock "8b7c490e-4c78-4e07-bc8a-3be2328963d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:25:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-dbd75cd1-0a02-43dc-b4f1-58cc5c894d76 req-4f599e63-85e9-4533-a9f4-5da2060da69a service nova] Lock "8b7c490e-4c78-4e07-bc8a-3be2328963d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:25:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-dbd75cd1-0a02-43dc-b4f1-58cc5c894d76 req-4f599e63-85e9-4533-a9f4-5da2060da69a service nova] Lock "8b7c490e-4c78-4e07-bc8a-3be2328963d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:25:25 user nova-compute[74840]: DEBUG nova.compute.manager [req-dbd75cd1-0a02-43dc-b4f1-58cc5c894d76 req-4f599e63-85e9-4533-a9f4-5da2060da69a service nova] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] No waiting events found dispatching network-vif-plugged-d9df071e-c4f0-4c80-9d63-3a41c849dca5 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:25:25 user nova-compute[74840]: WARNING nova.compute.manager [req-dbd75cd1-0a02-43dc-b4f1-58cc5c894d76 req-4f599e63-85e9-4533-a9f4-5da2060da69a service nova] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Received unexpected event network-vif-plugged-d9df071e-c4f0-4c80-9d63-3a41c849dca5 for instance with vm_state active and task_state rescuing.
Nov 08 12:25:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:27 user nova-compute[74840]: DEBUG nova.compute.manager [req-0c717fd1-9ec2-448d-8f05-9c9342581f05 req-f7bff5c0-c2fb-4b33-982d-3f038ab65b02 service nova] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Received event network-vif-plugged-d9df071e-c4f0-4c80-9d63-3a41c849dca5 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:25:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0c717fd1-9ec2-448d-8f05-9c9342581f05 req-f7bff5c0-c2fb-4b33-982d-3f038ab65b02 service nova] Acquiring lock "8b7c490e-4c78-4e07-bc8a-3be2328963d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:25:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0c717fd1-9ec2-448d-8f05-9c9342581f05 req-f7bff5c0-c2fb-4b33-982d-3f038ab65b02 service nova] Lock "8b7c490e-4c78-4e07-bc8a-3be2328963d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:25:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0c717fd1-9ec2-448d-8f05-9c9342581f05 req-f7bff5c0-c2fb-4b33-982d-3f038ab65b02 service nova] Lock "8b7c490e-4c78-4e07-bc8a-3be2328963d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:25:27 user nova-compute[74840]: DEBUG nova.compute.manager [req-0c717fd1-9ec2-448d-8f05-9c9342581f05 req-f7bff5c0-c2fb-4b33-982d-3f038ab65b02 service nova] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] No waiting events found dispatching network-vif-plugged-d9df071e-c4f0-4c80-9d63-3a41c849dca5 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:25:27 user nova-compute[74840]: WARNING nova.compute.manager [req-0c717fd1-9ec2-448d-8f05-9c9342581f05 req-f7bff5c0-c2fb-4b33-982d-3f038ab65b02 service nova] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Received unexpected event network-vif-plugged-d9df071e-c4f0-4c80-9d63-3a41c849dca5 for instance with vm_state active and task_state rescuing.
Nov 08 12:25:27 user nova-compute[74840]: DEBUG nova.compute.manager [req-0c717fd1-9ec2-448d-8f05-9c9342581f05 req-f7bff5c0-c2fb-4b33-982d-3f038ab65b02 service nova] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Received event network-vif-plugged-d9df071e-c4f0-4c80-9d63-3a41c849dca5 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:25:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0c717fd1-9ec2-448d-8f05-9c9342581f05 req-f7bff5c0-c2fb-4b33-982d-3f038ab65b02 service nova] Acquiring lock "8b7c490e-4c78-4e07-bc8a-3be2328963d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:25:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0c717fd1-9ec2-448d-8f05-9c9342581f05 req-f7bff5c0-c2fb-4b33-982d-3f038ab65b02 service nova] Lock "8b7c490e-4c78-4e07-bc8a-3be2328963d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:25:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0c717fd1-9ec2-448d-8f05-9c9342581f05 req-f7bff5c0-c2fb-4b33-982d-3f038ab65b02 service nova] Lock "8b7c490e-4c78-4e07-bc8a-3be2328963d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:25:27 user nova-compute[74840]: DEBUG nova.compute.manager [req-0c717fd1-9ec2-448d-8f05-9c9342581f05 req-f7bff5c0-c2fb-4b33-982d-3f038ab65b02 service nova] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] No waiting events found dispatching network-vif-plugged-d9df071e-c4f0-4c80-9d63-3a41c849dca5 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:25:27 user nova-compute[74840]: WARNING nova.compute.manager [req-0c717fd1-9ec2-448d-8f05-9c9342581f05 req-f7bff5c0-c2fb-4b33-982d-3f038ab65b02 service nova] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Received unexpected event network-vif-plugged-d9df071e-c4f0-4c80-9d63-3a41c849dca5 for instance with vm_state active and task_state rescuing.
Nov 08 12:25:28 user nova-compute[74840]: DEBUG nova.compute.manager [None req-00ff0d60-123f-4d49-b491-4fa43d5ecfef tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:25:29 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:30 user nova-compute[74840]: DEBUG nova.compute.manager [req-15b106a6-fb05-4cc3-a9a1-5b5f239ccd64 req-af5c5d9b-d33b-4d8f-b9ec-7bca8cfa4d48 service nova] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Received event network-changed-7e99639a-a260-4090-b429-69c9b64861aa {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:25:30 user nova-compute[74840]: DEBUG nova.compute.manager [req-15b106a6-fb05-4cc3-a9a1-5b5f239ccd64 req-af5c5d9b-d33b-4d8f-b9ec-7bca8cfa4d48 service nova] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Refreshing instance network info cache due to event network-changed-7e99639a-a260-4090-b429-69c9b64861aa. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:25:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-15b106a6-fb05-4cc3-a9a1-5b5f239ccd64 req-af5c5d9b-d33b-4d8f-b9ec-7bca8cfa4d48 service nova] Acquiring lock "refresh_cache-ef956aaf-1793-44f9-b33a-7a1f22edf161" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:25:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-15b106a6-fb05-4cc3-a9a1-5b5f239ccd64 req-af5c5d9b-d33b-4d8f-b9ec-7bca8cfa4d48 service nova] Acquired lock "refresh_cache-ef956aaf-1793-44f9-b33a-7a1f22edf161" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:25:30 user nova-compute[74840]: DEBUG nova.network.neutron [req-15b106a6-fb05-4cc3-a9a1-5b5f239ccd64 req-af5c5d9b-d33b-4d8f-b9ec-7bca8cfa4d48 service nova] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Refreshing network info cache for port 7e99639a-a260-4090-b429-69c9b64861aa {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:25:30 user nova-compute[74840]: DEBUG nova.network.neutron [req-15b106a6-fb05-4cc3-a9a1-5b5f239ccd64 req-af5c5d9b-d33b-4d8f-b9ec-7bca8cfa4d48 service nova] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Updated VIF entry in instance network info cache for port 7e99639a-a260-4090-b429-69c9b64861aa. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:25:30 user nova-compute[74840]: DEBUG nova.network.neutron [req-15b106a6-fb05-4cc3-a9a1-5b5f239ccd64 req-af5c5d9b-d33b-4d8f-b9ec-7bca8cfa4d48 service nova] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Updating instance_info_cache with network_info: [{"id": "7e99639a-a260-4090-b429-69c9b64861aa", "address": "fa:16:3e:bc:1e:ce", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e99639a-a2", "ovs_interfaceid": "7e99639a-a260-4090-b429-69c9b64861aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:25:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-15b106a6-fb05-4cc3-a9a1-5b5f239ccd64 req-af5c5d9b-d33b-4d8f-b9ec-7bca8cfa4d48 service nova] Releasing lock "refresh_cache-ef956aaf-1793-44f9-b33a-7a1f22edf161" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:25:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "ef956aaf-1793-44f9-b33a-7a1f22edf161" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:25:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "ef956aaf-1793-44f9-b33a-7a1f22edf161" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:25:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "ef956aaf-1793-44f9-b33a-7a1f22edf161-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:25:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "ef956aaf-1793-44f9-b33a-7a1f22edf161-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:25:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "ef956aaf-1793-44f9-b33a-7a1f22edf161-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:25:30 user nova-compute[74840]: INFO nova.compute.manager [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Terminating instance
Nov 08 12:25:30 user nova-compute[74840]: DEBUG nova.compute.manager [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Start destroying the instance on the hypervisor. {{(pid=74840) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 12:25:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:31 user nova-compute[74840]: DEBUG nova.compute.manager [req-855cf364-4b15-4c7d-90b3-c40bfa570aae req-3a7e1855-1938-48d9-9205-0d7f6c3a9e86 service nova] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Received event network-vif-unplugged-7e99639a-a260-4090-b429-69c9b64861aa {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:25:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-855cf364-4b15-4c7d-90b3-c40bfa570aae req-3a7e1855-1938-48d9-9205-0d7f6c3a9e86 service nova] Acquiring lock "ef956aaf-1793-44f9-b33a-7a1f22edf161-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:25:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-855cf364-4b15-4c7d-90b3-c40bfa570aae req-3a7e1855-1938-48d9-9205-0d7f6c3a9e86 service nova] Lock "ef956aaf-1793-44f9-b33a-7a1f22edf161-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:25:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-855cf364-4b15-4c7d-90b3-c40bfa570aae req-3a7e1855-1938-48d9-9205-0d7f6c3a9e86 service nova] Lock "ef956aaf-1793-44f9-b33a-7a1f22edf161-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:25:31 user nova-compute[74840]: DEBUG nova.compute.manager [req-855cf364-4b15-4c7d-90b3-c40bfa570aae req-3a7e1855-1938-48d9-9205-0d7f6c3a9e86 service nova] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] No waiting events found dispatching network-vif-unplugged-7e99639a-a260-4090-b429-69c9b64861aa {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:25:31 user nova-compute[74840]: DEBUG nova.compute.manager [req-855cf364-4b15-4c7d-90b3-c40bfa570aae req-3a7e1855-1938-48d9-9205-0d7f6c3a9e86 service nova] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Received event network-vif-unplugged-7e99639a-a260-4090-b429-69c9b64861aa for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:25:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:31 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Instance destroyed successfully.
Nov 08 12:25:31 user nova-compute[74840]: DEBUG nova.objects.instance [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lazy-loading 'resources' on Instance uuid ef956aaf-1793-44f9-b33a-7a1f22edf161 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:25:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:31 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:23:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1593166171',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1593166171',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1593166171',id=28,image_ref='9c877475-eac3-42ed-a106-87f5d239424f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnarJi3BBSUAx+vGcpgxOuJLDpVZAbY4ptnKTLNHljIZwFBJFKOALs751B+mfvm80rYTA+Fl+SJ6NqNh7KeIRnz5YzNJI2j8dAsu4tgXLIddM5bhDr4EFvbIPZw55KhVQ==',key_name='tempest-keypair-554008802',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:24:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1250106b55ae44b0b303849df7781ffb',ramdisk_id='',reservation_id='r-6yvumx1p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-77780905',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-77780905-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-77780905',owner_user_name='tempest-TestVolumeBootPattern-77780905-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:24:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='794c0281e1bf48f79117efdc3907e661',uuid=ef956aaf-1793-44f9-b33a-7a1f22edf161,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e99639a-a260-4090-b429-69c9b64861aa", "address": "fa:16:3e:bc:1e:ce", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e99639a-a2", "ovs_interfaceid": "7e99639a-a260-4090-b429-69c9b64861aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:25:31 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Converting VIF {"id": "7e99639a-a260-4090-b429-69c9b64861aa", "address": "fa:16:3e:bc:1e:ce", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e99639a-a2", "ovs_interfaceid": "7e99639a-a260-4090-b429-69c9b64861aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:25:31 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:1e:ce,bridge_name='br-int',has_traffic_filtering=True,id=7e99639a-a260-4090-b429-69c9b64861aa,network=Network(174da5e9-78cc-426f-87fb-1d3b23b8b459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e99639a-a2') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:25:31 user nova-compute[74840]: DEBUG os_vif [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:1e:ce,bridge_name='br-int',has_traffic_filtering=True,id=7e99639a-a260-4090-b429-69c9b64861aa,network=Network(174da5e9-78cc-426f-87fb-1d3b23b8b459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e99639a-a2') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:25:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e99639a-a2, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:25:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5bd41790-cda0-4be3-9aef-dbfa6b2aa7dd) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:25:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:25:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:31 user nova-compute[74840]: INFO os_vif [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:1e:ce,bridge_name='br-int',has_traffic_filtering=True,id=7e99639a-a260-4090-b429-69c9b64861aa,network=Network(174da5e9-78cc-426f-87fb-1d3b23b8b459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e99639a-a2')
Nov 08 12:25:31 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 12:25:31 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:918bf9dc-84aa-4cef-b0db-c9de45d81229', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qvaFQBfV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:25:31 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:25:31 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:25:31 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:25:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:25:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:25:31 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a151a9-f1a9-4e37-8146-f9568e82511d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:918bf9dc-84aa-4cef-b0db-c9de45d81229\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:25:31 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 12:25:31 user nova-compute[74840]: No targets found.
Nov 08 12:25:31 user nova-compute[74840]: iSNS:
Nov 08 12:25:31 user nova-compute[74840]: No targets found.
Nov 08 12:25:31 user nova-compute[74840]: STATIC:
Nov 08 12:25:31 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:918bf9dc-84aa-4cef-b0db-c9de45d81229
Nov 08 12:25:31 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:25:31 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:25:31 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4
Nov 08 12:25:31 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:25:31 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:25:31 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc
Nov 08 12:25:31 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:25:31 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:25:31 user nova-compute[74840]: FIRMWARE:
Nov 08 12:25:31 user nova-compute[74840]: No targets found.
Nov 08 12:25:31 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:25:31 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 12:25:31 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 12:25:31 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 12:25:31 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:918bf9dc-84aa-4cef-b0db-c9de45d81229', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 12:25:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:25:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:25:31 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ee2c02-7c58-4559-8bad-eaf9dca004b7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:918bf9dc-84aa-4cef-b0db-c9de45d81229\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:25:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:25:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:25:31 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[865d06e2-fc86-4dac-b4bf-1fc7fb4b468e]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:918bf9dc-84aa-4cef-b0db-c9de45d81229 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:25:31 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:25:31 user nova-compute[74840]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)
Nov 08 12:25:31 user nova-compute[74840]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:918bf9dc-84aa-4cef-b0db-c9de45d81229 (non-flash)
Nov 08 12:25:31 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:25:31 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:25:31 user nova-compute[74840]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)
Nov 08 12:25:31 user nova-compute[74840]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:918bf9dc-84aa-4cef-b0db-c9de45d81229 (non-flash)
Nov 08 12:25:31 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:25:31 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7f8f25f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:918bf9dc-84aa-4cef-b0db-c9de45d81229'): ({'sdb'}, set())}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 12:25:31 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Removing single pathed devices sdb {{(pid=74840) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 12:25:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:25:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:25:31 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e2ed23-bd9a-4181-be4b-40b3bf926ca9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:25:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:25:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.037s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:25:32 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[15bcc1e7-9d43-4eae-850d-ff0a0641a5a2]: (4, ('ok\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:25:32 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Flushing IO for device /dev/sdb {{(pid=74840) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 12:25:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:25:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:25:32 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b69f416-d8c7-4dc9-892b-b5aed6feb1ef]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:25:32 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74840) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 12:25:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:25:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:25:32 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6905ade2-0158-4f43-bff5-8984cf457682]: (4, ('1', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:25:32 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 12:25:32 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] SCSI volumes sdb have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 12:25:32 user nova-compute[74840]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO7f385fe-ccede599fa5b80b3', '/dev/disk/by-id/scsi-26363656465353939', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_7f385fe') {{(pid=85688) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 12:25:32 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff69473-7b38-4b71-9f39-5ebf9e56ad59]: (4, None) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:25:32 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:918bf9dc-84aa-4cef-b0db-c9de45d81229')] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 12:25:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:918bf9dc-84aa-4cef-b0db-c9de45d81229 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:25:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:918bf9dc-84aa-4cef-b0db-c9de45d81229 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:25:32 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c475ca3-e417-41f1-89e4-7abd322447b4]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:25:32 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:25:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:918bf9dc-84aa-4cef-b0db-c9de45d81229 -p 172.16.0.220:3260 --logout {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:25:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:918bf9dc-84aa-4cef-b0db-c9de45d81229 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:25:32 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a14092-a833-432e-94ba-f70d75434453]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:918bf9dc-84aa-4cef-b0db-c9de45d81229, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:918bf9dc-84aa-4cef-b0db-c9de45d81229, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:25:32 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:918bf9dc-84aa-4cef-b0db-c9de45d81229, portal: 172.16.0.220,3260]
Nov 08 12:25:32 user nova-compute[74840]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:918bf9dc-84aa-4cef-b0db-c9de45d81229, portal: 172.16.0.220,3260] successful.
Nov 08 12:25:32 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:25:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:918bf9dc-84aa-4cef-b0db-c9de45d81229 -p 172.16.0.220:3260 --op delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:25:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:918bf9dc-84aa-4cef-b0db-c9de45d81229 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:25:32 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5102062d-3663-4f7a-a36d-e93e7b4dc2ff]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:25:32 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:25:32 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.408s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:25:32 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] <== disconnect_volume: return (410ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:25:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 12:25:32 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Deleting instance files /opt/stack/data/nova/instances/ef956aaf-1793-44f9-b33a-7a1f22edf161_del
Nov 08 12:25:32 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Deletion of /opt/stack/data/nova/instances/ef956aaf-1793-44f9-b33a-7a1f22edf161_del complete
Nov 08 12:25:32 user nova-compute[74840]: INFO nova.compute.manager [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Took 1.35 seconds to destroy the instance on the hypervisor.
Nov 08 12:25:32 user nova-compute[74840]: DEBUG oslo.service.loopingcall [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74840) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 12:25:32 user nova-compute[74840]: DEBUG nova.compute.manager [-] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Deallocating network for instance {{(pid=74840) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 12:25:32 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] deallocate_for_instance() {{(pid=74840) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 12:25:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:33 user nova-compute[74840]: DEBUG nova.compute.manager [req-4b25bbac-28e6-4c21-9973-dd24f18d03ee req-6637a9c8-9e5a-4aa4-9cc5-17da22700574 service nova] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Received event network-vif-plugged-7e99639a-a260-4090-b429-69c9b64861aa {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:25:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4b25bbac-28e6-4c21-9973-dd24f18d03ee req-6637a9c8-9e5a-4aa4-9cc5-17da22700574 service nova] Acquiring lock "ef956aaf-1793-44f9-b33a-7a1f22edf161-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:25:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4b25bbac-28e6-4c21-9973-dd24f18d03ee req-6637a9c8-9e5a-4aa4-9cc5-17da22700574 service nova] Lock "ef956aaf-1793-44f9-b33a-7a1f22edf161-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:25:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4b25bbac-28e6-4c21-9973-dd24f18d03ee req-6637a9c8-9e5a-4aa4-9cc5-17da22700574 service nova] Lock "ef956aaf-1793-44f9-b33a-7a1f22edf161-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:25:33 user nova-compute[74840]: DEBUG nova.compute.manager [req-4b25bbac-28e6-4c21-9973-dd24f18d03ee req-6637a9c8-9e5a-4aa4-9cc5-17da22700574 service nova] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] No waiting events found dispatching network-vif-plugged-7e99639a-a260-4090-b429-69c9b64861aa {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:25:33 user nova-compute[74840]: WARNING nova.compute.manager [req-4b25bbac-28e6-4c21-9973-dd24f18d03ee req-6637a9c8-9e5a-4aa4-9cc5-17da22700574 service nova] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Received unexpected event network-vif-plugged-7e99639a-a260-4090-b429-69c9b64861aa for instance with vm_state active and task_state deleting.
Nov 08 12:25:33 user nova-compute[74840]: DEBUG nova.compute.manager [req-4b25bbac-28e6-4c21-9973-dd24f18d03ee req-6637a9c8-9e5a-4aa4-9cc5-17da22700574 service nova] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Received event network-vif-plugged-7e99639a-a260-4090-b429-69c9b64861aa {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:25:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4b25bbac-28e6-4c21-9973-dd24f18d03ee req-6637a9c8-9e5a-4aa4-9cc5-17da22700574 service nova] Acquiring lock "ef956aaf-1793-44f9-b33a-7a1f22edf161-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:25:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4b25bbac-28e6-4c21-9973-dd24f18d03ee req-6637a9c8-9e5a-4aa4-9cc5-17da22700574 service nova] Lock "ef956aaf-1793-44f9-b33a-7a1f22edf161-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:25:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4b25bbac-28e6-4c21-9973-dd24f18d03ee req-6637a9c8-9e5a-4aa4-9cc5-17da22700574 service nova] Lock "ef956aaf-1793-44f9-b33a-7a1f22edf161-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:25:33 user nova-compute[74840]: DEBUG nova.compute.manager [req-4b25bbac-28e6-4c21-9973-dd24f18d03ee req-6637a9c8-9e5a-4aa4-9cc5-17da22700574 service nova] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] No waiting events found dispatching network-vif-plugged-7e99639a-a260-4090-b429-69c9b64861aa {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:25:33 user nova-compute[74840]: WARNING nova.compute.manager [req-4b25bbac-28e6-4c21-9973-dd24f18d03ee req-6637a9c8-9e5a-4aa4-9cc5-17da22700574 service nova] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Received unexpected event network-vif-plugged-7e99639a-a260-4090-b429-69c9b64861aa for instance with vm_state active and task_state deleting.
Nov 08 12:25:33 user nova-compute[74840]: DEBUG nova.compute.manager [req-4b25bbac-28e6-4c21-9973-dd24f18d03ee req-6637a9c8-9e5a-4aa4-9cc5-17da22700574 service nova] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Received event network-vif-plugged-7e99639a-a260-4090-b429-69c9b64861aa {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:25:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4b25bbac-28e6-4c21-9973-dd24f18d03ee req-6637a9c8-9e5a-4aa4-9cc5-17da22700574 service nova] Acquiring lock "ef956aaf-1793-44f9-b33a-7a1f22edf161-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:25:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4b25bbac-28e6-4c21-9973-dd24f18d03ee req-6637a9c8-9e5a-4aa4-9cc5-17da22700574 service nova] Lock "ef956aaf-1793-44f9-b33a-7a1f22edf161-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:25:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4b25bbac-28e6-4c21-9973-dd24f18d03ee req-6637a9c8-9e5a-4aa4-9cc5-17da22700574 service nova] Lock "ef956aaf-1793-44f9-b33a-7a1f22edf161-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:25:33 user nova-compute[74840]: DEBUG nova.compute.manager [req-4b25bbac-28e6-4c21-9973-dd24f18d03ee req-6637a9c8-9e5a-4aa4-9cc5-17da22700574 service nova] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] No waiting events found dispatching network-vif-plugged-7e99639a-a260-4090-b429-69c9b64861aa {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:25:33 user nova-compute[74840]: WARNING nova.compute.manager [req-4b25bbac-28e6-4c21-9973-dd24f18d03ee req-6637a9c8-9e5a-4aa4-9cc5-17da22700574 service nova] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Received unexpected event network-vif-plugged-7e99639a-a260-4090-b429-69c9b64861aa for instance with vm_state active and task_state deleting.
Nov 08 12:25:33 user nova-compute[74840]: DEBUG nova.compute.manager [req-4b25bbac-28e6-4c21-9973-dd24f18d03ee req-6637a9c8-9e5a-4aa4-9cc5-17da22700574 service nova] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Received event network-vif-unplugged-7e99639a-a260-4090-b429-69c9b64861aa {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:25:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4b25bbac-28e6-4c21-9973-dd24f18d03ee req-6637a9c8-9e5a-4aa4-9cc5-17da22700574 service nova] Acquiring lock "ef956aaf-1793-44f9-b33a-7a1f22edf161-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:25:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4b25bbac-28e6-4c21-9973-dd24f18d03ee req-6637a9c8-9e5a-4aa4-9cc5-17da22700574 service nova] Lock "ef956aaf-1793-44f9-b33a-7a1f22edf161-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:25:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4b25bbac-28e6-4c21-9973-dd24f18d03ee req-6637a9c8-9e5a-4aa4-9cc5-17da22700574 service nova] Lock "ef956aaf-1793-44f9-b33a-7a1f22edf161-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:25:33 user nova-compute[74840]: DEBUG nova.compute.manager [req-4b25bbac-28e6-4c21-9973-dd24f18d03ee req-6637a9c8-9e5a-4aa4-9cc5-17da22700574 service nova] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] No waiting events found dispatching network-vif-unplugged-7e99639a-a260-4090-b429-69c9b64861aa {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:25:33 user nova-compute[74840]: DEBUG nova.compute.manager [req-4b25bbac-28e6-4c21-9973-dd24f18d03ee req-6637a9c8-9e5a-4aa4-9cc5-17da22700574 service nova] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Received event network-vif-unplugged-7e99639a-a260-4090-b429-69c9b64861aa for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:25:33 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:25:33 user nova-compute[74840]: INFO nova.compute.manager [-] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Took 1.55 seconds to deallocate network for instance.
Nov 08 12:25:34 user nova-compute[74840]: INFO nova.compute.manager [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Took 0.94 seconds to detach 1 volumes for instance.
Nov 08 12:25:34 user nova-compute[74840]: DEBUG nova.compute.manager [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Deleting volume: 918bf9dc-84aa-4cef-b0db-c9de45d81229 {{(pid=74840) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 12:25:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:25:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:25:35 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Refreshing inventories for resource provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 12:25:35 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Updating ProviderTree inventory for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 12:25:35 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Updating inventory in ProviderTree for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 12:25:35 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Refreshing aggregate associations for resource provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e, aggregates: None {{(pid=74840) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 12:25:35 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Refreshing trait associations for resource provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=74840) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 12:25:35 user nova-compute[74840]: DEBUG nova.compute.manager [req-0cba995b-bf54-423b-a585-9531ed7282b7 req-bd648a1a-0845-47bb-a269-62383e079f25 service nova] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Received event network-vif-plugged-7e99639a-a260-4090-b429-69c9b64861aa {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:25:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0cba995b-bf54-423b-a585-9531ed7282b7 req-bd648a1a-0845-47bb-a269-62383e079f25 service nova] Acquiring lock "ef956aaf-1793-44f9-b33a-7a1f22edf161-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:25:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0cba995b-bf54-423b-a585-9531ed7282b7 req-bd648a1a-0845-47bb-a269-62383e079f25 service nova] Lock "ef956aaf-1793-44f9-b33a-7a1f22edf161-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:25:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0cba995b-bf54-423b-a585-9531ed7282b7 req-bd648a1a-0845-47bb-a269-62383e079f25 service nova] Lock "ef956aaf-1793-44f9-b33a-7a1f22edf161-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:25:35 user nova-compute[74840]: DEBUG nova.compute.manager [req-0cba995b-bf54-423b-a585-9531ed7282b7 req-bd648a1a-0845-47bb-a269-62383e079f25 service nova] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] No waiting events found dispatching network-vif-plugged-7e99639a-a260-4090-b429-69c9b64861aa {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:25:35 user nova-compute[74840]: WARNING nova.compute.manager [req-0cba995b-bf54-423b-a585-9531ed7282b7 req-bd648a1a-0845-47bb-a269-62383e079f25 service nova] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Received unexpected event network-vif-plugged-7e99639a-a260-4090-b429-69c9b64861aa for instance with vm_state deleted and task_state None.
Nov 08 12:25:35 user nova-compute[74840]: DEBUG nova.compute.manager [req-0cba995b-bf54-423b-a585-9531ed7282b7 req-bd648a1a-0845-47bb-a269-62383e079f25 service nova] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Received event network-changed-c831f5ef-f115-4a26-9a02-227681561d9c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:25:35 user nova-compute[74840]: DEBUG nova.compute.manager [req-0cba995b-bf54-423b-a585-9531ed7282b7 req-bd648a1a-0845-47bb-a269-62383e079f25 service nova] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Refreshing instance network info cache due to event network-changed-c831f5ef-f115-4a26-9a02-227681561d9c. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:25:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0cba995b-bf54-423b-a585-9531ed7282b7 req-bd648a1a-0845-47bb-a269-62383e079f25 service nova] Acquiring lock "refresh_cache-ff4622ff-b81c-40d3-92bf-bc30ef64b68f" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:25:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0cba995b-bf54-423b-a585-9531ed7282b7 req-bd648a1a-0845-47bb-a269-62383e079f25 service nova] Acquired lock "refresh_cache-ff4622ff-b81c-40d3-92bf-bc30ef64b68f" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:25:35 user nova-compute[74840]: DEBUG nova.network.neutron [req-0cba995b-bf54-423b-a585-9531ed7282b7 req-bd648a1a-0845-47bb-a269-62383e079f25 service nova] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Refreshing network info cache for port c831f5ef-f115-4a26-9a02-227681561d9c {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:25:35 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:25:35 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:25:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.827s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:25:35 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Deleted allocations for instance ef956aaf-1793-44f9-b33a-7a1f22edf161
Nov 08 12:25:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-6283c957-e4f5-4661-acdd-e4d3e9ef3155 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "ef956aaf-1793-44f9-b33a-7a1f22edf161" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.985s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:25:36 user nova-compute[74840]: DEBUG nova.network.neutron [req-0cba995b-bf54-423b-a585-9531ed7282b7 req-bd648a1a-0845-47bb-a269-62383e079f25 service nova] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Updated VIF entry in instance network info cache for port c831f5ef-f115-4a26-9a02-227681561d9c. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:25:36 user nova-compute[74840]: DEBUG nova.network.neutron [req-0cba995b-bf54-423b-a585-9531ed7282b7 req-bd648a1a-0845-47bb-a269-62383e079f25 service nova] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Updating instance_info_cache with network_info: [{"id": "c831f5ef-f115-4a26-9a02-227681561d9c", "address": "fa:16:3e:dd:bf:19", "network": {"id": "e4de6ccf-60cb-4306-9865-a99d9d732446", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1640752753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18af32d3c92b465c92fddfee58d8ee19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc831f5ef-f1", "ovs_interfaceid": "c831f5ef-f115-4a26-9a02-227681561d9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:25:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0cba995b-bf54-423b-a585-9531ed7282b7 req-bd648a1a-0845-47bb-a269-62383e079f25 service nova] Releasing lock "refresh_cache-ff4622ff-b81c-40d3-92bf-bc30ef64b68f" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:25:36 user nova-compute[74840]: DEBUG nova.compute.manager [req-0cba995b-bf54-423b-a585-9531ed7282b7 req-bd648a1a-0845-47bb-a269-62383e079f25 service nova] [instance: ef956aaf-1793-44f9-b33a-7a1f22edf161] Received event network-vif-deleted-7e99639a-a260-4090-b429-69c9b64861aa {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:25:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-98a9ea9e-49dd-4d47-8d30-05e755a161ac tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Acquiring lock "ff4622ff-b81c-40d3-92bf-bc30ef64b68f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:25:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-98a9ea9e-49dd-4d47-8d30-05e755a161ac tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Lock "ff4622ff-b81c-40d3-92bf-bc30ef64b68f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:25:40 user nova-compute[74840]: DEBUG nova.objects.instance [None req-98a9ea9e-49dd-4d47-8d30-05e755a161ac tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Lazy-loading 'flavor' on Instance uuid ff4622ff-b81c-40d3-92bf-bc30ef64b68f {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:25:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-98a9ea9e-49dd-4d47-8d30-05e755a161ac tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Lock "ff4622ff-b81c-40d3-92bf-bc30ef64b68f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:25:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-98a9ea9e-49dd-4d47-8d30-05e755a161ac tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Acquiring lock "ff4622ff-b81c-40d3-92bf-bc30ef64b68f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:25:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-98a9ea9e-49dd-4d47-8d30-05e755a161ac tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Lock "ff4622ff-b81c-40d3-92bf-bc30ef64b68f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:25:40 user nova-compute[74840]: INFO nova.compute.manager [None req-98a9ea9e-49dd-4d47-8d30-05e755a161ac tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Attaching volume 79d66ec9-ce26-4a41-aa0d-14f9c5617bcc to /dev/vdb
Nov 08 12:25:40 user nova-compute[74840]: DEBUG os_brick.utils [None req-98a9ea9e-49dd-4d47-8d30-05e755a161ac tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:25:40 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:25:40 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:25:40 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b72d90-99a1-41fd-8621-334375ab27e3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c8228a11e03c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:25:40 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:25:40 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:25:40 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2fde2f4-3f93-489c-b175-5f544f096685]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:25:40 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:25:40 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:25:40 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abf789f-3516-4d69-989b-e00c5b0760ab]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:25:40 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c04d66-d46e-434a-acbf-cf059266cf9f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:25:40 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-98a9ea9e-49dd-4d47-8d30-05e755a161ac tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Running cmd (subprocess): nvme version {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:25:40 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-98a9ea9e-49dd-4d47-8d30-05e755a161ac tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] 'nvme version' failed. Not Retrying. {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:25:40 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.nvmeof [None req-98a9ea9e-49dd-4d47-8d30-05e755a161ac tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] nvme not present on system {{(pid=74840) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 12:25:40 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:25:40 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:25:40 user nova-compute[74840]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 12:25:40 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef2f8d8-be6c-41da-a90a-88578a084290]: (4, '') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:25:40 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-98a9ea9e-49dd-4d47-8d30-05e755a161ac tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74840) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 12:25:40 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-98a9ea9e-49dd-4d47-8d30-05e755a161ac tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 12:25:40 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-98a9ea9e-49dd-4d47-8d30-05e755a161ac tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] LIGHTOS: no hostnqn found. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 12:25:40 user nova-compute[74840]: DEBUG os_brick.utils [None req-98a9ea9e-49dd-4d47-8d30-05e755a161ac tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c8228a11e03c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:25:40 user nova-compute[74840]: DEBUG nova.virt.block_device [None req-98a9ea9e-49dd-4d47-8d30-05e755a161ac tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Updating existing volume attachment record: 527b1e5b-1bc7-4a19-a225-60841b20b1ba {{(pid=74840) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 12:25:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:42 user nova-compute[74840]: DEBUG nova.compute.manager [req-0ad5b685-e2a1-47cf-8081-9dfd986fc9b6 req-92e471a8-88a9-4c59-92b7-0ef828c880fd service nova] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Received event network-changed-4f9932a0-5bfa-48bc-bd1f-5f61bf96803c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:25:42 user nova-compute[74840]: DEBUG nova.compute.manager [req-0ad5b685-e2a1-47cf-8081-9dfd986fc9b6 req-92e471a8-88a9-4c59-92b7-0ef828c880fd service nova] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Refreshing instance network info cache due to event network-changed-4f9932a0-5bfa-48bc-bd1f-5f61bf96803c. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:25:42 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0ad5b685-e2a1-47cf-8081-9dfd986fc9b6 req-92e471a8-88a9-4c59-92b7-0ef828c880fd service nova] Acquiring lock "refresh_cache-e6ea2c9a-81d4-4933-bff3-406aedd79031" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:25:42 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0ad5b685-e2a1-47cf-8081-9dfd986fc9b6 req-92e471a8-88a9-4c59-92b7-0ef828c880fd service nova] Acquired lock "refresh_cache-e6ea2c9a-81d4-4933-bff3-406aedd79031" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:25:42 user nova-compute[74840]: DEBUG nova.network.neutron [req-0ad5b685-e2a1-47cf-8081-9dfd986fc9b6 req-92e471a8-88a9-4c59-92b7-0ef828c880fd service nova] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Refreshing network info cache for port 4f9932a0-5bfa-48bc-bd1f-5f61bf96803c {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:25:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Acquiring lock "e6ea2c9a-81d4-4933-bff3-406aedd79031" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:25:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "e6ea2c9a-81d4-4933-bff3-406aedd79031" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:25:43 user nova-compute[74840]: DEBUG nova.objects.instance [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lazy-loading 'flavor' on Instance uuid e6ea2c9a-81d4-4933-bff3-406aedd79031 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:25:43 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Ignoring supplied device name: /dev/vdb
Nov 08 12:25:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "e6ea2c9a-81d4-4933-bff3-406aedd79031" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.091s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:25:43 user nova-compute[74840]: DEBUG nova.network.neutron [req-0ad5b685-e2a1-47cf-8081-9dfd986fc9b6 req-92e471a8-88a9-4c59-92b7-0ef828c880fd service nova] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Updated VIF entry in instance network info cache for port 4f9932a0-5bfa-48bc-bd1f-5f61bf96803c. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:25:43 user nova-compute[74840]: DEBUG nova.network.neutron [req-0ad5b685-e2a1-47cf-8081-9dfd986fc9b6 req-92e471a8-88a9-4c59-92b7-0ef828c880fd service nova] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Updating instance_info_cache with network_info: [{"id": "4f9932a0-5bfa-48bc-bd1f-5f61bf96803c", "address": "fa:16:3e:0e:c1:c2", "network": {"id": "89a24eca-8c74-4e0e-b778-275f200927f0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1409559017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a082f8090094f009393593fb26b445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9932a0-5b", "ovs_interfaceid": "4f9932a0-5bfa-48bc-bd1f-5f61bf96803c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:25:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0ad5b685-e2a1-47cf-8081-9dfd986fc9b6 req-92e471a8-88a9-4c59-92b7-0ef828c880fd service nova] Releasing lock "refresh_cache-e6ea2c9a-81d4-4933-bff3-406aedd79031" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:25:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Acquiring lock "e6ea2c9a-81d4-4933-bff3-406aedd79031" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:25:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "e6ea2c9a-81d4-4933-bff3-406aedd79031" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:25:43 user nova-compute[74840]: INFO nova.compute.manager [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Attaching volume 6ae00900-c19b-42bd-b9ad-8d94f930741b to /dev/vdb
Nov 08 12:25:43 user nova-compute[74840]: DEBUG os_brick.utils [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:25:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:25:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:25:43 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[392b1258-1c52-4cf7-9ee8-43782159f637]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c8228a11e03c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:25:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:25:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:25:43 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c487fe2-e8e2-41da-ae82-2f34d9ee679c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:25:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:25:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:25:43 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeead885-9541-4805-9741-9baed62a6a55]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:25:43 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0347f4-70b3-4d65-b206-ca0156272e02]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:25:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Running cmd (subprocess): nvme version {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:25:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] 'nvme version' failed. Not Retrying. {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:25:43 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] nvme not present on system {{(pid=74840) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 12:25:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:25:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:25:43 user nova-compute[74840]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 12:25:43 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c41fa1-042b-4459-9507-d6609f6bef40]: (4, '') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:25:43 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74840) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 12:25:43 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 12:25:43 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] LIGHTOS: no hostnqn found. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 12:25:43 user nova-compute[74840]: DEBUG os_brick.utils [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c8228a11e03c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:25:43 user nova-compute[74840]: DEBUG nova.virt.block_device [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Updating existing volume attachment record: a1db99da-f661-4328-a1a1-9b2839d9acea {{(pid=74840) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 12:25:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:51 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:51 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:54 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:25:54 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:25:54 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:25:54 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "refresh_cache-832a6445-84ee-43a8-a5bc-a07670602912" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:25:54 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquired lock "refresh_cache-832a6445-84ee-43a8-a5bc-a07670602912" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:25:54 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Forcefully refreshing network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 12:25:55 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Updating instance_info_cache with network_info: [{"id": "48ba3111-f22a-4a29-8183-ccd94efa9086", "address": "fa:16:3e:83:fc:39", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ba3111-f2", "ovs_interfaceid": "48ba3111-f22a-4a29-8183-ccd94efa9086", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:25:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Releasing lock "refresh_cache-832a6445-84ee-43a8-a5bc-a07670602912" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:25:55 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Updated the network info_cache for instance {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 12:25:55 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:25:55 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:25:56 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:25:56 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:25:56 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:25:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:25:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:26:00 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:26:01 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:26:01 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:26:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:26:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:26:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:26:01 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:26:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:26:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:26:01 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:26:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6ea2c9a-81d4-4933-bff3-406aedd79031/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6ea2c9a-81d4-4933-bff3-406aedd79031/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6ea2c9a-81d4-4933-bff3-406aedd79031/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6ea2c9a-81d4-4933-bff3-406aedd79031/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcf7b89-a5ca-47ab-a4c9-878f53086de1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcf7b89-a5ca-47ab-a4c9-878f53086de1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcf7b89-a5ca-47ab-a4c9-878f53086de1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcf7b89-a5ca-47ab-a4c9-878f53086de1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4622ff-b81c-40d3-92bf-bc30ef64b68f/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4622ff-b81c-40d3-92bf-bc30ef64b68f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4622ff-b81c-40d3-92bf-bc30ef64b68f/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4622ff-b81c-40d3-92bf-bc30ef64b68f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk.rescue --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk.rescue --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98a9ea9e-49dd-4d47-8d30-05e755a161ac tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Calling os-brick to attach iSCSI Volume {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a9ea9e-49dd-4d47-8d30-05e755a161ac tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fyuEGKnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:26:05 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-98a9ea9e-49dd-4d47-8d30-05e755a161ac tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:26:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-98a9ea9e-49dd-4d47-8d30-05e755a161ac tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-98a9ea9e-49dd-4d47-8d30-05e755a161ac tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:26:05 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-98a9ea9e-49dd-4d47-8d30-05e755a161ac tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:26:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-98a9ea9e-49dd-4d47-8d30-05e755a161ac tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-98a9ea9e-49dd-4d47-8d30-05e755a161ac tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:26:05 user nova-compute[74840]: INFO os_brick.initiator.connectors.iscsi [None req-98a9ea9e-49dd-4d47-8d30-05e755a161ac tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 12:26:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc -p 172.16.0.220:3260 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:05 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:26:05 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:26:05 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=7577MB free_disk=25.039592742919922GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11d39d3-e2ba-4ead-b7db-779bd7f7ef61]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a9ea9e-49dd-4d47-8d30-05e755a161ac tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 12:26:05 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc -p 172.16.0.220:3260 --interface default --op new {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba995e1-04a4-41af-a141-267704a6459f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc] added\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a9ea9e-49dd-4d47-8d30-05e755a161ac tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc] added
Nov 08 12:26:05 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[043b5b5e-4fe6-44c1-9a7e-f3464b2ae387]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a9ea9e-49dd-4d47-8d30-05e755a161ac tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ca07e7-4816-495b-8fa0-082da6fc3e07]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a9ea9e-49dd-4d47-8d30-05e755a161ac tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fyuEGKnX {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fyuEGKnX" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb942e0-4f35-4b49-8306-22fa44d8f6b9]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a9ea9e-49dd-4d47-8d30-05e755a161ac tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fyuEGKnX'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance d3e8efc6-7146-46ef-8433-380d7e69120c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance ffe50042-29bf-4ef3-a148-8698bc75233b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 8b7c490e-4c78-4e07-bc8a-3be2328963d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 832a6445-84ee-43a8-a5bc-a07670602912 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 4ce94f9d-be90-4b82-bc83-6777d2c871a6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance ff4622ff-b81c-40d3-92bf-bc30ef64b68f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance e6ea2c9a-81d4-4933-bff3-406aedd79031 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 10c42516-62ba-4aa9-bc5a-d94499bd6b65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 4dcf7b89-a5ca-47ab-a4c9-878f53086de1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8acc0064-56d6-428f-a20e-2c6ac7aff8ef]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a9ea9e-49dd-4d47-8d30-05e755a161ac tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba91877-23d0-439c-904f-1b6d1a3f3da0]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a9ea9e-49dd-4d47-8d30-05e755a161ac tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:26:05 user nova-compute[74840]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)
Nov 08 12:26:05 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a9ea9e-49dd-4d47-8d30-05e755a161ac tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:26:05 user nova-compute[74840]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)
Nov 08 12:26:05 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc -p 172.16.0.220:3260 --login {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[220e5551-60ea-4a49-aadc-36dab007bc8d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a9ea9e-49dd-4d47-8d30-05e755a161ac tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc, portal: 172.16.0.220,3260]
Nov 08 12:26:05 user nova-compute[74840]: Login to [iface: default, target: iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc, portal: 172.16.0.220,3260] successful.
Nov 08 12:26:05 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[da923f3e-56d1-4461-8b82-6df876e59f85]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a9ea9e-49dd-4d47-8d30-05e755a161ac tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d8a5f8-f4e2-4026-9403-8de4f65a4439]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a9ea9e-49dd-4d47-8d30-05e755a161ac tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:26:05 user nova-compute[74840]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)
Nov 08 12:26:05 user nova-compute[74840]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc (non-flash)
Nov 08 12:26:05 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a9ea9e-49dd-4d47-8d30-05e755a161ac tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:26:05 user nova-compute[74840]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)
Nov 08 12:26:05 user nova-compute[74840]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc (non-flash)
Nov 08 12:26:05 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-98a9ea9e-49dd-4d47-8d30-05e755a161ac tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a9ea9e-49dd-4d47-8d30-05e755a161ac tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Connected to 172.16.0.220:3260 {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-98a9ea9e-49dd-4d47-8d30-05e755a161ac tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=74840) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-98a9ea9e-49dd-4d47-8d30-05e755a161ac tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74840) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9198652e-bca3-4d44-a008-229e096cd4d7]: (4, ('- - 0', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-98a9ea9e-49dd-4d47-8d30-05e755a161ac tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:26:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a9ea9e-49dd-4d47-8d30-05e755a161ac tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fyuEGKnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 12:26:06 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:26:06 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:26:06 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:26:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.465s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:26:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:26:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:26:06 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-98a9ea9e-49dd-4d47-8d30-05e755a161ac tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:26:06 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a9ea9e-49dd-4d47-8d30-05e755a161ac tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23666376166643333', 'path': '/dev/sdb'} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:26:06 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98a9ea9e-49dd-4d47-8d30-05e755a161ac tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666376166643333', 'path': '/dev/sdb'} {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 12:26:06 user nova-compute[74840]: DEBUG nova.objects.instance [None req-98a9ea9e-49dd-4d47-8d30-05e755a161ac tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Lazy-loading 'flavor' on Instance uuid ff4622ff-b81c-40d3-92bf-bc30ef64b68f {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:26:06 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-98a9ea9e-49dd-4d47-8d30-05e755a161ac tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 12:26:06 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:26:06 user nova-compute[74840]:   <source dev="/dev/sdb"/>
Nov 08 12:26:06 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:26:06 user nova-compute[74840]:   <serial>79d66ec9-ce26-4a41-aa0d-14f9c5617bcc</serial>
Nov 08 12:26:06 user nova-compute[74840]: </disk>
Nov 08 12:26:06 user nova-compute[74840]:  {{(pid=74840) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 12:26:07 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-98a9ea9e-49dd-4d47-8d30-05e755a161ac tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:26:07 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-98a9ea9e-49dd-4d47-8d30-05e755a161ac tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:26:07 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-98a9ea9e-49dd-4d47-8d30-05e755a161ac tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] No VIF found with MAC fa:16:3e:dd:bf:19, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:26:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-98a9ea9e-49dd-4d47-8d30-05e755a161ac tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Lock "ff4622ff-b81c-40d3-92bf-bc30ef64b68f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.074s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Calling os-brick to attach iSCSI Volume {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cOyegQGa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:26:08 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:26:08 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:26:08 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:26:08 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:26:08 user nova-compute[74840]: INFO os_brick.initiator.connectors.iscsi [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 12:26:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b -p 172.16.0.220:3260 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b19cb31-9a37-46b8-a48b-3ad525b537f0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 12:26:08 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b -p 172.16.0.220:3260 --interface default --op new {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3cd701c-a2b6-4bf5-b752-d8ad171d527a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b] added\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b] added
Nov 08 12:26:08 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[436ecf7d-939c-4659-bfbe-98a7250cdf66]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c966101-a9dc-405f-ae77-7dd94b576445]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cOyegQGa {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cOyegQGa" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0334bc-bb9b-41bc-8a69-90f257dd06f7]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cOyegQGa'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed938dde-a671-4075-9637-5e0c4455acc6]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d09825b-c08a-4d22-b860-5d4c09cbf19c]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:26:08 user nova-compute[74840]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)
Nov 08 12:26:08 user nova-compute[74840]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc (non-flash)
Nov 08 12:26:08 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:26:08 user nova-compute[74840]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)
Nov 08 12:26:08 user nova-compute[74840]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc (non-flash)
Nov 08 12:26:08 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b -p 172.16.0.220:3260 --login {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5431a720-cd32-485e-b8f7-6af20dbd1c1c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b, portal: 172.16.0.220,3260]
Nov 08 12:26:08 user nova-compute[74840]: Login to [iface: default, target: iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b, portal: 172.16.0.220,3260] successful.
Nov 08 12:26:08 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fec061c-522f-4ab3-ba63-6c08625bb54c]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ceb8c1-cfed-4c8c-a65c-8324066ecf6b]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:26:08 user nova-compute[74840]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)
Nov 08 12:26:08 user nova-compute[74840]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc (non-flash)
Nov 08 12:26:08 user nova-compute[74840]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b (non-flash)
Nov 08 12:26:08 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:26:08 user nova-compute[74840]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)
Nov 08 12:26:08 user nova-compute[74840]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc (non-flash)
Nov 08 12:26:08 user nova-compute[74840]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b (non-flash)
Nov 08 12:26:08 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Connected to 172.16.0.220:3260 {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=74840) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74840) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca0cc40-ff37-4260-9939-baeae43151e2]: (4, ('- - 0', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:26:08 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cOyegQGa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 12:26:09 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:26:09 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23864643166383061', 'path': '/dev/sdc'} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:26:09 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864643166383061', 'path': '/dev/sdc'} {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 12:26:09 user nova-compute[74840]: DEBUG nova.objects.instance [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lazy-loading 'flavor' on Instance uuid e6ea2c9a-81d4-4933-bff3-406aedd79031 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:26:09 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 12:26:09 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:26:09 user nova-compute[74840]:   <source dev="/dev/sdc"/>
Nov 08 12:26:09 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:26:09 user nova-compute[74840]:   <serial>6ae00900-c19b-42bd-b9ad-8d94f930741b</serial>
Nov 08 12:26:09 user nova-compute[74840]: </disk>
Nov 08 12:26:09 user nova-compute[74840]:  {{(pid=74840) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 12:26:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-66354191-be5e-4211-b22d-2283e9e61824 tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Acquiring lock "ff4622ff-b81c-40d3-92bf-bc30ef64b68f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:26:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-66354191-be5e-4211-b22d-2283e9e61824 tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Lock "ff4622ff-b81c-40d3-92bf-bc30ef64b68f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:26:09 user nova-compute[74840]: INFO nova.compute.manager [None req-66354191-be5e-4211-b22d-2283e9e61824 tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Detaching volume 79d66ec9-ce26-4a41-aa0d-14f9c5617bcc
Nov 08 12:26:09 user nova-compute[74840]: INFO nova.virt.block_device [None req-66354191-be5e-4211-b22d-2283e9e61824 tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Attempting to driver detach volume 79d66ec9-ce26-4a41-aa0d-14f9c5617bcc from mountpoint /dev/vdb
Nov 08 12:26:09 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-66354191-be5e-4211-b22d-2283e9e61824 tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Attempting to detach device vdb from instance ff4622ff-b81c-40d3-92bf-bc30ef64b68f from the persistent domain config. {{(pid=74840) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 12:26:09 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-66354191-be5e-4211-b22d-2283e9e61824 tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 12:26:09 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:26:09 user nova-compute[74840]:   <source dev="/dev/sdb"/>
Nov 08 12:26:09 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:26:09 user nova-compute[74840]:   <serial>79d66ec9-ce26-4a41-aa0d-14f9c5617bcc</serial>
Nov 08 12:26:09 user nova-compute[74840]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 12:26:09 user nova-compute[74840]: </disk>
Nov 08 12:26:09 user nova-compute[74840]:  {{(pid=74840) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 12:26:09 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-66354191-be5e-4211-b22d-2283e9e61824 tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Successfully detached device vdb from instance ff4622ff-b81c-40d3-92bf-bc30ef64b68f from the persistent domain config.
Nov 08 12:26:09 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-66354191-be5e-4211-b22d-2283e9e61824 tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ff4622ff-b81c-40d3-92bf-bc30ef64b68f from the live domain config. {{(pid=74840) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 12:26:09 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-66354191-be5e-4211-b22d-2283e9e61824 tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 12:26:09 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:26:09 user nova-compute[74840]:   <source dev="/dev/sdb"/>
Nov 08 12:26:09 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:26:09 user nova-compute[74840]:   <serial>79d66ec9-ce26-4a41-aa0d-14f9c5617bcc</serial>
Nov 08 12:26:09 user nova-compute[74840]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 12:26:09 user nova-compute[74840]: </disk>
Nov 08 12:26:09 user nova-compute[74840]:  {{(pid=74840) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 12:26:09 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:26:09 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:26:09 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] No VIF found with MAC fa:16:3e:0e:c1:c2, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:26:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-7f5080a3-b94e-4376-a82c-d9746ba7052d tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "e6ea2c9a-81d4-4933-bff3-406aedd79031" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.608s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:26:10 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-66354191-be5e-4211-b22d-2283e9e61824 tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ff4622ff-b81c-40d3-92bf-bc30ef64b68f {{(pid=74840) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 12:26:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:26:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:26:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 12:26:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:26:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:26:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:26:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:26:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:26:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:26:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:26:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:26:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 12:26:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:26:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:26:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:26:30 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-66354191-be5e-4211-b22d-2283e9e61824 tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ff4622ff-b81c-40d3-92bf-bc30ef64b68f is timed out.
Nov 08 12:26:30 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-66354191-be5e-4211-b22d-2283e9e61824 tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Successfully detached device vdb from instance ff4622ff-b81c-40d3-92bf-bc30ef64b68f from the live domain config.
Nov 08 12:26:30 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66354191-be5e-4211-b22d-2283e9e61824 tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 12:26:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-66354191-be5e-4211-b22d-2283e9e61824 tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fyuEGKnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:26:30 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-66354191-be5e-4211-b22d-2283e9e61824 tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:26:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-66354191-be5e-4211-b22d-2283e9e61824 tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:26:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-66354191-be5e-4211-b22d-2283e9e61824 tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:26:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:30 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01cc000-7fef-408a-a2d8-acbd87003ad9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f6442405-3472-418b-9276-eece58eceef9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:26:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-66354191-be5e-4211-b22d-2283e9e61824 tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 12:26:30 user nova-compute[74840]: No targets found.
Nov 08 12:26:30 user nova-compute[74840]: iSNS:
Nov 08 12:26:30 user nova-compute[74840]: No targets found.
Nov 08 12:26:30 user nova-compute[74840]: STATIC:
Nov 08 12:26:30 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b
Nov 08 12:26:30 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:26:30 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:26:30 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:f6442405-3472-418b-9276-eece58eceef9
Nov 08 12:26:30 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:26:30 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:26:30 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4
Nov 08 12:26:30 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:26:30 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:26:30 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc
Nov 08 12:26:30 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:26:30 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:26:30 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc
Nov 08 12:26:30 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:26:30 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:26:30 user nova-compute[74840]: FIRMWARE:
Nov 08 12:26:30 user nova-compute[74840]: No targets found.
Nov 08 12:26:30 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:26:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-66354191-be5e-4211-b22d-2283e9e61824 tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 12:26:30 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 12:26:30 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 12:26:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-66354191-be5e-4211-b22d-2283e9e61824 tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 12:26:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:30 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffcfb30-fc45-4bf9-af71-92aa0b60a4e7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6442405-3472-418b-9276-eece58eceef9\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:26:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:30 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[18020341-7a9a-43fa-8502-d7ca59823ac5]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6442405-3472-418b-9276-eece58eceef9 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:26:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-66354191-be5e-4211-b22d-2283e9e61824 tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:26:30 user nova-compute[74840]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)
Nov 08 12:26:30 user nova-compute[74840]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc (non-flash)
Nov 08 12:26:30 user nova-compute[74840]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b (non-flash)
Nov 08 12:26:30 user nova-compute[74840]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6442405-3472-418b-9276-eece58eceef9 (non-flash)
Nov 08 12:26:30 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:26:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-66354191-be5e-4211-b22d-2283e9e61824 tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:26:30 user nova-compute[74840]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)
Nov 08 12:26:30 user nova-compute[74840]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc (non-flash)
Nov 08 12:26:30 user nova-compute[74840]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b (non-flash)
Nov 08 12:26:30 user nova-compute[74840]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6442405-3472-418b-9276-eece58eceef9 (non-flash)
Nov 08 12:26:30 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:26:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-66354191-be5e-4211-b22d-2283e9e61824 tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7f47709d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc'): ({'sdb'}, set())}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 12:26:30 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-66354191-be5e-4211-b22d-2283e9e61824 tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Removing single pathed devices sdb {{(pid=74840) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 12:26:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:30 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5f995e-6e66-424f-b0b3-2ed5584dab30]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:26:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:30 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[00332d53-7e30-40d5-a630-b9cb4762ea2a]: (4, ('ok\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:26:30 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-66354191-be5e-4211-b22d-2283e9e61824 tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Flushing IO for device /dev/sdb {{(pid=74840) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 12:26:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:30 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e100fad-4ac4-4147-9ca5-32bffb0ca560]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:26:30 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-66354191-be5e-4211-b22d-2283e9e61824 tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74840) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 12:26:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:30 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa59010-39bf-4a8d-b497-1ca09a8e28c7]: (4, ('1', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:26:30 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-66354191-be5e-4211-b22d-2283e9e61824 tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 12:26:30 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-66354191-be5e-4211-b22d-2283e9e61824 tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] SCSI volumes sdb have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 12:26:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-66354191-be5e-4211-b22d-2283e9e61824 tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc')] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 12:26:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:30 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35eb20d-33ee-4180-93c1-6e99ec2f84ce]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:26:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-66354191-be5e-4211-b22d-2283e9e61824 tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:26:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc -p 172.16.0.220:3260 --logout {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:30 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[4279897b-15ed-475e-8ee2-f158991d2e06]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:26:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-66354191-be5e-4211-b22d-2283e9e61824 tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc, portal: 172.16.0.220,3260]
Nov 08 12:26:30 user nova-compute[74840]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc, portal: 172.16.0.220,3260] successful.
Nov 08 12:26:30 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:26:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc -p 172.16.0.220:3260 --op delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79d66ec9-ce26-4a41-aa0d-14f9c5617bcc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:30 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8037a0b-4d5b-4235-974a-34160b8e4a7e]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:26:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-66354191-be5e-4211-b22d-2283e9e61824 tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:26:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-66354191-be5e-4211-b22d-2283e9e61824 tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:26:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-66354191-be5e-4211-b22d-2283e9e61824 tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] <== disconnect_volume: return (352ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:26:30 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66354191-be5e-4211-b22d-2283e9e61824 tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 12:26:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:26:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d26462a5-709a-4b5c-b4fc-59794840a39a tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "4ce94f9d-be90-4b82-bc83-6777d2c871a6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:26:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d26462a5-709a-4b5c-b4fc-59794840a39a tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "4ce94f9d-be90-4b82-bc83-6777d2c871a6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:26:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d26462a5-709a-4b5c-b4fc-59794840a39a tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "4ce94f9d-be90-4b82-bc83-6777d2c871a6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:26:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d26462a5-709a-4b5c-b4fc-59794840a39a tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "4ce94f9d-be90-4b82-bc83-6777d2c871a6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:26:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d26462a5-709a-4b5c-b4fc-59794840a39a tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "4ce94f9d-be90-4b82-bc83-6777d2c871a6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:26:34 user nova-compute[74840]: INFO nova.compute.manager [None req-d26462a5-709a-4b5c-b4fc-59794840a39a tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Terminating instance
Nov 08 12:26:34 user nova-compute[74840]: DEBUG nova.compute.manager [None req-d26462a5-709a-4b5c-b4fc-59794840a39a tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Start destroying the instance on the hypervisor. {{(pid=74840) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 12:26:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:26:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:26:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:26:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:26:34 user nova-compute[74840]: DEBUG nova.compute.manager [req-1e122860-d00b-40bd-b5f3-ce1c6d189bd2 req-bba7241f-8e43-4f9a-9f9f-6bae821b81db service nova] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Received event network-vif-unplugged-ab70d9c8-3258-4119-ac39-e681ca7011a5 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:26:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-1e122860-d00b-40bd-b5f3-ce1c6d189bd2 req-bba7241f-8e43-4f9a-9f9f-6bae821b81db service nova] Acquiring lock "4ce94f9d-be90-4b82-bc83-6777d2c871a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:26:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-1e122860-d00b-40bd-b5f3-ce1c6d189bd2 req-bba7241f-8e43-4f9a-9f9f-6bae821b81db service nova] Lock "4ce94f9d-be90-4b82-bc83-6777d2c871a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:26:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-1e122860-d00b-40bd-b5f3-ce1c6d189bd2 req-bba7241f-8e43-4f9a-9f9f-6bae821b81db service nova] Lock "4ce94f9d-be90-4b82-bc83-6777d2c871a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:26:34 user nova-compute[74840]: DEBUG nova.compute.manager [req-1e122860-d00b-40bd-b5f3-ce1c6d189bd2 req-bba7241f-8e43-4f9a-9f9f-6bae821b81db service nova] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] No waiting events found dispatching network-vif-unplugged-ab70d9c8-3258-4119-ac39-e681ca7011a5 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:26:34 user nova-compute[74840]: DEBUG nova.compute.manager [req-1e122860-d00b-40bd-b5f3-ce1c6d189bd2 req-bba7241f-8e43-4f9a-9f9f-6bae821b81db service nova] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Received event network-vif-unplugged-ab70d9c8-3258-4119-ac39-e681ca7011a5 for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:26:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:26:34 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Instance destroyed successfully.
Nov 08 12:26:34 user nova-compute[74840]: DEBUG nova.objects.instance [None req-d26462a5-709a-4b5c-b4fc-59794840a39a tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lazy-loading 'resources' on Instance uuid 4ce94f9d-be90-4b82-bc83-6777d2c871a6 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:26:34 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-d26462a5-709a-4b5c-b4fc-59794840a39a tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:21:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-992505877',display_name='tempest-TestVolumeBootPattern-volume-backed-server-992505877',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-992505877',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAktHMgLbzBDoAyofm4phxzUUjJ/jYNKXRmMuTLv1Nzengag+nAAYXwXmxWmxXy2Gw3i1/IQY50cFfNuIFbyRx5q6+RCEetV30L+xiihEpyjC3ZjftWMSsT3eoUJtfTDWQ==',key_name='tempest-keypair-587177639',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:22:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1250106b55ae44b0b303849df7781ffb',ramdisk_id='',reservation_id='r-dz82j42i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-77780905',owner_user_name='tempest-TestVolumeBootPattern-77780905-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:22:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='794c0281e1bf48f79117efdc3907e661',uuid=4ce94f9d-be90-4b82-bc83-6777d2c871a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab70d9c8-3258-4119-ac39-e681ca7011a5", "address": "fa:16:3e:15:31:2f", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab70d9c8-32", "ovs_interfaceid": "ab70d9c8-3258-4119-ac39-e681ca7011a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:26:34 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-d26462a5-709a-4b5c-b4fc-59794840a39a tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Converting VIF {"id": "ab70d9c8-3258-4119-ac39-e681ca7011a5", "address": "fa:16:3e:15:31:2f", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab70d9c8-32", "ovs_interfaceid": "ab70d9c8-3258-4119-ac39-e681ca7011a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:26:34 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-d26462a5-709a-4b5c-b4fc-59794840a39a tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:31:2f,bridge_name='br-int',has_traffic_filtering=True,id=ab70d9c8-3258-4119-ac39-e681ca7011a5,network=Network(174da5e9-78cc-426f-87fb-1d3b23b8b459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab70d9c8-32') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:26:34 user nova-compute[74840]: DEBUG os_vif [None req-d26462a5-709a-4b5c-b4fc-59794840a39a tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:31:2f,bridge_name='br-int',has_traffic_filtering=True,id=ab70d9c8-3258-4119-ac39-e681ca7011a5,network=Network(174da5e9-78cc-426f-87fb-1d3b23b8b459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab70d9c8-32') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:26:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:26:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab70d9c8-32, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:26:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:26:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:26:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:26:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=13575d9b-1d02-4971-a145-193162fb2b60) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:26:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:26:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:26:34 user nova-compute[74840]: INFO os_vif [None req-d26462a5-709a-4b5c-b4fc-59794840a39a tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:31:2f,bridge_name='br-int',has_traffic_filtering=True,id=ab70d9c8-3258-4119-ac39-e681ca7011a5,network=Network(174da5e9-78cc-426f-87fb-1d3b23b8b459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab70d9c8-32')
Nov 08 12:26:34 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d26462a5-709a-4b5c-b4fc-59794840a39a tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 12:26:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26462a5-709a-4b5c-b4fc-59794840a39a tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EFBzDwJC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:26:34 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-d26462a5-709a-4b5c-b4fc-59794840a39a tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:26:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-d26462a5-709a-4b5c-b4fc-59794840a39a tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:26:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-d26462a5-709a-4b5c-b4fc-59794840a39a tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:26:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:34 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5752dbfc-380c-427a-8494-e58ed7a34083]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f6442405-3472-418b-9276-eece58eceef9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:26:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26462a5-709a-4b5c-b4fc-59794840a39a tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 12:26:34 user nova-compute[74840]: No targets found.
Nov 08 12:26:34 user nova-compute[74840]: iSNS:
Nov 08 12:26:34 user nova-compute[74840]: No targets found.
Nov 08 12:26:34 user nova-compute[74840]: STATIC:
Nov 08 12:26:34 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b
Nov 08 12:26:34 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:26:34 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:26:34 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:f6442405-3472-418b-9276-eece58eceef9
Nov 08 12:26:34 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:26:34 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:26:34 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4
Nov 08 12:26:34 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:26:34 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:26:34 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc
Nov 08 12:26:34 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:26:34 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:26:34 user nova-compute[74840]: FIRMWARE:
Nov 08 12:26:34 user nova-compute[74840]: No targets found.
Nov 08 12:26:34 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:26:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26462a5-709a-4b5c-b4fc-59794840a39a tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 12:26:34 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 12:26:34 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 12:26:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26462a5-709a-4b5c-b4fc-59794840a39a tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 12:26:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:34 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd03cc4-8b7a-4b7a-98c8-1b28f2aa89ab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6442405-3472-418b-9276-eece58eceef9\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:26:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:34 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a1807e-be67-4d45-a2bb-4c8687fbf026]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6442405-3472-418b-9276-eece58eceef9 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:26:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26462a5-709a-4b5c-b4fc-59794840a39a tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:26:34 user nova-compute[74840]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)
Nov 08 12:26:34 user nova-compute[74840]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b (non-flash)
Nov 08 12:26:34 user nova-compute[74840]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6442405-3472-418b-9276-eece58eceef9 (non-flash)
Nov 08 12:26:34 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:26:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26462a5-709a-4b5c-b4fc-59794840a39a tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:26:34 user nova-compute[74840]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc (non-flash)
Nov 08 12:26:34 user nova-compute[74840]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b (non-flash)
Nov 08 12:26:34 user nova-compute[74840]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6442405-3472-418b-9276-eece58eceef9 (non-flash)
Nov 08 12:26:34 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:26:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26462a5-709a-4b5c-b4fc-59794840a39a tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7d4677d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc'): ({'sdg'}, set())}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 12:26:34 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-d26462a5-709a-4b5c-b4fc-59794840a39a tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Removing single pathed devices sdg {{(pid=74840) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 12:26:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:34 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba00d01-1edd-4d63-b242-112011f9cd6d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:26:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:35 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bcd9497-c3f4-4901-a114-e060aa391865]: (4, ('ok\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:26:35 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-d26462a5-709a-4b5c-b4fc-59794840a39a tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Flushing IO for device /dev/sdg {{(pid=74840) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 12:26:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:35 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3619e90d-207d-4772-94d0-fa153796d22f]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:26:35 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-d26462a5-709a-4b5c-b4fc-59794840a39a tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74840) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 12:26:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.055s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:35 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6575eba0-d4cb-448a-b671-77e9d68b3d0c]: (4, ('1', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:26:35 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-d26462a5-709a-4b5c-b4fc-59794840a39a tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 12:26:35 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-d26462a5-709a-4b5c-b4fc-59794840a39a tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] SCSI volumes sdg have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 12:26:35 user nova-compute[74840]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_7bf23ad8', '/dev/disk/by-id/scsi-1SCST_BIO7bf23ad8-45f5f5929e331746', '/dev/disk/by-id/scsi-23435663566353932') {{(pid=85688) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 12:26:35 user nova-compute[74840]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_7bf23ad8
Nov 08 12:26:35 user nova-compute[74840]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO7bf23ad8-45f5f5929e331746
Nov 08 12:26:35 user nova-compute[74840]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23435663566353932
Nov 08 12:26:35 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cf8e55-d951-49e7-8ccf-3ba9213c16c2]: (4, None) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:26:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26462a5-709a-4b5c-b4fc-59794840a39a tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc')] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 12:26:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:35 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5edf948d-0555-4710-a4d9-df802ba13f11]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:26:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26462a5-709a-4b5c-b4fc-59794840a39a tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:26:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc -p 172.16.0.220:3260 --logout {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:35 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b7423a-1304-4f71-8454-cad58ab827eb]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:26:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26462a5-709a-4b5c-b4fc-59794840a39a tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc, portal: 172.16.0.220,3260]
Nov 08 12:26:35 user nova-compute[74840]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc, portal: 172.16.0.220,3260] successful.
Nov 08 12:26:35 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:26:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc -p 172.16.0.220:3260 --op delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:162867f5-948b-4308-8ee5-d43ad791b1bc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:35 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2de7b0-74be-473f-b9b3-3074d7bb86be]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:26:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26462a5-709a-4b5c-b4fc-59794840a39a tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:26:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-d26462a5-709a-4b5c-b4fc-59794840a39a tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:26:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26462a5-709a-4b5c-b4fc-59794840a39a tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] <== disconnect_volume: return (375ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:26:35 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d26462a5-709a-4b5c-b4fc-59794840a39a tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 12:26:35 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-d26462a5-709a-4b5c-b4fc-59794840a39a tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Deleting instance files /opt/stack/data/nova/instances/4ce94f9d-be90-4b82-bc83-6777d2c871a6_del
Nov 08 12:26:35 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-d26462a5-709a-4b5c-b4fc-59794840a39a tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Deletion of /opt/stack/data/nova/instances/4ce94f9d-be90-4b82-bc83-6777d2c871a6_del complete
Nov 08 12:26:35 user nova-compute[74840]: INFO nova.compute.manager [None req-d26462a5-709a-4b5c-b4fc-59794840a39a tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Took 1.27 seconds to destroy the instance on the hypervisor.
Nov 08 12:26:35 user nova-compute[74840]: DEBUG oslo.service.loopingcall [None req-d26462a5-709a-4b5c-b4fc-59794840a39a tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74840) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 12:26:35 user nova-compute[74840]: DEBUG nova.compute.manager [-] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Deallocating network for instance {{(pid=74840) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 12:26:35 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] deallocate_for_instance() {{(pid=74840) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 12:26:35 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:26:36 user nova-compute[74840]: INFO nova.compute.manager [-] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Took 0.69 seconds to deallocate network for instance.
Nov 08 12:26:36 user nova-compute[74840]: DEBUG nova.compute.manager [req-068d723d-d761-4366-8838-3239c14ba347 req-08d25fcd-0d47-497e-9cbf-f6f2bf1c7848 service nova] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Received event network-vif-deleted-ab70d9c8-3258-4119-ac39-e681ca7011a5 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:26:36 user nova-compute[74840]: INFO nova.compute.manager [req-068d723d-d761-4366-8838-3239c14ba347 req-08d25fcd-0d47-497e-9cbf-f6f2bf1c7848 service nova] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Neutron deleted interface ab70d9c8-3258-4119-ac39-e681ca7011a5; detaching it from the instance and deleting it from the info cache
Nov 08 12:26:36 user nova-compute[74840]: DEBUG nova.network.neutron [req-068d723d-d761-4366-8838-3239c14ba347 req-08d25fcd-0d47-497e-9cbf-f6f2bf1c7848 service nova] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:26:36 user nova-compute[74840]: DEBUG nova.compute.manager [req-068d723d-d761-4366-8838-3239c14ba347 req-08d25fcd-0d47-497e-9cbf-f6f2bf1c7848 service nova] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Detach interface failed, port_id=ab70d9c8-3258-4119-ac39-e681ca7011a5, reason: Instance 4ce94f9d-be90-4b82-bc83-6777d2c871a6 could not be found. {{(pid=74840) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 12:26:36 user nova-compute[74840]: DEBUG nova.compute.manager [req-0e27a8af-e696-4c9f-8573-488714607248 req-5dcc02e5-2e92-4280-9d0c-74fc2a6a3941 service nova] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Received event network-vif-plugged-ab70d9c8-3258-4119-ac39-e681ca7011a5 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:26:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0e27a8af-e696-4c9f-8573-488714607248 req-5dcc02e5-2e92-4280-9d0c-74fc2a6a3941 service nova] Acquiring lock "4ce94f9d-be90-4b82-bc83-6777d2c871a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:26:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0e27a8af-e696-4c9f-8573-488714607248 req-5dcc02e5-2e92-4280-9d0c-74fc2a6a3941 service nova] Lock "4ce94f9d-be90-4b82-bc83-6777d2c871a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:26:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0e27a8af-e696-4c9f-8573-488714607248 req-5dcc02e5-2e92-4280-9d0c-74fc2a6a3941 service nova] Lock "4ce94f9d-be90-4b82-bc83-6777d2c871a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:26:36 user nova-compute[74840]: DEBUG nova.compute.manager [req-0e27a8af-e696-4c9f-8573-488714607248 req-5dcc02e5-2e92-4280-9d0c-74fc2a6a3941 service nova] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] No waiting events found dispatching network-vif-plugged-ab70d9c8-3258-4119-ac39-e681ca7011a5 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:26:36 user nova-compute[74840]: WARNING nova.compute.manager [req-0e27a8af-e696-4c9f-8573-488714607248 req-5dcc02e5-2e92-4280-9d0c-74fc2a6a3941 service nova] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Received unexpected event network-vif-plugged-ab70d9c8-3258-4119-ac39-e681ca7011a5 for instance with vm_state active and task_state deleting.
Nov 08 12:26:37 user nova-compute[74840]: INFO nova.compute.manager [None req-d26462a5-709a-4b5c-b4fc-59794840a39a tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Took 1.08 seconds to detach 1 volumes for instance.
Nov 08 12:26:37 user nova-compute[74840]: DEBUG nova.compute.manager [None req-d26462a5-709a-4b5c-b4fc-59794840a39a tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 4ce94f9d-be90-4b82-bc83-6777d2c871a6] Deleting volume: 162867f5-948b-4308-8ee5-d43ad791b1bc {{(pid=74840) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 12:26:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d26462a5-709a-4b5c-b4fc-59794840a39a tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:26:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d26462a5-709a-4b5c-b4fc-59794840a39a tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:26:37 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-d26462a5-709a-4b5c-b4fc-59794840a39a tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:26:37 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-d26462a5-709a-4b5c-b4fc-59794840a39a tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:26:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d26462a5-709a-4b5c-b4fc-59794840a39a tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.346s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:26:37 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-d26462a5-709a-4b5c-b4fc-59794840a39a tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Deleted allocations for instance 4ce94f9d-be90-4b82-bc83-6777d2c871a6
Nov 08 12:26:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d26462a5-709a-4b5c-b4fc-59794840a39a tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "4ce94f9d-be90-4b82-bc83-6777d2c871a6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.750s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:26:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:26:42 user nova-compute[74840]: DEBUG nova.objects.instance [None req-66354191-be5e-4211-b22d-2283e9e61824 tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Lazy-loading 'flavor' on Instance uuid ff4622ff-b81c-40d3-92bf-bc30ef64b68f {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:26:42 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-66354191-be5e-4211-b22d-2283e9e61824 tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Lock "ff4622ff-b81c-40d3-92bf-bc30ef64b68f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 32.401s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:26:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:26:47 user nova-compute[74840]: DEBUG nova.compute.manager [req-8e6bf984-af9a-460a-afa5-832d06691d6c req-dc2e5702-4f36-48cb-9837-4eee16bb3cb0 service nova] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Received event network-changed-7cf349fa-e382-4526-af9d-f60a53d870cb {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:26:47 user nova-compute[74840]: DEBUG nova.compute.manager [req-8e6bf984-af9a-460a-afa5-832d06691d6c req-dc2e5702-4f36-48cb-9837-4eee16bb3cb0 service nova] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Refreshing instance network info cache due to event network-changed-7cf349fa-e382-4526-af9d-f60a53d870cb. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:26:47 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8e6bf984-af9a-460a-afa5-832d06691d6c req-dc2e5702-4f36-48cb-9837-4eee16bb3cb0 service nova] Acquiring lock "refresh_cache-10c42516-62ba-4aa9-bc5a-d94499bd6b65" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:26:47 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8e6bf984-af9a-460a-afa5-832d06691d6c req-dc2e5702-4f36-48cb-9837-4eee16bb3cb0 service nova] Acquired lock "refresh_cache-10c42516-62ba-4aa9-bc5a-d94499bd6b65" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:26:47 user nova-compute[74840]: DEBUG nova.network.neutron [req-8e6bf984-af9a-460a-afa5-832d06691d6c req-dc2e5702-4f36-48cb-9837-4eee16bb3cb0 service nova] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Refreshing network info cache for port 7cf349fa-e382-4526-af9d-f60a53d870cb {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:26:47 user nova-compute[74840]: DEBUG nova.network.neutron [req-8e6bf984-af9a-460a-afa5-832d06691d6c req-dc2e5702-4f36-48cb-9837-4eee16bb3cb0 service nova] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Updated VIF entry in instance network info cache for port 7cf349fa-e382-4526-af9d-f60a53d870cb. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:26:47 user nova-compute[74840]: DEBUG nova.network.neutron [req-8e6bf984-af9a-460a-afa5-832d06691d6c req-dc2e5702-4f36-48cb-9837-4eee16bb3cb0 service nova] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Updating instance_info_cache with network_info: [{"id": "7cf349fa-e382-4526-af9d-f60a53d870cb", "address": "fa:16:3e:97:67:76", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cf349fa-e3", "ovs_interfaceid": "7cf349fa-e382-4526-af9d-f60a53d870cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:26:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8e6bf984-af9a-460a-afa5-832d06691d6c req-dc2e5702-4f36-48cb-9837-4eee16bb3cb0 service nova] Releasing lock "refresh_cache-10c42516-62ba-4aa9-bc5a-d94499bd6b65" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:26:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:26:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:26:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 12:26:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:26:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:26:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:26:51 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:26:53 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquiring lock "9991e7b4-aaf8-4485-b658-e1af634925de" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:26:53 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "9991e7b4-aaf8-4485-b658-e1af634925de" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:26:53 user nova-compute[74840]: DEBUG nova.compute.manager [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Starting instance... {{(pid=74840) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 12:26:53 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:26:53 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:26:53 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:26:53 user nova-compute[74840]: INFO nova.compute.claims [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Claim successful on node user
Nov 08 12:26:54 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:26:54 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:26:54 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.538s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:26:54 user nova-compute[74840]: DEBUG nova.compute.manager [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Start building networks asynchronously for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 12:26:54 user nova-compute[74840]: DEBUG nova.compute.manager [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Allocating IP information in the background. {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 12:26:54 user nova-compute[74840]: DEBUG nova.network.neutron [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 12:26:54 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 12:26:54 user nova-compute[74840]: DEBUG nova.compute.manager [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Start building block device mappings for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 12:26:54 user nova-compute[74840]: DEBUG nova.compute.manager [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Start spawning the instance on the hypervisor. {{(pid=74840) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 12:26:54 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:26:54 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Creating image(s)
Nov 08 12:26:54 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquiring lock "/opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:26:54 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "/opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:26:54 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "/opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:26:54 user nova-compute[74840]: DEBUG nova.policy [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '275e3d340c9d4d9e90b579e4bc0bfe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c97c47ab144ef3a8d5e9ee1ecc059e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 12:26:54 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:54 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.198s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:54 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquiring lock "5d26578eba85497f494c575690c4248f381a0fe6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:26:54 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:26:54 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:54 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.215s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:54 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk 1073741824 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:54 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:26:54 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk 1073741824" returned: 0 in 0.069s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:54 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:26:54 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.230s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:55 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk. size=1073741824 {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 12:26:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:26:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:26:55 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Cannot resize image /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk to a smaller size. {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 12:26:55 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Created local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 12:26:55 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Ensure instance console log exists: /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:26:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:26:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:26:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:26:55 user nova-compute[74840]: DEBUG nova.compute.manager [req-223a5528-06de-4a8a-92ae-9d1c4e4eafbb req-9d2394a2-2b50-487d-bcd5-5cb04395d4e2 service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Received event network-changed-f0b1fa9b-7ace-4c3b-af97-f62a085e0076 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:26:55 user nova-compute[74840]: DEBUG nova.compute.manager [req-223a5528-06de-4a8a-92ae-9d1c4e4eafbb req-9d2394a2-2b50-487d-bcd5-5cb04395d4e2 service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Refreshing instance network info cache due to event network-changed-f0b1fa9b-7ace-4c3b-af97-f62a085e0076. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:26:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-223a5528-06de-4a8a-92ae-9d1c4e4eafbb req-9d2394a2-2b50-487d-bcd5-5cb04395d4e2 service nova] Acquiring lock "refresh_cache-4dcf7b89-a5ca-47ab-a4c9-878f53086de1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:26:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-223a5528-06de-4a8a-92ae-9d1c4e4eafbb req-9d2394a2-2b50-487d-bcd5-5cb04395d4e2 service nova] Acquired lock "refresh_cache-4dcf7b89-a5ca-47ab-a4c9-878f53086de1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:26:55 user nova-compute[74840]: DEBUG nova.network.neutron [req-223a5528-06de-4a8a-92ae-9d1c4e4eafbb req-9d2394a2-2b50-487d-bcd5-5cb04395d4e2 service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Refreshing network info cache for port f0b1fa9b-7ace-4c3b-af97-f62a085e0076 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:26:55 user nova-compute[74840]: DEBUG nova.network.neutron [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Successfully created port: fe5dab01-dd0f-4772-ab5b-1b089b47c565 {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:26:56 user nova-compute[74840]: DEBUG nova.network.neutron [req-223a5528-06de-4a8a-92ae-9d1c4e4eafbb req-9d2394a2-2b50-487d-bcd5-5cb04395d4e2 service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Updated VIF entry in instance network info cache for port f0b1fa9b-7ace-4c3b-af97-f62a085e0076. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:26:56 user nova-compute[74840]: DEBUG nova.network.neutron [req-223a5528-06de-4a8a-92ae-9d1c4e4eafbb req-9d2394a2-2b50-487d-bcd5-5cb04395d4e2 service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Updating instance_info_cache with network_info: [{"id": "f0b1fa9b-7ace-4c3b-af97-f62a085e0076", "address": "fa:16:3e:56:2a:9f", "network": {"id": "918d8aed-1f09-4cfb-9c7f-48f002ad6ba3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-927886396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a05cda834445fb94e71f6cac02f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b1fa9b-7a", "ovs_interfaceid": "f0b1fa9b-7ace-4c3b-af97-f62a085e0076", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:26:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-223a5528-06de-4a8a-92ae-9d1c4e4eafbb req-9d2394a2-2b50-487d-bcd5-5cb04395d4e2 service nova] Releasing lock "refresh_cache-4dcf7b89-a5ca-47ab-a4c9-878f53086de1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:26:56 user nova-compute[74840]: DEBUG nova.network.neutron [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Successfully updated port: fe5dab01-dd0f-4772-ab5b-1b089b47c565 {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:26:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquiring lock "refresh_cache-9991e7b4-aaf8-4485-b658-e1af634925de" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:26:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquired lock "refresh_cache-9991e7b4-aaf8-4485-b658-e1af634925de" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:26:56 user nova-compute[74840]: DEBUG nova.network.neutron [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:26:56 user nova-compute[74840]: DEBUG nova.network.neutron [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:26:56 user nova-compute[74840]: DEBUG nova.network.neutron [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Updating instance_info_cache with network_info: [{"id": "fe5dab01-dd0f-4772-ab5b-1b089b47c565", "address": "fa:16:3e:9b:27:ee", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe5dab01-dd", "ovs_interfaceid": "fe5dab01-dd0f-4772-ab5b-1b089b47c565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:26:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Releasing lock "refresh_cache-9991e7b4-aaf8-4485-b658-e1af634925de" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:26:56 user nova-compute[74840]: DEBUG nova.compute.manager [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Instance network_info: |[{"id": "fe5dab01-dd0f-4772-ab5b-1b089b47c565", "address": "fa:16:3e:9b:27:ee", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe5dab01-dd", "ovs_interfaceid": "fe5dab01-dd0f-4772-ab5b-1b089b47c565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 12:26:56 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Start _get_guest_xml network_info=[{"id": "fe5dab01-dd0f-4772-ab5b-1b089b47c565", "address": "fa:16:3e:9b:27:ee", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe5dab01-dd", "ovs_interfaceid": "fe5dab01-dd0f-4772-ab5b-1b089b47c565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'image_id': '4fa17706-d304-4117-a420-dab994c703dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:26:56 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:26:56 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:26:56 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:26:56 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:26:56 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:26:56 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:26:56 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:26:56 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:26:56 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:26:56 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:26:56 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:26:56 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:26:56 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:26:56 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:26:56 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:26:56 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:26:56 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:26:56 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:26:56 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:26:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1020744170',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1020744170',id=33,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72c97c47ab144ef3a8d5e9ee1ecc059e',ramdisk_id='',reservation_id='r-43t01ksq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-297593405',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:26:54Z,user_data=None,user_id='275e3d340c9d4d9e90b579e4bc0bfe0b',uuid=9991e7b4-aaf8-4485-b658-e1af634925de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe5dab01-dd0f-4772-ab5b-1b089b47c565", "address": "fa:16:3e:9b:27:ee", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe5dab01-dd", "ovs_interfaceid": "fe5dab01-dd0f-4772-ab5b-1b089b47c565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:26:56 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Converting VIF {"id": "fe5dab01-dd0f-4772-ab5b-1b089b47c565", "address": "fa:16:3e:9b:27:ee", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe5dab01-dd", "ovs_interfaceid": "fe5dab01-dd0f-4772-ab5b-1b089b47c565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:26:56 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:27:ee,bridge_name='br-int',has_traffic_filtering=True,id=fe5dab01-dd0f-4772-ab5b-1b089b47c565,network=Network(8388eafb-b115-49c7-82cd-0d85d0ee12e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe5dab01-dd') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:26:56 user nova-compute[74840]: DEBUG nova.objects.instance [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lazy-loading 'pci_devices' on Instance uuid 9991e7b4-aaf8-4485-b658-e1af634925de {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:26:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:26:56 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:26:56 user nova-compute[74840]:   <uuid>9991e7b4-aaf8-4485-b658-e1af634925de</uuid>
Nov 08 12:26:56 user nova-compute[74840]:   <name>instance-00000021</name>
Nov 08 12:26:56 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:26:56 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:26:56 user nova-compute[74840]:   <metadata>
Nov 08 12:26:56 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:26:56 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:26:56 user nova-compute[74840]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1020744170</nova:name>
Nov 08 12:26:56 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:26:56</nova:creationTime>
Nov 08 12:26:56 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:26:56 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:26:56 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:26:56 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:26:56 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:26:56 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:26:56 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:26:56 user nova-compute[74840]:       <nova:owner>
Nov 08 12:26:56 user nova-compute[74840]:         <nova:user uuid="275e3d340c9d4d9e90b579e4bc0bfe0b">tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member</nova:user>
Nov 08 12:26:56 user nova-compute[74840]:         <nova:project uuid="72c97c47ab144ef3a8d5e9ee1ecc059e">tempest-ServerBootFromVolumeStableRescueTest-297593405</nova:project>
Nov 08 12:26:56 user nova-compute[74840]:       </nova:owner>
Nov 08 12:26:56 user nova-compute[74840]:       <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:26:56 user nova-compute[74840]:       <nova:ports>
Nov 08 12:26:56 user nova-compute[74840]:         <nova:port uuid="fe5dab01-dd0f-4772-ab5b-1b089b47c565">
Nov 08 12:26:56 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 12:26:56 user nova-compute[74840]:         </nova:port>
Nov 08 12:26:56 user nova-compute[74840]:       </nova:ports>
Nov 08 12:26:56 user nova-compute[74840]:     </nova:instance>
Nov 08 12:26:56 user nova-compute[74840]:   </metadata>
Nov 08 12:26:56 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:26:56 user nova-compute[74840]:     <system>
Nov 08 12:26:56 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:26:56 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:26:56 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:26:56 user nova-compute[74840]:       <entry name="serial">9991e7b4-aaf8-4485-b658-e1af634925de</entry>
Nov 08 12:26:56 user nova-compute[74840]:       <entry name="uuid">9991e7b4-aaf8-4485-b658-e1af634925de</entry>
Nov 08 12:26:56 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:26:56 user nova-compute[74840]:     </system>
Nov 08 12:26:56 user nova-compute[74840]:   </sysinfo>
Nov 08 12:26:56 user nova-compute[74840]:   <os>
Nov 08 12:26:56 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:26:56 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:26:56 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:26:56 user nova-compute[74840]:   </os>
Nov 08 12:26:56 user nova-compute[74840]:   <features>
Nov 08 12:26:56 user nova-compute[74840]:     <acpi/>
Nov 08 12:26:56 user nova-compute[74840]:     <apic/>
Nov 08 12:26:56 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:26:56 user nova-compute[74840]:   </features>
Nov 08 12:26:56 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:26:56 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:26:56 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:26:56 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:26:56 user nova-compute[74840]:   </clock>
Nov 08 12:26:56 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:26:56 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:26:56 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:26:56 user nova-compute[74840]:   </cpu>
Nov 08 12:26:56 user nova-compute[74840]:   <devices>
Nov 08 12:26:56 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:26:56 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:26:56 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk"/>
Nov 08 12:26:56 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:26:56 user nova-compute[74840]:     </disk>
Nov 08 12:26:56 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:26:56 user nova-compute[74840]:       <mac address="fa:16:3e:9b:27:ee"/>
Nov 08 12:26:56 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:26:56 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:26:56 user nova-compute[74840]:       <target dev="tapfe5dab01-dd"/>
Nov 08 12:26:56 user nova-compute[74840]:     </interface>
Nov 08 12:26:56 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:26:56 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/console.log" append="off"/>
Nov 08 12:26:56 user nova-compute[74840]:     </serial>
Nov 08 12:26:56 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:26:56 user nova-compute[74840]:     <video>
Nov 08 12:26:56 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:26:56 user nova-compute[74840]:     </video>
Nov 08 12:26:56 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:26:56 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:26:56 user nova-compute[74840]:     </rng>
Nov 08 12:26:56 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:26:56 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:26:56 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:26:56 user nova-compute[74840]:     </memballoon>
Nov 08 12:26:56 user nova-compute[74840]:   </devices>
Nov 08 12:26:56 user nova-compute[74840]: </domain>
Nov 08 12:26:56 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:26:56 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:26:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1020744170',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1020744170',id=33,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72c97c47ab144ef3a8d5e9ee1ecc059e',ramdisk_id='',reservation_id='r-43t01ksq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-297593405',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:26:54Z,user_data=None,user_id='275e3d340c9d4d9e90b579e4bc0bfe0b',uuid=9991e7b4-aaf8-4485-b658-e1af634925de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe5dab01-dd0f-4772-ab5b-1b089b47c565", "address": "fa:16:3e:9b:27:ee", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe5dab01-dd", "ovs_interfaceid": "fe5dab01-dd0f-4772-ab5b-1b089b47c565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:26:56 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Converting VIF {"id": "fe5dab01-dd0f-4772-ab5b-1b089b47c565", "address": "fa:16:3e:9b:27:ee", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe5dab01-dd", "ovs_interfaceid": "fe5dab01-dd0f-4772-ab5b-1b089b47c565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:26:56 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:27:ee,bridge_name='br-int',has_traffic_filtering=True,id=fe5dab01-dd0f-4772-ab5b-1b089b47c565,network=Network(8388eafb-b115-49c7-82cd-0d85d0ee12e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe5dab01-dd') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:26:56 user nova-compute[74840]: DEBUG os_vif [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:27:ee,bridge_name='br-int',has_traffic_filtering=True,id=fe5dab01-dd0f-4772-ab5b-1b089b47c565,network=Network(8388eafb-b115-49c7-82cd-0d85d0ee12e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe5dab01-dd') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:26:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:26:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:26:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:26:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:26:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8c48f852-a325-5625-877c-d9e0d7478e58', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:26:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:26:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:26:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:26:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe5dab01-dd, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:26:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe5dab01-dd, col_values=(('qos', UUID('e219f723-6174-4b57-96b4-f7962cbeb69c')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:26:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe5dab01-dd, col_values=(('external_ids', {'iface-id': 'fe5dab01-dd0f-4772-ab5b-1b089b47c565', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:27:ee', 'vm-uuid': '9991e7b4-aaf8-4485-b658-e1af634925de'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:26:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:26:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:26:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:26:56 user nova-compute[74840]: INFO os_vif [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:27:ee,bridge_name='br-int',has_traffic_filtering=True,id=fe5dab01-dd0f-4772-ab5b-1b089b47c565,network=Network(8388eafb-b115-49c7-82cd-0d85d0ee12e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe5dab01-dd')
Nov 08 12:26:57 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:26:57 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] No VIF found with MAC fa:16:3e:9b:27:ee, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:26:57 user nova-compute[74840]: DEBUG nova.compute.manager [req-2985db0b-87d1-4a4b-8cb3-f7a12c698621 req-b4fea54a-f711-42db-a897-02670d2b6cc9 service nova] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Received event network-changed-fe5dab01-dd0f-4772-ab5b-1b089b47c565 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:26:57 user nova-compute[74840]: DEBUG nova.compute.manager [req-2985db0b-87d1-4a4b-8cb3-f7a12c698621 req-b4fea54a-f711-42db-a897-02670d2b6cc9 service nova] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Refreshing instance network info cache due to event network-changed-fe5dab01-dd0f-4772-ab5b-1b089b47c565. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:26:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2985db0b-87d1-4a4b-8cb3-f7a12c698621 req-b4fea54a-f711-42db-a897-02670d2b6cc9 service nova] Acquiring lock "refresh_cache-9991e7b4-aaf8-4485-b658-e1af634925de" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:26:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2985db0b-87d1-4a4b-8cb3-f7a12c698621 req-b4fea54a-f711-42db-a897-02670d2b6cc9 service nova] Acquired lock "refresh_cache-9991e7b4-aaf8-4485-b658-e1af634925de" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:26:57 user nova-compute[74840]: DEBUG nova.network.neutron [req-2985db0b-87d1-4a4b-8cb3-f7a12c698621 req-b4fea54a-f711-42db-a897-02670d2b6cc9 service nova] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Refreshing network info cache for port fe5dab01-dd0f-4772-ab5b-1b089b47c565 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:26:58 user nova-compute[74840]: DEBUG nova.network.neutron [req-2985db0b-87d1-4a4b-8cb3-f7a12c698621 req-b4fea54a-f711-42db-a897-02670d2b6cc9 service nova] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Updated VIF entry in instance network info cache for port fe5dab01-dd0f-4772-ab5b-1b089b47c565. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:26:58 user nova-compute[74840]: DEBUG nova.network.neutron [req-2985db0b-87d1-4a4b-8cb3-f7a12c698621 req-b4fea54a-f711-42db-a897-02670d2b6cc9 service nova] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Updating instance_info_cache with network_info: [{"id": "fe5dab01-dd0f-4772-ab5b-1b089b47c565", "address": "fa:16:3e:9b:27:ee", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe5dab01-dd", "ovs_interfaceid": "fe5dab01-dd0f-4772-ab5b-1b089b47c565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:26:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2985db0b-87d1-4a4b-8cb3-f7a12c698621 req-b4fea54a-f711-42db-a897-02670d2b6cc9 service nova] Releasing lock "refresh_cache-9991e7b4-aaf8-4485-b658-e1af634925de" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:26:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:26:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:26:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:26:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:26:58 user nova-compute[74840]: DEBUG nova.compute.manager [req-9653cd51-6501-413f-a82c-b23e200a4afc req-d2d2d91f-615d-4120-9ce3-69774385f9ee service nova] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Received event network-vif-plugged-fe5dab01-dd0f-4772-ab5b-1b089b47c565 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:26:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9653cd51-6501-413f-a82c-b23e200a4afc req-d2d2d91f-615d-4120-9ce3-69774385f9ee service nova] Acquiring lock "9991e7b4-aaf8-4485-b658-e1af634925de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:26:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9653cd51-6501-413f-a82c-b23e200a4afc req-d2d2d91f-615d-4120-9ce3-69774385f9ee service nova] Lock "9991e7b4-aaf8-4485-b658-e1af634925de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:26:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9653cd51-6501-413f-a82c-b23e200a4afc req-d2d2d91f-615d-4120-9ce3-69774385f9ee service nova] Lock "9991e7b4-aaf8-4485-b658-e1af634925de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:26:58 user nova-compute[74840]: DEBUG nova.compute.manager [req-9653cd51-6501-413f-a82c-b23e200a4afc req-d2d2d91f-615d-4120-9ce3-69774385f9ee service nova] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] No waiting events found dispatching network-vif-plugged-fe5dab01-dd0f-4772-ab5b-1b089b47c565 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:26:58 user nova-compute[74840]: WARNING nova.compute.manager [req-9653cd51-6501-413f-a82c-b23e200a4afc req-d2d2d91f-615d-4120-9ce3-69774385f9ee service nova] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Received unexpected event network-vif-plugged-fe5dab01-dd0f-4772-ab5b-1b089b47c565 for instance with vm_state building and task_state spawning.
Nov 08 12:26:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:26:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:00 user nova-compute[74840]: DEBUG nova.compute.manager [req-37c02ede-383e-4759-bcfe-51bdc630a1ef req-d734e3a7-65fa-4b32-b377-1b2a21c1bbf8 service nova] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Received event network-vif-plugged-fe5dab01-dd0f-4772-ab5b-1b089b47c565 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:27:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-37c02ede-383e-4759-bcfe-51bdc630a1ef req-d734e3a7-65fa-4b32-b377-1b2a21c1bbf8 service nova] Acquiring lock "9991e7b4-aaf8-4485-b658-e1af634925de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:27:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-37c02ede-383e-4759-bcfe-51bdc630a1ef req-d734e3a7-65fa-4b32-b377-1b2a21c1bbf8 service nova] Lock "9991e7b4-aaf8-4485-b658-e1af634925de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:27:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-37c02ede-383e-4759-bcfe-51bdc630a1ef req-d734e3a7-65fa-4b32-b377-1b2a21c1bbf8 service nova] Lock "9991e7b4-aaf8-4485-b658-e1af634925de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:27:00 user nova-compute[74840]: DEBUG nova.compute.manager [req-37c02ede-383e-4759-bcfe-51bdc630a1ef req-d734e3a7-65fa-4b32-b377-1b2a21c1bbf8 service nova] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] No waiting events found dispatching network-vif-plugged-fe5dab01-dd0f-4772-ab5b-1b089b47c565 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:27:00 user nova-compute[74840]: WARNING nova.compute.manager [req-37c02ede-383e-4759-bcfe-51bdc630a1ef req-d734e3a7-65fa-4b32-b377-1b2a21c1bbf8 service nova] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Received unexpected event network-vif-plugged-fe5dab01-dd0f-4772-ab5b-1b089b47c565 for instance with vm_state building and task_state spawning.
Nov 08 12:27:00 user nova-compute[74840]: DEBUG nova.compute.manager [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:27:00 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:27:00 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Instance spawned successfully.
Nov 08 12:27:00 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:27:00 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Found default for hw_cdrom_bus of ide {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:27:00 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Found default for hw_disk_bus of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:27:00 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:27:00 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:27:00 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Found default for hw_video_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:27:00 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Found default for hw_vif_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:27:01 user nova-compute[74840]: INFO nova.compute.manager [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Took 6.65 seconds to spawn the instance on the hypervisor.
Nov 08 12:27:01 user nova-compute[74840]: DEBUG nova.compute.manager [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:27:01 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:27:01 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:27:01 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:27:01 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Didn't find any instances for network info cache update. {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 12:27:01 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:27:01 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:27:01 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:27:01 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:27:01 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:27:01 user nova-compute[74840]: INFO nova.compute.manager [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Took 7.60 seconds to build instance.
Nov 08 12:27:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cc29f7b8-6f98-4f15-95de-fe379783645c tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "9991e7b4-aaf8-4485-b658-e1af634925de" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.735s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:27:01 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:27:01 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:27:01 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:27:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:27:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:27:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:27:01 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:27:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6ea2c9a-81d4-4933-bff3-406aedd79031/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:27:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6ea2c9a-81d4-4933-bff3-406aedd79031/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:27:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6ea2c9a-81d4-4933-bff3-406aedd79031/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:27:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6ea2c9a-81d4-4933-bff3-406aedd79031/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:27:02 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:27:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:27:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:27:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:27:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:27:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:27:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:27:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:27:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:27:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:27:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:27:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:27:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json" returned: 0 in 0.231s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:27:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:27:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:27:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:27:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:27:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcf7b89-a5ca-47ab-a4c9-878f53086de1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:27:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcf7b89-a5ca-47ab-a4c9-878f53086de1/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:27:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcf7b89-a5ca-47ab-a4c9-878f53086de1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:27:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcf7b89-a5ca-47ab-a4c9-878f53086de1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:27:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4622ff-b81c-40d3-92bf-bc30ef64b68f/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:27:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4622ff-b81c-40d3-92bf-bc30ef64b68f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:27:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4622ff-b81c-40d3-92bf-bc30ef64b68f/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:27:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff4622ff-b81c-40d3-92bf-bc30ef64b68f/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:27:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk.rescue --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:27:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:27:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk.rescue --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:27:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:27:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:27:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:27:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:27:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:27:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:27:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:27:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:27:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:27:06 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:27:06 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:27:06 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:27:06 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=7880MB free_disk=25.03539276123047GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:27:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:27:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:27:06 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance d3e8efc6-7146-46ef-8433-380d7e69120c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:27:06 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance ffe50042-29bf-4ef3-a148-8698bc75233b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:27:06 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 8b7c490e-4c78-4e07-bc8a-3be2328963d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:27:06 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 832a6445-84ee-43a8-a5bc-a07670602912 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:27:06 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance ff4622ff-b81c-40d3-92bf-bc30ef64b68f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:27:06 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance e6ea2c9a-81d4-4933-bff3-406aedd79031 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:27:06 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 10c42516-62ba-4aa9-bc5a-d94499bd6b65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:27:06 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 4dcf7b89-a5ca-47ab-a4c9-878f53086de1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:27:06 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 9991e7b4-aaf8-4485-b658-e1af634925de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:27:06 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:27:06 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:27:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:06 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:27:07 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:27:07 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:27:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.504s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:27:11 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5eb9d1c2-0350-460a-be2a-943087a60ce9 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Acquiring lock "e6ea2c9a-81d4-4933-bff3-406aedd79031" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:27:11 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5eb9d1c2-0350-460a-be2a-943087a60ce9 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "e6ea2c9a-81d4-4933-bff3-406aedd79031" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:27:11 user nova-compute[74840]: INFO nova.compute.manager [None req-5eb9d1c2-0350-460a-be2a-943087a60ce9 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Detaching volume 6ae00900-c19b-42bd-b9ad-8d94f930741b
Nov 08 12:27:11 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-dfd7644b-f262-4d14-85f9-6bbf0245c7a9 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Acquiring lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:27:11 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-dfd7644b-f262-4d14-85f9-6bbf0245c7a9 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:27:11 user nova-compute[74840]: INFO nova.compute.manager [None req-dfd7644b-f262-4d14-85f9-6bbf0245c7a9 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Shelving
Nov 08 12:27:11 user nova-compute[74840]: INFO nova.virt.block_device [None req-5eb9d1c2-0350-460a-be2a-943087a60ce9 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Attempting to driver detach volume 6ae00900-c19b-42bd-b9ad-8d94f930741b from mountpoint /dev/vdb
Nov 08 12:27:11 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-84773b07-f696-4aeb-a872-1e46c3c57519 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Acquiring lock "e6ea2c9a-81d4-4933-bff3-406aedd79031" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:27:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:11 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-5eb9d1c2-0350-460a-be2a-943087a60ce9 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Attempting to detach device vdb from instance e6ea2c9a-81d4-4933-bff3-406aedd79031 from the persistent domain config. {{(pid=74840) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 12:27:11 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-5eb9d1c2-0350-460a-be2a-943087a60ce9 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 12:27:11 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:27:11 user nova-compute[74840]:   <source dev="/dev/sdc"/>
Nov 08 12:27:11 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:27:11 user nova-compute[74840]:   <serial>6ae00900-c19b-42bd-b9ad-8d94f930741b</serial>
Nov 08 12:27:11 user nova-compute[74840]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 12:27:11 user nova-compute[74840]: </disk>
Nov 08 12:27:11 user nova-compute[74840]:  {{(pid=74840) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 12:27:11 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-5eb9d1c2-0350-460a-be2a-943087a60ce9 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Successfully detached device vdb from instance e6ea2c9a-81d4-4933-bff3-406aedd79031 from the persistent domain config.
Nov 08 12:27:11 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-5eb9d1c2-0350-460a-be2a-943087a60ce9 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e6ea2c9a-81d4-4933-bff3-406aedd79031 from the live domain config. {{(pid=74840) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 12:27:11 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-5eb9d1c2-0350-460a-be2a-943087a60ce9 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 12:27:11 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:27:11 user nova-compute[74840]:   <source dev="/dev/sdc"/>
Nov 08 12:27:11 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:27:11 user nova-compute[74840]:   <serial>6ae00900-c19b-42bd-b9ad-8d94f930741b</serial>
Nov 08 12:27:11 user nova-compute[74840]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 12:27:11 user nova-compute[74840]: </disk>
Nov 08 12:27:11 user nova-compute[74840]:  {{(pid=74840) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 12:27:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:12 user nova-compute[74840]: DEBUG nova.compute.manager [req-48ba73f6-8cc5-4664-bbcf-98822e846e86 req-90e66514-c697-40c8-8c29-ba050e203fcf service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Received event network-vif-unplugged-f0b1fa9b-7ace-4c3b-af97-f62a085e0076 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:27:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-48ba73f6-8cc5-4664-bbcf-98822e846e86 req-90e66514-c697-40c8-8c29-ba050e203fcf service nova] Acquiring lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:27:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-48ba73f6-8cc5-4664-bbcf-98822e846e86 req-90e66514-c697-40c8-8c29-ba050e203fcf service nova] Lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:27:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-48ba73f6-8cc5-4664-bbcf-98822e846e86 req-90e66514-c697-40c8-8c29-ba050e203fcf service nova] Lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:27:12 user nova-compute[74840]: DEBUG nova.compute.manager [req-48ba73f6-8cc5-4664-bbcf-98822e846e86 req-90e66514-c697-40c8-8c29-ba050e203fcf service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] No waiting events found dispatching network-vif-unplugged-f0b1fa9b-7ace-4c3b-af97-f62a085e0076 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:27:12 user nova-compute[74840]: WARNING nova.compute.manager [req-48ba73f6-8cc5-4664-bbcf-98822e846e86 req-90e66514-c697-40c8-8c29-ba050e203fcf service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Received unexpected event network-vif-unplugged-f0b1fa9b-7ace-4c3b-af97-f62a085e0076 for instance with vm_state active and task_state shelving.
Nov 08 12:27:12 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-5eb9d1c2-0350-460a-be2a-943087a60ce9 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e6ea2c9a-81d4-4933-bff3-406aedd79031 {{(pid=74840) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 12:27:12 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Instance destroyed successfully.
Nov 08 12:27:12 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-dfd7644b-f262-4d14-85f9-6bbf0245c7a9 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Beginning cold snapshot process
Nov 08 12:27:12 user nova-compute[74840]: DEBUG nova.privsep.utils [None req-dfd7644b-f262-4d14-85f9-6bbf0245c7a9 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74840) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 12:27:12 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-dfd7644b-f262-4d14-85f9-6bbf0245c7a9 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4dcf7b89-a5ca-47ab-a4c9-878f53086de1/disk /opt/stack/data/nova/instances/snapshots/tmpbs3qohtn/4c787457fe8446c08f3b76d479da6613 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:27:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-dfd7644b-f262-4d14-85f9-6bbf0245c7a9 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4dcf7b89-a5ca-47ab-a4c9-878f53086de1/disk /opt/stack/data/nova/instances/snapshots/tmpbs3qohtn/4c787457fe8446c08f3b76d479da6613" returned: 0 in 1.109s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:27:13 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-dfd7644b-f262-4d14-85f9-6bbf0245c7a9 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Snapshot extracted, beginning image upload
Nov 08 12:27:14 user nova-compute[74840]: INFO nova.compute.manager [None req-5ced9641-7ec0-4f9e-b282-55d27f5b6695 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Unrescuing
Nov 08 12:27:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5ced9641-7ec0-4f9e-b282-55d27f5b6695 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Acquiring lock "refresh_cache-8b7c490e-4c78-4e07-bc8a-3be2328963d7" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:27:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5ced9641-7ec0-4f9e-b282-55d27f5b6695 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Acquired lock "refresh_cache-8b7c490e-4c78-4e07-bc8a-3be2328963d7" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:27:14 user nova-compute[74840]: DEBUG nova.network.neutron [None req-5ced9641-7ec0-4f9e-b282-55d27f5b6695 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:27:14 user nova-compute[74840]: DEBUG nova.compute.manager [req-e3eaf653-82e3-494a-9aa3-4530baf3b478 req-c39446ad-7042-4188-8b1b-af009bed3df5 service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Received event network-vif-plugged-f0b1fa9b-7ace-4c3b-af97-f62a085e0076 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:27:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e3eaf653-82e3-494a-9aa3-4530baf3b478 req-c39446ad-7042-4188-8b1b-af009bed3df5 service nova] Acquiring lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:27:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e3eaf653-82e3-494a-9aa3-4530baf3b478 req-c39446ad-7042-4188-8b1b-af009bed3df5 service nova] Lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:27:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e3eaf653-82e3-494a-9aa3-4530baf3b478 req-c39446ad-7042-4188-8b1b-af009bed3df5 service nova] Lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:27:14 user nova-compute[74840]: DEBUG nova.compute.manager [req-e3eaf653-82e3-494a-9aa3-4530baf3b478 req-c39446ad-7042-4188-8b1b-af009bed3df5 service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] No waiting events found dispatching network-vif-plugged-f0b1fa9b-7ace-4c3b-af97-f62a085e0076 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:27:14 user nova-compute[74840]: WARNING nova.compute.manager [req-e3eaf653-82e3-494a-9aa3-4530baf3b478 req-c39446ad-7042-4188-8b1b-af009bed3df5 service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Received unexpected event network-vif-plugged-f0b1fa9b-7ace-4c3b-af97-f62a085e0076 for instance with vm_state active and task_state shelving_image_uploading.
Nov 08 12:27:14 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5b056a13-6bb3-4073-a31f-980a7da0589f tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Acquiring lock "ff4622ff-b81c-40d3-92bf-bc30ef64b68f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:27:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5b056a13-6bb3-4073-a31f-980a7da0589f tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Lock "ff4622ff-b81c-40d3-92bf-bc30ef64b68f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:27:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5b056a13-6bb3-4073-a31f-980a7da0589f tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Acquiring lock "ff4622ff-b81c-40d3-92bf-bc30ef64b68f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:27:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5b056a13-6bb3-4073-a31f-980a7da0589f tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Lock "ff4622ff-b81c-40d3-92bf-bc30ef64b68f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:27:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5b056a13-6bb3-4073-a31f-980a7da0589f tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Lock "ff4622ff-b81c-40d3-92bf-bc30ef64b68f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:27:14 user nova-compute[74840]: INFO nova.compute.manager [None req-5b056a13-6bb3-4073-a31f-980a7da0589f tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Terminating instance
Nov 08 12:27:14 user nova-compute[74840]: DEBUG nova.compute.manager [None req-5b056a13-6bb3-4073-a31f-980a7da0589f tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Start destroying the instance on the hypervisor. {{(pid=74840) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 12:27:14 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:14 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:14 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:14 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:14 user nova-compute[74840]: DEBUG nova.compute.manager [req-8803c8da-5747-40db-aa17-b3963a398cfd req-2fa78624-283a-46b1-9b4d-dfb9c09054d1 service nova] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Received event network-vif-unplugged-c831f5ef-f115-4a26-9a02-227681561d9c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:27:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8803c8da-5747-40db-aa17-b3963a398cfd req-2fa78624-283a-46b1-9b4d-dfb9c09054d1 service nova] Acquiring lock "ff4622ff-b81c-40d3-92bf-bc30ef64b68f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:27:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8803c8da-5747-40db-aa17-b3963a398cfd req-2fa78624-283a-46b1-9b4d-dfb9c09054d1 service nova] Lock "ff4622ff-b81c-40d3-92bf-bc30ef64b68f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:27:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8803c8da-5747-40db-aa17-b3963a398cfd req-2fa78624-283a-46b1-9b4d-dfb9c09054d1 service nova] Lock "ff4622ff-b81c-40d3-92bf-bc30ef64b68f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:27:14 user nova-compute[74840]: DEBUG nova.compute.manager [req-8803c8da-5747-40db-aa17-b3963a398cfd req-2fa78624-283a-46b1-9b4d-dfb9c09054d1 service nova] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] No waiting events found dispatching network-vif-unplugged-c831f5ef-f115-4a26-9a02-227681561d9c {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:27:14 user nova-compute[74840]: DEBUG nova.compute.manager [req-8803c8da-5747-40db-aa17-b3963a398cfd req-2fa78624-283a-46b1-9b4d-dfb9c09054d1 service nova] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Received event network-vif-unplugged-c831f5ef-f115-4a26-9a02-227681561d9c for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:27:14 user nova-compute[74840]: DEBUG nova.network.neutron [None req-5ced9641-7ec0-4f9e-b282-55d27f5b6695 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Updating instance_info_cache with network_info: [{"id": "d9df071e-c4f0-4c80-9d63-3a41c849dca5", "address": "fa:16:3e:32:c4:9b", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9df071e-c4", "ovs_interfaceid": "d9df071e-c4f0-4c80-9d63-3a41c849dca5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:27:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5ced9641-7ec0-4f9e-b282-55d27f5b6695 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Releasing lock "refresh_cache-8b7c490e-4c78-4e07-bc8a-3be2328963d7" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:27:14 user nova-compute[74840]: DEBUG nova.objects.instance [None req-5ced9641-7ec0-4f9e-b282-55d27f5b6695 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lazy-loading 'flavor' on Instance uuid 8b7c490e-4c78-4e07-bc8a-3be2328963d7 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:27:15 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:15 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:15 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Instance destroyed successfully.
Nov 08 12:27:15 user nova-compute[74840]: DEBUG nova.objects.instance [None req-5b056a13-6bb3-4073-a31f-980a7da0589f tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Lazy-loading 'resources' on Instance uuid ff4622ff-b81c-40d3-92bf-bc30ef64b68f {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:27:15 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-5b056a13-6bb3-4073-a31f-980a7da0589f tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:23:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1376701806',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1376701806',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1376701',id=29,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGuNvvsEcRS49FUuutpKYu50zKliY9VVUoxzE+rpro9yRGfnXKXdSCNm1+eOZCf3J6FyWUi0TSDym3JOLZEi8O2Y9QeGw0Qi/7LTHEekE3YdIkryF8xwRXq886LYHLTCA==',key_name='tempest-keypair-1593576063',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:23:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='18af32d3c92b465c92fddfee58d8ee19',ramdisk_id='',reservation_id='r-s9pp30n2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-795706254',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:23:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='082576ea38994b598fcdf92ade6f74b7',uuid=ff4622ff-b81c-40d3-92bf-bc30ef64b68f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c831f5ef-f115-4a26-9a02-227681561d9c", "address": "fa:16:3e:dd:bf:19", "network": {"id": "e4de6ccf-60cb-4306-9865-a99d9d732446", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1640752753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18af32d3c92b465c92fddfee58d8ee19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc831f5ef-f1", "ovs_interfaceid": "c831f5ef-f115-4a26-9a02-227681561d9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:27:15 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-5b056a13-6bb3-4073-a31f-980a7da0589f tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Converting VIF {"id": "c831f5ef-f115-4a26-9a02-227681561d9c", "address": "fa:16:3e:dd:bf:19", "network": {"id": "e4de6ccf-60cb-4306-9865-a99d9d732446", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1640752753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18af32d3c92b465c92fddfee58d8ee19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc831f5ef-f1", "ovs_interfaceid": "c831f5ef-f115-4a26-9a02-227681561d9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:27:15 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-5b056a13-6bb3-4073-a31f-980a7da0589f tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:bf:19,bridge_name='br-int',has_traffic_filtering=True,id=c831f5ef-f115-4a26-9a02-227681561d9c,network=Network(e4de6ccf-60cb-4306-9865-a99d9d732446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc831f5ef-f1') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:27:15 user nova-compute[74840]: DEBUG os_vif [None req-5b056a13-6bb3-4073-a31f-980a7da0589f tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:bf:19,bridge_name='br-int',has_traffic_filtering=True,id=c831f5ef-f115-4a26-9a02-227681561d9c,network=Network(e4de6ccf-60cb-4306-9865-a99d9d732446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc831f5ef-f1') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:27:15 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:15 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc831f5ef-f1, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:27:15 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:15 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:27:15 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:15 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:15 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cb373d5c-2f8d-4153-be3d-ff7f59056170) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:27:15 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:15 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:27:15 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:15 user nova-compute[74840]: INFO os_vif [None req-5b056a13-6bb3-4073-a31f-980a7da0589f tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:bf:19,bridge_name='br-int',has_traffic_filtering=True,id=c831f5ef-f115-4a26-9a02-227681561d9c,network=Network(e4de6ccf-60cb-4306-9865-a99d9d732446),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc831f5ef-f1')
Nov 08 12:27:15 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-5b056a13-6bb3-4073-a31f-980a7da0589f tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Deleting instance files /opt/stack/data/nova/instances/ff4622ff-b81c-40d3-92bf-bc30ef64b68f_del
Nov 08 12:27:15 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-5b056a13-6bb3-4073-a31f-980a7da0589f tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Deletion of /opt/stack/data/nova/instances/ff4622ff-b81c-40d3-92bf-bc30ef64b68f_del complete
Nov 08 12:27:15 user nova-compute[74840]: INFO nova.compute.manager [None req-5b056a13-6bb3-4073-a31f-980a7da0589f tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 08 12:27:15 user nova-compute[74840]: DEBUG oslo.service.loopingcall [None req-5b056a13-6bb3-4073-a31f-980a7da0589f tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74840) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 12:27:15 user nova-compute[74840]: DEBUG nova.compute.manager [-] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Deallocating network for instance {{(pid=74840) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 12:27:15 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] deallocate_for_instance() {{(pid=74840) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 12:27:15 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:15 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:15 user nova-compute[74840]: DEBUG nova.compute.manager [req-56d542dc-89a4-4139-817a-f24abd71cb0f req-7dd2fc54-34fd-4d52-8fcb-31f97e91c0bf service nova] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Received event network-vif-unplugged-d9df071e-c4f0-4c80-9d63-3a41c849dca5 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:27:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-56d542dc-89a4-4139-817a-f24abd71cb0f req-7dd2fc54-34fd-4d52-8fcb-31f97e91c0bf service nova] Acquiring lock "8b7c490e-4c78-4e07-bc8a-3be2328963d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:27:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-56d542dc-89a4-4139-817a-f24abd71cb0f req-7dd2fc54-34fd-4d52-8fcb-31f97e91c0bf service nova] Lock "8b7c490e-4c78-4e07-bc8a-3be2328963d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:27:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-56d542dc-89a4-4139-817a-f24abd71cb0f req-7dd2fc54-34fd-4d52-8fcb-31f97e91c0bf service nova] Lock "8b7c490e-4c78-4e07-bc8a-3be2328963d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:27:15 user nova-compute[74840]: DEBUG nova.compute.manager [req-56d542dc-89a4-4139-817a-f24abd71cb0f req-7dd2fc54-34fd-4d52-8fcb-31f97e91c0bf service nova] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] No waiting events found dispatching network-vif-unplugged-d9df071e-c4f0-4c80-9d63-3a41c849dca5 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:27:15 user nova-compute[74840]: WARNING nova.compute.manager [req-56d542dc-89a4-4139-817a-f24abd71cb0f req-7dd2fc54-34fd-4d52-8fcb-31f97e91c0bf service nova] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Received unexpected event network-vif-unplugged-d9df071e-c4f0-4c80-9d63-3a41c849dca5 for instance with vm_state rescued and task_state unrescuing.
Nov 08 12:27:15 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Instance destroyed successfully.
Nov 08 12:27:16 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:27:16 user nova-compute[74840]: INFO nova.compute.manager [-] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Took 0.94 seconds to deallocate network for instance.
Nov 08 12:27:16 user nova-compute[74840]: DEBUG nova.compute.manager [req-3d3f0910-d409-465d-aab3-8f38a9424235 req-d048c85b-22d1-41cb-a713-a1b5431153b9 service nova] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Received event network-vif-deleted-c831f5ef-f115-4a26-9a02-227681561d9c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:27:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5b056a13-6bb3-4073-a31f-980a7da0589f tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:27:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5b056a13-6bb3-4073-a31f-980a7da0589f tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:27:16 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-5b056a13-6bb3-4073-a31f-980a7da0589f tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:27:16 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-5b056a13-6bb3-4073-a31f-980a7da0589f tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:27:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5b056a13-6bb3-4073-a31f-980a7da0589f tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.378s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:27:16 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-5b056a13-6bb3-4073-a31f-980a7da0589f tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Deleted allocations for instance ff4622ff-b81c-40d3-92bf-bc30ef64b68f
Nov 08 12:27:16 user nova-compute[74840]: DEBUG nova.compute.manager [req-e4269b77-d37e-4003-a48c-7d31380b7379 req-65b0705e-3868-456b-b58f-5597a2fd8256 service nova] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Received event network-vif-plugged-c831f5ef-f115-4a26-9a02-227681561d9c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:27:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e4269b77-d37e-4003-a48c-7d31380b7379 req-65b0705e-3868-456b-b58f-5597a2fd8256 service nova] Acquiring lock "ff4622ff-b81c-40d3-92bf-bc30ef64b68f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:27:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e4269b77-d37e-4003-a48c-7d31380b7379 req-65b0705e-3868-456b-b58f-5597a2fd8256 service nova] Lock "ff4622ff-b81c-40d3-92bf-bc30ef64b68f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:27:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e4269b77-d37e-4003-a48c-7d31380b7379 req-65b0705e-3868-456b-b58f-5597a2fd8256 service nova] Lock "ff4622ff-b81c-40d3-92bf-bc30ef64b68f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:27:16 user nova-compute[74840]: DEBUG nova.compute.manager [req-e4269b77-d37e-4003-a48c-7d31380b7379 req-65b0705e-3868-456b-b58f-5597a2fd8256 service nova] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] No waiting events found dispatching network-vif-plugged-c831f5ef-f115-4a26-9a02-227681561d9c {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:27:16 user nova-compute[74840]: WARNING nova.compute.manager [req-e4269b77-d37e-4003-a48c-7d31380b7379 req-65b0705e-3868-456b-b58f-5597a2fd8256 service nova] [instance: ff4622ff-b81c-40d3-92bf-bc30ef64b68f] Received unexpected event network-vif-plugged-c831f5ef-f115-4a26-9a02-227681561d9c for instance with vm_state deleted and task_state None.
Nov 08 12:27:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5b056a13-6bb3-4073-a31f-980a7da0589f tempest-TestServerVolumeAttachScenarioOldVersion-795706254 tempest-TestServerVolumeAttachScenarioOldVersion-795706254-project-member] Lock "ff4622ff-b81c-40d3-92bf-bc30ef64b68f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.557s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:27:17 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-dfd7644b-f262-4d14-85f9-6bbf0245c7a9 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Snapshot image upload complete
Nov 08 12:27:17 user nova-compute[74840]: DEBUG nova.compute.manager [None req-dfd7644b-f262-4d14-85f9-6bbf0245c7a9 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:27:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:17 user nova-compute[74840]: INFO nova.compute.manager [None req-dfd7644b-f262-4d14-85f9-6bbf0245c7a9 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Shelve offloading
Nov 08 12:27:17 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Instance destroyed successfully.
Nov 08 12:27:17 user nova-compute[74840]: DEBUG nova.compute.manager [None req-dfd7644b-f262-4d14-85f9-6bbf0245c7a9 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:27:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-dfd7644b-f262-4d14-85f9-6bbf0245c7a9 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Acquiring lock "refresh_cache-4dcf7b89-a5ca-47ab-a4c9-878f53086de1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:27:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-dfd7644b-f262-4d14-85f9-6bbf0245c7a9 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Acquired lock "refresh_cache-4dcf7b89-a5ca-47ab-a4c9-878f53086de1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:27:17 user nova-compute[74840]: DEBUG nova.network.neutron [None req-dfd7644b-f262-4d14-85f9-6bbf0245c7a9 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:27:17 user nova-compute[74840]: DEBUG nova.compute.manager [req-8e641576-7316-4cff-84cb-d8d7cc182d11 req-ced7cef5-feff-432a-82c5-ff7f77877b40 service nova] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Received event network-vif-plugged-d9df071e-c4f0-4c80-9d63-3a41c849dca5 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:27:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8e641576-7316-4cff-84cb-d8d7cc182d11 req-ced7cef5-feff-432a-82c5-ff7f77877b40 service nova] Acquiring lock "8b7c490e-4c78-4e07-bc8a-3be2328963d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:27:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8e641576-7316-4cff-84cb-d8d7cc182d11 req-ced7cef5-feff-432a-82c5-ff7f77877b40 service nova] Lock "8b7c490e-4c78-4e07-bc8a-3be2328963d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:27:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8e641576-7316-4cff-84cb-d8d7cc182d11 req-ced7cef5-feff-432a-82c5-ff7f77877b40 service nova] Lock "8b7c490e-4c78-4e07-bc8a-3be2328963d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:27:17 user nova-compute[74840]: DEBUG nova.compute.manager [req-8e641576-7316-4cff-84cb-d8d7cc182d11 req-ced7cef5-feff-432a-82c5-ff7f77877b40 service nova] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] No waiting events found dispatching network-vif-plugged-d9df071e-c4f0-4c80-9d63-3a41c849dca5 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:27:17 user nova-compute[74840]: WARNING nova.compute.manager [req-8e641576-7316-4cff-84cb-d8d7cc182d11 req-ced7cef5-feff-432a-82c5-ff7f77877b40 service nova] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Received unexpected event network-vif-plugged-d9df071e-c4f0-4c80-9d63-3a41c849dca5 for instance with vm_state rescued and task_state unrescuing.
Nov 08 12:27:17 user nova-compute[74840]: DEBUG nova.compute.manager [req-8e641576-7316-4cff-84cb-d8d7cc182d11 req-ced7cef5-feff-432a-82c5-ff7f77877b40 service nova] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Received event network-vif-plugged-d9df071e-c4f0-4c80-9d63-3a41c849dca5 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:27:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8e641576-7316-4cff-84cb-d8d7cc182d11 req-ced7cef5-feff-432a-82c5-ff7f77877b40 service nova] Acquiring lock "8b7c490e-4c78-4e07-bc8a-3be2328963d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:27:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8e641576-7316-4cff-84cb-d8d7cc182d11 req-ced7cef5-feff-432a-82c5-ff7f77877b40 service nova] Lock "8b7c490e-4c78-4e07-bc8a-3be2328963d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:27:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8e641576-7316-4cff-84cb-d8d7cc182d11 req-ced7cef5-feff-432a-82c5-ff7f77877b40 service nova] Lock "8b7c490e-4c78-4e07-bc8a-3be2328963d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:27:17 user nova-compute[74840]: DEBUG nova.compute.manager [req-8e641576-7316-4cff-84cb-d8d7cc182d11 req-ced7cef5-feff-432a-82c5-ff7f77877b40 service nova] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] No waiting events found dispatching network-vif-plugged-d9df071e-c4f0-4c80-9d63-3a41c849dca5 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:27:17 user nova-compute[74840]: WARNING nova.compute.manager [req-8e641576-7316-4cff-84cb-d8d7cc182d11 req-ced7cef5-feff-432a-82c5-ff7f77877b40 service nova] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Received unexpected event network-vif-plugged-d9df071e-c4f0-4c80-9d63-3a41c849dca5 for instance with vm_state rescued and task_state unrescuing.
Nov 08 12:27:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:18 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:27:18 user nova-compute[74840]: DEBUG nova.network.neutron [None req-dfd7644b-f262-4d14-85f9-6bbf0245c7a9 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Updating instance_info_cache with network_info: [{"id": "f0b1fa9b-7ace-4c3b-af97-f62a085e0076", "address": "fa:16:3e:56:2a:9f", "network": {"id": "918d8aed-1f09-4cfb-9c7f-48f002ad6ba3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-927886396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a05cda834445fb94e71f6cac02f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b1fa9b-7a", "ovs_interfaceid": "f0b1fa9b-7ace-4c3b-af97-f62a085e0076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:27:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-dfd7644b-f262-4d14-85f9-6bbf0245c7a9 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Releasing lock "refresh_cache-4dcf7b89-a5ca-47ab-a4c9-878f53086de1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:27:18 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Instance destroyed successfully.
Nov 08 12:27:18 user nova-compute[74840]: DEBUG nova.objects.instance [None req-dfd7644b-f262-4d14-85f9-6bbf0245c7a9 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lazy-loading 'resources' on Instance uuid 4dcf7b89-a5ca-47ab-a4c9-878f53086de1 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:27:18 user nova-compute[74840]: DEBUG nova.compute.manager [req-197ac5fc-e898-4f2b-b16c-de7af1d6848d req-a0f92dd3-2c02-4d70-bdc8-04dce5a1fda1 service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Received event network-changed-f0b1fa9b-7ace-4c3b-af97-f62a085e0076 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:27:18 user nova-compute[74840]: DEBUG nova.compute.manager [req-197ac5fc-e898-4f2b-b16c-de7af1d6848d req-a0f92dd3-2c02-4d70-bdc8-04dce5a1fda1 service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Refreshing instance network info cache due to event network-changed-f0b1fa9b-7ace-4c3b-af97-f62a085e0076. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:27:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-197ac5fc-e898-4f2b-b16c-de7af1d6848d req-a0f92dd3-2c02-4d70-bdc8-04dce5a1fda1 service nova] Acquiring lock "refresh_cache-4dcf7b89-a5ca-47ab-a4c9-878f53086de1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:27:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-197ac5fc-e898-4f2b-b16c-de7af1d6848d req-a0f92dd3-2c02-4d70-bdc8-04dce5a1fda1 service nova] Acquired lock "refresh_cache-4dcf7b89-a5ca-47ab-a4c9-878f53086de1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:27:18 user nova-compute[74840]: DEBUG nova.network.neutron [req-197ac5fc-e898-4f2b-b16c-de7af1d6848d req-a0f92dd3-2c02-4d70-bdc8-04dce5a1fda1 service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Refreshing network info cache for port f0b1fa9b-7ace-4c3b-af97-f62a085e0076 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:27:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-dfd7644b-f262-4d14-85f9-6bbf0245c7a9 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:25:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-391869052',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-391869052',id=32,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrGy7EpmCBYTbWiiHXAUW34ziKvgVFQxqUXholjrggD3zzCzFnJaLmcpIi16aC0dgaBENrhZl/DCndvcoRIFslJq5F6SEzu3+3GzYY2+JpNAzefU+twGFUUtMYhD5mdUw==',key_name='tempest-keypair-1869051926',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:25:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='93a05cda834445fb94e71f6cac02f198',ramdisk_id='',reservation_id='r-ovc6od6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1958698266',owner_user_name='tempest-AttachVolumeShelveTestJSON-1958698266-project-member',shelved_at='2023-11-08T12:27:17.182367',shelved_host='user',shelved_image_id='e98e81ae-8be8-4f44-b63c-d875a709e229'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:27:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='afc4e8483a1f4e08b3f81a9b9323be84',uuid=4dcf7b89-a5ca-47ab-a4c9-878f53086de1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "f0b1fa9b-7ace-4c3b-af97-f62a085e0076", "address": "fa:16:3e:56:2a:9f", "network": {"id": "918d8aed-1f09-4cfb-9c7f-48f002ad6ba3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-927886396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a05cda834445fb94e71f6cac02f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b1fa9b-7a", "ovs_interfaceid": "f0b1fa9b-7ace-4c3b-af97-f62a085e0076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:27:18 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-dfd7644b-f262-4d14-85f9-6bbf0245c7a9 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Converting VIF {"id": "f0b1fa9b-7ace-4c3b-af97-f62a085e0076", "address": "fa:16:3e:56:2a:9f", "network": {"id": "918d8aed-1f09-4cfb-9c7f-48f002ad6ba3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-927886396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a05cda834445fb94e71f6cac02f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b1fa9b-7a", "ovs_interfaceid": "f0b1fa9b-7ace-4c3b-af97-f62a085e0076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:27:18 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-dfd7644b-f262-4d14-85f9-6bbf0245c7a9 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:2a:9f,bridge_name='br-int',has_traffic_filtering=True,id=f0b1fa9b-7ace-4c3b-af97-f62a085e0076,network=Network(918d8aed-1f09-4cfb-9c7f-48f002ad6ba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b1fa9b-7a') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:27:18 user nova-compute[74840]: DEBUG os_vif [None req-dfd7644b-f262-4d14-85f9-6bbf0245c7a9 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:2a:9f,bridge_name='br-int',has_traffic_filtering=True,id=f0b1fa9b-7ace-4c3b-af97-f62a085e0076,network=Network(918d8aed-1f09-4cfb-9c7f-48f002ad6ba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b1fa9b-7a') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:27:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0b1fa9b-7a, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:27:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:27:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cea8495f-4094-4511-9915-41b697b2db7c) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:27:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:18 user nova-compute[74840]: INFO os_vif [None req-dfd7644b-f262-4d14-85f9-6bbf0245c7a9 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:2a:9f,bridge_name='br-int',has_traffic_filtering=True,id=f0b1fa9b-7ace-4c3b-af97-f62a085e0076,network=Network(918d8aed-1f09-4cfb-9c7f-48f002ad6ba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b1fa9b-7a')
Nov 08 12:27:18 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-dfd7644b-f262-4d14-85f9-6bbf0245c7a9 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Deleting instance files /opt/stack/data/nova/instances/4dcf7b89-a5ca-47ab-a4c9-878f53086de1_del
Nov 08 12:27:18 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-dfd7644b-f262-4d14-85f9-6bbf0245c7a9 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Deletion of /opt/stack/data/nova/instances/4dcf7b89-a5ca-47ab-a4c9-878f53086de1_del complete
Nov 08 12:27:19 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-dfd7644b-f262-4d14-85f9-6bbf0245c7a9 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Deleted allocations for instance 4dcf7b89-a5ca-47ab-a4c9-878f53086de1
Nov 08 12:27:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-dfd7644b-f262-4d14-85f9-6bbf0245c7a9 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:27:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-dfd7644b-f262-4d14-85f9-6bbf0245c7a9 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:27:19 user nova-compute[74840]: DEBUG nova.objects.instance [None req-dfd7644b-f262-4d14-85f9-6bbf0245c7a9 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lazy-loading 'numa_topology' on Instance uuid 4dcf7b89-a5ca-47ab-a4c9-878f53086de1 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:27:19 user nova-compute[74840]: DEBUG nova.objects.base [None req-dfd7644b-f262-4d14-85f9-6bbf0245c7a9 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Object Instance<4dcf7b89-a5ca-47ab-a4c9-878f53086de1> lazy-loaded attributes: resources,numa_topology {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:27:19 user nova-compute[74840]: DEBUG nova.network.neutron [req-197ac5fc-e898-4f2b-b16c-de7af1d6848d req-a0f92dd3-2c02-4d70-bdc8-04dce5a1fda1 service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Updated VIF entry in instance network info cache for port f0b1fa9b-7ace-4c3b-af97-f62a085e0076. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:27:19 user nova-compute[74840]: DEBUG nova.network.neutron [req-197ac5fc-e898-4f2b-b16c-de7af1d6848d req-a0f92dd3-2c02-4d70-bdc8-04dce5a1fda1 service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Updating instance_info_cache with network_info: [{"id": "f0b1fa9b-7ace-4c3b-af97-f62a085e0076", "address": "fa:16:3e:56:2a:9f", "network": {"id": "918d8aed-1f09-4cfb-9c7f-48f002ad6ba3", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-927886396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a05cda834445fb94e71f6cac02f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapf0b1fa9b-7a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:27:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-197ac5fc-e898-4f2b-b16c-de7af1d6848d req-a0f92dd3-2c02-4d70-bdc8-04dce5a1fda1 service nova] Releasing lock "refresh_cache-4dcf7b89-a5ca-47ab-a4c9-878f53086de1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:27:19 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-dfd7644b-f262-4d14-85f9-6bbf0245c7a9 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:27:19 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-dfd7644b-f262-4d14-85f9-6bbf0245c7a9 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:27:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-dfd7644b-f262-4d14-85f9-6bbf0245c7a9 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:27:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-dfd7644b-f262-4d14-85f9-6bbf0245c7a9 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.050s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:27:19 user nova-compute[74840]: DEBUG nova.compute.manager [req-b65f9ea8-b656-4d9c-8891-1ee19708b555 req-9097220c-e69a-40ae-85de-162eb30df217 service nova] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Received event network-vif-plugged-d9df071e-c4f0-4c80-9d63-3a41c849dca5 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:27:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-b65f9ea8-b656-4d9c-8891-1ee19708b555 req-9097220c-e69a-40ae-85de-162eb30df217 service nova] Acquiring lock "8b7c490e-4c78-4e07-bc8a-3be2328963d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:27:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-b65f9ea8-b656-4d9c-8891-1ee19708b555 req-9097220c-e69a-40ae-85de-162eb30df217 service nova] Lock "8b7c490e-4c78-4e07-bc8a-3be2328963d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:27:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-b65f9ea8-b656-4d9c-8891-1ee19708b555 req-9097220c-e69a-40ae-85de-162eb30df217 service nova] Lock "8b7c490e-4c78-4e07-bc8a-3be2328963d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:27:19 user nova-compute[74840]: DEBUG nova.compute.manager [req-b65f9ea8-b656-4d9c-8891-1ee19708b555 req-9097220c-e69a-40ae-85de-162eb30df217 service nova] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] No waiting events found dispatching network-vif-plugged-d9df071e-c4f0-4c80-9d63-3a41c849dca5 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:27:19 user nova-compute[74840]: WARNING nova.compute.manager [req-b65f9ea8-b656-4d9c-8891-1ee19708b555 req-9097220c-e69a-40ae-85de-162eb30df217 service nova] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Received unexpected event network-vif-plugged-d9df071e-c4f0-4c80-9d63-3a41c849dca5 for instance with vm_state rescued and task_state unrescuing.
Nov 08 12:27:20 user nova-compute[74840]: DEBUG nova.compute.manager [None req-5ced9641-7ec0-4f9e-b282-55d27f5b6695 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:27:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:28 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:32 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-5eb9d1c2-0350-460a-be2a-943087a60ce9 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e6ea2c9a-81d4-4933-bff3-406aedd79031 is timed out.
Nov 08 12:27:32 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-5eb9d1c2-0350-460a-be2a-943087a60ce9 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Successfully detached device vdb from instance e6ea2c9a-81d4-4933-bff3-406aedd79031 from the live domain config.
Nov 08 12:27:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5eb9d1c2-0350-460a-be2a-943087a60ce9 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 12:27:32 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb9d1c2-0350-460a-be2a-943087a60ce9 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cOyegQGa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:27:32 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-5eb9d1c2-0350-460a-be2a-943087a60ce9 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:27:32 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-5eb9d1c2-0350-460a-be2a-943087a60ce9 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:27:32 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-5eb9d1c2-0350-460a-be2a-943087a60ce9 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:27:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:27:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:27:32 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[558f40f2-923f-454c-b23c-60979ad4bbb2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:27:32 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb9d1c2-0350-460a-be2a-943087a60ce9 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 12:27:32 user nova-compute[74840]: No targets found.
Nov 08 12:27:32 user nova-compute[74840]: iSNS:
Nov 08 12:27:32 user nova-compute[74840]: No targets found.
Nov 08 12:27:32 user nova-compute[74840]: STATIC:
Nov 08 12:27:32 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b
Nov 08 12:27:32 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:27:32 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:27:32 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4
Nov 08 12:27:32 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:27:32 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:27:32 user nova-compute[74840]: FIRMWARE:
Nov 08 12:27:32 user nova-compute[74840]: No targets found.
Nov 08 12:27:32 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:27:32 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb9d1c2-0350-460a-be2a-943087a60ce9 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 12:27:32 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 12:27:32 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 12:27:32 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb9d1c2-0350-460a-be2a-943087a60ce9 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 12:27:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:27:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:27:32 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d4389e-f707-4ca4-bf88-75e359de88cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:27:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:27:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:27:32 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b103cc5-173a-4d5d-bf88-a0b70bb440fc]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:27:32 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb9d1c2-0350-460a-be2a-943087a60ce9 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:27:32 user nova-compute[74840]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b (non-flash)
Nov 08 12:27:32 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:27:32 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb9d1c2-0350-460a-be2a-943087a60ce9 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:27:32 user nova-compute[74840]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b (non-flash)
Nov 08 12:27:32 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:27:32 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb9d1c2-0350-460a-be2a-943087a60ce9 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7f4526dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b'): ({'sdc'}, set())}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 12:27:32 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-5eb9d1c2-0350-460a-be2a-943087a60ce9 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Removing single pathed devices sdc {{(pid=74840) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 12:27:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:27:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:27:32 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[494d0d50-476d-4aa6-b6f8-c6af86311495]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:27:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:27:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:27:32 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd215c6-9519-4e8b-ab71-08edb2795a7d]: (4, ('ok\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:27:32 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-5eb9d1c2-0350-460a-be2a-943087a60ce9 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Flushing IO for device /dev/sdc {{(pid=74840) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 12:27:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:27:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:27:32 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fc4435-a41d-4908-bb0f-68c192949a85]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:27:32 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-5eb9d1c2-0350-460a-be2a-943087a60ce9 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74840) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 12:27:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:27:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:27:32 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[932d59b5-2df2-48b3-b3d5-d5bc314c1191]: (4, ('1', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:27:32 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-5eb9d1c2-0350-460a-be2a-943087a60ce9 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 12:27:32 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-5eb9d1c2-0350-460a-be2a-943087a60ce9 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] SCSI volumes sdc have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 12:27:32 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb9d1c2-0350-460a-be2a-943087a60ce9 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b')] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 12:27:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:27:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:27:32 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ea3600-a7dd-41f4-a284-bea62384f561]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:27:32 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb9d1c2-0350-460a-be2a-943087a60ce9 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:27:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b -p 172.16.0.220:3260 --logout {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:27:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b -p 172.16.0.220:3260 --logout" returned: 0 in 0.098s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:27:32 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f023b8-b3f9-4881-8ab8-311500dbdf5c]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:27:32 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb9d1c2-0350-460a-be2a-943087a60ce9 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b, portal: 172.16.0.220,3260]
Nov 08 12:27:32 user nova-compute[74840]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b, portal: 172.16.0.220,3260] successful.
Nov 08 12:27:32 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:27:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b -p 172.16.0.220:3260 --op delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:27:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:27:32 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[49848317-97f5-4b22-a147-5bead890c238]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:27:32 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb9d1c2-0350-460a-be2a-943087a60ce9 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:27:32 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-5eb9d1c2-0350-460a-be2a-943087a60ce9 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:27:32 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb9d1c2-0350-460a-be2a-943087a60ce9 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] <== disconnect_volume: return (331ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:27:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5eb9d1c2-0350-460a-be2a-943087a60ce9 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 12:27:33 user nova-compute[74840]: DEBUG nova.objects.instance [None req-5eb9d1c2-0350-460a-be2a-943087a60ce9 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lazy-loading 'flavor' on Instance uuid e6ea2c9a-81d4-4933-bff3-406aedd79031 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:27:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5eb9d1c2-0350-460a-be2a-943087a60ce9 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "e6ea2c9a-81d4-4933-bff3-406aedd79031" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.098s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:27:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-84773b07-f696-4aeb-a872-1e46c3c57519 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "e6ea2c9a-81d4-4933-bff3-406aedd79031" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.948s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:27:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-84773b07-f696-4aeb-a872-1e46c3c57519 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Acquiring lock "e6ea2c9a-81d4-4933-bff3-406aedd79031-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:27:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-84773b07-f696-4aeb-a872-1e46c3c57519 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "e6ea2c9a-81d4-4933-bff3-406aedd79031-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:27:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-84773b07-f696-4aeb-a872-1e46c3c57519 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "e6ea2c9a-81d4-4933-bff3-406aedd79031-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:27:33 user nova-compute[74840]: INFO nova.compute.manager [None req-84773b07-f696-4aeb-a872-1e46c3c57519 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Terminating instance
Nov 08 12:27:33 user nova-compute[74840]: DEBUG nova.compute.manager [None req-84773b07-f696-4aeb-a872-1e46c3c57519 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Start destroying the instance on the hypervisor. {{(pid=74840) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 12:27:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:33 user nova-compute[74840]: DEBUG nova.compute.manager [req-72efc84e-c074-4496-b67c-1fe529433c73 req-069c05cc-a5df-46d5-99f8-9be4d4ed561b service nova] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Received event network-vif-unplugged-4f9932a0-5bfa-48bc-bd1f-5f61bf96803c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:27:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-72efc84e-c074-4496-b67c-1fe529433c73 req-069c05cc-a5df-46d5-99f8-9be4d4ed561b service nova] Acquiring lock "e6ea2c9a-81d4-4933-bff3-406aedd79031-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:27:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-72efc84e-c074-4496-b67c-1fe529433c73 req-069c05cc-a5df-46d5-99f8-9be4d4ed561b service nova] Lock "e6ea2c9a-81d4-4933-bff3-406aedd79031-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:27:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-72efc84e-c074-4496-b67c-1fe529433c73 req-069c05cc-a5df-46d5-99f8-9be4d4ed561b service nova] Lock "e6ea2c9a-81d4-4933-bff3-406aedd79031-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:27:33 user nova-compute[74840]: DEBUG nova.compute.manager [req-72efc84e-c074-4496-b67c-1fe529433c73 req-069c05cc-a5df-46d5-99f8-9be4d4ed561b service nova] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] No waiting events found dispatching network-vif-unplugged-4f9932a0-5bfa-48bc-bd1f-5f61bf96803c {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:27:33 user nova-compute[74840]: DEBUG nova.compute.manager [req-72efc84e-c074-4496-b67c-1fe529433c73 req-069c05cc-a5df-46d5-99f8-9be4d4ed561b service nova] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Received event network-vif-unplugged-4f9932a0-5bfa-48bc-bd1f-5f61bf96803c for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:27:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:34 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Instance destroyed successfully.
Nov 08 12:27:34 user nova-compute[74840]: DEBUG nova.objects.instance [None req-84773b07-f696-4aeb-a872-1e46c3c57519 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lazy-loading 'resources' on Instance uuid e6ea2c9a-81d4-4933-bff3-406aedd79031 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:27:34 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-84773b07-f696-4aeb-a872-1e46c3c57519 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:23:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-91787869',display_name='tempest-VolumesSnapshotTestJSON-instance-91787869',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-91787869',id=30,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKT3Lt3eFS8NKNcfls5H0s+3K/dLsBsbYLM971M63Po9vga+q8A/tFpnnSpjt81BF15Bvbx86xynsH3JpiBFAaLK/R1P0/ALiFrse7mdr/TXPzlNHMTt2nbtnKaXbQaNpw==',key_name='tempest-keypair-542349603',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:23:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9a082f8090094f009393593fb26b445b',ramdisk_id='',reservation_id='r-a2nmydxk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1995603553',owner_user_name='tempest-VolumesSnapshotTestJSON-1995603553-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:23:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5a96f2e0a304f278120312edb71d7ac',uuid=e6ea2c9a-81d4-4933-bff3-406aedd79031,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f9932a0-5bfa-48bc-bd1f-5f61bf96803c", "address": "fa:16:3e:0e:c1:c2", "network": {"id": "89a24eca-8c74-4e0e-b778-275f200927f0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1409559017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a082f8090094f009393593fb26b445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9932a0-5b", "ovs_interfaceid": "4f9932a0-5bfa-48bc-bd1f-5f61bf96803c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:27:34 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-84773b07-f696-4aeb-a872-1e46c3c57519 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Converting VIF {"id": "4f9932a0-5bfa-48bc-bd1f-5f61bf96803c", "address": "fa:16:3e:0e:c1:c2", "network": {"id": "89a24eca-8c74-4e0e-b778-275f200927f0", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1409559017-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a082f8090094f009393593fb26b445b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9932a0-5b", "ovs_interfaceid": "4f9932a0-5bfa-48bc-bd1f-5f61bf96803c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:27:34 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-84773b07-f696-4aeb-a872-1e46c3c57519 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:c1:c2,bridge_name='br-int',has_traffic_filtering=True,id=4f9932a0-5bfa-48bc-bd1f-5f61bf96803c,network=Network(89a24eca-8c74-4e0e-b778-275f200927f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f9932a0-5b') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:27:34 user nova-compute[74840]: DEBUG os_vif [None req-84773b07-f696-4aeb-a872-1e46c3c57519 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:c1:c2,bridge_name='br-int',has_traffic_filtering=True,id=4f9932a0-5bfa-48bc-bd1f-5f61bf96803c,network=Network(89a24eca-8c74-4e0e-b778-275f200927f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f9932a0-5b') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:27:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f9932a0-5b, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:27:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:27:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1d83a92d-33d5-4261-b7f3-b1a846f6e37c) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:27:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:27:34 user nova-compute[74840]: INFO os_vif [None req-84773b07-f696-4aeb-a872-1e46c3c57519 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:c1:c2,bridge_name='br-int',has_traffic_filtering=True,id=4f9932a0-5bfa-48bc-bd1f-5f61bf96803c,network=Network(89a24eca-8c74-4e0e-b778-275f200927f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f9932a0-5b')
Nov 08 12:27:34 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84773b07-f696-4aeb-a872-1e46c3c57519 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 12:27:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-84773b07-f696-4aeb-a872-1e46c3c57519 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cOyegQGa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:27:34 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-84773b07-f696-4aeb-a872-1e46c3c57519 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:27:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-84773b07-f696-4aeb-a872-1e46c3c57519 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:27:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-84773b07-f696-4aeb-a872-1e46c3c57519 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:27:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:27:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:27:34 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6362e179-5280-47d7-ac18-2a5ba6f281b6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:27:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-84773b07-f696-4aeb-a872-1e46c3c57519 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 12:27:34 user nova-compute[74840]: No targets found.
Nov 08 12:27:34 user nova-compute[74840]: iSNS:
Nov 08 12:27:34 user nova-compute[74840]: No targets found.
Nov 08 12:27:34 user nova-compute[74840]: STATIC:
Nov 08 12:27:34 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4
Nov 08 12:27:34 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:27:34 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:27:34 user nova-compute[74840]: FIRMWARE:
Nov 08 12:27:34 user nova-compute[74840]: No targets found.
Nov 08 12:27:34 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:27:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-84773b07-f696-4aeb-a872-1e46c3c57519 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 12:27:34 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 12:27:34 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 12:27:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-84773b07-f696-4aeb-a872-1e46c3c57519 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ae00900-c19b-42bd-b9ad-8d94f930741b', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 12:27:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:27:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:27:34 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5422832-50e6-4712-82c1-fbaa4a3c105b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:27:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:27:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:27:34 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af75693-23bd-45cd-b03d-60a5bb84a26a]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:27:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-84773b07-f696-4aeb-a872-1e46c3c57519 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:27:34 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:27:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-84773b07-f696-4aeb-a872-1e46c3c57519 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:27:34 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:27:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-84773b07-f696-4aeb-a872-1e46c3c57519 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7f4231630>, {}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 12:27:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-84773b07-f696-4aeb-a872-1e46c3c57519 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Disconnecting from: [] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 12:27:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-84773b07-f696-4aeb-a872-1e46c3c57519 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.073s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:27:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-84773b07-f696-4aeb-a872-1e46c3c57519 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] <== disconnect_volume: return (75ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:27:34 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84773b07-f696-4aeb-a872-1e46c3c57519 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 12:27:34 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-84773b07-f696-4aeb-a872-1e46c3c57519 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Deleting instance files /opt/stack/data/nova/instances/e6ea2c9a-81d4-4933-bff3-406aedd79031_del
Nov 08 12:27:34 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-84773b07-f696-4aeb-a872-1e46c3c57519 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Deletion of /opt/stack/data/nova/instances/e6ea2c9a-81d4-4933-bff3-406aedd79031_del complete
Nov 08 12:27:34 user nova-compute[74840]: INFO nova.compute.manager [None req-84773b07-f696-4aeb-a872-1e46c3c57519 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Took 1.04 seconds to destroy the instance on the hypervisor.
Nov 08 12:27:34 user nova-compute[74840]: DEBUG oslo.service.loopingcall [None req-84773b07-f696-4aeb-a872-1e46c3c57519 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74840) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 12:27:34 user nova-compute[74840]: DEBUG nova.compute.manager [-] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Deallocating network for instance {{(pid=74840) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 12:27:34 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] deallocate_for_instance() {{(pid=74840) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 12:27:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:35 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:27:35 user nova-compute[74840]: INFO nova.compute.manager [-] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Took 0.75 seconds to deallocate network for instance.
Nov 08 12:27:35 user nova-compute[74840]: WARNING nova.volume.cinder [None req-84773b07-f696-4aeb-a872-1e46c3c57519 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Attachment a1db99da-f661-4328-a1a1-9b2839d9acea does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = a1db99da-f661-4328-a1a1-9b2839d9acea. (HTTP 404) (Request-ID: req-220db817-7144-47b8-8ad2-cfeddcef17d0)
Nov 08 12:27:35 user nova-compute[74840]: INFO nova.compute.manager [None req-84773b07-f696-4aeb-a872-1e46c3c57519 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Took 0.03 seconds to detach 1 volumes for instance.
Nov 08 12:27:35 user nova-compute[74840]: DEBUG nova.compute.manager [req-28061226-eddb-49b1-b5f4-19da8002d4ae req-9fd3273f-a12c-4c34-8af1-dccb034caf58 service nova] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Received event network-vif-deleted-4f9932a0-5bfa-48bc-bd1f-5f61bf96803c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:27:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-84773b07-f696-4aeb-a872-1e46c3c57519 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:27:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-84773b07-f696-4aeb-a872-1e46c3c57519 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:27:35 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-84773b07-f696-4aeb-a872-1e46c3c57519 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:27:35 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-84773b07-f696-4aeb-a872-1e46c3c57519 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:27:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-84773b07-f696-4aeb-a872-1e46c3c57519 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.258s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:27:35 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-84773b07-f696-4aeb-a872-1e46c3c57519 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Deleted allocations for instance e6ea2c9a-81d4-4933-bff3-406aedd79031
Nov 08 12:27:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-84773b07-f696-4aeb-a872-1e46c3c57519 tempest-VolumesSnapshotTestJSON-1995603553 tempest-VolumesSnapshotTestJSON-1995603553-project-member] Lock "e6ea2c9a-81d4-4933-bff3-406aedd79031" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.263s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:27:35 user nova-compute[74840]: DEBUG nova.compute.manager [req-9a7e51da-f203-4591-a553-6cae3d07aeef req-41b022f8-9d48-4a28-a501-ccf939d46e84 service nova] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Received event network-vif-plugged-4f9932a0-5bfa-48bc-bd1f-5f61bf96803c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:27:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9a7e51da-f203-4591-a553-6cae3d07aeef req-41b022f8-9d48-4a28-a501-ccf939d46e84 service nova] Acquiring lock "e6ea2c9a-81d4-4933-bff3-406aedd79031-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:27:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9a7e51da-f203-4591-a553-6cae3d07aeef req-41b022f8-9d48-4a28-a501-ccf939d46e84 service nova] Lock "e6ea2c9a-81d4-4933-bff3-406aedd79031-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:27:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9a7e51da-f203-4591-a553-6cae3d07aeef req-41b022f8-9d48-4a28-a501-ccf939d46e84 service nova] Lock "e6ea2c9a-81d4-4933-bff3-406aedd79031-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:27:35 user nova-compute[74840]: DEBUG nova.compute.manager [req-9a7e51da-f203-4591-a553-6cae3d07aeef req-41b022f8-9d48-4a28-a501-ccf939d46e84 service nova] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] No waiting events found dispatching network-vif-plugged-4f9932a0-5bfa-48bc-bd1f-5f61bf96803c {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:27:35 user nova-compute[74840]: WARNING nova.compute.manager [req-9a7e51da-f203-4591-a553-6cae3d07aeef req-41b022f8-9d48-4a28-a501-ccf939d46e84 service nova] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Received unexpected event network-vif-plugged-4f9932a0-5bfa-48bc-bd1f-5f61bf96803c for instance with vm_state deleted and task_state None.
Nov 08 12:27:35 user nova-compute[74840]: DEBUG nova.compute.manager [req-9a7e51da-f203-4591-a553-6cae3d07aeef req-41b022f8-9d48-4a28-a501-ccf939d46e84 service nova] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Received event network-vif-plugged-4f9932a0-5bfa-48bc-bd1f-5f61bf96803c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:27:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9a7e51da-f203-4591-a553-6cae3d07aeef req-41b022f8-9d48-4a28-a501-ccf939d46e84 service nova] Acquiring lock "e6ea2c9a-81d4-4933-bff3-406aedd79031-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:27:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9a7e51da-f203-4591-a553-6cae3d07aeef req-41b022f8-9d48-4a28-a501-ccf939d46e84 service nova] Lock "e6ea2c9a-81d4-4933-bff3-406aedd79031-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:27:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9a7e51da-f203-4591-a553-6cae3d07aeef req-41b022f8-9d48-4a28-a501-ccf939d46e84 service nova] Lock "e6ea2c9a-81d4-4933-bff3-406aedd79031-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:27:35 user nova-compute[74840]: DEBUG nova.compute.manager [req-9a7e51da-f203-4591-a553-6cae3d07aeef req-41b022f8-9d48-4a28-a501-ccf939d46e84 service nova] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] No waiting events found dispatching network-vif-plugged-4f9932a0-5bfa-48bc-bd1f-5f61bf96803c {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:27:35 user nova-compute[74840]: WARNING nova.compute.manager [req-9a7e51da-f203-4591-a553-6cae3d07aeef req-41b022f8-9d48-4a28-a501-ccf939d46e84 service nova] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Received unexpected event network-vif-plugged-4f9932a0-5bfa-48bc-bd1f-5f61bf96803c for instance with vm_state deleted and task_state None.
Nov 08 12:27:35 user nova-compute[74840]: DEBUG nova.compute.manager [req-9a7e51da-f203-4591-a553-6cae3d07aeef req-41b022f8-9d48-4a28-a501-ccf939d46e84 service nova] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Received event network-vif-plugged-4f9932a0-5bfa-48bc-bd1f-5f61bf96803c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:27:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9a7e51da-f203-4591-a553-6cae3d07aeef req-41b022f8-9d48-4a28-a501-ccf939d46e84 service nova] Acquiring lock "e6ea2c9a-81d4-4933-bff3-406aedd79031-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:27:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9a7e51da-f203-4591-a553-6cae3d07aeef req-41b022f8-9d48-4a28-a501-ccf939d46e84 service nova] Lock "e6ea2c9a-81d4-4933-bff3-406aedd79031-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:27:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9a7e51da-f203-4591-a553-6cae3d07aeef req-41b022f8-9d48-4a28-a501-ccf939d46e84 service nova] Lock "e6ea2c9a-81d4-4933-bff3-406aedd79031-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:27:35 user nova-compute[74840]: DEBUG nova.compute.manager [req-9a7e51da-f203-4591-a553-6cae3d07aeef req-41b022f8-9d48-4a28-a501-ccf939d46e84 service nova] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] No waiting events found dispatching network-vif-plugged-4f9932a0-5bfa-48bc-bd1f-5f61bf96803c {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:27:35 user nova-compute[74840]: WARNING nova.compute.manager [req-9a7e51da-f203-4591-a553-6cae3d07aeef req-41b022f8-9d48-4a28-a501-ccf939d46e84 service nova] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Received unexpected event network-vif-plugged-4f9932a0-5bfa-48bc-bd1f-5f61bf96803c for instance with vm_state deleted and task_state None.
Nov 08 12:27:35 user nova-compute[74840]: DEBUG nova.compute.manager [req-9a7e51da-f203-4591-a553-6cae3d07aeef req-41b022f8-9d48-4a28-a501-ccf939d46e84 service nova] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Received event network-vif-unplugged-4f9932a0-5bfa-48bc-bd1f-5f61bf96803c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:27:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9a7e51da-f203-4591-a553-6cae3d07aeef req-41b022f8-9d48-4a28-a501-ccf939d46e84 service nova] Acquiring lock "e6ea2c9a-81d4-4933-bff3-406aedd79031-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:27:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9a7e51da-f203-4591-a553-6cae3d07aeef req-41b022f8-9d48-4a28-a501-ccf939d46e84 service nova] Lock "e6ea2c9a-81d4-4933-bff3-406aedd79031-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:27:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9a7e51da-f203-4591-a553-6cae3d07aeef req-41b022f8-9d48-4a28-a501-ccf939d46e84 service nova] Lock "e6ea2c9a-81d4-4933-bff3-406aedd79031-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:27:35 user nova-compute[74840]: DEBUG nova.compute.manager [req-9a7e51da-f203-4591-a553-6cae3d07aeef req-41b022f8-9d48-4a28-a501-ccf939d46e84 service nova] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] No waiting events found dispatching network-vif-unplugged-4f9932a0-5bfa-48bc-bd1f-5f61bf96803c {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:27:35 user nova-compute[74840]: WARNING nova.compute.manager [req-9a7e51da-f203-4591-a553-6cae3d07aeef req-41b022f8-9d48-4a28-a501-ccf939d46e84 service nova] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Received unexpected event network-vif-unplugged-4f9932a0-5bfa-48bc-bd1f-5f61bf96803c for instance with vm_state deleted and task_state None.
Nov 08 12:27:35 user nova-compute[74840]: DEBUG nova.compute.manager [req-9a7e51da-f203-4591-a553-6cae3d07aeef req-41b022f8-9d48-4a28-a501-ccf939d46e84 service nova] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Received event network-vif-plugged-4f9932a0-5bfa-48bc-bd1f-5f61bf96803c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:27:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9a7e51da-f203-4591-a553-6cae3d07aeef req-41b022f8-9d48-4a28-a501-ccf939d46e84 service nova] Acquiring lock "e6ea2c9a-81d4-4933-bff3-406aedd79031-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:27:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9a7e51da-f203-4591-a553-6cae3d07aeef req-41b022f8-9d48-4a28-a501-ccf939d46e84 service nova] Lock "e6ea2c9a-81d4-4933-bff3-406aedd79031-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:27:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9a7e51da-f203-4591-a553-6cae3d07aeef req-41b022f8-9d48-4a28-a501-ccf939d46e84 service nova] Lock "e6ea2c9a-81d4-4933-bff3-406aedd79031-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:27:35 user nova-compute[74840]: DEBUG nova.compute.manager [req-9a7e51da-f203-4591-a553-6cae3d07aeef req-41b022f8-9d48-4a28-a501-ccf939d46e84 service nova] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] No waiting events found dispatching network-vif-plugged-4f9932a0-5bfa-48bc-bd1f-5f61bf96803c {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:27:35 user nova-compute[74840]: WARNING nova.compute.manager [req-9a7e51da-f203-4591-a553-6cae3d07aeef req-41b022f8-9d48-4a28-a501-ccf939d46e84 service nova] [instance: e6ea2c9a-81d4-4933-bff3-406aedd79031] Received unexpected event network-vif-plugged-4f9932a0-5bfa-48bc-bd1f-5f61bf96803c for instance with vm_state deleted and task_state None.
Nov 08 12:27:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:51 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:54 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:56 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:27:57 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:27:57 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:27:57 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Rebuilding the list of instances to heal {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 12:27:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "refresh_cache-d3e8efc6-7146-46ef-8433-380d7e69120c" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:27:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquired lock "refresh_cache-d3e8efc6-7146-46ef-8433-380d7e69120c" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:27:57 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Forcefully refreshing network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 12:27:57 user nova-compute[74840]: DEBUG nova.objects.instance [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lazy-loading 'info_cache' on Instance uuid d3e8efc6-7146-46ef-8433-380d7e69120c {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:27:58 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Updating instance_info_cache with network_info: [{"id": "5c942bb3-846b-4319-961f-42aed0e55bdf", "address": "fa:16:3e:29:6a:cd", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c942bb3-84", "ovs_interfaceid": "5c942bb3-846b-4319-961f-42aed0e55bdf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:27:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Releasing lock "refresh_cache-d3e8efc6-7146-46ef-8433-380d7e69120c" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:27:58 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Updated the network info_cache for instance {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 12:27:58 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:27:58 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:27:58 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:27:58 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:27:58 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:27:59 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:27:59 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:27:59 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 12:27:59 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:27:59 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:27:59 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:28:01 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:28:02 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:28:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:28:03 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:28:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:28:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:28:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:28:03 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:28:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:28:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:28:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:28:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:28:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:28:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:28:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:28:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:28:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:28:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:28:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:28:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:28:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:28:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:28:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:28:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:28:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:28:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:28:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:28:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:28:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:28:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:28:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:28:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:28:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:28:06 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:28:06 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:28:06 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:28:06 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=8072MB free_disk=25.029544830322266GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:28:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:28:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:28:06 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance d3e8efc6-7146-46ef-8433-380d7e69120c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:28:06 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance ffe50042-29bf-4ef3-a148-8698bc75233b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:28:06 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 8b7c490e-4c78-4e07-bc8a-3be2328963d7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:28:06 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 832a6445-84ee-43a8-a5bc-a07670602912 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:28:06 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 10c42516-62ba-4aa9-bc5a-d94499bd6b65 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:28:06 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 9991e7b4-aaf8-4485-b658-e1af634925de actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:28:06 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:28:06 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:28:06 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:28:06 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:28:06 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:28:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.388s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:28:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:28:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:28:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:28:14 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:28:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:28:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:28:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 12:28:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:28:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:28:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:28:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "aef3c8bf-d1a4-405b-a659-5bdee2415d6f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:28:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "aef3c8bf-d1a4-405b-a659-5bdee2415d6f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:28:20 user nova-compute[74840]: DEBUG nova.compute.manager [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Starting instance... {{(pid=74840) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 12:28:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:28:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:28:20 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:28:20 user nova-compute[74840]: INFO nova.compute.claims [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Claim successful on node user
Nov 08 12:28:20 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:28:20 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:28:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.349s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:28:20 user nova-compute[74840]: DEBUG nova.compute.manager [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Start building networks asynchronously for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 12:28:20 user nova-compute[74840]: DEBUG nova.compute.manager [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Allocating IP information in the background. {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 12:28:20 user nova-compute[74840]: DEBUG nova.network.neutron [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 12:28:20 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 12:28:20 user nova-compute[74840]: DEBUG nova.compute.manager [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Start building block device mappings for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 12:28:21 user nova-compute[74840]: INFO nova.virt.block_device [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Booting with volume 3633e924-8440-44ef-8902-fdceb5a4787b at /dev/vda
Nov 08 12:28:21 user nova-compute[74840]: DEBUG nova.policy [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '794c0281e1bf48f79117efdc3907e661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1250106b55ae44b0b303849df7781ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 12:28:21 user nova-compute[74840]: DEBUG os_brick.utils [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:28:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:28:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:28:21 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cac95fe-fcc3-41ca-9c6c-a645246db8b0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c8228a11e03c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:28:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:28:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:28:21 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6d0762-3202-4071-8337-2f6c324c34ed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:28:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:28:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:28:21 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8ceae4-dce2-407c-b914-b0b994301891]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:28:21 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d378f148-353b-4278-8c16-0459b7169d41]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:28:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Running cmd (subprocess): nvme version {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:28:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] 'nvme version' failed. Not Retrying. {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:28:21 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] nvme not present on system {{(pid=74840) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 12:28:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:28:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:28:21 user nova-compute[74840]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 12:28:21 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fa09f3-dbf9-4620-821d-eda204fff470]: (4, '') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:28:21 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74840) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 12:28:21 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 12:28:21 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] LIGHTOS: no hostnqn found. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 12:28:21 user nova-compute[74840]: DEBUG os_brick.utils [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c8228a11e03c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:28:21 user nova-compute[74840]: DEBUG nova.virt.block_device [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Updating existing volume attachment record: d90888e9-9212-4b7d-9009-2dd06551c0cf {{(pid=74840) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 12:28:21 user nova-compute[74840]: DEBUG nova.network.neutron [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Successfully created port: c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1 {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:28:22 user nova-compute[74840]: DEBUG nova.network.neutron [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Successfully updated port: c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1 {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:28:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "refresh_cache-aef3c8bf-d1a4-405b-a659-5bdee2415d6f" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:28:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquired lock "refresh_cache-aef3c8bf-d1a4-405b-a659-5bdee2415d6f" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:28:22 user nova-compute[74840]: DEBUG nova.network.neutron [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:28:22 user nova-compute[74840]: DEBUG nova.compute.manager [req-7d749592-474d-463f-adc3-f86eb2bb6b15 req-da471c1c-ef06-48a8-a247-7d7ca712d885 service nova] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Received event network-changed-c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:28:22 user nova-compute[74840]: DEBUG nova.compute.manager [req-7d749592-474d-463f-adc3-f86eb2bb6b15 req-da471c1c-ef06-48a8-a247-7d7ca712d885 service nova] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Refreshing instance network info cache due to event network-changed-c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:28:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-7d749592-474d-463f-adc3-f86eb2bb6b15 req-da471c1c-ef06-48a8-a247-7d7ca712d885 service nova] Acquiring lock "refresh_cache-aef3c8bf-d1a4-405b-a659-5bdee2415d6f" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:28:22 user nova-compute[74840]: DEBUG nova.network.neutron [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:28:22 user nova-compute[74840]: DEBUG nova.network.neutron [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Updating instance_info_cache with network_info: [{"id": "c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1", "address": "fa:16:3e:84:5c:0f", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc009e4aa-0d", "ovs_interfaceid": "c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:28:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Releasing lock "refresh_cache-aef3c8bf-d1a4-405b-a659-5bdee2415d6f" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:28:22 user nova-compute[74840]: DEBUG nova.compute.manager [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Instance network_info: |[{"id": "c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1", "address": "fa:16:3e:84:5c:0f", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc009e4aa-0d", "ovs_interfaceid": "c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 12:28:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-7d749592-474d-463f-adc3-f86eb2bb6b15 req-da471c1c-ef06-48a8-a247-7d7ca712d885 service nova] Acquired lock "refresh_cache-aef3c8bf-d1a4-405b-a659-5bdee2415d6f" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:28:22 user nova-compute[74840]: DEBUG nova.network.neutron [req-7d749592-474d-463f-adc3-f86eb2bb6b15 req-da471c1c-ef06-48a8-a247-7d7ca712d885 service nova] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Refreshing network info cache for port c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:28:23 user nova-compute[74840]: DEBUG nova.network.neutron [req-7d749592-474d-463f-adc3-f86eb2bb6b15 req-da471c1c-ef06-48a8-a247-7d7ca712d885 service nova] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Updated VIF entry in instance network info cache for port c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:28:23 user nova-compute[74840]: DEBUG nova.network.neutron [req-7d749592-474d-463f-adc3-f86eb2bb6b15 req-da471c1c-ef06-48a8-a247-7d7ca712d885 service nova] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Updating instance_info_cache with network_info: [{"id": "c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1", "address": "fa:16:3e:84:5c:0f", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc009e4aa-0d", "ovs_interfaceid": "c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:28:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-7d749592-474d-463f-adc3-f86eb2bb6b15 req-da471c1c-ef06-48a8-a247-7d7ca712d885 service nova] Releasing lock "refresh_cache-aef3c8bf-d1a4-405b-a659-5bdee2415d6f" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:28:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:28:29 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:28:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:28:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:28:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 12:28:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:28:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:28:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:28:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:28:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "e3175752-45a5-43e3-a99a-9377440e7bea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:28:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "e3175752-45a5-43e3-a99a-9377440e7bea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:28:41 user nova-compute[74840]: DEBUG nova.compute.manager [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Starting instance... {{(pid=74840) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 12:28:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:28:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:28:41 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:28:41 user nova-compute[74840]: INFO nova.compute.claims [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Claim successful on node user
Nov 08 12:28:42 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:28:42 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:28:42 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.425s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:28:42 user nova-compute[74840]: DEBUG nova.compute.manager [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Start building networks asynchronously for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 12:28:42 user nova-compute[74840]: DEBUG nova.compute.manager [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Allocating IP information in the background. {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 12:28:42 user nova-compute[74840]: DEBUG nova.network.neutron [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 12:28:42 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 12:28:42 user nova-compute[74840]: DEBUG nova.compute.manager [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Start building block device mappings for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 12:28:42 user nova-compute[74840]: DEBUG nova.compute.manager [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Start spawning the instance on the hypervisor. {{(pid=74840) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 12:28:42 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:28:42 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Creating image(s)
Nov 08 12:28:42 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "/opt/stack/data/nova/instances/e3175752-45a5-43e3-a99a-9377440e7bea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:28:42 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "/opt/stack/data/nova/instances/e3175752-45a5-43e3-a99a-9377440e7bea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:28:42 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "/opt/stack/data/nova/instances/e3175752-45a5-43e3-a99a-9377440e7bea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:28:42 user nova-compute[74840]: DEBUG nova.policy [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9a49f88cb74c47bdb9a35883adbae454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e47ef156b3649839ff728eaf23121da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 12:28:42 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:28:42 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.197s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:28:42 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "5d26578eba85497f494c575690c4248f381a0fe6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:28:42 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:28:42 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:28:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.202s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:28:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/e3175752-45a5-43e3-a99a-9377440e7bea/disk 1073741824 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:28:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/e3175752-45a5-43e3-a99a-9377440e7bea/disk 1073741824" returned: 0 in 0.057s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:28:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:28:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:28:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.203s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:28:43 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e3175752-45a5-43e3-a99a-9377440e7bea/disk. size=1073741824 {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 12:28:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3175752-45a5-43e3-a99a-9377440e7bea/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:28:43 user nova-compute[74840]: DEBUG nova.network.neutron [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Successfully created port: e0c27d11-afc7-4e26-8024-d4c7ad9a6baf {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:28:43 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3175752-45a5-43e3-a99a-9377440e7bea/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:28:43 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Cannot resize image /opt/stack/data/nova/instances/e3175752-45a5-43e3-a99a-9377440e7bea/disk to a smaller size. {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 12:28:43 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Created local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 12:28:43 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Ensure instance console log exists: /opt/stack/data/nova/instances/e3175752-45a5-43e3-a99a-9377440e7bea/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:28:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:28:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:28:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG nova.network.neutron [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Successfully updated port: e0c27d11-afc7-4e26-8024-d4c7ad9a6baf {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "refresh_cache-e3175752-45a5-43e3-a99a-9377440e7bea" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquired lock "refresh_cache-e3175752-45a5-43e3-a99a-9377440e7bea" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG nova.network.neutron [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG nova.compute.manager [req-cf039b55-7ee7-4a7a-a020-428d9264ae88 req-b758ad3a-8dcf-4fb7-b713-31fded8cf470 service nova] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Received event network-changed-e0c27d11-afc7-4e26-8024-d4c7ad9a6baf {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG nova.compute.manager [req-cf039b55-7ee7-4a7a-a020-428d9264ae88 req-b758ad3a-8dcf-4fb7-b713-31fded8cf470 service nova] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Refreshing instance network info cache due to event network-changed-e0c27d11-afc7-4e26-8024-d4c7ad9a6baf. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-cf039b55-7ee7-4a7a-a020-428d9264ae88 req-b758ad3a-8dcf-4fb7-b713-31fded8cf470 service nova] Acquiring lock "refresh_cache-e3175752-45a5-43e3-a99a-9377440e7bea" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG nova.network.neutron [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG nova.compute.manager [None req-37eb79c1-daec-4087-b95c-bd28a72f9f9e tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:28:44 user nova-compute[74840]: INFO nova.compute.manager [None req-37eb79c1-daec-4087-b95c-bd28a72f9f9e tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] instance snapshotting
Nov 08 12:28:44 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-37eb79c1-daec-4087-b95c-bd28a72f9f9e tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Beginning live snapshot process
Nov 08 12:28:44 user nova-compute[74840]: DEBUG nova.network.neutron [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Updating instance_info_cache with network_info: [{"id": "e0c27d11-afc7-4e26-8024-d4c7ad9a6baf", "address": "fa:16:3e:86:18:09", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0c27d11-af", "ovs_interfaceid": "e0c27d11-afc7-4e26-8024-d4c7ad9a6baf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Releasing lock "refresh_cache-e3175752-45a5-43e3-a99a-9377440e7bea" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG nova.compute.manager [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Instance network_info: |[{"id": "e0c27d11-afc7-4e26-8024-d4c7ad9a6baf", "address": "fa:16:3e:86:18:09", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0c27d11-af", "ovs_interfaceid": "e0c27d11-afc7-4e26-8024-d4c7ad9a6baf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-cf039b55-7ee7-4a7a-a020-428d9264ae88 req-b758ad3a-8dcf-4fb7-b713-31fded8cf470 service nova] Acquired lock "refresh_cache-e3175752-45a5-43e3-a99a-9377440e7bea" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG nova.network.neutron [req-cf039b55-7ee7-4a7a-a020-428d9264ae88 req-b758ad3a-8dcf-4fb7-b713-31fded8cf470 service nova] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Refreshing network info cache for port e0c27d11-afc7-4e26-8024-d4c7ad9a6baf {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Start _get_guest_xml network_info=[{"id": "e0c27d11-afc7-4e26-8024-d4c7ad9a6baf", "address": "fa:16:3e:86:18:09", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0c27d11-af", "ovs_interfaceid": "e0c27d11-afc7-4e26-8024-d4c7ad9a6baf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'image_id': '4fa17706-d304-4117-a420-dab994c703dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:28:44 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:28:44 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:28:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:28:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-199314448',display_name='tempest-tempest.common.compute-instance-199314448',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-199314448',id=35,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSNrYheJ8Lzn3ZHvNUQvlNC/AEkaeIt4FFfFZ6MDZZKThsvIjNiHNZVHlAFC+XE6iHCrr/eoF+btmdxSZwQV3WJpatsIGdnvZUn9Tn2nZPQiFTZnNkVsedEjHcwcaa0jw==',key_name='tempest-keypair-1203623053',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e47ef156b3649839ff728eaf23121da',ramdisk_id='',reservation_id='r-qttfimk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-401855506',owner_user_name='tempest-ServerActionsTestOtherA-401855506-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:28:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a49f88cb74c47bdb9a35883adbae454',uuid=e3175752-45a5-43e3-a99a-9377440e7bea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0c27d11-afc7-4e26-8024-d4c7ad9a6baf", "address": "fa:16:3e:86:18:09", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0c27d11-af", "ovs_interfaceid": "e0c27d11-afc7-4e26-8024-d4c7ad9a6baf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Converting VIF {"id": "e0c27d11-afc7-4e26-8024-d4c7ad9a6baf", "address": "fa:16:3e:86:18:09", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0c27d11-af", "ovs_interfaceid": "e0c27d11-afc7-4e26-8024-d4c7ad9a6baf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:18:09,bridge_name='br-int',has_traffic_filtering=True,id=e0c27d11-afc7-4e26-8024-d4c7ad9a6baf,network=Network(e92448c4-9bc0-424b-a07f-a398ac46fada),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0c27d11-af') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG nova.objects.instance [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lazy-loading 'pci_devices' on Instance uuid e3175752-45a5-43e3-a99a-9377440e7bea {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:28:44 user nova-compute[74840]:   <uuid>e3175752-45a5-43e3-a99a-9377440e7bea</uuid>
Nov 08 12:28:44 user nova-compute[74840]:   <name>instance-00000023</name>
Nov 08 12:28:44 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:28:44 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:28:44 user nova-compute[74840]:   <metadata>
Nov 08 12:28:44 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:28:44 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:28:44 user nova-compute[74840]:       <nova:name>tempest-tempest.common.compute-instance-199314448</nova:name>
Nov 08 12:28:44 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:28:44</nova:creationTime>
Nov 08 12:28:44 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:28:44 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:28:44 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:28:44 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:28:44 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:28:44 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:28:44 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:28:44 user nova-compute[74840]:       <nova:owner>
Nov 08 12:28:44 user nova-compute[74840]:         <nova:user uuid="9a49f88cb74c47bdb9a35883adbae454">tempest-ServerActionsTestOtherA-401855506-project-member</nova:user>
Nov 08 12:28:44 user nova-compute[74840]:         <nova:project uuid="5e47ef156b3649839ff728eaf23121da">tempest-ServerActionsTestOtherA-401855506</nova:project>
Nov 08 12:28:44 user nova-compute[74840]:       </nova:owner>
Nov 08 12:28:44 user nova-compute[74840]:       <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:28:44 user nova-compute[74840]:       <nova:ports>
Nov 08 12:28:44 user nova-compute[74840]:         <nova:port uuid="e0c27d11-afc7-4e26-8024-d4c7ad9a6baf">
Nov 08 12:28:44 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 08 12:28:44 user nova-compute[74840]:         </nova:port>
Nov 08 12:28:44 user nova-compute[74840]:       </nova:ports>
Nov 08 12:28:44 user nova-compute[74840]:     </nova:instance>
Nov 08 12:28:44 user nova-compute[74840]:   </metadata>
Nov 08 12:28:44 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:28:44 user nova-compute[74840]:     <system>
Nov 08 12:28:44 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:28:44 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:28:44 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:28:44 user nova-compute[74840]:       <entry name="serial">e3175752-45a5-43e3-a99a-9377440e7bea</entry>
Nov 08 12:28:44 user nova-compute[74840]:       <entry name="uuid">e3175752-45a5-43e3-a99a-9377440e7bea</entry>
Nov 08 12:28:44 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:28:44 user nova-compute[74840]:     </system>
Nov 08 12:28:44 user nova-compute[74840]:   </sysinfo>
Nov 08 12:28:44 user nova-compute[74840]:   <os>
Nov 08 12:28:44 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:28:44 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:28:44 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:28:44 user nova-compute[74840]:   </os>
Nov 08 12:28:44 user nova-compute[74840]:   <features>
Nov 08 12:28:44 user nova-compute[74840]:     <acpi/>
Nov 08 12:28:44 user nova-compute[74840]:     <apic/>
Nov 08 12:28:44 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:28:44 user nova-compute[74840]:   </features>
Nov 08 12:28:44 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:28:44 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:28:44 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:28:44 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:28:44 user nova-compute[74840]:   </clock>
Nov 08 12:28:44 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:28:44 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:28:44 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:28:44 user nova-compute[74840]:   </cpu>
Nov 08 12:28:44 user nova-compute[74840]:   <devices>
Nov 08 12:28:44 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:28:44 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:28:44 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/e3175752-45a5-43e3-a99a-9377440e7bea/disk"/>
Nov 08 12:28:44 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:28:44 user nova-compute[74840]:     </disk>
Nov 08 12:28:44 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:28:44 user nova-compute[74840]:       <mac address="fa:16:3e:86:18:09"/>
Nov 08 12:28:44 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:28:44 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:28:44 user nova-compute[74840]:       <target dev="tape0c27d11-af"/>
Nov 08 12:28:44 user nova-compute[74840]:     </interface>
Nov 08 12:28:44 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:28:44 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/e3175752-45a5-43e3-a99a-9377440e7bea/console.log" append="off"/>
Nov 08 12:28:44 user nova-compute[74840]:     </serial>
Nov 08 12:28:44 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:28:44 user nova-compute[74840]:     <video>
Nov 08 12:28:44 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:28:44 user nova-compute[74840]:     </video>
Nov 08 12:28:44 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:28:44 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:28:44 user nova-compute[74840]:     </rng>
Nov 08 12:28:44 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:28:44 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:28:44 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:28:44 user nova-compute[74840]:     </memballoon>
Nov 08 12:28:44 user nova-compute[74840]:   </devices>
Nov 08 12:28:44 user nova-compute[74840]: </domain>
Nov 08 12:28:44 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:28:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-199314448',display_name='tempest-tempest.common.compute-instance-199314448',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-199314448',id=35,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSNrYheJ8Lzn3ZHvNUQvlNC/AEkaeIt4FFfFZ6MDZZKThsvIjNiHNZVHlAFC+XE6iHCrr/eoF+btmdxSZwQV3WJpatsIGdnvZUn9Tn2nZPQiFTZnNkVsedEjHcwcaa0jw==',key_name='tempest-keypair-1203623053',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e47ef156b3649839ff728eaf23121da',ramdisk_id='',reservation_id='r-qttfimk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-401855506',owner_user_name='tempest-ServerActionsTestOtherA-401855506-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:28:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a49f88cb74c47bdb9a35883adbae454',uuid=e3175752-45a5-43e3-a99a-9377440e7bea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0c27d11-afc7-4e26-8024-d4c7ad9a6baf", "address": "fa:16:3e:86:18:09", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0c27d11-af", "ovs_interfaceid": "e0c27d11-afc7-4e26-8024-d4c7ad9a6baf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Converting VIF {"id": "e0c27d11-afc7-4e26-8024-d4c7ad9a6baf", "address": "fa:16:3e:86:18:09", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0c27d11-af", "ovs_interfaceid": "e0c27d11-afc7-4e26-8024-d4c7ad9a6baf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:18:09,bridge_name='br-int',has_traffic_filtering=True,id=e0c27d11-afc7-4e26-8024-d4c7ad9a6baf,network=Network(e92448c4-9bc0-424b-a07f-a398ac46fada),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0c27d11-af') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG os_vif [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:18:09,bridge_name='br-int',has_traffic_filtering=True,id=e0c27d11-afc7-4e26-8024-d4c7ad9a6baf,network=Network(e92448c4-9bc0-424b-a07f-a398ac46fada),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0c27d11-af') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8df3d3ef-4770-5e1a-b3b5-abd96b837941', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-37eb79c1-daec-4087-b95c-bd28a72f9f9e tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk --force-share --output=json -f qcow2 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape0c27d11-af, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape0c27d11-af, col_values=(('qos', UUID('9e1988eb-4a8c-49c5-aeaa-9abbaafa02b4')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape0c27d11-af, col_values=(('external_ids', {'iface-id': 'e0c27d11-afc7-4e26-8024-d4c7ad9a6baf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:18:09', 'vm-uuid': 'e3175752-45a5-43e3-a99a-9377440e7bea'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:28:44 user nova-compute[74840]: INFO os_vif [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:18:09,bridge_name='br-int',has_traffic_filtering=True,id=e0c27d11-afc7-4e26-8024-d4c7ad9a6baf,network=Network(e92448c4-9bc0-424b-a07f-a398ac46fada),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0c27d11-af')
Nov 08 12:28:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:28:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] No VIF found with MAC fa:16:3e:86:18:09, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:28:45 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-37eb79c1-daec-4087-b95c-bd28a72f9f9e tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk --force-share --output=json -f qcow2" returned: 0 in 0.185s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:28:45 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-37eb79c1-daec-4087-b95c-bd28a72f9f9e tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk --force-share --output=json -f qcow2 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:28:45 user nova-compute[74840]: DEBUG nova.network.neutron [req-cf039b55-7ee7-4a7a-a020-428d9264ae88 req-b758ad3a-8dcf-4fb7-b713-31fded8cf470 service nova] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Updated VIF entry in instance network info cache for port e0c27d11-afc7-4e26-8024-d4c7ad9a6baf. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:28:45 user nova-compute[74840]: DEBUG nova.network.neutron [req-cf039b55-7ee7-4a7a-a020-428d9264ae88 req-b758ad3a-8dcf-4fb7-b713-31fded8cf470 service nova] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Updating instance_info_cache with network_info: [{"id": "e0c27d11-afc7-4e26-8024-d4c7ad9a6baf", "address": "fa:16:3e:86:18:09", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0c27d11-af", "ovs_interfaceid": "e0c27d11-afc7-4e26-8024-d4c7ad9a6baf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:28:45 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-cf039b55-7ee7-4a7a-a020-428d9264ae88 req-b758ad3a-8dcf-4fb7-b713-31fded8cf470 service nova] Releasing lock "refresh_cache-e3175752-45a5-43e3-a99a-9377440e7bea" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:28:45 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-37eb79c1-daec-4087-b95c-bd28a72f9f9e tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk --force-share --output=json -f qcow2" returned: 0 in 0.195s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:28:45 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-37eb79c1-daec-4087-b95c-bd28a72f9f9e tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:28:45 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-37eb79c1-daec-4087-b95c-bd28a72f9f9e tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.188s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:28:45 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-37eb79c1-daec-4087-b95c-bd28a72f9f9e tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp6_ru_ee8/902fa519650947bebfe1dab5fce9dae6.delta 1073741824 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:28:45 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-37eb79c1-daec-4087-b95c-bd28a72f9f9e tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp6_ru_ee8/902fa519650947bebfe1dab5fce9dae6.delta 1073741824" returned: 0 in 0.058s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:28:45 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-37eb79c1-daec-4087-b95c-bd28a72f9f9e tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 08 12:28:46 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-37eb79c1-daec-4087-b95c-bd28a72f9f9e tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74840) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 12:28:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:28:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:28:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:28:47 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-37eb79c1-daec-4087-b95c-bd28a72f9f9e tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74840) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 12:28:47 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-37eb79c1-daec-4087-b95c-bd28a72f9f9e tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 08 12:28:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:28:47 user nova-compute[74840]: DEBUG nova.compute.manager [req-74e6fae6-58e8-4033-bf7b-fde6e6aeab10 req-483a80c3-f007-4eaa-a22d-ecd81ba3fec9 service nova] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Received event network-vif-plugged-e0c27d11-afc7-4e26-8024-d4c7ad9a6baf {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:28:47 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-74e6fae6-58e8-4033-bf7b-fde6e6aeab10 req-483a80c3-f007-4eaa-a22d-ecd81ba3fec9 service nova] Acquiring lock "e3175752-45a5-43e3-a99a-9377440e7bea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:28:47 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-74e6fae6-58e8-4033-bf7b-fde6e6aeab10 req-483a80c3-f007-4eaa-a22d-ecd81ba3fec9 service nova] Lock "e3175752-45a5-43e3-a99a-9377440e7bea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:28:47 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-74e6fae6-58e8-4033-bf7b-fde6e6aeab10 req-483a80c3-f007-4eaa-a22d-ecd81ba3fec9 service nova] Lock "e3175752-45a5-43e3-a99a-9377440e7bea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:28:47 user nova-compute[74840]: DEBUG nova.compute.manager [req-74e6fae6-58e8-4033-bf7b-fde6e6aeab10 req-483a80c3-f007-4eaa-a22d-ecd81ba3fec9 service nova] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] No waiting events found dispatching network-vif-plugged-e0c27d11-afc7-4e26-8024-d4c7ad9a6baf {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:28:47 user nova-compute[74840]: WARNING nova.compute.manager [req-74e6fae6-58e8-4033-bf7b-fde6e6aeab10 req-483a80c3-f007-4eaa-a22d-ecd81ba3fec9 service nova] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Received unexpected event network-vif-plugged-e0c27d11-afc7-4e26-8024-d4c7ad9a6baf for instance with vm_state building and task_state spawning.
Nov 08 12:28:47 user nova-compute[74840]: DEBUG nova.privsep.utils [None req-37eb79c1-daec-4087-b95c-bd28a72f9f9e tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74840) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 12:28:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-37eb79c1-daec-4087-b95c-bd28a72f9f9e tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp6_ru_ee8/902fa519650947bebfe1dab5fce9dae6.delta /opt/stack/data/nova/instances/snapshots/tmp6_ru_ee8/902fa519650947bebfe1dab5fce9dae6 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:28:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-37eb79c1-daec-4087-b95c-bd28a72f9f9e tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp6_ru_ee8/902fa519650947bebfe1dab5fce9dae6.delta /opt/stack/data/nova/instances/snapshots/tmp6_ru_ee8/902fa519650947bebfe1dab5fce9dae6" returned: 0 in 0.521s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:28:47 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-37eb79c1-daec-4087-b95c-bd28a72f9f9e tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Snapshot extracted, beginning image upload
Nov 08 12:28:49 user nova-compute[74840]: DEBUG nova.compute.manager [req-00cf438c-b8bc-4e0a-a3da-951dd65a4f59 req-54bc35a1-315b-4fa3-9a6e-1cd356d256da service nova] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Received event network-vif-plugged-e0c27d11-afc7-4e26-8024-d4c7ad9a6baf {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:28:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-00cf438c-b8bc-4e0a-a3da-951dd65a4f59 req-54bc35a1-315b-4fa3-9a6e-1cd356d256da service nova] Acquiring lock "e3175752-45a5-43e3-a99a-9377440e7bea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:28:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-00cf438c-b8bc-4e0a-a3da-951dd65a4f59 req-54bc35a1-315b-4fa3-9a6e-1cd356d256da service nova] Lock "e3175752-45a5-43e3-a99a-9377440e7bea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:28:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-00cf438c-b8bc-4e0a-a3da-951dd65a4f59 req-54bc35a1-315b-4fa3-9a6e-1cd356d256da service nova] Lock "e3175752-45a5-43e3-a99a-9377440e7bea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:28:49 user nova-compute[74840]: DEBUG nova.compute.manager [req-00cf438c-b8bc-4e0a-a3da-951dd65a4f59 req-54bc35a1-315b-4fa3-9a6e-1cd356d256da service nova] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] No waiting events found dispatching network-vif-plugged-e0c27d11-afc7-4e26-8024-d4c7ad9a6baf {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:28:49 user nova-compute[74840]: WARNING nova.compute.manager [req-00cf438c-b8bc-4e0a-a3da-951dd65a4f59 req-54bc35a1-315b-4fa3-9a6e-1cd356d256da service nova] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Received unexpected event network-vif-plugged-e0c27d11-afc7-4e26-8024-d4c7ad9a6baf for instance with vm_state building and task_state spawning.
Nov 08 12:28:49 user nova-compute[74840]: DEBUG nova.compute.manager [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:28:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:28:49 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Instance spawned successfully.
Nov 08 12:28:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:28:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Found default for hw_cdrom_bus of ide {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:28:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Found default for hw_disk_bus of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:28:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:28:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:28:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Found default for hw_video_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:28:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Found default for hw_vif_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:28:49 user nova-compute[74840]: INFO nova.compute.manager [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Took 7.01 seconds to spawn the instance on the hypervisor.
Nov 08 12:28:49 user nova-compute[74840]: DEBUG nova.compute.manager [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:28:49 user nova-compute[74840]: INFO nova.compute.manager [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Took 7.80 seconds to build instance.
Nov 08 12:28:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-31b1fa1f-bcdf-4333-b25f-611d2e653a18 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "e3175752-45a5-43e3-a99a-9377440e7bea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.920s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:28:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:28:50 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-37eb79c1-daec-4087-b95c-bd28a72f9f9e tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Snapshot image upload complete
Nov 08 12:28:50 user nova-compute[74840]: INFO nova.compute.manager [None req-37eb79c1-daec-4087-b95c-bd28a72f9f9e tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Took 6.16 seconds to snapshot the instance on the hypervisor.
Nov 08 12:28:51 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:28:54 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:28:59 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:28:59 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:28:59 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 12:28:59 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:28:59 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:28:59 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:29:00 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:29:00 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:29:00 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:29:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "refresh_cache-ffe50042-29bf-4ef3-a148-8698bc75233b" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:29:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquired lock "refresh_cache-ffe50042-29bf-4ef3-a148-8698bc75233b" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:29:01 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Forcefully refreshing network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 12:29:01 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Updating instance_info_cache with network_info: [{"id": "6169b221-7840-4cfb-ba25-e34a95b35e77", "address": "fa:16:3e:b0:6a:c2", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6169b221-78", "ovs_interfaceid": "6169b221-7840-4cfb-ba25-e34a95b35e77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:29:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Releasing lock "refresh_cache-ffe50042-29bf-4ef3-a148-8698bc75233b" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:29:01 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Updated the network info_cache for instance {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 12:29:01 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:29:01 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:29:01 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:29:01 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:29:01 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:29:01 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:29:02 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG nova.compute.manager [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Start spawning the instance on the hypervisor. {{(pid=74840) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:29:03 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Creating image(s)
Nov 08 12:29:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Did not create local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Ensure instance console log exists: /opt/stack/data/nova/instances/aef3c8bf-d1a4-405b-a659-5bdee2415d6f/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Start _get_guest_xml network_info=[{"id": "c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1", "address": "fa:16:3e:84:5c:0f", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc009e4aa-0d", "ovs_interfaceid": "c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd90888e9-9212-4b7d-9009-2dd06551c0cf', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AXqwMDBP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'aef3c8bf-d1a4-405b-a659-5bdee2415d6f', 'attached_at': '', 'detached_at': '', 'volume_id': '3633e924-8440-44ef-8902-fdceb5a4787b', 'serial': '3633e924-8440-44ef-8902-fdceb5a4787b'}, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:29:03 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:29:03 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:29:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Calling os-brick to attach iSCSI Volume {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AXqwMDBP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:29:03 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:29:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:29:03 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:29:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:29:03 user nova-compute[74840]: INFO os_brick.initiator.connectors.iscsi [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 12:29:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b -p 172.16.0.220:3260 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[00038806-9148-4602-bffc-81f198764d25]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 12:29:03 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b -p 172.16.0.220:3260 --interface default --op new {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6766945-0d56-4e83-8ffe-abac8a7de208]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b] added\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b] added
Nov 08 12:29:03 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[175e2871-85ac-44ee-996e-3f8532acb929]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0a6e77-df94-4805-8ec1-0361b846deaf]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AXqwMDBP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AXqwMDBP" returned: 0 in 0.032s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[441a4053-31f5-4506-8146-fc1c3f748554]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AXqwMDBP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[69cdd079-e682-4ec8-9f58-13d0c71ca4b4]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2b26e8-be91-432a-a59e-9397144d6a53]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:29:03 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:29:03 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b -p 172.16.0.220:3260 --login {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc034b2-9129-4faa-8c77-2563249e83df]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b, portal: 172.16.0.220,3260]
Nov 08 12:29:03 user nova-compute[74840]: Login to [iface: default, target: iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b, portal: 172.16.0.220,3260] successful.
Nov 08 12:29:03 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b146d76-468d-450f-8bb1-725fa849288f]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b877642a-6e2e-4450-a920-ee6ef9448271]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:29:03 user nova-compute[74840]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)
Nov 08 12:29:03 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:29:03 user nova-compute[74840]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)
Nov 08 12:29:03 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Connected to 172.16.0.220:3260 {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] HCTL ('33', '-', '-', 0) found on session 33 with lun 0 {{(pid=74840) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74840) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b48f1f5-3aab-40a0-ba60-ac377d865437]: (4, ('- - 0', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:29:03 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: None {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:29:04 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Acquiring lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:29:04 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:29:04 user nova-compute[74840]: INFO nova.compute.manager [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Unshelving
Nov 08 12:29:04 user nova-compute[74840]: INFO nova.virt.block_device [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Booting with volume 596bd9e9-a02d-4b9d-95dd-87127daf8a60 at /dev/vdc
Nov 08 12:29:04 user nova-compute[74840]: DEBUG os_brick.utils [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:29:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:29:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:29:04 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ceb32c-4ff6-4304-8615-68b00cab928c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c8228a11e03c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:29:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:29:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:29:04 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb6fbfc-2d7b-4101-9f56-ee0c7fc49158]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:29:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:29:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:29:04 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd5b6fe-d974-4d31-b508-b1bdc25a0fe7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:29:04 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f764cdf7-8814-4242-9c33-a34c09ab97f1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:29:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Running cmd (subprocess): nvme version {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:29:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] 'nvme version' failed. Not Retrying. {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:29:04 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.nvmeof [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] nvme not present on system {{(pid=74840) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 12:29:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:29:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:29:04 user nova-compute[74840]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 12:29:04 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4a7b98-bf0e-4c74-918d-1b39fb52f759]: (4, '') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:29:04 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74840) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 12:29:04 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 12:29:04 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] LIGHTOS: no hostnqn found. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 12:29:04 user nova-compute[74840]: DEBUG os_brick.utils [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c8228a11e03c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:29:04 user nova-compute[74840]: DEBUG nova.virt.block_device [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Updating existing volume attachment record: cd343afb-43fe-4e07-8518-9a5dc0299eff {{(pid=74840) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 12:29:04 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:29:04 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AXqwMDBP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 12:29:04 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:29:04 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '26639643364376637', 'path': '/dev/sdb'} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:29:04 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639643364376637', 'path': '/dev/sdb'} {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 12:29:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:29:04 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:28:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-648053841',display_name='tempest-TestVolumeBootPattern-server-648053841',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-648053841',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDnf/rgNeauxsdXCuQeVAa6oJl7IvXSpNN83Cdo1qtwT4P0g8IuWhFw/l+HOo44zetcJEHbPUEQ14N2qnoFV4I4QWYhF+y8Gsgf65CRdUjmUlU4hjQG+QvZzqapWj/SBg==',key_name='tempest-TestVolumeBootPattern-1773717711',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1250106b55ae44b0b303849df7781ffb',ramdisk_id='',reservation_id='r-pmsq5j8z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-77780905',owner_user_name='tempest-TestVolumeBootPattern-77780905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:28:21Z,user_data=None,user_id='794c0281e1bf48f79117efdc3907e661',uuid=aef3c8bf-d1a4-405b-a659-5bdee2415d6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1", "address": "fa:16:3e:84:5c:0f", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc009e4aa-0d", "ovs_interfaceid": "c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:29:04 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Converting VIF {"id": "c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1", "address": "fa:16:3e:84:5c:0f", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc009e4aa-0d", "ovs_interfaceid": "c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:29:04 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:5c:0f,bridge_name='br-int',has_traffic_filtering=True,id=c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1,network=Network(174da5e9-78cc-426f-87fb-1d3b23b8b459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc009e4aa-0d') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:29:04 user nova-compute[74840]: DEBUG nova.objects.instance [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lazy-loading 'pci_devices' on Instance uuid aef3c8bf-d1a4-405b-a659-5bdee2415d6f {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:29:04 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:29:04 user nova-compute[74840]:   <uuid>aef3c8bf-d1a4-405b-a659-5bdee2415d6f</uuid>
Nov 08 12:29:04 user nova-compute[74840]:   <name>instance-00000022</name>
Nov 08 12:29:04 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:29:04 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:29:04 user nova-compute[74840]:   <metadata>
Nov 08 12:29:04 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:29:04 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:29:04 user nova-compute[74840]:       <nova:name>tempest-TestVolumeBootPattern-server-648053841</nova:name>
Nov 08 12:29:04 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:29:03</nova:creationTime>
Nov 08 12:29:04 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:29:04 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:29:04 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:29:04 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:29:04 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:29:04 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:29:04 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:29:04 user nova-compute[74840]:       <nova:owner>
Nov 08 12:29:04 user nova-compute[74840]:         <nova:user uuid="794c0281e1bf48f79117efdc3907e661">tempest-TestVolumeBootPattern-77780905-project-member</nova:user>
Nov 08 12:29:04 user nova-compute[74840]:         <nova:project uuid="1250106b55ae44b0b303849df7781ffb">tempest-TestVolumeBootPattern-77780905</nova:project>
Nov 08 12:29:04 user nova-compute[74840]:       </nova:owner>
Nov 08 12:29:04 user nova-compute[74840]:       <nova:ports>
Nov 08 12:29:04 user nova-compute[74840]:         <nova:port uuid="c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1">
Nov 08 12:29:04 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 12:29:04 user nova-compute[74840]:         </nova:port>
Nov 08 12:29:04 user nova-compute[74840]:       </nova:ports>
Nov 08 12:29:04 user nova-compute[74840]:     </nova:instance>
Nov 08 12:29:04 user nova-compute[74840]:   </metadata>
Nov 08 12:29:04 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:29:04 user nova-compute[74840]:     <system>
Nov 08 12:29:04 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:29:04 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:29:04 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:29:04 user nova-compute[74840]:       <entry name="serial">aef3c8bf-d1a4-405b-a659-5bdee2415d6f</entry>
Nov 08 12:29:04 user nova-compute[74840]:       <entry name="uuid">aef3c8bf-d1a4-405b-a659-5bdee2415d6f</entry>
Nov 08 12:29:04 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:29:04 user nova-compute[74840]:     </system>
Nov 08 12:29:04 user nova-compute[74840]:   </sysinfo>
Nov 08 12:29:04 user nova-compute[74840]:   <os>
Nov 08 12:29:04 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:29:04 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:29:04 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:29:04 user nova-compute[74840]:   </os>
Nov 08 12:29:04 user nova-compute[74840]:   <features>
Nov 08 12:29:04 user nova-compute[74840]:     <acpi/>
Nov 08 12:29:04 user nova-compute[74840]:     <apic/>
Nov 08 12:29:04 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:29:04 user nova-compute[74840]:   </features>
Nov 08 12:29:04 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:29:04 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:29:04 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:29:04 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:29:04 user nova-compute[74840]:   </clock>
Nov 08 12:29:04 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:29:04 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:29:04 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:29:04 user nova-compute[74840]:   </cpu>
Nov 08 12:29:04 user nova-compute[74840]:   <devices>
Nov 08 12:29:04 user nova-compute[74840]:     <disk type="block" device="disk">
Nov 08 12:29:04 user nova-compute[74840]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:29:04 user nova-compute[74840]:       <source dev="/dev/sdb"/>
Nov 08 12:29:04 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:29:04 user nova-compute[74840]:       <serial>3633e924-8440-44ef-8902-fdceb5a4787b</serial>
Nov 08 12:29:04 user nova-compute[74840]:     </disk>
Nov 08 12:29:04 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:29:04 user nova-compute[74840]:       <mac address="fa:16:3e:84:5c:0f"/>
Nov 08 12:29:04 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:29:04 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:29:04 user nova-compute[74840]:       <target dev="tapc009e4aa-0d"/>
Nov 08 12:29:04 user nova-compute[74840]:     </interface>
Nov 08 12:29:04 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:29:04 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/aef3c8bf-d1a4-405b-a659-5bdee2415d6f/console.log" append="off"/>
Nov 08 12:29:04 user nova-compute[74840]:     </serial>
Nov 08 12:29:04 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:29:04 user nova-compute[74840]:     <video>
Nov 08 12:29:04 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:29:04 user nova-compute[74840]:     </video>
Nov 08 12:29:04 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:29:04 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:29:04 user nova-compute[74840]:     </rng>
Nov 08 12:29:04 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:29:04 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:29:04 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:29:04 user nova-compute[74840]:     </memballoon>
Nov 08 12:29:04 user nova-compute[74840]:   </devices>
Nov 08 12:29:04 user nova-compute[74840]: </domain>
Nov 08 12:29:04 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:29:04 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:28:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-648053841',display_name='tempest-TestVolumeBootPattern-server-648053841',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-648053841',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDnf/rgNeauxsdXCuQeVAa6oJl7IvXSpNN83Cdo1qtwT4P0g8IuWhFw/l+HOo44zetcJEHbPUEQ14N2qnoFV4I4QWYhF+y8Gsgf65CRdUjmUlU4hjQG+QvZzqapWj/SBg==',key_name='tempest-TestVolumeBootPattern-1773717711',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1250106b55ae44b0b303849df7781ffb',ramdisk_id='',reservation_id='r-pmsq5j8z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-77780905',owner_user_name='tempest-TestVolumeBootPattern-77780905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:28:21Z,user_data=None,user_id='794c0281e1bf48f79117efdc3907e661',uuid=aef3c8bf-d1a4-405b-a659-5bdee2415d6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1", "address": "fa:16:3e:84:5c:0f", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc009e4aa-0d", "ovs_interfaceid": "c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:29:04 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Converting VIF {"id": "c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1", "address": "fa:16:3e:84:5c:0f", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc009e4aa-0d", "ovs_interfaceid": "c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:29:04 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:5c:0f,bridge_name='br-int',has_traffic_filtering=True,id=c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1,network=Network(174da5e9-78cc-426f-87fb-1d3b23b8b459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc009e4aa-0d') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:29:04 user nova-compute[74840]: DEBUG os_vif [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:5c:0f,bridge_name='br-int',has_traffic_filtering=True,id=c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1,network=Network(174da5e9-78cc-426f-87fb-1d3b23b8b459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc009e4aa-0d') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:29:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:29:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:29:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:29:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:29:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '56141272-ad7d-5304-ab5a-fc9f25717ae0', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:29:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:29:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:29:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:29:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc009e4aa-0d, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:29:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc009e4aa-0d, col_values=(('qos', UUID('ebb49e3f-f7a6-43d7-acd8-21d75f8a3c13')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:29:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc009e4aa-0d, col_values=(('external_ids', {'iface-id': 'c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:5c:0f', 'vm-uuid': 'aef3c8bf-d1a4-405b-a659-5bdee2415d6f'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:29:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:29:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:29:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:29:05 user nova-compute[74840]: INFO os_vif [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:5c:0f,bridge_name='br-int',has_traffic_filtering=True,id=c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1,network=Network(174da5e9-78cc-426f-87fb-1d3b23b8b459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc009e4aa-0d')
Nov 08 12:29:05 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:29:05 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] No VIF found with MAC fa:16:3e:84:5c:0f, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:29:05 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:29:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:29:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:29:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:29:05 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:29:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:29:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:29:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:29:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:29:06 user nova-compute[74840]: DEBUG nova.compute.manager [req-dc9e565e-fba2-4304-9ae9-7e71215f2d9e req-06f1c66b-1280-4c89-a463-079bb2a5634d service nova] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Received event network-vif-plugged-c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:29:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-dc9e565e-fba2-4304-9ae9-7e71215f2d9e req-06f1c66b-1280-4c89-a463-079bb2a5634d service nova] Acquiring lock "aef3c8bf-d1a4-405b-a659-5bdee2415d6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:29:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-dc9e565e-fba2-4304-9ae9-7e71215f2d9e req-06f1c66b-1280-4c89-a463-079bb2a5634d service nova] Lock "aef3c8bf-d1a4-405b-a659-5bdee2415d6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:29:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-dc9e565e-fba2-4304-9ae9-7e71215f2d9e req-06f1c66b-1280-4c89-a463-079bb2a5634d service nova] Lock "aef3c8bf-d1a4-405b-a659-5bdee2415d6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:29:06 user nova-compute[74840]: DEBUG nova.compute.manager [req-dc9e565e-fba2-4304-9ae9-7e71215f2d9e req-06f1c66b-1280-4c89-a463-079bb2a5634d service nova] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] No waiting events found dispatching network-vif-plugged-c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:29:06 user nova-compute[74840]: WARNING nova.compute.manager [req-dc9e565e-fba2-4304-9ae9-7e71215f2d9e req-06f1c66b-1280-4c89-a463-079bb2a5634d service nova] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Received unexpected event network-vif-plugged-c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1 for instance with vm_state building and task_state spawning.
Nov 08 12:29:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:29:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:29:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:29:07 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:29:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:29:07 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:29:07 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:29:07 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:29:07 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:29:07 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:29:07 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:29:07 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:29:07 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:29:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:29:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:29:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:29:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:29:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:29:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:29:08 user nova-compute[74840]: DEBUG nova.compute.manager [req-2388f0f7-6715-48b3-a4a4-f6ee2c94edb2 req-5b2f4041-107e-47e2-aaff-039d8cd3a7d4 service nova] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Received event network-vif-plugged-c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:29:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2388f0f7-6715-48b3-a4a4-f6ee2c94edb2 req-5b2f4041-107e-47e2-aaff-039d8cd3a7d4 service nova] Acquiring lock "aef3c8bf-d1a4-405b-a659-5bdee2415d6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:29:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2388f0f7-6715-48b3-a4a4-f6ee2c94edb2 req-5b2f4041-107e-47e2-aaff-039d8cd3a7d4 service nova] Lock "aef3c8bf-d1a4-405b-a659-5bdee2415d6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:29:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2388f0f7-6715-48b3-a4a4-f6ee2c94edb2 req-5b2f4041-107e-47e2-aaff-039d8cd3a7d4 service nova] Lock "aef3c8bf-d1a4-405b-a659-5bdee2415d6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:29:08 user nova-compute[74840]: DEBUG nova.compute.manager [req-2388f0f7-6715-48b3-a4a4-f6ee2c94edb2 req-5b2f4041-107e-47e2-aaff-039d8cd3a7d4 service nova] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] No waiting events found dispatching network-vif-plugged-c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:29:08 user nova-compute[74840]: WARNING nova.compute.manager [req-2388f0f7-6715-48b3-a4a4-f6ee2c94edb2 req-5b2f4041-107e-47e2-aaff-039d8cd3a7d4 service nova] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Received unexpected event network-vif-plugged-c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1 for instance with vm_state building and task_state spawning.
Nov 08 12:29:08 user nova-compute[74840]: DEBUG nova.compute.manager [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:29:08 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:29:08 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Instance spawned successfully.
Nov 08 12:29:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:29:08 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:29:08 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:29:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3175752-45a5-43e3-a99a-9377440e7bea/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:29:08 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Found default for hw_cdrom_bus of ide {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:29:08 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Found default for hw_disk_bus of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:29:08 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:29:08 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:29:08 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Found default for hw_video_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:29:08 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Found default for hw_vif_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:29:08 user nova-compute[74840]: INFO nova.compute.manager [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Took 5.45 seconds to spawn the instance on the hypervisor.
Nov 08 12:29:08 user nova-compute[74840]: DEBUG nova.compute.manager [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:29:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3175752-45a5-43e3-a99a-9377440e7bea/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:29:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3175752-45a5-43e3-a99a-9377440e7bea/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:29:09 user nova-compute[74840]: INFO nova.compute.manager [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Took 48.63 seconds to build instance.
Nov 08 12:29:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-6fd9ff33-9650-40cb-953e-e5b5f7f47111 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "aef3c8bf-d1a4-405b-a659-5bdee2415d6f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 48.731s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:29:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3175752-45a5-43e3-a99a-9377440e7bea/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:29:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:29:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:29:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:29:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:29:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:29:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:29:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:29:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:29:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:29:10 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:29:10 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:29:10 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:29:10 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=8072MB free_disk=24.94173812866211GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:29:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:29:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:29:10 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance d3e8efc6-7146-46ef-8433-380d7e69120c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:29:10 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance ffe50042-29bf-4ef3-a148-8698bc75233b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:29:10 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 8b7c490e-4c78-4e07-bc8a-3be2328963d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:29:10 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 832a6445-84ee-43a8-a5bc-a07670602912 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:29:10 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 10c42516-62ba-4aa9-bc5a-d94499bd6b65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:29:10 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 9991e7b4-aaf8-4485-b658-e1af634925de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:29:10 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance aef3c8bf-d1a4-405b-a659-5bdee2415d6f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:29:10 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance e3175752-45a5-43e3-a99a-9377440e7bea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:29:10 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 4dcf7b89-a5ca-47ab-a4c9-878f53086de1 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 08 12:29:10 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:29:10 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:29:11 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:29:11 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:29:11 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:29:11 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.743s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:29:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:29:14 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:29:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Acquiring lock "a2c4fc63-0757-46da-ad00-7b6c6513deca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:29:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "a2c4fc63-0757-46da-ad00-7b6c6513deca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:29:15 user nova-compute[74840]: DEBUG nova.compute.manager [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Starting instance... {{(pid=74840) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 12:29:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:29:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:29:15 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:29:15 user nova-compute[74840]: INFO nova.compute.claims [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Claim successful on node user
Nov 08 12:29:15 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:29:15 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:29:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.505s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:29:15 user nova-compute[74840]: DEBUG nova.compute.manager [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Start building networks asynchronously for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 12:29:15 user nova-compute[74840]: DEBUG nova.compute.manager [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Allocating IP information in the background. {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 12:29:15 user nova-compute[74840]: DEBUG nova.network.neutron [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 12:29:15 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 12:29:15 user nova-compute[74840]: DEBUG nova.compute.manager [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Start building block device mappings for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 12:29:15 user nova-compute[74840]: DEBUG nova.policy [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6d4a3286c7d64d59b8ce2e4456db9cc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457d61e0588847528ef3dd42a6146599', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 12:29:15 user nova-compute[74840]: DEBUG nova.compute.manager [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Start spawning the instance on the hypervisor. {{(pid=74840) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 12:29:15 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:29:15 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Creating image(s)
Nov 08 12:29:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Acquiring lock "/opt/stack/data/nova/instances/a2c4fc63-0757-46da-ad00-7b6c6513deca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:29:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "/opt/stack/data/nova/instances/a2c4fc63-0757-46da-ad00-7b6c6513deca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:29:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "/opt/stack/data/nova/instances/a2c4fc63-0757-46da-ad00-7b6c6513deca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:29:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:29:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.229s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:29:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Acquiring lock "5d26578eba85497f494c575690c4248f381a0fe6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:29:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:29:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:29:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.185s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:29:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/a2c4fc63-0757-46da-ad00-7b6c6513deca/disk 1073741824 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:29:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/a2c4fc63-0757-46da-ad00-7b6c6513deca/disk 1073741824" returned: 0 in 0.056s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:29:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:29:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:29:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.229s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:29:16 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a2c4fc63-0757-46da-ad00-7b6c6513deca/disk. size=1073741824 {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 12:29:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c4fc63-0757-46da-ad00-7b6c6513deca/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:29:16 user nova-compute[74840]: DEBUG nova.network.neutron [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Successfully created port: 4d351123-6297-4be2-808d-50cdbe9e3aa6 {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:29:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c4fc63-0757-46da-ad00-7b6c6513deca/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:29:16 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Cannot resize image /opt/stack/data/nova/instances/a2c4fc63-0757-46da-ad00-7b6c6513deca/disk to a smaller size. {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 12:29:16 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Created local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 12:29:16 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Ensure instance console log exists: /opt/stack/data/nova/instances/a2c4fc63-0757-46da-ad00-7b6c6513deca/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:29:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:29:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:29:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:29:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG nova.network.neutron [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Successfully updated port: 4d351123-6297-4be2-808d-50cdbe9e3aa6 {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Acquiring lock "refresh_cache-a2c4fc63-0757-46da-ad00-7b6c6513deca" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Acquired lock "refresh_cache-a2c4fc63-0757-46da-ad00-7b6c6513deca" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG nova.network.neutron [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG nova.compute.manager [req-760f9484-948e-4138-82c2-f0f6fd7622a1 req-54bb6883-cf17-4029-b125-b7a8275afd01 service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Received event network-changed-4d351123-6297-4be2-808d-50cdbe9e3aa6 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG nova.compute.manager [req-760f9484-948e-4138-82c2-f0f6fd7622a1 req-54bb6883-cf17-4029-b125-b7a8275afd01 service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Refreshing instance network info cache due to event network-changed-4d351123-6297-4be2-808d-50cdbe9e3aa6. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-760f9484-948e-4138-82c2-f0f6fd7622a1 req-54bb6883-cf17-4029-b125-b7a8275afd01 service nova] Acquiring lock "refresh_cache-a2c4fc63-0757-46da-ad00-7b6c6513deca" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG nova.network.neutron [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG nova.network.neutron [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Updating instance_info_cache with network_info: [{"id": "4d351123-6297-4be2-808d-50cdbe9e3aa6", "address": "fa:16:3e:4e:0c:f0", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d351123-62", "ovs_interfaceid": "4d351123-6297-4be2-808d-50cdbe9e3aa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Releasing lock "refresh_cache-a2c4fc63-0757-46da-ad00-7b6c6513deca" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG nova.compute.manager [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Instance network_info: |[{"id": "4d351123-6297-4be2-808d-50cdbe9e3aa6", "address": "fa:16:3e:4e:0c:f0", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d351123-62", "ovs_interfaceid": "4d351123-6297-4be2-808d-50cdbe9e3aa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-760f9484-948e-4138-82c2-f0f6fd7622a1 req-54bb6883-cf17-4029-b125-b7a8275afd01 service nova] Acquired lock "refresh_cache-a2c4fc63-0757-46da-ad00-7b6c6513deca" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG nova.network.neutron [req-760f9484-948e-4138-82c2-f0f6fd7622a1 req-54bb6883-cf17-4029-b125-b7a8275afd01 service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Refreshing network info cache for port 4d351123-6297-4be2-808d-50cdbe9e3aa6 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Start _get_guest_xml network_info=[{"id": "4d351123-6297-4be2-808d-50cdbe9e3aa6", "address": "fa:16:3e:4e:0c:f0", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d351123-62", "ovs_interfaceid": "4d351123-6297-4be2-808d-50cdbe9e3aa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'image_id': '4fa17706-d304-4117-a420-dab994c703dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:29:18 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:29:18 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:29:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:29:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1244088697',display_name='tempest-ServerRescueNegativeTestJSON-server-1244088697',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1244088697',id=36,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvyvuealSmv8oj2TiSPbJYSMimajIZY4FNDaO08P7UQK09BPjIy4vh1eS/+h4sgiVjixuStEYbu1g4HgvRzMry2Yy5U2GAE5k/tYdAAzmPsftIe0+/T6DAUds34r9j79A==',key_name='tempest-keypair-625852250',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='457d61e0588847528ef3dd42a6146599',ramdisk_id='',reservation_id='r-4gm9nthr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1814868989',owner_user_name='tempest-ServerRescueNegativeTestJSON-1814868989-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:29:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d4a3286c7d64d59b8ce2e4456db9cc2',uuid=a2c4fc63-0757-46da-ad00-7b6c6513deca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d351123-6297-4be2-808d-50cdbe9e3aa6", "address": "fa:16:3e:4e:0c:f0", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d351123-62", "ovs_interfaceid": "4d351123-6297-4be2-808d-50cdbe9e3aa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Converting VIF {"id": "4d351123-6297-4be2-808d-50cdbe9e3aa6", "address": "fa:16:3e:4e:0c:f0", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d351123-62", "ovs_interfaceid": "4d351123-6297-4be2-808d-50cdbe9e3aa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:0c:f0,bridge_name='br-int',has_traffic_filtering=True,id=4d351123-6297-4be2-808d-50cdbe9e3aa6,network=Network(5ee2626f-3d55-44da-a731-761059adfa85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d351123-62') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG nova.objects.instance [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lazy-loading 'pci_devices' on Instance uuid a2c4fc63-0757-46da-ad00-7b6c6513deca {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:29:18 user nova-compute[74840]:   <uuid>a2c4fc63-0757-46da-ad00-7b6c6513deca</uuid>
Nov 08 12:29:18 user nova-compute[74840]:   <name>instance-00000024</name>
Nov 08 12:29:18 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:29:18 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:29:18 user nova-compute[74840]:   <metadata>
Nov 08 12:29:18 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:29:18 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:29:18 user nova-compute[74840]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1244088697</nova:name>
Nov 08 12:29:18 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:29:18</nova:creationTime>
Nov 08 12:29:18 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:29:18 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:29:18 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:29:18 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:29:18 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:29:18 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:29:18 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:29:18 user nova-compute[74840]:       <nova:owner>
Nov 08 12:29:18 user nova-compute[74840]:         <nova:user uuid="6d4a3286c7d64d59b8ce2e4456db9cc2">tempest-ServerRescueNegativeTestJSON-1814868989-project-member</nova:user>
Nov 08 12:29:18 user nova-compute[74840]:         <nova:project uuid="457d61e0588847528ef3dd42a6146599">tempest-ServerRescueNegativeTestJSON-1814868989</nova:project>
Nov 08 12:29:18 user nova-compute[74840]:       </nova:owner>
Nov 08 12:29:18 user nova-compute[74840]:       <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:29:18 user nova-compute[74840]:       <nova:ports>
Nov 08 12:29:18 user nova-compute[74840]:         <nova:port uuid="4d351123-6297-4be2-808d-50cdbe9e3aa6">
Nov 08 12:29:18 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 12:29:18 user nova-compute[74840]:         </nova:port>
Nov 08 12:29:18 user nova-compute[74840]:       </nova:ports>
Nov 08 12:29:18 user nova-compute[74840]:     </nova:instance>
Nov 08 12:29:18 user nova-compute[74840]:   </metadata>
Nov 08 12:29:18 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:29:18 user nova-compute[74840]:     <system>
Nov 08 12:29:18 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:29:18 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:29:18 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:29:18 user nova-compute[74840]:       <entry name="serial">a2c4fc63-0757-46da-ad00-7b6c6513deca</entry>
Nov 08 12:29:18 user nova-compute[74840]:       <entry name="uuid">a2c4fc63-0757-46da-ad00-7b6c6513deca</entry>
Nov 08 12:29:18 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:29:18 user nova-compute[74840]:     </system>
Nov 08 12:29:18 user nova-compute[74840]:   </sysinfo>
Nov 08 12:29:18 user nova-compute[74840]:   <os>
Nov 08 12:29:18 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:29:18 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:29:18 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:29:18 user nova-compute[74840]:   </os>
Nov 08 12:29:18 user nova-compute[74840]:   <features>
Nov 08 12:29:18 user nova-compute[74840]:     <acpi/>
Nov 08 12:29:18 user nova-compute[74840]:     <apic/>
Nov 08 12:29:18 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:29:18 user nova-compute[74840]:   </features>
Nov 08 12:29:18 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:29:18 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:29:18 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:29:18 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:29:18 user nova-compute[74840]:   </clock>
Nov 08 12:29:18 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:29:18 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:29:18 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:29:18 user nova-compute[74840]:   </cpu>
Nov 08 12:29:18 user nova-compute[74840]:   <devices>
Nov 08 12:29:18 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:29:18 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:29:18 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/a2c4fc63-0757-46da-ad00-7b6c6513deca/disk"/>
Nov 08 12:29:18 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:29:18 user nova-compute[74840]:     </disk>
Nov 08 12:29:18 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:29:18 user nova-compute[74840]:       <mac address="fa:16:3e:4e:0c:f0"/>
Nov 08 12:29:18 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:29:18 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:29:18 user nova-compute[74840]:       <target dev="tap4d351123-62"/>
Nov 08 12:29:18 user nova-compute[74840]:     </interface>
Nov 08 12:29:18 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:29:18 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/a2c4fc63-0757-46da-ad00-7b6c6513deca/console.log" append="off"/>
Nov 08 12:29:18 user nova-compute[74840]:     </serial>
Nov 08 12:29:18 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:29:18 user nova-compute[74840]:     <video>
Nov 08 12:29:18 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:29:18 user nova-compute[74840]:     </video>
Nov 08 12:29:18 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:29:18 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:29:18 user nova-compute[74840]:     </rng>
Nov 08 12:29:18 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:29:18 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:29:18 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:29:18 user nova-compute[74840]:     </memballoon>
Nov 08 12:29:18 user nova-compute[74840]:   </devices>
Nov 08 12:29:18 user nova-compute[74840]: </domain>
Nov 08 12:29:18 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:29:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1244088697',display_name='tempest-ServerRescueNegativeTestJSON-server-1244088697',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1244088697',id=36,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvyvuealSmv8oj2TiSPbJYSMimajIZY4FNDaO08P7UQK09BPjIy4vh1eS/+h4sgiVjixuStEYbu1g4HgvRzMry2Yy5U2GAE5k/tYdAAzmPsftIe0+/T6DAUds34r9j79A==',key_name='tempest-keypair-625852250',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='457d61e0588847528ef3dd42a6146599',ramdisk_id='',reservation_id='r-4gm9nthr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1814868989',owner_user_name='tempest-ServerRescueNegativeTestJSON-1814868989-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:29:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d4a3286c7d64d59b8ce2e4456db9cc2',uuid=a2c4fc63-0757-46da-ad00-7b6c6513deca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d351123-6297-4be2-808d-50cdbe9e3aa6", "address": "fa:16:3e:4e:0c:f0", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d351123-62", "ovs_interfaceid": "4d351123-6297-4be2-808d-50cdbe9e3aa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Converting VIF {"id": "4d351123-6297-4be2-808d-50cdbe9e3aa6", "address": "fa:16:3e:4e:0c:f0", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d351123-62", "ovs_interfaceid": "4d351123-6297-4be2-808d-50cdbe9e3aa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:0c:f0,bridge_name='br-int',has_traffic_filtering=True,id=4d351123-6297-4be2-808d-50cdbe9e3aa6,network=Network(5ee2626f-3d55-44da-a731-761059adfa85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d351123-62') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG os_vif [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:0c:f0,bridge_name='br-int',has_traffic_filtering=True,id=4d351123-6297-4be2-808d-50cdbe9e3aa6,network=Network(5ee2626f-3d55-44da-a731-761059adfa85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d351123-62') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4eab3131-ba70-5b7e-969f-8028bf146134', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d351123-62, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4d351123-62, col_values=(('qos', UUID('414646d1-7b89-45f9-b561-70c0ae3df655')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4d351123-62, col_values=(('external_ids', {'iface-id': '4d351123-6297-4be2-808d-50cdbe9e3aa6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:0c:f0', 'vm-uuid': 'a2c4fc63-0757-46da-ad00-7b6c6513deca'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:29:18 user nova-compute[74840]: INFO os_vif [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:0c:f0,bridge_name='br-int',has_traffic_filtering=True,id=4d351123-6297-4be2-808d-50cdbe9e3aa6,network=Network(5ee2626f-3d55-44da-a731-761059adfa85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d351123-62')
Nov 08 12:29:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:29:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] No VIF found with MAC fa:16:3e:4e:0c:f0, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:29:19 user nova-compute[74840]: DEBUG nova.network.neutron [req-760f9484-948e-4138-82c2-f0f6fd7622a1 req-54bb6883-cf17-4029-b125-b7a8275afd01 service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Updated VIF entry in instance network info cache for port 4d351123-6297-4be2-808d-50cdbe9e3aa6. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:29:19 user nova-compute[74840]: DEBUG nova.network.neutron [req-760f9484-948e-4138-82c2-f0f6fd7622a1 req-54bb6883-cf17-4029-b125-b7a8275afd01 service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Updating instance_info_cache with network_info: [{"id": "4d351123-6297-4be2-808d-50cdbe9e3aa6", "address": "fa:16:3e:4e:0c:f0", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d351123-62", "ovs_interfaceid": "4d351123-6297-4be2-808d-50cdbe9e3aa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:29:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-760f9484-948e-4138-82c2-f0f6fd7622a1 req-54bb6883-cf17-4029-b125-b7a8275afd01 service nova] Releasing lock "refresh_cache-a2c4fc63-0757-46da-ad00-7b6c6513deca" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:29:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:29:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:29:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:29:20 user nova-compute[74840]: DEBUG nova.compute.manager [req-e19ce089-bbe7-44a8-b3c8-81a6e2c202a6 req-e7909fbb-f81c-4044-b832-8160f6e90646 service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Received event network-vif-plugged-4d351123-6297-4be2-808d-50cdbe9e3aa6 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:29:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e19ce089-bbe7-44a8-b3c8-81a6e2c202a6 req-e7909fbb-f81c-4044-b832-8160f6e90646 service nova] Acquiring lock "a2c4fc63-0757-46da-ad00-7b6c6513deca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:29:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e19ce089-bbe7-44a8-b3c8-81a6e2c202a6 req-e7909fbb-f81c-4044-b832-8160f6e90646 service nova] Lock "a2c4fc63-0757-46da-ad00-7b6c6513deca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:29:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e19ce089-bbe7-44a8-b3c8-81a6e2c202a6 req-e7909fbb-f81c-4044-b832-8160f6e90646 service nova] Lock "a2c4fc63-0757-46da-ad00-7b6c6513deca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:29:20 user nova-compute[74840]: DEBUG nova.compute.manager [req-e19ce089-bbe7-44a8-b3c8-81a6e2c202a6 req-e7909fbb-f81c-4044-b832-8160f6e90646 service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] No waiting events found dispatching network-vif-plugged-4d351123-6297-4be2-808d-50cdbe9e3aa6 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:29:20 user nova-compute[74840]: WARNING nova.compute.manager [req-e19ce089-bbe7-44a8-b3c8-81a6e2c202a6 req-e7909fbb-f81c-4044-b832-8160f6e90646 service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Received unexpected event network-vif-plugged-4d351123-6297-4be2-808d-50cdbe9e3aa6 for instance with vm_state building and task_state spawning.
Nov 08 12:29:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:29:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:29:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:29:22 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:29:22 user nova-compute[74840]: DEBUG nova.compute.manager [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:29:22 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:29:22 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Instance spawned successfully.
Nov 08 12:29:22 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:29:22 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Found default for hw_cdrom_bus of ide {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:29:22 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Found default for hw_disk_bus of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:29:22 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:29:22 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:29:22 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Found default for hw_video_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:29:22 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Found default for hw_vif_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:29:22 user nova-compute[74840]: DEBUG nova.compute.manager [req-7e2720f8-2ae0-4a61-ad67-274d145f248c req-be2ab9cc-5d6f-43a1-8893-221d8b009bf9 service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Received event network-vif-plugged-4d351123-6297-4be2-808d-50cdbe9e3aa6 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:29:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-7e2720f8-2ae0-4a61-ad67-274d145f248c req-be2ab9cc-5d6f-43a1-8893-221d8b009bf9 service nova] Acquiring lock "a2c4fc63-0757-46da-ad00-7b6c6513deca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:29:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-7e2720f8-2ae0-4a61-ad67-274d145f248c req-be2ab9cc-5d6f-43a1-8893-221d8b009bf9 service nova] Lock "a2c4fc63-0757-46da-ad00-7b6c6513deca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:29:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-7e2720f8-2ae0-4a61-ad67-274d145f248c req-be2ab9cc-5d6f-43a1-8893-221d8b009bf9 service nova] Lock "a2c4fc63-0757-46da-ad00-7b6c6513deca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:29:22 user nova-compute[74840]: DEBUG nova.compute.manager [req-7e2720f8-2ae0-4a61-ad67-274d145f248c req-be2ab9cc-5d6f-43a1-8893-221d8b009bf9 service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] No waiting events found dispatching network-vif-plugged-4d351123-6297-4be2-808d-50cdbe9e3aa6 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:29:22 user nova-compute[74840]: WARNING nova.compute.manager [req-7e2720f8-2ae0-4a61-ad67-274d145f248c req-be2ab9cc-5d6f-43a1-8893-221d8b009bf9 service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Received unexpected event network-vif-plugged-4d351123-6297-4be2-808d-50cdbe9e3aa6 for instance with vm_state building and task_state spawning.
Nov 08 12:29:22 user nova-compute[74840]: INFO nova.compute.manager [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Took 6.73 seconds to spawn the instance on the hypervisor.
Nov 08 12:29:22 user nova-compute[74840]: DEBUG nova.compute.manager [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:29:22 user nova-compute[74840]: INFO nova.compute.manager [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Took 7.60 seconds to build instance.
Nov 08 12:29:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f90722ec-2e37-4fca-8665-d0a288fb7de3 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "a2c4fc63-0757-46da-ad00-7b6c6513deca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.713s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:29:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:29:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:29:28 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:29:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:29:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:29:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:29:38 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:29:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:29:43 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:29:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:29:48 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:29:51 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:29:53 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquiring lock "b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:29:53 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:29:53 user nova-compute[74840]: DEBUG nova.compute.manager [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Starting instance... {{(pid=74840) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 12:29:53 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:29:53 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:29:53 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:29:53 user nova-compute[74840]: INFO nova.compute.claims [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Claim successful on node user
Nov 08 12:29:53 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:29:53 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:29:53 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:29:53 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.553s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:29:53 user nova-compute[74840]: DEBUG nova.compute.manager [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Start building networks asynchronously for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 12:29:54 user nova-compute[74840]: DEBUG nova.compute.manager [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Allocating IP information in the background. {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 12:29:54 user nova-compute[74840]: DEBUG nova.network.neutron [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 12:29:54 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 12:29:54 user nova-compute[74840]: DEBUG nova.compute.manager [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Start building block device mappings for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 12:29:54 user nova-compute[74840]: DEBUG nova.policy [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '275e3d340c9d4d9e90b579e4bc0bfe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c97c47ab144ef3a8d5e9ee1ecc059e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 12:29:54 user nova-compute[74840]: INFO nova.virt.block_device [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Booting with volume-backed-image 4fa17706-d304-4117-a420-dab994c703dc at /dev/vda
Nov 08 12:29:54 user nova-compute[74840]: DEBUG nova.network.neutron [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Successfully created port: 8fd26752-a3a0-4b97-a43f-73454925abea {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:29:55 user nova-compute[74840]: DEBUG nova.network.neutron [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Successfully updated port: 8fd26752-a3a0-4b97-a43f-73454925abea {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:29:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquiring lock "refresh_cache-b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:29:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquired lock "refresh_cache-b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:29:55 user nova-compute[74840]: DEBUG nova.network.neutron [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:29:55 user nova-compute[74840]: DEBUG nova.compute.manager [req-b49975c4-5f08-4828-9645-af01f03111bf req-406f9361-2f92-4526-a88f-63e12f572ceb service nova] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Received event network-changed-8fd26752-a3a0-4b97-a43f-73454925abea {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:29:55 user nova-compute[74840]: DEBUG nova.compute.manager [req-b49975c4-5f08-4828-9645-af01f03111bf req-406f9361-2f92-4526-a88f-63e12f572ceb service nova] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Refreshing instance network info cache due to event network-changed-8fd26752-a3a0-4b97-a43f-73454925abea. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:29:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-b49975c4-5f08-4828-9645-af01f03111bf req-406f9361-2f92-4526-a88f-63e12f572ceb service nova] Acquiring lock "refresh_cache-b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:29:55 user nova-compute[74840]: DEBUG nova.network.neutron [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:29:56 user nova-compute[74840]: DEBUG nova.network.neutron [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Updating instance_info_cache with network_info: [{"id": "8fd26752-a3a0-4b97-a43f-73454925abea", "address": "fa:16:3e:2a:e1:f9", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd26752-a3", "ovs_interfaceid": "8fd26752-a3a0-4b97-a43f-73454925abea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:29:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Releasing lock "refresh_cache-b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:29:56 user nova-compute[74840]: DEBUG nova.compute.manager [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Instance network_info: |[{"id": "8fd26752-a3a0-4b97-a43f-73454925abea", "address": "fa:16:3e:2a:e1:f9", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd26752-a3", "ovs_interfaceid": "8fd26752-a3a0-4b97-a43f-73454925abea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 12:29:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-b49975c4-5f08-4828-9645-af01f03111bf req-406f9361-2f92-4526-a88f-63e12f572ceb service nova] Acquired lock "refresh_cache-b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:29:56 user nova-compute[74840]: DEBUG nova.network.neutron [req-b49975c4-5f08-4828-9645-af01f03111bf req-406f9361-2f92-4526-a88f-63e12f572ceb service nova] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Refreshing network info cache for port 8fd26752-a3a0-4b97-a43f-73454925abea {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:29:56 user nova-compute[74840]: DEBUG nova.network.neutron [req-b49975c4-5f08-4828-9645-af01f03111bf req-406f9361-2f92-4526-a88f-63e12f572ceb service nova] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Updated VIF entry in instance network info cache for port 8fd26752-a3a0-4b97-a43f-73454925abea. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:29:56 user nova-compute[74840]: DEBUG nova.network.neutron [req-b49975c4-5f08-4828-9645-af01f03111bf req-406f9361-2f92-4526-a88f-63e12f572ceb service nova] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Updating instance_info_cache with network_info: [{"id": "8fd26752-a3a0-4b97-a43f-73454925abea", "address": "fa:16:3e:2a:e1:f9", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd26752-a3", "ovs_interfaceid": "8fd26752-a3a0-4b97-a43f-73454925abea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:29:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-b49975c4-5f08-4828-9645-af01f03111bf req-406f9361-2f92-4526-a88f-63e12f572ceb service nova] Releasing lock "refresh_cache-b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:29:57 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:29:57 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:29:58 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:29:58 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:29:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:29:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:29:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 12:29:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:29:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:29:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:29:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "refresh_cache-8b7c490e-4c78-4e07-bc8a-3be2328963d7" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:29:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquired lock "refresh_cache-8b7c490e-4c78-4e07-bc8a-3be2328963d7" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:29:58 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Forcefully refreshing network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 12:29:59 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Updating instance_info_cache with network_info: [{"id": "d9df071e-c4f0-4c80-9d63-3a41c849dca5", "address": "fa:16:3e:32:c4:9b", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9df071e-c4", "ovs_interfaceid": "d9df071e-c4f0-4c80-9d63-3a41c849dca5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:29:59 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Releasing lock "refresh_cache-8b7c490e-4c78-4e07-bc8a-3be2328963d7" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:29:59 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Updated the network info_cache for instance {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 12:29:59 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:29:59 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:30:00 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:30:00 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:30:01 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:30:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:30:04 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:30:07 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:30:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:30:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:30:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:30:07 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:30:07 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c4fc63-0757-46da-ad00-7b6c6513deca/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c4fc63-0757-46da-ad00-7b6c6513deca/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c4fc63-0757-46da-ad00-7b6c6513deca/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c4fc63-0757-46da-ad00-7b6c6513deca/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:30:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:09 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:30:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3175752-45a5-43e3-a99a-9377440e7bea/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3175752-45a5-43e3-a99a-9377440e7bea/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3175752-45a5-43e3-a99a-9377440e7bea/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3175752-45a5-43e3-a99a-9377440e7bea/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:11 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:30:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:30:11 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:30:11 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:30:11 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=7853MB free_disk=24.907913208007812GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:30:11 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:30:11 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:30:11 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance d3e8efc6-7146-46ef-8433-380d7e69120c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:30:11 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance ffe50042-29bf-4ef3-a148-8698bc75233b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:30:11 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 8b7c490e-4c78-4e07-bc8a-3be2328963d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:30:11 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 832a6445-84ee-43a8-a5bc-a07670602912 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:30:11 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 10c42516-62ba-4aa9-bc5a-d94499bd6b65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:30:11 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 9991e7b4-aaf8-4485-b658-e1af634925de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:30:11 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance aef3c8bf-d1a4-405b-a659-5bdee2415d6f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:30:11 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance e3175752-45a5-43e3-a99a-9377440e7bea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:30:11 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 4dcf7b89-a5ca-47ab-a4c9-878f53086de1 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 08 12:30:11 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance a2c4fc63-0757-46da-ad00-7b6c6513deca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:30:11 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:30:11 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:30:11 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:30:12 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:30:12 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:30:12 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:30:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.523s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:30:12 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:30:12 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74840) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 12:30:12 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:30:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:30:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:30:12 user nova-compute[74840]: DEBUG nova.objects.instance [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lazy-loading 'pci_requests' on Instance uuid 4dcf7b89-a5ca-47ab-a4c9-878f53086de1 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:30:12 user nova-compute[74840]: DEBUG nova.objects.instance [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lazy-loading 'numa_topology' on Instance uuid 4dcf7b89-a5ca-47ab-a4c9-878f53086de1 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:30:12 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:30:12 user nova-compute[74840]: INFO nova.compute.claims [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Claim successful on node user
Nov 08 12:30:12 user nova-compute[74840]: DEBUG nova.compute.manager [req-cf74fbf1-318c-4524-b0d3-97d396fcd830 req-7a0a210d-51d0-4c80-9a6b-a5d3bffa85e0 service nova] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Received event network-changed-c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:30:12 user nova-compute[74840]: DEBUG nova.compute.manager [req-cf74fbf1-318c-4524-b0d3-97d396fcd830 req-7a0a210d-51d0-4c80-9a6b-a5d3bffa85e0 service nova] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Refreshing instance network info cache due to event network-changed-c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:30:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-cf74fbf1-318c-4524-b0d3-97d396fcd830 req-7a0a210d-51d0-4c80-9a6b-a5d3bffa85e0 service nova] Acquiring lock "refresh_cache-aef3c8bf-d1a4-405b-a659-5bdee2415d6f" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:30:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-cf74fbf1-318c-4524-b0d3-97d396fcd830 req-7a0a210d-51d0-4c80-9a6b-a5d3bffa85e0 service nova] Acquired lock "refresh_cache-aef3c8bf-d1a4-405b-a659-5bdee2415d6f" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:30:12 user nova-compute[74840]: DEBUG nova.network.neutron [req-cf74fbf1-318c-4524-b0d3-97d396fcd830 req-7a0a210d-51d0-4c80-9a6b-a5d3bffa85e0 service nova] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Refreshing network info cache for port c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:30:12 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:30:12 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:30:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.523s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:30:12 user nova-compute[74840]: DEBUG nova.network.neutron [req-cf74fbf1-318c-4524-b0d3-97d396fcd830 req-7a0a210d-51d0-4c80-9a6b-a5d3bffa85e0 service nova] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Updated VIF entry in instance network info cache for port c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:30:12 user nova-compute[74840]: DEBUG nova.network.neutron [req-cf74fbf1-318c-4524-b0d3-97d396fcd830 req-7a0a210d-51d0-4c80-9a6b-a5d3bffa85e0 service nova] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Updating instance_info_cache with network_info: [{"id": "c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1", "address": "fa:16:3e:84:5c:0f", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc009e4aa-0d", "ovs_interfaceid": "c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:30:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-64d0a026-39b6-4392-b34b-67e38a9eea5c tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "aef3c8bf-d1a4-405b-a659-5bdee2415d6f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:30:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-64d0a026-39b6-4392-b34b-67e38a9eea5c tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "aef3c8bf-d1a4-405b-a659-5bdee2415d6f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:30:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-64d0a026-39b6-4392-b34b-67e38a9eea5c tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "aef3c8bf-d1a4-405b-a659-5bdee2415d6f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:30:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-64d0a026-39b6-4392-b34b-67e38a9eea5c tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "aef3c8bf-d1a4-405b-a659-5bdee2415d6f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:30:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-64d0a026-39b6-4392-b34b-67e38a9eea5c tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "aef3c8bf-d1a4-405b-a659-5bdee2415d6f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:30:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-cf74fbf1-318c-4524-b0d3-97d396fcd830 req-7a0a210d-51d0-4c80-9a6b-a5d3bffa85e0 service nova] Releasing lock "refresh_cache-aef3c8bf-d1a4-405b-a659-5bdee2415d6f" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:30:12 user nova-compute[74840]: INFO nova.compute.manager [None req-64d0a026-39b6-4392-b34b-67e38a9eea5c tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Terminating instance
Nov 08 12:30:12 user nova-compute[74840]: DEBUG nova.compute.manager [None req-64d0a026-39b6-4392-b34b-67e38a9eea5c tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Start destroying the instance on the hypervisor. {{(pid=74840) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 12:30:12 user nova-compute[74840]: INFO nova.network.neutron [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Updating port f0b1fa9b-7ace-4c3b-af97-f62a085e0076 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 08 12:30:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:30:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:30:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Acquiring lock "refresh_cache-4dcf7b89-a5ca-47ab-a4c9-878f53086de1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Acquired lock "refresh_cache-4dcf7b89-a5ca-47ab-a4c9-878f53086de1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG nova.network.neutron [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:30:13 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Instance destroyed successfully.
Nov 08 12:30:13 user nova-compute[74840]: DEBUG nova.objects.instance [None req-64d0a026-39b6-4392-b34b-67e38a9eea5c tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lazy-loading 'resources' on Instance uuid aef3c8bf-d1a4-405b-a659-5bdee2415d6f {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG nova.compute.manager [req-78edb3a8-f923-4878-8599-b6285db5f6af req-24439cad-ef99-4513-988e-5b2146e61925 service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Received event network-changed-f0b1fa9b-7ace-4c3b-af97-f62a085e0076 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG nova.compute.manager [req-78edb3a8-f923-4878-8599-b6285db5f6af req-24439cad-ef99-4513-988e-5b2146e61925 service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Refreshing instance network info cache due to event network-changed-f0b1fa9b-7ace-4c3b-af97-f62a085e0076. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-78edb3a8-f923-4878-8599-b6285db5f6af req-24439cad-ef99-4513-988e-5b2146e61925 service nova] Acquiring lock "refresh_cache-4dcf7b89-a5ca-47ab-a4c9-878f53086de1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-64d0a026-39b6-4392-b34b-67e38a9eea5c tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:28:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-648053841',display_name='tempest-TestVolumeBootPattern-server-648053841',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-648053841',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDnf/rgNeauxsdXCuQeVAa6oJl7IvXSpNN83Cdo1qtwT4P0g8IuWhFw/l+HOo44zetcJEHbPUEQ14N2qnoFV4I4QWYhF+y8Gsgf65CRdUjmUlU4hjQG+QvZzqapWj/SBg==',key_name='tempest-TestVolumeBootPattern-1773717711',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:29:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1250106b55ae44b0b303849df7781ffb',ramdisk_id='',reservation_id='r-pmsq5j8z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-77780905',owner_user_name='tempest-TestVolumeBootPattern-77780905-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:29:09Z,user_data=None,user_id='794c0281e1bf48f79117efdc3907e661',uuid=aef3c8bf-d1a4-405b-a659-5bdee2415d6f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1", "address": "fa:16:3e:84:5c:0f", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc009e4aa-0d", "ovs_interfaceid": "c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-64d0a026-39b6-4392-b34b-67e38a9eea5c tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Converting VIF {"id": "c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1", "address": "fa:16:3e:84:5c:0f", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc009e4aa-0d", "ovs_interfaceid": "c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-64d0a026-39b6-4392-b34b-67e38a9eea5c tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:5c:0f,bridge_name='br-int',has_traffic_filtering=True,id=c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1,network=Network(174da5e9-78cc-426f-87fb-1d3b23b8b459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc009e4aa-0d') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG os_vif [None req-64d0a026-39b6-4392-b34b-67e38a9eea5c tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:5c:0f,bridge_name='br-int',has_traffic_filtering=True,id=c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1,network=Network(174da5e9-78cc-426f-87fb-1d3b23b8b459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc009e4aa-0d') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc009e4aa-0d, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ebb49e3f-f7a6-43d7-acd8-21d75f8a3c13) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:30:13 user nova-compute[74840]: INFO os_vif [None req-64d0a026-39b6-4392-b34b-67e38a9eea5c tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:5c:0f,bridge_name='br-int',has_traffic_filtering=True,id=c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1,network=Network(174da5e9-78cc-426f-87fb-1d3b23b8b459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc009e4aa-0d')
Nov 08 12:30:13 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64d0a026-39b6-4392-b34b-67e38a9eea5c tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d0a026-39b6-4392-b34b-67e38a9eea5c tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AXqwMDBP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:30:13 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-64d0a026-39b6-4392-b34b-67e38a9eea5c tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:30:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-64d0a026-39b6-4392-b34b-67e38a9eea5c tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-64d0a026-39b6-4392-b34b-67e38a9eea5c tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b20cce2-eb7d-4c71-9999-f103095a4ef2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d0a026-39b6-4392-b34b-67e38a9eea5c tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 12:30:13 user nova-compute[74840]: No targets found.
Nov 08 12:30:13 user nova-compute[74840]: iSNS:
Nov 08 12:30:13 user nova-compute[74840]: No targets found.
Nov 08 12:30:13 user nova-compute[74840]: STATIC:
Nov 08 12:30:13 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4
Nov 08 12:30:13 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:30:13 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:30:13 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b
Nov 08 12:30:13 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:30:13 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:30:13 user nova-compute[74840]: FIRMWARE:
Nov 08 12:30:13 user nova-compute[74840]: No targets found.
Nov 08 12:30:13 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d0a026-39b6-4392-b34b-67e38a9eea5c tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 12:30:13 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 12:30:13 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d0a026-39b6-4392-b34b-67e38a9eea5c tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eee5243-8d87-4fe1-a4dc-43ff21bd9375]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[485df60d-0b87-43e9-a355-a079423c9500]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d0a026-39b6-4392-b34b-67e38a9eea5c tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:30:13 user nova-compute[74840]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)
Nov 08 12:30:13 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d0a026-39b6-4392-b34b-67e38a9eea5c tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:30:13 user nova-compute[74840]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)
Nov 08 12:30:13 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d0a026-39b6-4392-b34b-67e38a9eea5c tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7ec343f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b'): ({'sdb'}, set())}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-64d0a026-39b6-4392-b34b-67e38a9eea5c tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Removing single pathed devices sdb {{(pid=74840) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[0746c0fd-b1f1-4733-8798-6b254d6badd5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5c0fa3-69d4-4380-a915-047d798a73ba]: (4, ('ok\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-64d0a026-39b6-4392-b34b-67e38a9eea5c tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Flushing IO for device /dev/sdb {{(pid=74840) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b33106-3eeb-4ca9-88bc-20c684fdeeda]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-64d0a026-39b6-4392-b34b-67e38a9eea5c tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74840) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb1c6e9-7850-4ff0-b806-12cc3cee97e8]: (4, ('1', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-64d0a026-39b6-4392-b34b-67e38a9eea5c tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-64d0a026-39b6-4392-b34b-67e38a9eea5c tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] SCSI volumes sdb have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d0a026-39b6-4392-b34b-67e38a9eea5c tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b')] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 12:30:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:14 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:14 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[19079da4-0d53-4e8d-b5d6-919a93483bff]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:14 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d0a026-39b6-4392-b34b-67e38a9eea5c tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:30:14 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b -p 172.16.0.220:3260 --logout {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:14 user nova-compute[74840]: DEBUG nova.network.neutron [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Updating instance_info_cache with network_info: [{"id": "f0b1fa9b-7ace-4c3b-af97-f62a085e0076", "address": "fa:16:3e:56:2a:9f", "network": {"id": "918d8aed-1f09-4cfb-9c7f-48f002ad6ba3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-927886396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a05cda834445fb94e71f6cac02f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b1fa9b-7a", "ovs_interfaceid": "f0b1fa9b-7ace-4c3b-af97-f62a085e0076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:30:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Releasing lock "refresh_cache-4dcf7b89-a5ca-47ab-a4c9-878f53086de1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:30:14 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:30:14 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Creating image(s)
Nov 08 12:30:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Acquiring lock "/opt/stack/data/nova/instances/4dcf7b89-a5ca-47ab-a4c9-878f53086de1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:30:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "/opt/stack/data/nova/instances/4dcf7b89-a5ca-47ab-a4c9-878f53086de1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:30:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "/opt/stack/data/nova/instances/4dcf7b89-a5ca-47ab-a4c9-878f53086de1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:30:14 user nova-compute[74840]: DEBUG nova.objects.instance [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4dcf7b89-a5ca-47ab-a4c9-878f53086de1 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:30:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-78edb3a8-f923-4878-8599-b6285db5f6af req-24439cad-ef99-4513-988e-5b2146e61925 service nova] Acquired lock "refresh_cache-4dcf7b89-a5ca-47ab-a4c9-878f53086de1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:30:14 user nova-compute[74840]: DEBUG nova.network.neutron [req-78edb3a8-f923-4878-8599-b6285db5f6af req-24439cad-ef99-4513-988e-5b2146e61925 service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Refreshing network info cache for port f0b1fa9b-7ace-4c3b-af97-f62a085e0076 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:30:14 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:14 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[635607ae-72fc-49f2-a19d-a6306b404117]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:14 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d0a026-39b6-4392-b34b-67e38a9eea5c tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b, portal: 172.16.0.220,3260]
Nov 08 12:30:14 user nova-compute[74840]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b, portal: 172.16.0.220,3260] successful.
Nov 08 12:30:14 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:30:14 user nova-compute[74840]: DEBUG nova.objects.base [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Object Instance<4dcf7b89-a5ca-47ab-a4c9-878f53086de1> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:30:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Acquiring lock "5b6470ee09f569b53ed589342eb14f3238f1b92b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:30:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "5b6470ee09f569b53ed589342eb14f3238f1b92b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:30:14 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b -p 172.16.0.220:3260 --op delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:14 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:14 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6a70d6-e318-4fd4-b2e6-3f8bb0142ad8]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:14 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d0a026-39b6-4392-b34b-67e38a9eea5c tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:30:14 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-64d0a026-39b6-4392-b34b-67e38a9eea5c tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:30:14 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d0a026-39b6-4392-b34b-67e38a9eea5c tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] <== disconnect_volume: return (361ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:30:14 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64d0a026-39b6-4392-b34b-67e38a9eea5c tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 12:30:14 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-64d0a026-39b6-4392-b34b-67e38a9eea5c tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Deleting instance files /opt/stack/data/nova/instances/aef3c8bf-d1a4-405b-a659-5bdee2415d6f_del
Nov 08 12:30:14 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-64d0a026-39b6-4392-b34b-67e38a9eea5c tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Deletion of /opt/stack/data/nova/instances/aef3c8bf-d1a4-405b-a659-5bdee2415d6f_del complete
Nov 08 12:30:14 user nova-compute[74840]: INFO nova.compute.manager [None req-64d0a026-39b6-4392-b34b-67e38a9eea5c tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Took 1.31 seconds to destroy the instance on the hypervisor.
Nov 08 12:30:14 user nova-compute[74840]: DEBUG oslo.service.loopingcall [None req-64d0a026-39b6-4392-b34b-67e38a9eea5c tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74840) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 12:30:14 user nova-compute[74840]: DEBUG nova.compute.manager [-] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Deallocating network for instance {{(pid=74840) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 12:30:14 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] deallocate_for_instance() {{(pid=74840) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 12:30:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b6470ee09f569b53ed589342eb14f3238f1b92b.part --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:15 user nova-compute[74840]: DEBUG nova.compute.manager [req-a56cba1d-d4bc-4caf-ac5d-448f9c25d886 req-6c6069a8-eff1-4a25-a22b-87ead5d9ab77 service nova] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Received event network-vif-unplugged-c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:30:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a56cba1d-d4bc-4caf-ac5d-448f9c25d886 req-6c6069a8-eff1-4a25-a22b-87ead5d9ab77 service nova] Acquiring lock "aef3c8bf-d1a4-405b-a659-5bdee2415d6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:30:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a56cba1d-d4bc-4caf-ac5d-448f9c25d886 req-6c6069a8-eff1-4a25-a22b-87ead5d9ab77 service nova] Lock "aef3c8bf-d1a4-405b-a659-5bdee2415d6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:30:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a56cba1d-d4bc-4caf-ac5d-448f9c25d886 req-6c6069a8-eff1-4a25-a22b-87ead5d9ab77 service nova] Lock "aef3c8bf-d1a4-405b-a659-5bdee2415d6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:30:15 user nova-compute[74840]: DEBUG nova.compute.manager [req-a56cba1d-d4bc-4caf-ac5d-448f9c25d886 req-6c6069a8-eff1-4a25-a22b-87ead5d9ab77 service nova] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] No waiting events found dispatching network-vif-unplugged-c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:30:15 user nova-compute[74840]: DEBUG nova.compute.manager [req-a56cba1d-d4bc-4caf-ac5d-448f9c25d886 req-6c6069a8-eff1-4a25-a22b-87ead5d9ab77 service nova] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Received event network-vif-unplugged-c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1 for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:30:15 user nova-compute[74840]: DEBUG nova.compute.manager [req-a56cba1d-d4bc-4caf-ac5d-448f9c25d886 req-6c6069a8-eff1-4a25-a22b-87ead5d9ab77 service nova] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Received event network-vif-plugged-c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:30:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a56cba1d-d4bc-4caf-ac5d-448f9c25d886 req-6c6069a8-eff1-4a25-a22b-87ead5d9ab77 service nova] Acquiring lock "aef3c8bf-d1a4-405b-a659-5bdee2415d6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:30:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a56cba1d-d4bc-4caf-ac5d-448f9c25d886 req-6c6069a8-eff1-4a25-a22b-87ead5d9ab77 service nova] Lock "aef3c8bf-d1a4-405b-a659-5bdee2415d6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:30:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a56cba1d-d4bc-4caf-ac5d-448f9c25d886 req-6c6069a8-eff1-4a25-a22b-87ead5d9ab77 service nova] Lock "aef3c8bf-d1a4-405b-a659-5bdee2415d6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:30:15 user nova-compute[74840]: DEBUG nova.compute.manager [req-a56cba1d-d4bc-4caf-ac5d-448f9c25d886 req-6c6069a8-eff1-4a25-a22b-87ead5d9ab77 service nova] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] No waiting events found dispatching network-vif-plugged-c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:30:15 user nova-compute[74840]: WARNING nova.compute.manager [req-a56cba1d-d4bc-4caf-ac5d-448f9c25d886 req-6c6069a8-eff1-4a25-a22b-87ead5d9ab77 service nova] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Received unexpected event network-vif-plugged-c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1 for instance with vm_state active and task_state deleting.
Nov 08 12:30:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b6470ee09f569b53ed589342eb14f3238f1b92b.part --force-share --output=json" returned: 0 in 0.187s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:15 user nova-compute[74840]: DEBUG nova.virt.images [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] e98e81ae-8be8-4f44-b63c-d875a709e229 was qcow2, converting to raw {{(pid=74840) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 12:30:15 user nova-compute[74840]: DEBUG nova.privsep.utils [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74840) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 12:30:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5b6470ee09f569b53ed589342eb14f3238f1b92b.part /opt/stack/data/nova/instances/_base/5b6470ee09f569b53ed589342eb14f3238f1b92b.converted {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:15 user nova-compute[74840]: DEBUG os_brick.utils [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:30:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:15 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a465b45b-e22b-49b7-b819-4befb43fb9b1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c8228a11e03c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:15 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b252415b-6e85-4208-9083-ad02716ef1eb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:15 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9db1ca6-3c65-4b7c-841f-ca947e566e6f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:15 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[755bc9bf-8f67-453e-b913-0dba34c50eed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Running cmd (subprocess): nvme version {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] 'nvme version' failed. Not Retrying. {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:30:15 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.nvmeof [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] nvme not present on system {{(pid=74840) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 12:30:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:30:15 user nova-compute[74840]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 12:30:15 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[2272851c-f75c-46a4-84f5-2df66b9daac0]: (4, '') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:15 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74840) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 12:30:15 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 12:30:15 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] LIGHTOS: no hostnqn found. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 12:30:15 user nova-compute[74840]: DEBUG os_brick.utils [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c8228a11e03c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:30:15 user nova-compute[74840]: DEBUG nova.virt.block_device [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Updating existing volume attachment record: 659d54ea-7eaa-42f5-a51d-0a8be27ff3e1 {{(pid=74840) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 12:30:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5b6470ee09f569b53ed589342eb14f3238f1b92b.part /opt/stack/data/nova/instances/_base/5b6470ee09f569b53ed589342eb14f3238f1b92b.converted" returned: 0 in 0.463s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b6470ee09f569b53ed589342eb14f3238f1b92b.converted --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:15 user nova-compute[74840]: DEBUG nova.network.neutron [req-78edb3a8-f923-4878-8599-b6285db5f6af req-24439cad-ef99-4513-988e-5b2146e61925 service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Updated VIF entry in instance network info cache for port f0b1fa9b-7ace-4c3b-af97-f62a085e0076. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:30:15 user nova-compute[74840]: DEBUG nova.network.neutron [req-78edb3a8-f923-4878-8599-b6285db5f6af req-24439cad-ef99-4513-988e-5b2146e61925 service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Updating instance_info_cache with network_info: [{"id": "f0b1fa9b-7ace-4c3b-af97-f62a085e0076", "address": "fa:16:3e:56:2a:9f", "network": {"id": "918d8aed-1f09-4cfb-9c7f-48f002ad6ba3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-927886396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a05cda834445fb94e71f6cac02f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b1fa9b-7a", "ovs_interfaceid": "f0b1fa9b-7ace-4c3b-af97-f62a085e0076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:30:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-78edb3a8-f923-4878-8599-b6285db5f6af req-24439cad-ef99-4513-988e-5b2146e61925 service nova] Releasing lock "refresh_cache-4dcf7b89-a5ca-47ab-a4c9-878f53086de1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:30:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b6470ee09f569b53ed589342eb14f3238f1b92b.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "5b6470ee09f569b53ed589342eb14f3238f1b92b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.864s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:30:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b6470ee09f569b53ed589342eb14f3238f1b92b --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b6470ee09f569b53ed589342eb14f3238f1b92b --force-share --output=json" returned: 0 in 0.189s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Acquiring lock "5b6470ee09f569b53ed589342eb14f3238f1b92b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:30:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "5b6470ee09f569b53ed589342eb14f3238f1b92b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:30:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b6470ee09f569b53ed589342eb14f3238f1b92b --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b6470ee09f569b53ed589342eb14f3238f1b92b --force-share --output=json" returned: 0 in 0.176s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b6470ee09f569b53ed589342eb14f3238f1b92b,backing_fmt=raw /opt/stack/data/nova/instances/4dcf7b89-a5ca-47ab-a4c9-878f53086de1/disk 1073741824 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b6470ee09f569b53ed589342eb14f3238f1b92b,backing_fmt=raw /opt/stack/data/nova/instances/4dcf7b89-a5ca-47ab-a4c9-878f53086de1/disk 1073741824" returned: 0 in 0.095s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "5b6470ee09f569b53ed589342eb14f3238f1b92b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:30:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b6470ee09f569b53ed589342eb14f3238f1b92b --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:16 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:30:16 user nova-compute[74840]: DEBUG nova.compute.manager [req-a339e108-16e9-46af-bbae-1eda53c4005f req-13fe0f76-a6e3-4513-bda7-8ee78df4ec16 service nova] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Received event network-vif-deleted-c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:30:16 user nova-compute[74840]: INFO nova.compute.manager [req-a339e108-16e9-46af-bbae-1eda53c4005f req-13fe0f76-a6e3-4513-bda7-8ee78df4ec16 service nova] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Neutron deleted interface c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1; detaching it from the instance and deleting it from the info cache
Nov 08 12:30:16 user nova-compute[74840]: DEBUG nova.network.neutron [req-a339e108-16e9-46af-bbae-1eda53c4005f req-13fe0f76-a6e3-4513-bda7-8ee78df4ec16 service nova] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:30:16 user nova-compute[74840]: INFO nova.compute.manager [-] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Took 2.33 seconds to deallocate network for instance.
Nov 08 12:30:16 user nova-compute[74840]: DEBUG nova.compute.manager [req-a339e108-16e9-46af-bbae-1eda53c4005f req-13fe0f76-a6e3-4513-bda7-8ee78df4ec16 service nova] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Detach interface failed, port_id=c009e4aa-0da1-4c66-a6a9-7bf4f98cb1c1, reason: Instance aef3c8bf-d1a4-405b-a659-5bdee2415d6f could not be found. {{(pid=74840) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 12:30:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b6470ee09f569b53ed589342eb14f3238f1b92b --force-share --output=json" returned: 0 in 0.178s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:16 user nova-compute[74840]: DEBUG nova.objects.instance [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lazy-loading 'migration_context' on Instance uuid 4dcf7b89-a5ca-47ab-a4c9-878f53086de1 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:30:16 user nova-compute[74840]: DEBUG nova.objects.base [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Object Instance<4dcf7b89-a5ca-47ab-a4c9-878f53086de1> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:30:16 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Rebasing disk image.
Nov 08 12:30:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.174s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 -F raw /opt/stack/data/nova/instances/4dcf7b89-a5ca-47ab-a4c9-878f53086de1/disk {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:30:17 user nova-compute[74840]: INFO nova.compute.manager [None req-64d0a026-39b6-4392-b34b-67e38a9eea5c tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: aef3c8bf-d1a4-405b-a659-5bdee2415d6f] Took 0.94 seconds to detach 1 volumes for instance.
Nov 08 12:30:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-64d0a026-39b6-4392-b34b-67e38a9eea5c tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:30:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-64d0a026-39b6-4392-b34b-67e38a9eea5c tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:30:17 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:30:17 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Cleaning up deleted instances {{(pid=74840) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 12:30:17 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] There are 0 instances to clean {{(pid=74840) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 12:30:17 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-64d0a026-39b6-4392-b34b-67e38a9eea5c tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:30:17 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-64d0a026-39b6-4392-b34b-67e38a9eea5c tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:30:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-64d0a026-39b6-4392-b34b-67e38a9eea5c tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.464s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:30:18 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-64d0a026-39b6-4392-b34b-67e38a9eea5c tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Deleted allocations for instance aef3c8bf-d1a4-405b-a659-5bdee2415d6f
Nov 08 12:30:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-64d0a026-39b6-4392-b34b-67e38a9eea5c tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "aef3c8bf-d1a4-405b-a659-5bdee2415d6f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.477s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:30:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:30:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 -F raw /opt/stack/data/nova/instances/4dcf7b89-a5ca-47ab-a4c9-878f53086de1/disk" returned: 0 in 3.000s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:19 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Created local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 12:30:19 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Ensure instance console log exists: /opt/stack/data/nova/instances/4dcf7b89-a5ca-47ab-a4c9-878f53086de1/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:30:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:30:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:30:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:30:19 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Start _get_guest_xml network_info=[{"id": "f0b1fa9b-7ace-4c3b-af97-f62a085e0076", "address": "fa:16:3e:56:2a:9f", "network": {"id": "918d8aed-1f09-4cfb-9c7f-48f002ad6ba3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-927886396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a05cda834445fb94e71f6cac02f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b1fa9b-7a", "ovs_interfaceid": "f0b1fa9b-7ace-4c3b-af97-f62a085e0076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='e40c594dc03d2abc8a6df7e22166b07b',container_format='bare',created_at=2023-11-08T12:27:11Z,direct_url=<?>,disk_format='qcow2',id=e98e81ae-8be8-4f44-b63c-d875a709e229,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-391869052-shelved',owner='93a05cda834445fb94e71f6cac02f198',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T12:27:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'image_id': '4fa17706-d304-4117-a420-dab994c703dc'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'cd343afb-43fe-4e07-8518-9a5dc0299eff', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gwHTmAna', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '4dcf7b89-a5ca-47ab-a4c9-878f53086de1', 'attached_at': '', 'detached_at': '', 'volume_id': '596bd9e9-a02d-4b9d-95dd-87127daf8a60', 'serial': '596bd9e9-a02d-4b9d-95dd-87127daf8a60'}, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:30:19 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:30:19 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:30:19 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:30:19 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:30:19 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:30:19 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:30:19 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:30:19 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='e40c594dc03d2abc8a6df7e22166b07b',container_format='bare',created_at=2023-11-08T12:27:11Z,direct_url=<?>,disk_format='qcow2',id=e98e81ae-8be8-4f44-b63c-d875a709e229,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-391869052-shelved',owner='93a05cda834445fb94e71f6cac02f198',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T12:27:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:30:19 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:30:19 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:30:19 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:30:19 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:30:19 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:30:19 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:30:19 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:30:19 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:30:19 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:30:19 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:30:19 user nova-compute[74840]: DEBUG nova.objects.instance [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4dcf7b89-a5ca-47ab-a4c9-878f53086de1 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:30:19 user nova-compute[74840]: DEBUG nova.objects.base [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Object Instance<4dcf7b89-a5ca-47ab-a4c9-878f53086de1> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:30:19 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Calling os-brick to attach iSCSI Volume {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 12:30:19 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gwHTmAna', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:30:19 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:30:19 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:30:19 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:30:19 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:30:19 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:30:19 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:30:19 user nova-compute[74840]: INFO os_brick.initiator.connectors.iscsi [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 12:30:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 -p 172.16.0.220:3260 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:19 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91caabe-ca00-453f-affe-f8d3a51fc31a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:19 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 12:30:19 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:30:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 -p 172.16.0.220:3260 --interface default --op new {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:19 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[527d7b2f-dd16-469d-af9e-b3d6d2f9564b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60] added\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:19 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60] added
Nov 08 12:30:19 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:30:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:19 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2e8eb6-67b0-4935-b04c-788f064e9b74]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:19 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:30:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.036s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:19 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba0a1da-c17b-4992-b6cd-7df006bced29]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:19 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:30:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gwHTmAna {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gwHTmAna" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:20 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b49f1d2-487a-4a5f-972d-4ee64f74b86c]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gwHTmAna'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:30:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:20 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[725ef949-5be4-451a-ba99-f1144c24e4a8]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:30:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:20 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4c3a99-e2fd-49fc-a40d-67e50d1abbea]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:30:20 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:30:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:30:20 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:30:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 -p 172.16.0.220:3260 --login {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:20 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fb92ea-653e-41a8-b595-5a9c34dba5aa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60, portal: 172.16.0.220,3260]
Nov 08 12:30:20 user nova-compute[74840]: Login to [iface: default, target: iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60, portal: 172.16.0.220,3260] successful.
Nov 08 12:30:20 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:30:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:20 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e0bb70-6c71-467c-b95c-3e9aa0b7e7db]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:30:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:20 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ee923d-5c3b-4688-a151-a8026ee8005d]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:30:20 user nova-compute[74840]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 (non-flash)
Nov 08 12:30:20 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:30:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:30:20 user nova-compute[74840]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 (non-flash)
Nov 08 12:30:20 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:30:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:30:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Connected to 172.16.0.220:3260 {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 12:30:20 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] HCTL ('33', '-', '-', 0) found on session 34 with lun 0 {{(pid=74840) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 12:30:20 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74840) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 12:30:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:20 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[30fe9a87-d812-4201-a7d0-3e2820453de0]: (4, ('- - 0', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:20 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: None {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:30:21 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:30:21 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gwHTmAna', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 12:30:21 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:30:21 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23339386165396332', 'path': '/dev/sdb'} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:30:21 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339386165396332', 'path': '/dev/sdb'} {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 12:30:21 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T12:25:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-391869052',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-391869052',id=32,image_ref='e98e81ae-8be8-4f44-b63c-d875a709e229',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1869051926',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:25:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='93a05cda834445fb94e71f6cac02f198',ramdisk_id='',reservation_id='r-ovc6od6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1958698266',owner_user_name='tempest-AttachVolumeShelveTestJSON-1958698266-project-member',shelved_at='2023-11-08T12:27:17.182367',shelved_host='user',shelved_image_id='e98e81ae-8be8-4f44-b63c-d875a709e229'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:29:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='afc4e8483a1f4e08b3f81a9b9323be84',uuid=4dcf7b89-a5ca-47ab-a4c9-878f53086de1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f0b1fa9b-7ace-4c3b-af97-f62a085e0076", "address": "fa:16:3e:56:2a:9f", "network": {"id": "918d8aed-1f09-4cfb-9c7f-48f002ad6ba3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-927886396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a05cda834445fb94e71f6cac02f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b1fa9b-7a", "ovs_interfaceid": "f0b1fa9b-7ace-4c3b-af97-f62a085e0076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:30:21 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Converting VIF {"id": "f0b1fa9b-7ace-4c3b-af97-f62a085e0076", "address": "fa:16:3e:56:2a:9f", "network": {"id": "918d8aed-1f09-4cfb-9c7f-48f002ad6ba3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-927886396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a05cda834445fb94e71f6cac02f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b1fa9b-7a", "ovs_interfaceid": "f0b1fa9b-7ace-4c3b-af97-f62a085e0076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:30:21 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:2a:9f,bridge_name='br-int',has_traffic_filtering=True,id=f0b1fa9b-7ace-4c3b-af97-f62a085e0076,network=Network(918d8aed-1f09-4cfb-9c7f-48f002ad6ba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b1fa9b-7a') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:30:21 user nova-compute[74840]: DEBUG nova.objects.instance [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lazy-loading 'pci_devices' on Instance uuid 4dcf7b89-a5ca-47ab-a4c9-878f53086de1 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:30:21 user nova-compute[74840]: DEBUG nova.objects.base [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Object Instance<4dcf7b89-a5ca-47ab-a4c9-878f53086de1> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:30:21 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:30:21 user nova-compute[74840]:   <uuid>4dcf7b89-a5ca-47ab-a4c9-878f53086de1</uuid>
Nov 08 12:30:21 user nova-compute[74840]:   <name>instance-00000020</name>
Nov 08 12:30:21 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:30:21 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:30:21 user nova-compute[74840]:   <metadata>
Nov 08 12:30:21 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:30:21 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:30:21 user nova-compute[74840]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-391869052</nova:name>
Nov 08 12:30:21 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:30:19</nova:creationTime>
Nov 08 12:30:21 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:30:21 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:30:21 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:30:21 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:30:21 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:30:21 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:30:21 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:30:21 user nova-compute[74840]:       <nova:owner>
Nov 08 12:30:21 user nova-compute[74840]:         <nova:user uuid="afc4e8483a1f4e08b3f81a9b9323be84">tempest-AttachVolumeShelveTestJSON-1958698266-project-member</nova:user>
Nov 08 12:30:21 user nova-compute[74840]:         <nova:project uuid="93a05cda834445fb94e71f6cac02f198">tempest-AttachVolumeShelveTestJSON-1958698266</nova:project>
Nov 08 12:30:21 user nova-compute[74840]:       </nova:owner>
Nov 08 12:30:21 user nova-compute[74840]:       <nova:root type="image" uuid="e98e81ae-8be8-4f44-b63c-d875a709e229"/>
Nov 08 12:30:21 user nova-compute[74840]:       <nova:ports>
Nov 08 12:30:21 user nova-compute[74840]:         <nova:port uuid="f0b1fa9b-7ace-4c3b-af97-f62a085e0076">
Nov 08 12:30:21 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 08 12:30:21 user nova-compute[74840]:         </nova:port>
Nov 08 12:30:21 user nova-compute[74840]:       </nova:ports>
Nov 08 12:30:21 user nova-compute[74840]:     </nova:instance>
Nov 08 12:30:21 user nova-compute[74840]:   </metadata>
Nov 08 12:30:21 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:30:21 user nova-compute[74840]:     <system>
Nov 08 12:30:21 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:30:21 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:30:21 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:30:21 user nova-compute[74840]:       <entry name="serial">4dcf7b89-a5ca-47ab-a4c9-878f53086de1</entry>
Nov 08 12:30:21 user nova-compute[74840]:       <entry name="uuid">4dcf7b89-a5ca-47ab-a4c9-878f53086de1</entry>
Nov 08 12:30:21 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:30:21 user nova-compute[74840]:     </system>
Nov 08 12:30:21 user nova-compute[74840]:   </sysinfo>
Nov 08 12:30:21 user nova-compute[74840]:   <os>
Nov 08 12:30:21 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:30:21 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:30:21 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:30:21 user nova-compute[74840]:   </os>
Nov 08 12:30:21 user nova-compute[74840]:   <features>
Nov 08 12:30:21 user nova-compute[74840]:     <acpi/>
Nov 08 12:30:21 user nova-compute[74840]:     <apic/>
Nov 08 12:30:21 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:30:21 user nova-compute[74840]:   </features>
Nov 08 12:30:21 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:30:21 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:30:21 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:30:21 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:30:21 user nova-compute[74840]:   </clock>
Nov 08 12:30:21 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:30:21 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:30:21 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:30:21 user nova-compute[74840]:   </cpu>
Nov 08 12:30:21 user nova-compute[74840]:   <devices>
Nov 08 12:30:21 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:30:21 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:30:21 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/4dcf7b89-a5ca-47ab-a4c9-878f53086de1/disk"/>
Nov 08 12:30:21 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:30:21 user nova-compute[74840]:     </disk>
Nov 08 12:30:21 user nova-compute[74840]:     <disk type="block" device="disk">
Nov 08 12:30:21 user nova-compute[74840]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:30:21 user nova-compute[74840]:       <source dev="/dev/sdb"/>
Nov 08 12:30:21 user nova-compute[74840]:       <target dev="vdc" bus="virtio"/>
Nov 08 12:30:21 user nova-compute[74840]:       <serial>596bd9e9-a02d-4b9d-95dd-87127daf8a60</serial>
Nov 08 12:30:21 user nova-compute[74840]:     </disk>
Nov 08 12:30:21 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:30:21 user nova-compute[74840]:       <mac address="fa:16:3e:56:2a:9f"/>
Nov 08 12:30:21 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:30:21 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:30:21 user nova-compute[74840]:       <target dev="tapf0b1fa9b-7a"/>
Nov 08 12:30:21 user nova-compute[74840]:     </interface>
Nov 08 12:30:21 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:30:21 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/4dcf7b89-a5ca-47ab-a4c9-878f53086de1/console.log" append="off"/>
Nov 08 12:30:21 user nova-compute[74840]:     </serial>
Nov 08 12:30:21 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:30:21 user nova-compute[74840]:     <video>
Nov 08 12:30:21 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:30:21 user nova-compute[74840]:     </video>
Nov 08 12:30:21 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:30:21 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:30:21 user nova-compute[74840]:     </rng>
Nov 08 12:30:21 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:30:21 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:30:21 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:30:21 user nova-compute[74840]:     </memballoon>
Nov 08 12:30:21 user nova-compute[74840]:   </devices>
Nov 08 12:30:21 user nova-compute[74840]: </domain>
Nov 08 12:30:21 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:30:21 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T12:25:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-391869052',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-391869052',id=32,image_ref='e98e81ae-8be8-4f44-b63c-d875a709e229',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1869051926',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:25:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='93a05cda834445fb94e71f6cac02f198',ramdisk_id='',reservation_id='r-ovc6od6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1958698266',owner_user_name='tempest-AttachVolumeShelveTestJSON-1958698266-project-member',shelved_at='2023-11-08T12:27:17.182367',shelved_host='user',shelved_image_id='e98e81ae-8be8-4f44-b63c-d875a709e229'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:29:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='afc4e8483a1f4e08b3f81a9b9323be84',uuid=4dcf7b89-a5ca-47ab-a4c9-878f53086de1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f0b1fa9b-7ace-4c3b-af97-f62a085e0076", "address": "fa:16:3e:56:2a:9f", "network": {"id": "918d8aed-1f09-4cfb-9c7f-48f002ad6ba3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-927886396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a05cda834445fb94e71f6cac02f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b1fa9b-7a", "ovs_interfaceid": "f0b1fa9b-7ace-4c3b-af97-f62a085e0076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:30:21 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Converting VIF {"id": "f0b1fa9b-7ace-4c3b-af97-f62a085e0076", "address": "fa:16:3e:56:2a:9f", "network": {"id": "918d8aed-1f09-4cfb-9c7f-48f002ad6ba3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-927886396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a05cda834445fb94e71f6cac02f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b1fa9b-7a", "ovs_interfaceid": "f0b1fa9b-7ace-4c3b-af97-f62a085e0076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:30:21 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:2a:9f,bridge_name='br-int',has_traffic_filtering=True,id=f0b1fa9b-7ace-4c3b-af97-f62a085e0076,network=Network(918d8aed-1f09-4cfb-9c7f-48f002ad6ba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b1fa9b-7a') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:30:21 user nova-compute[74840]: DEBUG os_vif [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:2a:9f,bridge_name='br-int',has_traffic_filtering=True,id=f0b1fa9b-7ace-4c3b-af97-f62a085e0076,network=Network(918d8aed-1f09-4cfb-9c7f-48f002ad6ba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b1fa9b-7a') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:30:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:30:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:30:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:30:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:30:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4a20c944-8920-5dbe-a285-42570b3055d5', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:30:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:30:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:30:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:30:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0b1fa9b-7a, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:30:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf0b1fa9b-7a, col_values=(('qos', UUID('b3444da9-ac6b-4a0b-9ced-5720057e6c95')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:30:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf0b1fa9b-7a, col_values=(('external_ids', {'iface-id': 'f0b1fa9b-7ace-4c3b-af97-f62a085e0076', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:2a:9f', 'vm-uuid': '4dcf7b89-a5ca-47ab-a4c9-878f53086de1'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:30:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:30:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:30:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:30:21 user nova-compute[74840]: INFO os_vif [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:2a:9f,bridge_name='br-int',has_traffic_filtering=True,id=f0b1fa9b-7ace-4c3b-af97-f62a085e0076,network=Network(918d8aed-1f09-4cfb-9c7f-48f002ad6ba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b1fa9b-7a')
Nov 08 12:30:21 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:30:21 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:30:21 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] No VIF found with MAC fa:16:3e:56:2a:9f, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:30:22 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:30:22 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:30:22 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:30:22 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:30:22 user nova-compute[74840]: DEBUG nova.compute.manager [req-83e3e10d-d84d-4b5f-a360-f0072caf3765 req-1ef424b3-9a23-4658-808d-521d2582e2bd service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Received event network-vif-plugged-f0b1fa9b-7ace-4c3b-af97-f62a085e0076 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:30:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-83e3e10d-d84d-4b5f-a360-f0072caf3765 req-1ef424b3-9a23-4658-808d-521d2582e2bd service nova] Acquiring lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:30:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-83e3e10d-d84d-4b5f-a360-f0072caf3765 req-1ef424b3-9a23-4658-808d-521d2582e2bd service nova] Lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:30:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-83e3e10d-d84d-4b5f-a360-f0072caf3765 req-1ef424b3-9a23-4658-808d-521d2582e2bd service nova] Lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:30:22 user nova-compute[74840]: DEBUG nova.compute.manager [req-83e3e10d-d84d-4b5f-a360-f0072caf3765 req-1ef424b3-9a23-4658-808d-521d2582e2bd service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] No waiting events found dispatching network-vif-plugged-f0b1fa9b-7ace-4c3b-af97-f62a085e0076 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:30:22 user nova-compute[74840]: WARNING nova.compute.manager [req-83e3e10d-d84d-4b5f-a360-f0072caf3765 req-1ef424b3-9a23-4658-808d-521d2582e2bd service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Received unexpected event network-vif-plugged-f0b1fa9b-7ace-4c3b-af97-f62a085e0076 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 08 12:30:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:30:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:30:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:30:25 user nova-compute[74840]: DEBUG nova.compute.manager [req-846d3701-fb41-42df-83f2-1a63a7fc254c req-717599ca-63f3-4b87-9c50-a11f27291f48 service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Received event network-vif-plugged-f0b1fa9b-7ace-4c3b-af97-f62a085e0076 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:30:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-846d3701-fb41-42df-83f2-1a63a7fc254c req-717599ca-63f3-4b87-9c50-a11f27291f48 service nova] Acquiring lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:30:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-846d3701-fb41-42df-83f2-1a63a7fc254c req-717599ca-63f3-4b87-9c50-a11f27291f48 service nova] Lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:30:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-846d3701-fb41-42df-83f2-1a63a7fc254c req-717599ca-63f3-4b87-9c50-a11f27291f48 service nova] Lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:30:25 user nova-compute[74840]: DEBUG nova.compute.manager [req-846d3701-fb41-42df-83f2-1a63a7fc254c req-717599ca-63f3-4b87-9c50-a11f27291f48 service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] No waiting events found dispatching network-vif-plugged-f0b1fa9b-7ace-4c3b-af97-f62a085e0076 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:30:25 user nova-compute[74840]: WARNING nova.compute.manager [req-846d3701-fb41-42df-83f2-1a63a7fc254c req-717599ca-63f3-4b87-9c50-a11f27291f48 service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Received unexpected event network-vif-plugged-f0b1fa9b-7ace-4c3b-af97-f62a085e0076 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 08 12:30:25 user nova-compute[74840]: DEBUG nova.compute.manager [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:30:25 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:30:25 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Instance spawned successfully.
Nov 08 12:30:25 user nova-compute[74840]: DEBUG nova.compute.manager [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:30:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-40c96349-3591-48e3-976d-cc6c1f94386a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 81.293s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:30:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:30:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:30:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:30:32 user nova-compute[74840]: DEBUG nova.compute.manager [req-af10f13f-f7b8-4057-ad91-412ff9bd16c7 req-840ef86b-3a57-49c1-8e3d-1248f9e7ab5f service nova] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Received event network-changed-e0c27d11-afc7-4e26-8024-d4c7ad9a6baf {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:30:32 user nova-compute[74840]: DEBUG nova.compute.manager [req-af10f13f-f7b8-4057-ad91-412ff9bd16c7 req-840ef86b-3a57-49c1-8e3d-1248f9e7ab5f service nova] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Refreshing instance network info cache due to event network-changed-e0c27d11-afc7-4e26-8024-d4c7ad9a6baf. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:30:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-af10f13f-f7b8-4057-ad91-412ff9bd16c7 req-840ef86b-3a57-49c1-8e3d-1248f9e7ab5f service nova] Acquiring lock "refresh_cache-e3175752-45a5-43e3-a99a-9377440e7bea" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:30:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-af10f13f-f7b8-4057-ad91-412ff9bd16c7 req-840ef86b-3a57-49c1-8e3d-1248f9e7ab5f service nova] Acquired lock "refresh_cache-e3175752-45a5-43e3-a99a-9377440e7bea" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:30:32 user nova-compute[74840]: DEBUG nova.network.neutron [req-af10f13f-f7b8-4057-ad91-412ff9bd16c7 req-840ef86b-3a57-49c1-8e3d-1248f9e7ab5f service nova] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Refreshing network info cache for port e0c27d11-afc7-4e26-8024-d4c7ad9a6baf {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:30:33 user nova-compute[74840]: DEBUG nova.network.neutron [req-af10f13f-f7b8-4057-ad91-412ff9bd16c7 req-840ef86b-3a57-49c1-8e3d-1248f9e7ab5f service nova] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Updated VIF entry in instance network info cache for port e0c27d11-afc7-4e26-8024-d4c7ad9a6baf. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:30:33 user nova-compute[74840]: DEBUG nova.network.neutron [req-af10f13f-f7b8-4057-ad91-412ff9bd16c7 req-840ef86b-3a57-49c1-8e3d-1248f9e7ab5f service nova] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Updating instance_info_cache with network_info: [{"id": "e0c27d11-afc7-4e26-8024-d4c7ad9a6baf", "address": "fa:16:3e:86:18:09", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0c27d11-af", "ovs_interfaceid": "e0c27d11-afc7-4e26-8024-d4c7ad9a6baf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:30:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "e3175752-45a5-43e3-a99a-9377440e7bea" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:30:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "e3175752-45a5-43e3-a99a-9377440e7bea" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:30:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-af10f13f-f7b8-4057-ad91-412ff9bd16c7 req-840ef86b-3a57-49c1-8e3d-1248f9e7ab5f service nova] Releasing lock "refresh_cache-e3175752-45a5-43e3-a99a-9377440e7bea" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:30:33 user nova-compute[74840]: DEBUG nova.objects.instance [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lazy-loading 'flavor' on Instance uuid e3175752-45a5-43e3-a99a-9377440e7bea {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:30:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "e3175752-45a5-43e3-a99a-9377440e7bea" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.165s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:30:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "e3175752-45a5-43e3-a99a-9377440e7bea" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:30:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "e3175752-45a5-43e3-a99a-9377440e7bea" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:30:33 user nova-compute[74840]: INFO nova.compute.manager [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Attaching volume 67de400a-4361-4d2c-b9f0-a17af7822321 to /dev/vdb
Nov 08 12:30:33 user nova-compute[74840]: DEBUG os_brick.utils [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:30:33 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:33 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:33 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[273fa263-85aa-49d4-b7f0-099de3147383]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c8228a11e03c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:33 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:33 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:33 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9a0c5e-a1d1-4d73-86d3-8768010d7f0f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:33 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:34 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7cd7c1e-a721-4e41-ba83-b11a541aea1c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:34 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaec7a37-ca85-4ad0-995d-fe9d824dffb9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Running cmd (subprocess): nvme version {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] 'nvme version' failed. Not Retrying. {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:30:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] nvme not present on system {{(pid=74840) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 12:30:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:30:34 user nova-compute[74840]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 12:30:34 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c876af94-b1b3-4e86-bf16-2d59b00df56d]: (4, '') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74840) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 12:30:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 12:30:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] LIGHTOS: no hostnqn found. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 12:30:34 user nova-compute[74840]: DEBUG os_brick.utils [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c8228a11e03c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:30:34 user nova-compute[74840]: DEBUG nova.virt.block_device [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Updating existing volume attachment record: b9149c57-485e-44da-9078-ee60fc5c604e {{(pid=74840) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 12:30:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:30:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG nova.compute.manager [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Start spawning the instance on the hypervisor. {{(pid=74840) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:30:41 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Creating image(s)
Nov 08 12:30:41 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Did not create local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Ensure instance console log exists: /opt/stack/data/nova/instances/b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Start _get_guest_xml network_info=[{"id": "8fd26752-a3a0-4b97-a43f-73454925abea", "address": "fa:16:3e:2a:e1:f9", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd26752-a3", "ovs_interfaceid": "8fd26752-a3a0-4b97-a43f-73454925abea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '659d54ea-7eaa-42f5-a51d-0a8be27ff3e1', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KvbyqZVG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c', 'attached_at': '', 'detached_at': '', 'volume_id': 'c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c', 'serial': 'c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c'}, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:30:41 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:30:41 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:30:41 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Calling os-brick to attach iSCSI Volume {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KvbyqZVG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:30:41 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:30:41 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:30:41 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:30:41 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:30:41 user nova-compute[74840]: INFO os_brick.initiator.connectors.iscsi [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 12:30:41 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c -p 172.16.0.220:3260 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d242b395-f59e-43c4-b1e6-5668e1c169cc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 12:30:41 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c -p 172.16.0.220:3260 --interface default --op new {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a955d3-4e0c-46f0-bcd5-fc9d7bbc57d4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c] added\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c] added
Nov 08 12:30:41 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6bad76-ffef-4123-9be8-e9ee06738c65]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5fe7d0-767e-448f-b1fd-95dcba6bb227]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KvbyqZVG {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KvbyqZVG" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9de186b-7cd4-4227-a48e-886d6683cf38]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KvbyqZVG'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba2b669-8be0-42c7-8d2d-5e18c0887095]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9818f3f5-082a-4285-90a0-8d3ae633100e]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:30:41 user nova-compute[74840]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 (non-flash)
Nov 08 12:30:41 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:30:41 user nova-compute[74840]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 (non-flash)
Nov 08 12:30:41 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c -p 172.16.0.220:3260 --login {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2503d3-7164-41f9-9231-df742aa7d648]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c, portal: 172.16.0.220,3260]
Nov 08 12:30:41 user nova-compute[74840]: Login to [iface: default, target: iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c, portal: 172.16.0.220,3260] successful.
Nov 08 12:30:41 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22d82f6-fb9c-4656-be37-ae70e9f3ac9f]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[4626705e-2d6a-4078-a70a-39835fb24db4]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:30:41 user nova-compute[74840]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 (non-flash)
Nov 08 12:30:41 user nova-compute[74840]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)
Nov 08 12:30:41 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:30:41 user nova-compute[74840]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 (non-flash)
Nov 08 12:30:41 user nova-compute[74840]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)
Nov 08 12:30:41 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Connected to 172.16.0.220:3260 {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] HCTL ('34', '-', '-', 0) found on session 35 with lun 0 {{(pid=74840) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74840) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebd5fe8-ec7a-41ab-aade-411636a82e76]: (4, ('- - 0', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: None {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:30:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:30:42 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:30:42 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KvbyqZVG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 12:30:42 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:30:42 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23061366631656539', 'path': '/dev/sdc'} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:30:42 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061366631656539', 'path': '/dev/sdc'} {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 12:30:42 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:29:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-997398221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-997398221',id=37,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72c97c47ab144ef3a8d5e9ee1ecc059e',ramdisk_id='',reservation_id='r-oxi3426h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-297593405',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:29:54Z,user_data=None,user_id='275e3d340c9d4d9e90b579e4bc0bfe0b',uuid=b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fd26752-a3a0-4b97-a43f-73454925abea", "address": "fa:16:3e:2a:e1:f9", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd26752-a3", "ovs_interfaceid": "8fd26752-a3a0-4b97-a43f-73454925abea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:30:42 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Converting VIF {"id": "8fd26752-a3a0-4b97-a43f-73454925abea", "address": "fa:16:3e:2a:e1:f9", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd26752-a3", "ovs_interfaceid": "8fd26752-a3a0-4b97-a43f-73454925abea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:30:42 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:e1:f9,bridge_name='br-int',has_traffic_filtering=True,id=8fd26752-a3a0-4b97-a43f-73454925abea,network=Network(8388eafb-b115-49c7-82cd-0d85d0ee12e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fd26752-a3') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:30:42 user nova-compute[74840]: DEBUG nova.objects.instance [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lazy-loading 'pci_devices' on Instance uuid b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:30:42 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:30:42 user nova-compute[74840]:   <uuid>b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c</uuid>
Nov 08 12:30:42 user nova-compute[74840]:   <name>instance-00000025</name>
Nov 08 12:30:42 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:30:42 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:30:42 user nova-compute[74840]:   <metadata>
Nov 08 12:30:42 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:30:42 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:30:42 user nova-compute[74840]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-997398221</nova:name>
Nov 08 12:30:42 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:30:41</nova:creationTime>
Nov 08 12:30:42 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:30:42 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:30:42 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:30:42 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:30:42 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:30:42 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:30:42 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:30:42 user nova-compute[74840]:       <nova:owner>
Nov 08 12:30:42 user nova-compute[74840]:         <nova:user uuid="275e3d340c9d4d9e90b579e4bc0bfe0b">tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member</nova:user>
Nov 08 12:30:42 user nova-compute[74840]:         <nova:project uuid="72c97c47ab144ef3a8d5e9ee1ecc059e">tempest-ServerBootFromVolumeStableRescueTest-297593405</nova:project>
Nov 08 12:30:42 user nova-compute[74840]:       </nova:owner>
Nov 08 12:30:42 user nova-compute[74840]:       <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:30:42 user nova-compute[74840]:       <nova:ports>
Nov 08 12:30:42 user nova-compute[74840]:         <nova:port uuid="8fd26752-a3a0-4b97-a43f-73454925abea">
Nov 08 12:30:42 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 08 12:30:42 user nova-compute[74840]:         </nova:port>
Nov 08 12:30:42 user nova-compute[74840]:       </nova:ports>
Nov 08 12:30:42 user nova-compute[74840]:     </nova:instance>
Nov 08 12:30:42 user nova-compute[74840]:   </metadata>
Nov 08 12:30:42 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:30:42 user nova-compute[74840]:     <system>
Nov 08 12:30:42 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:30:42 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:30:42 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:30:42 user nova-compute[74840]:       <entry name="serial">b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c</entry>
Nov 08 12:30:42 user nova-compute[74840]:       <entry name="uuid">b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c</entry>
Nov 08 12:30:42 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:30:42 user nova-compute[74840]:     </system>
Nov 08 12:30:42 user nova-compute[74840]:   </sysinfo>
Nov 08 12:30:42 user nova-compute[74840]:   <os>
Nov 08 12:30:42 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:30:42 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:30:42 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:30:42 user nova-compute[74840]:   </os>
Nov 08 12:30:42 user nova-compute[74840]:   <features>
Nov 08 12:30:42 user nova-compute[74840]:     <acpi/>
Nov 08 12:30:42 user nova-compute[74840]:     <apic/>
Nov 08 12:30:42 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:30:42 user nova-compute[74840]:   </features>
Nov 08 12:30:42 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:30:42 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:30:42 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:30:42 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:30:42 user nova-compute[74840]:   </clock>
Nov 08 12:30:42 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:30:42 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:30:42 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:30:42 user nova-compute[74840]:   </cpu>
Nov 08 12:30:42 user nova-compute[74840]:   <devices>
Nov 08 12:30:42 user nova-compute[74840]:     <disk type="block" device="disk">
Nov 08 12:30:42 user nova-compute[74840]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:30:42 user nova-compute[74840]:       <source dev="/dev/sdc"/>
Nov 08 12:30:42 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:30:42 user nova-compute[74840]:       <serial>c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c</serial>
Nov 08 12:30:42 user nova-compute[74840]:     </disk>
Nov 08 12:30:42 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:30:42 user nova-compute[74840]:       <mac address="fa:16:3e:2a:e1:f9"/>
Nov 08 12:30:42 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:30:42 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:30:42 user nova-compute[74840]:       <target dev="tap8fd26752-a3"/>
Nov 08 12:30:42 user nova-compute[74840]:     </interface>
Nov 08 12:30:42 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:30:42 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c/console.log" append="off"/>
Nov 08 12:30:42 user nova-compute[74840]:     </serial>
Nov 08 12:30:42 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:30:42 user nova-compute[74840]:     <video>
Nov 08 12:30:42 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:30:42 user nova-compute[74840]:     </video>
Nov 08 12:30:42 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:30:42 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:30:42 user nova-compute[74840]:     </rng>
Nov 08 12:30:42 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:30:42 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:30:42 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:30:42 user nova-compute[74840]:     </memballoon>
Nov 08 12:30:42 user nova-compute[74840]:   </devices>
Nov 08 12:30:42 user nova-compute[74840]: </domain>
Nov 08 12:30:42 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:30:42 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:29:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-997398221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-997398221',id=37,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72c97c47ab144ef3a8d5e9ee1ecc059e',ramdisk_id='',reservation_id='r-oxi3426h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-297593405',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:29:54Z,user_data=None,user_id='275e3d340c9d4d9e90b579e4bc0bfe0b',uuid=b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fd26752-a3a0-4b97-a43f-73454925abea", "address": "fa:16:3e:2a:e1:f9", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd26752-a3", "ovs_interfaceid": "8fd26752-a3a0-4b97-a43f-73454925abea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:30:42 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Converting VIF {"id": "8fd26752-a3a0-4b97-a43f-73454925abea", "address": "fa:16:3e:2a:e1:f9", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd26752-a3", "ovs_interfaceid": "8fd26752-a3a0-4b97-a43f-73454925abea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:30:42 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:e1:f9,bridge_name='br-int',has_traffic_filtering=True,id=8fd26752-a3a0-4b97-a43f-73454925abea,network=Network(8388eafb-b115-49c7-82cd-0d85d0ee12e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fd26752-a3') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:30:42 user nova-compute[74840]: DEBUG os_vif [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:e1:f9,bridge_name='br-int',has_traffic_filtering=True,id=8fd26752-a3a0-4b97-a43f-73454925abea,network=Network(8388eafb-b115-49c7-82cd-0d85d0ee12e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fd26752-a3') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:30:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:30:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:30:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:30:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:30:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '16c6ed3b-9341-527d-abd0-8530203bd3d1', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:30:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:30:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:30:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:30:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8fd26752-a3, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:30:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8fd26752-a3, col_values=(('qos', UUID('d38171fa-d5f5-40b6-8fd8-63ef465885bb')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:30:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8fd26752-a3, col_values=(('external_ids', {'iface-id': '8fd26752-a3a0-4b97-a43f-73454925abea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:e1:f9', 'vm-uuid': 'b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:30:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:30:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:30:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:30:42 user nova-compute[74840]: INFO os_vif [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:e1:f9,bridge_name='br-int',has_traffic_filtering=True,id=8fd26752-a3a0-4b97-a43f-73454925abea,network=Network(8388eafb-b115-49c7-82cd-0d85d0ee12e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fd26752-a3')
Nov 08 12:30:42 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:30:43 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] No VIF found with MAC fa:16:3e:2a:e1:f9, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:30:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:30:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:30:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:30:44 user nova-compute[74840]: DEBUG nova.compute.manager [req-fec055f5-263a-4919-91dc-ba3fe60c85e2 req-87ad2b51-043c-4df4-9c03-0966dafc795f service nova] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Received event network-vif-plugged-8fd26752-a3a0-4b97-a43f-73454925abea {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:30:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-fec055f5-263a-4919-91dc-ba3fe60c85e2 req-87ad2b51-043c-4df4-9c03-0966dafc795f service nova] Acquiring lock "b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:30:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-fec055f5-263a-4919-91dc-ba3fe60c85e2 req-87ad2b51-043c-4df4-9c03-0966dafc795f service nova] Lock "b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:30:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-fec055f5-263a-4919-91dc-ba3fe60c85e2 req-87ad2b51-043c-4df4-9c03-0966dafc795f service nova] Lock "b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:30:44 user nova-compute[74840]: DEBUG nova.compute.manager [req-fec055f5-263a-4919-91dc-ba3fe60c85e2 req-87ad2b51-043c-4df4-9c03-0966dafc795f service nova] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] No waiting events found dispatching network-vif-plugged-8fd26752-a3a0-4b97-a43f-73454925abea {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:30:44 user nova-compute[74840]: WARNING nova.compute.manager [req-fec055f5-263a-4919-91dc-ba3fe60c85e2 req-87ad2b51-043c-4df4-9c03-0966dafc795f service nova] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Received unexpected event network-vif-plugged-8fd26752-a3a0-4b97-a43f-73454925abea for instance with vm_state building and task_state spawning.
Nov 08 12:30:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:30:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:30:46 user nova-compute[74840]: DEBUG nova.compute.manager [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:30:46 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:30:46 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Instance spawned successfully.
Nov 08 12:30:46 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:30:46 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Found default for hw_cdrom_bus of ide {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:30:46 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Found default for hw_disk_bus of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:30:46 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:30:46 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:30:46 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Found default for hw_video_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:30:46 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Found default for hw_vif_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:30:46 user nova-compute[74840]: DEBUG nova.compute.manager [req-03726d1d-f97e-4b48-bd25-35f59830a6eb req-4dd70433-06e1-4e6e-a42e-03fd441ba23b service nova] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Received event network-vif-plugged-8fd26752-a3a0-4b97-a43f-73454925abea {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:30:46 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-03726d1d-f97e-4b48-bd25-35f59830a6eb req-4dd70433-06e1-4e6e-a42e-03fd441ba23b service nova] Acquiring lock "b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:30:46 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-03726d1d-f97e-4b48-bd25-35f59830a6eb req-4dd70433-06e1-4e6e-a42e-03fd441ba23b service nova] Lock "b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:30:46 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-03726d1d-f97e-4b48-bd25-35f59830a6eb req-4dd70433-06e1-4e6e-a42e-03fd441ba23b service nova] Lock "b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:30:46 user nova-compute[74840]: DEBUG nova.compute.manager [req-03726d1d-f97e-4b48-bd25-35f59830a6eb req-4dd70433-06e1-4e6e-a42e-03fd441ba23b service nova] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] No waiting events found dispatching network-vif-plugged-8fd26752-a3a0-4b97-a43f-73454925abea {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:30:46 user nova-compute[74840]: WARNING nova.compute.manager [req-03726d1d-f97e-4b48-bd25-35f59830a6eb req-4dd70433-06e1-4e6e-a42e-03fd441ba23b service nova] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Received unexpected event network-vif-plugged-8fd26752-a3a0-4b97-a43f-73454925abea for instance with vm_state building and task_state spawning.
Nov 08 12:30:46 user nova-compute[74840]: INFO nova.compute.manager [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Took 5.28 seconds to spawn the instance on the hypervisor.
Nov 08 12:30:46 user nova-compute[74840]: DEBUG nova.compute.manager [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:30:46 user nova-compute[74840]: INFO nova.compute.manager [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Took 53.39 seconds to build instance.
Nov 08 12:30:46 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-61a91a78-2bf7-4804-aed8-70c825915b54 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 53.551s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:30:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:30:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:30:51 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:30:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:30:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:30:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:30:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:30:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Calling os-brick to attach iSCSI Volume {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cxshviGp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:30:59 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:30:59 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:30:59 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:30:59 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:30:59 user nova-compute[74840]: INFO os_brick.initiator.connectors.iscsi [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 12:30:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 -p 172.16.0.220:3260 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac342d6-2672-4f68-84a8-2215c335a2a8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 12:30:59 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 -p 172.16.0.220:3260 --interface default --op new {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda29b41-799b-40a2-bf46-ee3266414fe6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321] added\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321] added
Nov 08 12:30:59 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.040s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1872e71c-81d6-4d8b-a7b7-dc79e947c064]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6462b88c-ea29-412a-9cd6-34fb42b43b5e]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cxshviGp {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cxshviGp" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[604f4096-78f6-4058-a856-401c6086081d]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cxshviGp'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c845fcb5-6500-4c3c-bf10-65fc14ac0fc7]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e7052a-922e-4c46-93f4-ae333961e0cb]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:30:59 user nova-compute[74840]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 (non-flash)
Nov 08 12:30:59 user nova-compute[74840]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)
Nov 08 12:30:59 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:30:59 user nova-compute[74840]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 (non-flash)
Nov 08 12:30:59 user nova-compute[74840]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)
Nov 08 12:30:59 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 -p 172.16.0.220:3260 --login {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f37f496-1c88-4d39-9c15-7a77becd43ac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321, portal: 172.16.0.220,3260]
Nov 08 12:30:59 user nova-compute[74840]: Login to [iface: default, target: iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321, portal: 172.16.0.220,3260] successful.
Nov 08 12:30:59 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8319aa97-5e62-446b-b6fc-7deb32e5435d]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47db86d-ccd9-45fb-b2f4-fd1227d88922]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:30:59 user nova-compute[74840]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 (non-flash)
Nov 08 12:30:59 user nova-compute[74840]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)
Nov 08 12:30:59 user nova-compute[74840]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 (non-flash)
Nov 08 12:30:59 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:30:59 user nova-compute[74840]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 (non-flash)
Nov 08 12:30:59 user nova-compute[74840]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)
Nov 08 12:30:59 user nova-compute[74840]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 (non-flash)
Nov 08 12:30:59 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Connected to 172.16.0.220:3260 {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] HCTL ('35', '-', '-', 0) found on session 36 with lun 0 {{(pid=74840) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74840) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[357755a2-f9e6-49b5-9e5a-45ccf16e3fc9]: (4, ('- - 0', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Searching for a device in session 36 and hctl ['35', '*', '*', 0] yield: None {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "refresh_cache-832a6445-84ee-43a8-a5bc-a07670602912" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquired lock "refresh_cache-832a6445-84ee-43a8-a5bc-a07670602912" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:30:59 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Forcefully refreshing network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 12:31:00 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Updating instance_info_cache with network_info: [{"id": "48ba3111-f22a-4a29-8183-ccd94efa9086", "address": "fa:16:3e:83:fc:39", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ba3111-f2", "ovs_interfaceid": "48ba3111-f22a-4a29-8183-ccd94efa9086", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:31:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Releasing lock "refresh_cache-832a6445-84ee-43a8-a5bc-a07670602912" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:31:00 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Updated the network info_cache for instance {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 12:31:00 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:31:00 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:31:00 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Searching for a device in session 36 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:31:00 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cxshviGp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 12:31:00 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:31:00 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '26665346136653130', 'path': '/dev/sdd'} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:31:00 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665346136653130', 'path': '/dev/sdd'} {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 12:31:00 user nova-compute[74840]: DEBUG nova.objects.instance [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lazy-loading 'flavor' on Instance uuid e3175752-45a5-43e3-a99a-9377440e7bea {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:31:00 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 12:31:00 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:31:00 user nova-compute[74840]:   <source dev="/dev/sdd"/>
Nov 08 12:31:00 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:31:00 user nova-compute[74840]:   <serial>67de400a-4361-4d2c-b9f0-a17af7822321</serial>
Nov 08 12:31:00 user nova-compute[74840]: </disk>
Nov 08 12:31:00 user nova-compute[74840]:  {{(pid=74840) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 12:31:00 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:31:01 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:31:01 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:31:01 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] No VIF found with MAC fa:16:3e:86:18:09, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:31:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-9ebba214-6d4b-4592-98bc-fd2e32638ca9 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "e3175752-45a5-43e3-a99a-9377440e7bea" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.487s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:31:01 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:31:01 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:31:01 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:31:02 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:31:02 user nova-compute[74840]: INFO nova.compute.manager [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Rebuilding instance
Nov 08 12:31:02 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:02 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:03 user nova-compute[74840]: DEBUG nova.compute.manager [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:31:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:03 user nova-compute[74840]: DEBUG nova.compute.manager [req-5231436f-31e4-4d1d-ab98-ddc45e65bc08 req-c9353163-20b7-4a9d-afdf-1b6a38d9a6a9 service nova] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Received event network-vif-unplugged-e0c27d11-afc7-4e26-8024-d4c7ad9a6baf {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:31:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-5231436f-31e4-4d1d-ab98-ddc45e65bc08 req-c9353163-20b7-4a9d-afdf-1b6a38d9a6a9 service nova] Acquiring lock "e3175752-45a5-43e3-a99a-9377440e7bea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:31:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-5231436f-31e4-4d1d-ab98-ddc45e65bc08 req-c9353163-20b7-4a9d-afdf-1b6a38d9a6a9 service nova] Lock "e3175752-45a5-43e3-a99a-9377440e7bea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:31:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-5231436f-31e4-4d1d-ab98-ddc45e65bc08 req-c9353163-20b7-4a9d-afdf-1b6a38d9a6a9 service nova] Lock "e3175752-45a5-43e3-a99a-9377440e7bea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:31:03 user nova-compute[74840]: DEBUG nova.compute.manager [req-5231436f-31e4-4d1d-ab98-ddc45e65bc08 req-c9353163-20b7-4a9d-afdf-1b6a38d9a6a9 service nova] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] No waiting events found dispatching network-vif-unplugged-e0c27d11-afc7-4e26-8024-d4c7ad9a6baf {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:31:03 user nova-compute[74840]: WARNING nova.compute.manager [req-5231436f-31e4-4d1d-ab98-ddc45e65bc08 req-c9353163-20b7-4a9d-afdf-1b6a38d9a6a9 service nova] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Received unexpected event network-vif-unplugged-e0c27d11-afc7-4e26-8024-d4c7ad9a6baf for instance with vm_state active and task_state rebuilding.
Nov 08 12:31:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:03 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Instance destroyed successfully.
Nov 08 12:31:04 user nova-compute[74840]: INFO nova.compute.manager [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Detaching volume 67de400a-4361-4d2c-b9f0-a17af7822321
Nov 08 12:31:04 user nova-compute[74840]: INFO nova.virt.block_device [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Attempting to driver detach volume 67de400a-4361-4d2c-b9f0-a17af7822321 from mountpoint /dev/vdb
Nov 08 12:31:04 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Attempting to detach device vdb from instance e3175752-45a5-43e3-a99a-9377440e7bea from the persistent domain config. {{(pid=74840) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 12:31:04 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 12:31:04 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:31:04 user nova-compute[74840]:   <source dev="/dev/sdd"/>
Nov 08 12:31:04 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:31:04 user nova-compute[74840]:   <serial>67de400a-4361-4d2c-b9f0-a17af7822321</serial>
Nov 08 12:31:04 user nova-compute[74840]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 12:31:04 user nova-compute[74840]: </disk>
Nov 08 12:31:04 user nova-compute[74840]:  {{(pid=74840) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 12:31:04 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Successfully detached device vdb from instance e3175752-45a5-43e3-a99a-9377440e7bea from the persistent domain config.
Nov 08 12:31:04 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 12:31:04 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cxshviGp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:31:04 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 12:31:04 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:31:04 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:31:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:04 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1011eb7-0d21-47ef-bd7b-32fe7de6ed9e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:04 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 12:31:04 user nova-compute[74840]: No targets found.
Nov 08 12:31:04 user nova-compute[74840]: iSNS:
Nov 08 12:31:04 user nova-compute[74840]: No targets found.
Nov 08 12:31:04 user nova-compute[74840]: STATIC:
Nov 08 12:31:04 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c
Nov 08 12:31:04 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:31:04 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:31:04 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4
Nov 08 12:31:04 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:31:04 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:31:04 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321
Nov 08 12:31:04 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:31:04 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:31:04 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60
Nov 08 12:31:04 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:31:04 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:31:04 user nova-compute[74840]: FIRMWARE:
Nov 08 12:31:04 user nova-compute[74840]: No targets found.
Nov 08 12:31:04 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:31:04 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 12:31:04 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 12:31:04 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 12:31:04 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 12:31:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:04 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d0719a-b712-4549-9362-b9908748a489]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:04 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5355ae0-6e1a-48ba-9afe-b91cbb0606f0]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:04 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:31:04 user nova-compute[74840]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 (non-flash)
Nov 08 12:31:04 user nova-compute[74840]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)
Nov 08 12:31:04 user nova-compute[74840]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 (non-flash)
Nov 08 12:31:04 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:31:04 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:31:04 user nova-compute[74840]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 (non-flash)
Nov 08 12:31:04 user nova-compute[74840]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)
Nov 08 12:31:04 user nova-compute[74840]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 (non-flash)
Nov 08 12:31:04 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:31:04 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7ec342830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321'): ({'sdd'}, set())}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 12:31:04 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Removing single pathed devices sdd {{(pid=74840) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 12:31:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:04 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[68bbbb52-bb75-4ec0-bd79-c7ccd387d5ac]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:04 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8beac61-3c87-45e6-9b35-a8c493e5d915]: (4, ('ok\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:04 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Flushing IO for device /dev/sdd {{(pid=74840) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 12:31:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:04 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[095ad2fd-796a-41cc-b6a8-b1d6541e0a48]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:04 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74840) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 12:31:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.068s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:04 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf767371-1a16-4507-ab04-a7c2799d3085]: (4, ('1', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:04 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 12:31:04 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] SCSI volumes sdd have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 12:31:04 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321')] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 12:31:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:04 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5209a78-5159-4662-9b68-3199f5b0d347]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:04 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:31:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 -p 172.16.0.220:3260 --logout {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:04 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[23904058-e067-4d98-9be1-84d4b08b309b]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:04 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321, portal: 172.16.0.220,3260]
Nov 08 12:31:04 user nova-compute[74840]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321, portal: 172.16.0.220,3260] successful.
Nov 08 12:31:04 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:31:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 -p 172.16.0.220:3260 --op delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:04 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:04 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8745c29a-d0dd-494e-8cd1-bbe68747b089]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:04 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:31:04 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.389s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:31:04 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] <== disconnect_volume: return (390ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:31:04 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 12:31:04 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:31:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "83da3dce-e270-4054-910d-c8ad28eb18da" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:31:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "83da3dce-e270-4054-910d-c8ad28eb18da" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:31:05 user nova-compute[74840]: DEBUG nova.compute.manager [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Starting instance... {{(pid=74840) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 12:31:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:31:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:31:05 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:31:05 user nova-compute[74840]: INFO nova.compute.claims [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Claim successful on node user
Nov 08 12:31:05 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Refreshing inventories for resource provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 12:31:05 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Updating ProviderTree inventory for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 12:31:05 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Updating inventory in ProviderTree for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 12:31:05 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Refreshing aggregate associations for resource provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e, aggregates: None {{(pid=74840) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 12:31:05 user nova-compute[74840]: DEBUG nova.compute.manager [req-66f140bc-711c-40a9-a1cd-b6e3567a7b6f req-fbd93dbf-8124-4d31-bf30-a577ccc1d2d7 service nova] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Received event network-vif-plugged-e0c27d11-afc7-4e26-8024-d4c7ad9a6baf {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:31:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-66f140bc-711c-40a9-a1cd-b6e3567a7b6f req-fbd93dbf-8124-4d31-bf30-a577ccc1d2d7 service nova] Acquiring lock "e3175752-45a5-43e3-a99a-9377440e7bea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:31:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-66f140bc-711c-40a9-a1cd-b6e3567a7b6f req-fbd93dbf-8124-4d31-bf30-a577ccc1d2d7 service nova] Lock "e3175752-45a5-43e3-a99a-9377440e7bea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:31:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-66f140bc-711c-40a9-a1cd-b6e3567a7b6f req-fbd93dbf-8124-4d31-bf30-a577ccc1d2d7 service nova] Lock "e3175752-45a5-43e3-a99a-9377440e7bea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:31:05 user nova-compute[74840]: DEBUG nova.compute.manager [req-66f140bc-711c-40a9-a1cd-b6e3567a7b6f req-fbd93dbf-8124-4d31-bf30-a577ccc1d2d7 service nova] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] No waiting events found dispatching network-vif-plugged-e0c27d11-afc7-4e26-8024-d4c7ad9a6baf {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:31:05 user nova-compute[74840]: WARNING nova.compute.manager [req-66f140bc-711c-40a9-a1cd-b6e3567a7b6f req-fbd93dbf-8124-4d31-bf30-a577ccc1d2d7 service nova] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Received unexpected event network-vif-plugged-e0c27d11-afc7-4e26-8024-d4c7ad9a6baf for instance with vm_state active and task_state rebuilding.
Nov 08 12:31:05 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Refreshing trait associations for resource provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=74840) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 12:31:05 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:31:05 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.693s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG nova.compute.manager [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Start building networks asynchronously for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG nova.compute.manager [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Allocating IP information in the background. {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG nova.network.neutron [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 12:31:06 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 12:31:06 user nova-compute[74840]: DEBUG nova.compute.manager [req-dcae956f-795c-4350-9c09-1526cdddc962 req-80e6f9d8-aa78-46db-92c3-bc7b8a713b37 service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Received event network-changed-4d351123-6297-4be2-808d-50cdbe9e3aa6 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG nova.compute.manager [req-dcae956f-795c-4350-9c09-1526cdddc962 req-80e6f9d8-aa78-46db-92c3-bc7b8a713b37 service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Refreshing instance network info cache due to event network-changed-4d351123-6297-4be2-808d-50cdbe9e3aa6. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-dcae956f-795c-4350-9c09-1526cdddc962 req-80e6f9d8-aa78-46db-92c3-bc7b8a713b37 service nova] Acquiring lock "refresh_cache-a2c4fc63-0757-46da-ad00-7b6c6513deca" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-dcae956f-795c-4350-9c09-1526cdddc962 req-80e6f9d8-aa78-46db-92c3-bc7b8a713b37 service nova] Acquired lock "refresh_cache-a2c4fc63-0757-46da-ad00-7b6c6513deca" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG nova.network.neutron [req-dcae956f-795c-4350-9c09-1526cdddc962 req-80e6f9d8-aa78-46db-92c3-bc7b8a713b37 service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Refreshing network info cache for port 4d351123-6297-4be2-808d-50cdbe9e3aa6 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG nova.compute.manager [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Start building block device mappings for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 12:31:06 user nova-compute[74840]: INFO nova.virt.block_device [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Booting with volume 3633e924-8440-44ef-8902-fdceb5a4787b at /dev/vda
Nov 08 12:31:06 user nova-compute[74840]: DEBUG nova.policy [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '794c0281e1bf48f79117efdc3907e661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1250106b55ae44b0b303849df7781ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG os_brick.utils [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3293cd1a-b115-4150-aa05-4f75885515de]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c8228a11e03c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a872b4-2346-482d-a47b-cf7246f3bfab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a453477a-e56e-432e-9274-5aa8d533a509]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa81b2e0-4a8a-4ca8-aa53-f8d1ac972081]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Running cmd (subprocess): nvme version {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] 'nvme version' failed. Not Retrying. {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.nvmeof [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] nvme not present on system {{(pid=74840) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c708c19d-6ccb-4332-aebc-052ae1b4ec83 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Acquiring lock "a2c4fc63-0757-46da-ad00-7b6c6513deca" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c708c19d-6ccb-4332-aebc-052ae1b4ec83 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "a2c4fc63-0757-46da-ad00-7b6c6513deca" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:31:06 user nova-compute[74840]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 12:31:06 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[36135c4d-f6e0-434d-a9ef-6998ceeb2440]: (4, '') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74840) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] LIGHTOS: no hostnqn found. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG os_brick.utils [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c8228a11e03c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG nova.virt.block_device [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Updating existing volume attachment record: 54f17769-f4fb-496b-9945-8672a6fd0fd5 {{(pid=74840) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG nova.objects.instance [None req-c708c19d-6ccb-4332-aebc-052ae1b4ec83 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lazy-loading 'flavor' on Instance uuid a2c4fc63-0757-46da-ad00-7b6c6513deca {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c708c19d-6ccb-4332-aebc-052ae1b4ec83 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "a2c4fc63-0757-46da-ad00-7b6c6513deca" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.084s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG nova.network.neutron [req-dcae956f-795c-4350-9c09-1526cdddc962 req-80e6f9d8-aa78-46db-92c3-bc7b8a713b37 service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Updated VIF entry in instance network info cache for port 4d351123-6297-4be2-808d-50cdbe9e3aa6. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG nova.network.neutron [req-dcae956f-795c-4350-9c09-1526cdddc962 req-80e6f9d8-aa78-46db-92c3-bc7b8a713b37 service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Updating instance_info_cache with network_info: [{"id": "4d351123-6297-4be2-808d-50cdbe9e3aa6", "address": "fa:16:3e:4e:0c:f0", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d351123-62", "ovs_interfaceid": "4d351123-6297-4be2-808d-50cdbe9e3aa6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-dcae956f-795c-4350-9c09-1526cdddc962 req-80e6f9d8-aa78-46db-92c3-bc7b8a713b37 service nova] Releasing lock "refresh_cache-a2c4fc63-0757-46da-ad00-7b6c6513deca" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c708c19d-6ccb-4332-aebc-052ae1b4ec83 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Acquiring lock "a2c4fc63-0757-46da-ad00-7b6c6513deca" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c708c19d-6ccb-4332-aebc-052ae1b4ec83 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "a2c4fc63-0757-46da-ad00-7b6c6513deca" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:31:06 user nova-compute[74840]: INFO nova.compute.manager [None req-c708c19d-6ccb-4332-aebc-052ae1b4ec83 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Attaching volume 5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 to /dev/vdb
Nov 08 12:31:06 user nova-compute[74840]: DEBUG os_brick.utils [None req-c708c19d-6ccb-4332-aebc-052ae1b4ec83 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f42ed0-7263-4350-85b3-449cd668e91e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c8228a11e03c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c5a9c7-415e-4991-98d5-bf015b82c23a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[697b8293-1e55-4073-a45e-4b99e9a8e313]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2bf322-f79b-4a7b-88fb-230336e478c7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-c708c19d-6ccb-4332-aebc-052ae1b4ec83 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Running cmd (subprocess): nvme version {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-c708c19d-6ccb-4332-aebc-052ae1b4ec83 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] 'nvme version' failed. Not Retrying. {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c708c19d-6ccb-4332-aebc-052ae1b4ec83 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] nvme not present on system {{(pid=74840) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:31:06 user nova-compute[74840]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 12:31:06 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[526f225a-9bd6-4bac-92c8-469cf3c48adc]: (4, '') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-c708c19d-6ccb-4332-aebc-052ae1b4ec83 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74840) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-c708c19d-6ccb-4332-aebc-052ae1b4ec83 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-c708c19d-6ccb-4332-aebc-052ae1b4ec83 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] LIGHTOS: no hostnqn found. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG os_brick.utils [None req-c708c19d-6ccb-4332-aebc-052ae1b4ec83 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c8228a11e03c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG nova.virt.block_device [None req-c708c19d-6ccb-4332-aebc-052ae1b4ec83 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Updating existing volume attachment record: 9d673ffc-ffd1-4fed-8135-a5707febfe5d {{(pid=74840) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 12:31:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:07 user nova-compute[74840]: DEBUG nova.network.neutron [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Successfully created port: c2a4679c-207f-4dfa-9209-f1a4d7d70834 {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:31:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:08 user nova-compute[74840]: DEBUG nova.network.neutron [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Successfully updated port: c2a4679c-207f-4dfa-9209-f1a4d7d70834 {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:31:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "refresh_cache-83da3dce-e270-4054-910d-c8ad28eb18da" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:31:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquired lock "refresh_cache-83da3dce-e270-4054-910d-c8ad28eb18da" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:31:08 user nova-compute[74840]: DEBUG nova.network.neutron [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:31:08 user nova-compute[74840]: DEBUG nova.compute.manager [req-0a180012-13b1-474f-a81d-24731649768c req-671be595-f456-4ba4-8275-30a9fe8d3ba0 service nova] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Received event network-changed-c2a4679c-207f-4dfa-9209-f1a4d7d70834 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:31:08 user nova-compute[74840]: DEBUG nova.compute.manager [req-0a180012-13b1-474f-a81d-24731649768c req-671be595-f456-4ba4-8275-30a9fe8d3ba0 service nova] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Refreshing instance network info cache due to event network-changed-c2a4679c-207f-4dfa-9209-f1a4d7d70834. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:31:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0a180012-13b1-474f-a81d-24731649768c req-671be595-f456-4ba4-8275-30a9fe8d3ba0 service nova] Acquiring lock "refresh_cache-83da3dce-e270-4054-910d-c8ad28eb18da" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:31:08 user nova-compute[74840]: DEBUG nova.network.neutron [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:31:08 user nova-compute[74840]: DEBUG nova.network.neutron [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Updating instance_info_cache with network_info: [{"id": "c2a4679c-207f-4dfa-9209-f1a4d7d70834", "address": "fa:16:3e:4e:da:51", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a4679c-20", "ovs_interfaceid": "c2a4679c-207f-4dfa-9209-f1a4d7d70834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:31:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Releasing lock "refresh_cache-83da3dce-e270-4054-910d-c8ad28eb18da" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:31:08 user nova-compute[74840]: DEBUG nova.compute.manager [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Instance network_info: |[{"id": "c2a4679c-207f-4dfa-9209-f1a4d7d70834", "address": "fa:16:3e:4e:da:51", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a4679c-20", "ovs_interfaceid": "c2a4679c-207f-4dfa-9209-f1a4d7d70834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 12:31:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0a180012-13b1-474f-a81d-24731649768c req-671be595-f456-4ba4-8275-30a9fe8d3ba0 service nova] Acquired lock "refresh_cache-83da3dce-e270-4054-910d-c8ad28eb18da" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:31:08 user nova-compute[74840]: DEBUG nova.network.neutron [req-0a180012-13b1-474f-a81d-24731649768c req-671be595-f456-4ba4-8275-30a9fe8d3ba0 service nova] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Refreshing network info cache for port c2a4679c-207f-4dfa-9209-f1a4d7d70834 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:31:08 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:31:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:31:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:31:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:31:08 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:31:08 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:31:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c4fc63-0757-46da-ad00-7b6c6513deca/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:09 user nova-compute[74840]: DEBUG nova.network.neutron [req-0a180012-13b1-474f-a81d-24731649768c req-671be595-f456-4ba4-8275-30a9fe8d3ba0 service nova] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Updated VIF entry in instance network info cache for port c2a4679c-207f-4dfa-9209-f1a4d7d70834. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:31:09 user nova-compute[74840]: DEBUG nova.network.neutron [req-0a180012-13b1-474f-a81d-24731649768c req-671be595-f456-4ba4-8275-30a9fe8d3ba0 service nova] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Updating instance_info_cache with network_info: [{"id": "c2a4679c-207f-4dfa-9209-f1a4d7d70834", "address": "fa:16:3e:4e:da:51", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a4679c-20", "ovs_interfaceid": "c2a4679c-207f-4dfa-9209-f1a4d7d70834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:31:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0a180012-13b1-474f-a81d-24731649768c req-671be595-f456-4ba4-8275-30a9fe8d3ba0 service nova] Releasing lock "refresh_cache-83da3dce-e270-4054-910d-c8ad28eb18da" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:31:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c4fc63-0757-46da-ad00-7b6c6513deca/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c4fc63-0757-46da-ad00-7b6c6513deca/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c4fc63-0757-46da-ad00-7b6c6513deca/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:09 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Instance destroyed successfully.
Nov 08 12:31:09 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:28:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-199314448',display_name='tempest-ServerActionsTestOtherA-server-137189190',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-199314448',id=35,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSNrYheJ8Lzn3ZHvNUQvlNC/AEkaeIt4FFfFZ6MDZZKThsvIjNiHNZVHlAFC+XE6iHCrr/eoF+btmdxSZwQV3WJpatsIGdnvZUn9Tn2nZPQiFTZnNkVsedEjHcwcaa0jw==',key_name='tempest-keypair-1203623053',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:28:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5e47ef156b3649839ff728eaf23121da',ramdisk_id='',reservation_id='r-qttfimk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-401855506',owner_user_name='tempest-ServerActionsTestOtherA-401855506-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:31:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a49f88cb74c47bdb9a35883adbae454',uuid=e3175752-45a5-43e3-a99a-9377440e7bea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e0c27d11-afc7-4e26-8024-d4c7ad9a6baf", "address": "fa:16:3e:86:18:09", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0c27d11-af", "ovs_interfaceid": "e0c27d11-afc7-4e26-8024-d4c7ad9a6baf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:31:09 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Converting VIF {"id": "e0c27d11-afc7-4e26-8024-d4c7ad9a6baf", "address": "fa:16:3e:86:18:09", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0c27d11-af", "ovs_interfaceid": "e0c27d11-afc7-4e26-8024-d4c7ad9a6baf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:31:09 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:18:09,bridge_name='br-int',has_traffic_filtering=True,id=e0c27d11-afc7-4e26-8024-d4c7ad9a6baf,network=Network(e92448c4-9bc0-424b-a07f-a398ac46fada),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0c27d11-af') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:31:09 user nova-compute[74840]: DEBUG os_vif [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:18:09,bridge_name='br-int',has_traffic_filtering=True,id=e0c27d11-afc7-4e26-8024-d4c7ad9a6baf,network=Network(e92448c4-9bc0-424b-a07f-a398ac46fada),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0c27d11-af') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:31:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape0c27d11-af, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:31:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:31:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9e1988eb-4a8c-49c5-aeaa-9abbaafa02b4) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:31:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:09 user nova-compute[74840]: INFO os_vif [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:18:09,bridge_name='br-int',has_traffic_filtering=True,id=e0c27d11-afc7-4e26-8024-d4c7ad9a6baf,network=Network(e92448c4-9bc0-424b-a07f-a398ac46fada),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0c27d11-af')
Nov 08 12:31:09 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 12:31:09 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cxshviGp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:31:09 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 12:31:09 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:31:09 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:31:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:09 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e6ce4f-62b9-4a24-ad9c-88a963b52f40]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:09 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 12:31:09 user nova-compute[74840]: No targets found.
Nov 08 12:31:09 user nova-compute[74840]: iSNS:
Nov 08 12:31:09 user nova-compute[74840]: No targets found.
Nov 08 12:31:09 user nova-compute[74840]: STATIC:
Nov 08 12:31:09 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c
Nov 08 12:31:09 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:31:09 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:31:09 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4
Nov 08 12:31:09 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:31:09 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:31:09 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60
Nov 08 12:31:09 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:31:09 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:31:09 user nova-compute[74840]: FIRMWARE:
Nov 08 12:31:09 user nova-compute[74840]: No targets found.
Nov 08 12:31:09 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:31:09 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 12:31:09 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 12:31:09 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 12:31:09 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 12:31:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:09 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[460cb4b6-aa10-4f7b-9d3b-cfb6e732fc01]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:09 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6894bbb-3ec9-4d98-95b8-96ebd5b4c413]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:09 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:31:09 user nova-compute[74840]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 (non-flash)
Nov 08 12:31:09 user nova-compute[74840]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)
Nov 08 12:31:09 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:31:09 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:31:09 user nova-compute[74840]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 (non-flash)
Nov 08 12:31:09 user nova-compute[74840]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)
Nov 08 12:31:09 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:31:09 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7f458ed40>, {}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 12:31:09 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Disconnecting from: [] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 12:31:09 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.095s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:31:09 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] <== disconnect_volume: return (97ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:31:09 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 12:31:09 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Deleting instance files /opt/stack/data/nova/instances/e3175752-45a5-43e3-a99a-9377440e7bea_del
Nov 08 12:31:09 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Deletion of /opt/stack/data/nova/instances/e3175752-45a5-43e3-a99a-9377440e7bea_del complete
Nov 08 12:31:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:09 user nova-compute[74840]: INFO nova.virt.block_device [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Booting with volume 67de400a-4361-4d2c-b9f0-a17af7822321 at /dev/vdb
Nov 08 12:31:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:10 user nova-compute[74840]: DEBUG os_brick.utils [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:31:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:10 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d47c3d-b0fc-453a-9d0e-cfee6875ff73]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c8228a11e03c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:10 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dee040f-221e-448c-b96e-eca3beb8cfdb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:10 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffde987-2039-4607-8044-fc4b390b563e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:10 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48c49a3-13f9-4c0d-b1d3-db00b3628b4a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Running cmd (subprocess): nvme version {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] 'nvme version' failed. Not Retrying. {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:31:10 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] nvme not present on system {{(pid=74840) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 12:31:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:31:10 user nova-compute[74840]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 12:31:10 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66866ce-6018-4808-bfc6-ff7f14a9baf9]: (4, '') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:10 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74840) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 12:31:10 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 12:31:10 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] LIGHTOS: no hostnqn found. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 12:31:10 user nova-compute[74840]: DEBUG os_brick.utils [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c8228a11e03c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:31:10 user nova-compute[74840]: DEBUG nova.virt.block_device [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Updating existing volume attachment record: bf16a7c6-f251-4848-9535-6d7377d85625 {{(pid=74840) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 12:31:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json" returned: 0 in 0.266s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json" returned: 0 in 0.237s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcf7b89-a5ca-47ab-a4c9-878f53086de1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcf7b89-a5ca-47ab-a4c9-878f53086de1/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcf7b89-a5ca-47ab-a4c9-878f53086de1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcf7b89-a5ca-47ab-a4c9-878f53086de1/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:11 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:31:11 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Error from libvirt while getting description of instance-00000023: [Error Code 42] Domain not found: no domain with matching uuid 'e3175752-45a5-43e3-a99a-9377440e7bea' (instance-00000023): libvirt.libvirtError: Domain not found: no domain with matching uuid 'e3175752-45a5-43e3-a99a-9377440e7bea' (instance-00000023)
Nov 08 12:31:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:12 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:12 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:12 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:12 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:12 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:12 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:31:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:13 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:31:13 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:31:13 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=7810MB free_disk=24.869998931884766GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:31:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:31:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:31:13 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance d3e8efc6-7146-46ef-8433-380d7e69120c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:31:13 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance ffe50042-29bf-4ef3-a148-8698bc75233b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:31:13 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 8b7c490e-4c78-4e07-bc8a-3be2328963d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:31:13 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 832a6445-84ee-43a8-a5bc-a07670602912 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:31:13 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 10c42516-62ba-4aa9-bc5a-d94499bd6b65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:31:13 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 9991e7b4-aaf8-4485-b658-e1af634925de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:31:13 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance e3175752-45a5-43e3-a99a-9377440e7bea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:31:13 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 4dcf7b89-a5ca-47ab-a4c9-878f53086de1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:31:13 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance a2c4fc63-0757-46da-ad00-7b6c6513deca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:31:13 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:31:13 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 83da3dce-e270-4054-910d-c8ad28eb18da actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:31:13 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:31:13 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:31:13 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:31:13 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:31:13 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:31:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.908s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:31:14 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:26 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:31:29 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:31 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c708c19d-6ccb-4332-aebc-052ae1b4ec83 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Calling os-brick to attach iSCSI Volume {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 12:31:31 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c708c19d-6ccb-4332-aebc-052ae1b4ec83 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JjnGargI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:31:31 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-c708c19d-6ccb-4332-aebc-052ae1b4ec83 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:31:31 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-c708c19d-6ccb-4332-aebc-052ae1b4ec83 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:31:31 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-c708c19d-6ccb-4332-aebc-052ae1b4ec83 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:31:31 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-c708c19d-6ccb-4332-aebc-052ae1b4ec83 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:31:31 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-c708c19d-6ccb-4332-aebc-052ae1b4ec83 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:31:31 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-c708c19d-6ccb-4332-aebc-052ae1b4ec83 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:31:31 user nova-compute[74840]: INFO os_brick.initiator.connectors.iscsi [None req-c708c19d-6ccb-4332-aebc-052ae1b4ec83 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 12:31:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 -p 172.16.0.220:3260 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:31 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed3ff15-0e1c-4667-9739-f1feb1548249]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:31 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c708c19d-6ccb-4332-aebc-052ae1b4ec83 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 12:31:31 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:31:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:31 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[342751d2-e252-481e-9e6b-481ac5447275]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2] added\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:31 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c708c19d-6ccb-4332-aebc-052ae1b4ec83 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2] added
Nov 08 12:31:31 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:31:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:31 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8188e7b6-5da1-49bc-97d9-89031085926d]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:31 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c708c19d-6ccb-4332-aebc-052ae1b4ec83 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:31:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:31 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[487b04a1-eaac-409a-92c1-c8f3fcf838d2]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:31 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c708c19d-6ccb-4332-aebc-052ae1b4ec83 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:31:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JjnGargI {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JjnGargI" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:31 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6495ca2-e33a-4a4c-a552-1eab4256886d]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:31 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c708c19d-6ccb-4332-aebc-052ae1b4ec83 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JjnGargI'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:31:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:31 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8790e4ab-8fee-4f53-adc4-4dfdc62e1675]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:31 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c708c19d-6ccb-4332-aebc-052ae1b4ec83 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:31:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:31 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cacf9cd-ca9d-4e41-ab74-e783d0e51c2f]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:31 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c708c19d-6ccb-4332-aebc-052ae1b4ec83 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:31:31 user nova-compute[74840]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 (non-flash)
Nov 08 12:31:31 user nova-compute[74840]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)
Nov 08 12:31:31 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:31:31 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c708c19d-6ccb-4332-aebc-052ae1b4ec83 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:31:31 user nova-compute[74840]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 (non-flash)
Nov 08 12:31:31 user nova-compute[74840]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)
Nov 08 12:31:31 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:31:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 -p 172.16.0.220:3260 --login {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:31 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[0173363b-742b-47c0-9a65-9166e9a0e675]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:31 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c708c19d-6ccb-4332-aebc-052ae1b4ec83 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2, portal: 172.16.0.220,3260]
Nov 08 12:31:31 user nova-compute[74840]: Login to [iface: default, target: iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2, portal: 172.16.0.220,3260] successful.
Nov 08 12:31:31 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:31:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:32 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[2feb9091-004e-4064-ba28-668533ec4ba1]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:32 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c708c19d-6ccb-4332-aebc-052ae1b4ec83 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:31:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:32 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d39a90-054a-43f2-ab73-778f3fe26b8d]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:32 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c708c19d-6ccb-4332-aebc-052ae1b4ec83 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:31:32 user nova-compute[74840]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 (non-flash)
Nov 08 12:31:32 user nova-compute[74840]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)
Nov 08 12:31:32 user nova-compute[74840]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 (non-flash)
Nov 08 12:31:32 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:31:32 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c708c19d-6ccb-4332-aebc-052ae1b4ec83 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:31:32 user nova-compute[74840]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 (non-flash)
Nov 08 12:31:32 user nova-compute[74840]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)
Nov 08 12:31:32 user nova-compute[74840]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 (non-flash)
Nov 08 12:31:32 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:31:32 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-c708c19d-6ccb-4332-aebc-052ae1b4ec83 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.642s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:31:32 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c708c19d-6ccb-4332-aebc-052ae1b4ec83 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Connected to 172.16.0.220:3260 {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 12:31:32 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-c708c19d-6ccb-4332-aebc-052ae1b4ec83 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=74840) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 12:31:32 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-c708c19d-6ccb-4332-aebc-052ae1b4ec83 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74840) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 12:31:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:32 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2777527-6bd1-4423-9fc2-bc67826eebec]: (4, ('- - 0', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:32 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-c708c19d-6ccb-4332-aebc-052ae1b4ec83 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:31:32 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c708c19d-6ccb-4332-aebc-052ae1b4ec83 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JjnGargI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 12:31:32 user nova-compute[74840]: DEBUG nova.compute.manager [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Start spawning the instance on the hypervisor. {{(pid=74840) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 12:31:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:31:32 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Creating image(s)
Nov 08 12:31:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Did not create local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 12:31:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Ensure instance console log exists: /opt/stack/data/nova/instances/83da3dce-e270-4054-910d-c8ad28eb18da/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:31:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:31:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:31:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:31:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Start _get_guest_xml network_info=[{"id": "c2a4679c-207f-4dfa-9209-f1a4d7d70834", "address": "fa:16:3e:4e:da:51", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a4679c-20", "ovs_interfaceid": "c2a4679c-207f-4dfa-9209-f1a4d7d70834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '54f17769-f4fb-496b-9945-8672a6fd0fd5', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AXqwMDBP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '83da3dce-e270-4054-910d-c8ad28eb18da', 'attached_at': '', 'detached_at': '', 'volume_id': '3633e924-8440-44ef-8902-fdceb5a4787b', 'serial': '3633e924-8440-44ef-8902-fdceb5a4787b'}, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:31:32 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:31:32 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:31:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:31:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:31:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:31:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:31:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:31:32 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:31:32 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:31:32 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:31:32 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:31:32 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:31:32 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:31:32 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:31:32 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:31:32 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:31:32 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:31:32 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:31:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Calling os-brick to attach iSCSI Volume {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 12:31:32 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AXqwMDBP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:31:32 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:31:32 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-c708c19d-6ccb-4332-aebc-052ae1b4ec83 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.681s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c708c19d-6ccb-4332-aebc-052ae1b4ec83 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] <== connect_volume: return (1684ms) {'type': 'block', 'scsi_wwn': '23838653834626332', 'path': '/dev/sdd'} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c708c19d-6ccb-4332-aebc-052ae1b4ec83 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838653834626332', 'path': '/dev/sdd'} {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.889s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:31:33 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:31:33 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:31:33 user nova-compute[74840]: INFO os_brick.initiator.connectors.iscsi [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 12:31:33 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b -p 172.16.0.220:3260 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG nova.objects.instance [None req-c708c19d-6ccb-4332-aebc-052ae1b4ec83 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lazy-loading 'flavor' on Instance uuid a2c4fc63-0757-46da-ad00-7b6c6513deca {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[148c7339-62d1-47d5-aaf8-56ea4ed471a9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 12:31:33 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b -p 172.16.0.220:3260 --interface default --op new {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-c708c19d-6ccb-4332-aebc-052ae1b4ec83 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 12:31:33 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:31:33 user nova-compute[74840]:   <source dev="/dev/sdd"/>
Nov 08 12:31:33 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:31:33 user nova-compute[74840]:   <serial>5cbf13b2-dd3d-45b7-b02d-45d78966d7f2</serial>
Nov 08 12:31:33 user nova-compute[74840]: </disk>
Nov 08 12:31:33 user nova-compute[74840]:  {{(pid=74840) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a42ce36-da85-49fb-99b6-b81f6a597b8b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b] added\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b] added
Nov 08 12:31:33 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce4eb30-2254-4ccb-88fb-d13882fcd086]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc475519-31dc-4c25-b62d-8223417d753c]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AXqwMDBP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AXqwMDBP" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f5c6f8-b544-4d06-a865-bc1e7c5bd863]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AXqwMDBP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3158f57-d724-4bf2-a570-d8948e54887f]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c59b6ab-668e-4857-a22c-ea4704f71e5f]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:31:33 user nova-compute[74840]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 (non-flash)
Nov 08 12:31:33 user nova-compute[74840]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)
Nov 08 12:31:33 user nova-compute[74840]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 (non-flash)
Nov 08 12:31:33 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:31:33 user nova-compute[74840]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 (non-flash)
Nov 08 12:31:33 user nova-compute[74840]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)
Nov 08 12:31:33 user nova-compute[74840]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 (non-flash)
Nov 08 12:31:33 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b -p 172.16.0.220:3260 --login {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b -p 172.16.0.220:3260 --login" returned: 0 in 0.109s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[24744c6d-8b6c-45a9-86ee-a65faefd7f99]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b, portal: 172.16.0.220,3260]
Nov 08 12:31:33 user nova-compute[74840]: Login to [iface: default, target: iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b, portal: 172.16.0.220,3260] successful.
Nov 08 12:31:33 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c43bbdb-f4d7-438b-adf8-1a0e0b92e41a]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a402769-4f6c-45d2-88d8-c6149ec90a91]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:31:33 user nova-compute[74840]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 (non-flash)
Nov 08 12:31:33 user nova-compute[74840]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)
Nov 08 12:31:33 user nova-compute[74840]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 (non-flash)
Nov 08 12:31:33 user nova-compute[74840]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)
Nov 08 12:31:33 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:31:33 user nova-compute[74840]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 (non-flash)
Nov 08 12:31:33 user nova-compute[74840]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)
Nov 08 12:31:33 user nova-compute[74840]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 (non-flash)
Nov 08 12:31:33 user nova-compute[74840]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)
Nov 08 12:31:33 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.396s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Connected to 172.16.0.220:3260 {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] HCTL ('36', '-', '-', 0) found on session 38 with lun 0 {{(pid=74840) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74840) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Acquiring lock "7a482219-16ac-49e2-84ad-7e2030c97184" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "7a482219-16ac-49e2-84ad-7e2030c97184" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff32f9e3-bc6a-48a8-b8f8-82acc425123b]: (4, ('- - 0', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Searching for a device in session 38 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AXqwMDBP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG nova.compute.manager [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Starting instance... {{(pid=74840) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-c708c19d-6ccb-4332-aebc-052ae1b4ec83 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-c708c19d-6ccb-4332-aebc-052ae1b4ec83 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-c708c19d-6ccb-4332-aebc-052ae1b4ec83 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] No VIF found with MAC fa:16:3e:4e:0c:f0, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:31:33 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:31:33 user nova-compute[74840]: INFO nova.compute.claims [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Claim successful on node user
Nov 08 12:31:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c708c19d-6ccb-4332-aebc-052ae1b4ec83 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "a2c4fc63-0757-46da-ad00-7b6c6513deca" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.052s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:31:34 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:31:34 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:31:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.483s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:31:34 user nova-compute[74840]: DEBUG nova.compute.manager [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Start building networks asynchronously for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 12:31:34 user nova-compute[74840]: DEBUG nova.compute.manager [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Allocating IP information in the background. {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 12:31:34 user nova-compute[74840]: DEBUG nova.network.neutron [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 12:31:34 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 12:31:34 user nova-compute[74840]: DEBUG nova.compute.manager [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Start building block device mappings for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 12:31:34 user nova-compute[74840]: DEBUG nova.policy [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '719ac4d31ae447a6a04c1c62c0a73191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d52e18e8e41dfa50aa5aff1f40c6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 12:31:34 user nova-compute[74840]: DEBUG nova.compute.manager [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Start spawning the instance on the hypervisor. {{(pid=74840) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 12:31:34 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:31:34 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Creating image(s)
Nov 08 12:31:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Acquiring lock "/opt/stack/data/nova/instances/7a482219-16ac-49e2-84ad-7e2030c97184/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:31:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "/opt/stack/data/nova/instances/7a482219-16ac-49e2-84ad-7e2030c97184/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:31:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "/opt/stack/data/nova/instances/7a482219-16ac-49e2-84ad-7e2030c97184/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:31:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.438s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:31:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] <== connect_volume: return (2328ms) {'type': 'block', 'scsi_wwn': '26639643364376637', 'path': '/dev/sde'} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:31:34 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639643364376637', 'path': '/dev/sde'} {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 12:31:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.199s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Acquiring lock "5d26578eba85497f494c575690c4248f381a0fe6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:31:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:31:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:34 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:31:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-52209854',display_name='tempest-TestVolumeBootPattern-server-52209854',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-52209854',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDnf/rgNeauxsdXCuQeVAa6oJl7IvXSpNN83Cdo1qtwT4P0g8IuWhFw/l+HOo44zetcJEHbPUEQ14N2qnoFV4I4QWYhF+y8Gsgf65CRdUjmUlU4hjQG+QvZzqapWj/SBg==',key_name='tempest-TestVolumeBootPattern-1773717711',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1250106b55ae44b0b303849df7781ffb',ramdisk_id='',reservation_id='r-to05psnh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-77780905',owner_user_name='tempest-TestVolumeBootPattern-77780905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:31:06Z,user_data=None,user_id='794c0281e1bf48f79117efdc3907e661',uuid=83da3dce-e270-4054-910d-c8ad28eb18da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2a4679c-207f-4dfa-9209-f1a4d7d70834", "address": "fa:16:3e:4e:da:51", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a4679c-20", "ovs_interfaceid": "c2a4679c-207f-4dfa-9209-f1a4d7d70834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:31:34 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Converting VIF {"id": "c2a4679c-207f-4dfa-9209-f1a4d7d70834", "address": "fa:16:3e:4e:da:51", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a4679c-20", "ovs_interfaceid": "c2a4679c-207f-4dfa-9209-f1a4d7d70834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:31:34 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:da:51,bridge_name='br-int',has_traffic_filtering=True,id=c2a4679c-207f-4dfa-9209-f1a4d7d70834,network=Network(174da5e9-78cc-426f-87fb-1d3b23b8b459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2a4679c-20') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:31:34 user nova-compute[74840]: DEBUG nova.objects.instance [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lazy-loading 'pci_devices' on Instance uuid 83da3dce-e270-4054-910d-c8ad28eb18da {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:31:34 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:31:34 user nova-compute[74840]:   <uuid>83da3dce-e270-4054-910d-c8ad28eb18da</uuid>
Nov 08 12:31:34 user nova-compute[74840]:   <name>instance-00000026</name>
Nov 08 12:31:34 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:31:34 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:31:34 user nova-compute[74840]:   <metadata>
Nov 08 12:31:34 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:31:34 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:31:34 user nova-compute[74840]:       <nova:name>tempest-TestVolumeBootPattern-server-52209854</nova:name>
Nov 08 12:31:34 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:31:32</nova:creationTime>
Nov 08 12:31:34 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:31:34 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:31:34 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:31:34 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:31:34 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:31:34 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:31:34 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:31:34 user nova-compute[74840]:       <nova:owner>
Nov 08 12:31:34 user nova-compute[74840]:         <nova:user uuid="794c0281e1bf48f79117efdc3907e661">tempest-TestVolumeBootPattern-77780905-project-member</nova:user>
Nov 08 12:31:34 user nova-compute[74840]:         <nova:project uuid="1250106b55ae44b0b303849df7781ffb">tempest-TestVolumeBootPattern-77780905</nova:project>
Nov 08 12:31:34 user nova-compute[74840]:       </nova:owner>
Nov 08 12:31:34 user nova-compute[74840]:       <nova:ports>
Nov 08 12:31:34 user nova-compute[74840]:         <nova:port uuid="c2a4679c-207f-4dfa-9209-f1a4d7d70834">
Nov 08 12:31:34 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 12:31:34 user nova-compute[74840]:         </nova:port>
Nov 08 12:31:34 user nova-compute[74840]:       </nova:ports>
Nov 08 12:31:34 user nova-compute[74840]:     </nova:instance>
Nov 08 12:31:34 user nova-compute[74840]:   </metadata>
Nov 08 12:31:34 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:31:34 user nova-compute[74840]:     <system>
Nov 08 12:31:34 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:31:34 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:31:34 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:31:34 user nova-compute[74840]:       <entry name="serial">83da3dce-e270-4054-910d-c8ad28eb18da</entry>
Nov 08 12:31:34 user nova-compute[74840]:       <entry name="uuid">83da3dce-e270-4054-910d-c8ad28eb18da</entry>
Nov 08 12:31:34 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:31:34 user nova-compute[74840]:     </system>
Nov 08 12:31:34 user nova-compute[74840]:   </sysinfo>
Nov 08 12:31:34 user nova-compute[74840]:   <os>
Nov 08 12:31:34 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:31:34 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:31:34 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:31:34 user nova-compute[74840]:   </os>
Nov 08 12:31:34 user nova-compute[74840]:   <features>
Nov 08 12:31:34 user nova-compute[74840]:     <acpi/>
Nov 08 12:31:34 user nova-compute[74840]:     <apic/>
Nov 08 12:31:34 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:31:34 user nova-compute[74840]:   </features>
Nov 08 12:31:34 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:31:34 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:31:34 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:31:34 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:31:34 user nova-compute[74840]:   </clock>
Nov 08 12:31:34 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:31:34 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:31:34 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:31:34 user nova-compute[74840]:   </cpu>
Nov 08 12:31:34 user nova-compute[74840]:   <devices>
Nov 08 12:31:34 user nova-compute[74840]:     <disk type="block" device="disk">
Nov 08 12:31:34 user nova-compute[74840]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:31:34 user nova-compute[74840]:       <source dev="/dev/sde"/>
Nov 08 12:31:34 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:31:34 user nova-compute[74840]:       <serial>3633e924-8440-44ef-8902-fdceb5a4787b</serial>
Nov 08 12:31:34 user nova-compute[74840]:     </disk>
Nov 08 12:31:34 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:31:34 user nova-compute[74840]:       <mac address="fa:16:3e:4e:da:51"/>
Nov 08 12:31:34 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:31:34 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:31:34 user nova-compute[74840]:       <target dev="tapc2a4679c-20"/>
Nov 08 12:31:34 user nova-compute[74840]:     </interface>
Nov 08 12:31:34 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:31:34 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/83da3dce-e270-4054-910d-c8ad28eb18da/console.log" append="off"/>
Nov 08 12:31:34 user nova-compute[74840]:     </serial>
Nov 08 12:31:34 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:31:34 user nova-compute[74840]:     <video>
Nov 08 12:31:34 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:31:34 user nova-compute[74840]:     </video>
Nov 08 12:31:34 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:31:34 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:31:34 user nova-compute[74840]:     </rng>
Nov 08 12:31:34 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:31:34 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:31:34 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:31:34 user nova-compute[74840]:     </memballoon>
Nov 08 12:31:34 user nova-compute[74840]:   </devices>
Nov 08 12:31:34 user nova-compute[74840]: </domain>
Nov 08 12:31:34 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:31:34 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:31:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-52209854',display_name='tempest-TestVolumeBootPattern-server-52209854',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-52209854',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDnf/rgNeauxsdXCuQeVAa6oJl7IvXSpNN83Cdo1qtwT4P0g8IuWhFw/l+HOo44zetcJEHbPUEQ14N2qnoFV4I4QWYhF+y8Gsgf65CRdUjmUlU4hjQG+QvZzqapWj/SBg==',key_name='tempest-TestVolumeBootPattern-1773717711',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1250106b55ae44b0b303849df7781ffb',ramdisk_id='',reservation_id='r-to05psnh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-77780905',owner_user_name='tempest-TestVolumeBootPattern-77780905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:31:06Z,user_data=None,user_id='794c0281e1bf48f79117efdc3907e661',uuid=83da3dce-e270-4054-910d-c8ad28eb18da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2a4679c-207f-4dfa-9209-f1a4d7d70834", "address": "fa:16:3e:4e:da:51", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a4679c-20", "ovs_interfaceid": "c2a4679c-207f-4dfa-9209-f1a4d7d70834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:31:34 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Converting VIF {"id": "c2a4679c-207f-4dfa-9209-f1a4d7d70834", "address": "fa:16:3e:4e:da:51", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a4679c-20", "ovs_interfaceid": "c2a4679c-207f-4dfa-9209-f1a4d7d70834", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:31:34 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:da:51,bridge_name='br-int',has_traffic_filtering=True,id=c2a4679c-207f-4dfa-9209-f1a4d7d70834,network=Network(174da5e9-78cc-426f-87fb-1d3b23b8b459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2a4679c-20') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:31:34 user nova-compute[74840]: DEBUG os_vif [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:da:51,bridge_name='br-int',has_traffic_filtering=True,id=c2a4679c-207f-4dfa-9209-f1a4d7d70834,network=Network(174da5e9-78cc-426f-87fb-1d3b23b8b459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2a4679c-20') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:31:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:31:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:31:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7190537e-8b5f-5c5b-8866-efc99d31d0e0', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:31:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2a4679c-20, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:31:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc2a4679c-20, col_values=(('qos', UUID('c2b304be-771e-4fa3-8b2c-4741f288ca3c')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:31:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc2a4679c-20, col_values=(('external_ids', {'iface-id': 'c2a4679c-207f-4dfa-9209-f1a4d7d70834', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:da:51', 'vm-uuid': '83da3dce-e270-4054-910d-c8ad28eb18da'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:31:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:31:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:34 user nova-compute[74840]: INFO os_vif [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:da:51,bridge_name='br-int',has_traffic_filtering=True,id=c2a4679c-207f-4dfa-9209-f1a4d7d70834,network=Network(174da5e9-78cc-426f-87fb-1d3b23b8b459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2a4679c-20')
Nov 08 12:31:34 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:31:34 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] No VIF found with MAC fa:16:3e:4e:da:51, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:31:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.303s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/7a482219-16ac-49e2-84ad-7e2030c97184/disk 1073741824 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/7a482219-16ac-49e2-84ad-7e2030c97184/disk 1073741824" returned: 0 in 0.135s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.445s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:31:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.177s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:35 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7a482219-16ac-49e2-84ad-7e2030c97184/disk. size=1073741824 {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 12:31:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a482219-16ac-49e2-84ad-7e2030c97184/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:35 user nova-compute[74840]: DEBUG nova.network.neutron [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Successfully created port: 00efdc72-8528-41eb-be2b-c9b190863053 {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:31:35 user nova-compute[74840]: INFO nova.compute.manager [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Rescuing
Nov 08 12:31:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Acquiring lock "refresh_cache-a2c4fc63-0757-46da-ad00-7b6c6513deca" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:31:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Acquired lock "refresh_cache-a2c4fc63-0757-46da-ad00-7b6c6513deca" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:31:35 user nova-compute[74840]: DEBUG nova.network.neutron [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:31:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a482219-16ac-49e2-84ad-7e2030c97184/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:35 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Cannot resize image /opt/stack/data/nova/instances/7a482219-16ac-49e2-84ad-7e2030c97184/disk to a smaller size. {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 12:31:35 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Created local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 12:31:35 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Ensure instance console log exists: /opt/stack/data/nova/instances/7a482219-16ac-49e2-84ad-7e2030c97184/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:31:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:31:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:31:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:31:35 user nova-compute[74840]: DEBUG nova.network.neutron [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Updating instance_info_cache with network_info: [{"id": "4d351123-6297-4be2-808d-50cdbe9e3aa6", "address": "fa:16:3e:4e:0c:f0", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d351123-62", "ovs_interfaceid": "4d351123-6297-4be2-808d-50cdbe9e3aa6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:31:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Releasing lock "refresh_cache-a2c4fc63-0757-46da-ad00-7b6c6513deca" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:31:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:36 user nova-compute[74840]: DEBUG nova.network.neutron [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Successfully updated port: 00efdc72-8528-41eb-be2b-c9b190863053 {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:31:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Acquiring lock "refresh_cache-7a482219-16ac-49e2-84ad-7e2030c97184" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:31:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Acquired lock "refresh_cache-7a482219-16ac-49e2-84ad-7e2030c97184" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:31:36 user nova-compute[74840]: DEBUG nova.network.neutron [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:31:36 user nova-compute[74840]: DEBUG nova.compute.manager [req-f6abced2-4f90-48cb-b8d8-5bbc34ed31f4 req-6aa811b1-4c52-4240-95e2-33f15be5ba49 service nova] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Received event network-changed-00efdc72-8528-41eb-be2b-c9b190863053 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:31:36 user nova-compute[74840]: DEBUG nova.compute.manager [req-f6abced2-4f90-48cb-b8d8-5bbc34ed31f4 req-6aa811b1-4c52-4240-95e2-33f15be5ba49 service nova] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Refreshing instance network info cache due to event network-changed-00efdc72-8528-41eb-be2b-c9b190863053. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:31:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-f6abced2-4f90-48cb-b8d8-5bbc34ed31f4 req-6aa811b1-4c52-4240-95e2-33f15be5ba49 service nova] Acquiring lock "refresh_cache-7a482219-16ac-49e2-84ad-7e2030c97184" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:31:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:36 user nova-compute[74840]: DEBUG nova.compute.manager [req-836e8cdc-14a4-4de2-b382-0292ec544963 req-34e876bd-2489-43f6-80b7-94982fa0aa0a service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Received event network-vif-unplugged-4d351123-6297-4be2-808d-50cdbe9e3aa6 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:31:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-836e8cdc-14a4-4de2-b382-0292ec544963 req-34e876bd-2489-43f6-80b7-94982fa0aa0a service nova] Acquiring lock "a2c4fc63-0757-46da-ad00-7b6c6513deca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:31:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-836e8cdc-14a4-4de2-b382-0292ec544963 req-34e876bd-2489-43f6-80b7-94982fa0aa0a service nova] Lock "a2c4fc63-0757-46da-ad00-7b6c6513deca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:31:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-836e8cdc-14a4-4de2-b382-0292ec544963 req-34e876bd-2489-43f6-80b7-94982fa0aa0a service nova] Lock "a2c4fc63-0757-46da-ad00-7b6c6513deca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:31:36 user nova-compute[74840]: DEBUG nova.compute.manager [req-836e8cdc-14a4-4de2-b382-0292ec544963 req-34e876bd-2489-43f6-80b7-94982fa0aa0a service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] No waiting events found dispatching network-vif-unplugged-4d351123-6297-4be2-808d-50cdbe9e3aa6 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:31:36 user nova-compute[74840]: WARNING nova.compute.manager [req-836e8cdc-14a4-4de2-b382-0292ec544963 req-34e876bd-2489-43f6-80b7-94982fa0aa0a service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Received unexpected event network-vif-unplugged-4d351123-6297-4be2-808d-50cdbe9e3aa6 for instance with vm_state active and task_state rescuing.
Nov 08 12:31:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:36 user nova-compute[74840]: DEBUG nova.compute.manager [req-a4037c27-43b3-467e-9bd1-93217be231f4 req-a3c4874a-ddda-4ffc-b37f-53c86d3fd906 service nova] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Received event network-vif-plugged-c2a4679c-207f-4dfa-9209-f1a4d7d70834 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:31:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a4037c27-43b3-467e-9bd1-93217be231f4 req-a3c4874a-ddda-4ffc-b37f-53c86d3fd906 service nova] Acquiring lock "83da3dce-e270-4054-910d-c8ad28eb18da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:31:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a4037c27-43b3-467e-9bd1-93217be231f4 req-a3c4874a-ddda-4ffc-b37f-53c86d3fd906 service nova] Lock "83da3dce-e270-4054-910d-c8ad28eb18da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:31:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a4037c27-43b3-467e-9bd1-93217be231f4 req-a3c4874a-ddda-4ffc-b37f-53c86d3fd906 service nova] Lock "83da3dce-e270-4054-910d-c8ad28eb18da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:31:36 user nova-compute[74840]: DEBUG nova.compute.manager [req-a4037c27-43b3-467e-9bd1-93217be231f4 req-a3c4874a-ddda-4ffc-b37f-53c86d3fd906 service nova] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] No waiting events found dispatching network-vif-plugged-c2a4679c-207f-4dfa-9209-f1a4d7d70834 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:31:36 user nova-compute[74840]: WARNING nova.compute.manager [req-a4037c27-43b3-467e-9bd1-93217be231f4 req-a3c4874a-ddda-4ffc-b37f-53c86d3fd906 service nova] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Received unexpected event network-vif-plugged-c2a4679c-207f-4dfa-9209-f1a4d7d70834 for instance with vm_state building and task_state spawning.
Nov 08 12:31:36 user nova-compute[74840]: DEBUG nova.network.neutron [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:31:36 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:31:36 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Creating image(s)
Nov 08 12:31:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "/opt/stack/data/nova/instances/e3175752-45a5-43e3-a99a-9377440e7bea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:31:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "/opt/stack/data/nova/instances/e3175752-45a5-43e3-a99a-9377440e7bea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:31:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "/opt/stack/data/nova/instances/e3175752-45a5-43e3-a99a-9377440e7bea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:31:36 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:36 user nova-compute[74840]: DEBUG nova.network.neutron [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Updating instance_info_cache with network_info: [{"id": "00efdc72-8528-41eb-be2b-c9b190863053", "address": "fa:16:3e:72:4b:1f", "network": {"id": "7faeaea5-04e0-46e0-bb55-9426d599fb1b", "bridge": "br-int", "label": "tempest-TestStampPattern-1080763140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c24d52e18e8e41dfa50aa5aff1f40c6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00efdc72-85", "ovs_interfaceid": "00efdc72-8528-41eb-be2b-c9b190863053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:31:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Releasing lock "refresh_cache-7a482219-16ac-49e2-84ad-7e2030c97184" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:31:36 user nova-compute[74840]: DEBUG nova.compute.manager [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Instance network_info: |[{"id": "00efdc72-8528-41eb-be2b-c9b190863053", "address": "fa:16:3e:72:4b:1f", "network": {"id": "7faeaea5-04e0-46e0-bb55-9426d599fb1b", "bridge": "br-int", "label": "tempest-TestStampPattern-1080763140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c24d52e18e8e41dfa50aa5aff1f40c6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00efdc72-85", "ovs_interfaceid": "00efdc72-8528-41eb-be2b-c9b190863053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 12:31:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-f6abced2-4f90-48cb-b8d8-5bbc34ed31f4 req-6aa811b1-4c52-4240-95e2-33f15be5ba49 service nova] Acquired lock "refresh_cache-7a482219-16ac-49e2-84ad-7e2030c97184" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:31:36 user nova-compute[74840]: DEBUG nova.network.neutron [req-f6abced2-4f90-48cb-b8d8-5bbc34ed31f4 req-6aa811b1-4c52-4240-95e2-33f15be5ba49 service nova] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Refreshing network info cache for port 00efdc72-8528-41eb-be2b-c9b190863053 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:31:36 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Start _get_guest_xml network_info=[{"id": "00efdc72-8528-41eb-be2b-c9b190863053", "address": "fa:16:3e:72:4b:1f", "network": {"id": "7faeaea5-04e0-46e0-bb55-9426d599fb1b", "bridge": "br-int", "label": "tempest-TestStampPattern-1080763140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c24d52e18e8e41dfa50aa5aff1f40c6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00efdc72-85", "ovs_interfaceid": "00efdc72-8528-41eb-be2b-c9b190863053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'image_id': '4fa17706-d304-4117-a420-dab994c703dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:31:36 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.178s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "5d26578eba85497f494c575690c4248f381a0fe6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:31:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:31:36 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:36 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:31:36 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:31:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:36 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:31:36 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:31:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1167917458',display_name='tempest-TestStampPattern-server-1167917458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1167917458',id=39,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAifdjOvE03LGvvENDtVW5s6JmsBpHl/N8DE5nBoGW2g5OLHF4XEiYFI0Pa1nSZrBetG5b+iQnlywZCqyB795WR0LxYnf+fBshC/Pye35f17zjZfcJWjmT0YUIL12Rw9Xg==',key_name='tempest-TestStampPattern-101204523',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c24d52e18e8e41dfa50aa5aff1f40c6d',ramdisk_id='',reservation_id='r-33csrtv1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-55983118',owner_user_name='tempest-TestStampPattern-55983118-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:31:34Z,user_data=None,user_id='719ac4d31ae447a6a04c1c62c0a73191',uuid=7a482219-16ac-49e2-84ad-7e2030c97184,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00efdc72-8528-41eb-be2b-c9b190863053", "address": "fa:16:3e:72:4b:1f", "network": {"id": "7faeaea5-04e0-46e0-bb55-9426d599fb1b", "bridge": "br-int", "label": "tempest-TestStampPattern-1080763140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c24d52e18e8e41dfa50aa5aff1f40c6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00efdc72-85", "ovs_interfaceid": "00efdc72-8528-41eb-be2b-c9b190863053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Converting VIF {"id": "00efdc72-8528-41eb-be2b-c9b190863053", "address": "fa:16:3e:72:4b:1f", "network": {"id": "7faeaea5-04e0-46e0-bb55-9426d599fb1b", "bridge": "br-int", "label": "tempest-TestStampPattern-1080763140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c24d52e18e8e41dfa50aa5aff1f40c6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00efdc72-85", "ovs_interfaceid": "00efdc72-8528-41eb-be2b-c9b190863053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:4b:1f,bridge_name='br-int',has_traffic_filtering=True,id=00efdc72-8528-41eb-be2b-c9b190863053,network=Network(7faeaea5-04e0-46e0-bb55-9426d599fb1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00efdc72-85') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.objects.instance [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lazy-loading 'pci_devices' on Instance uuid 7a482219-16ac-49e2-84ad-7e2030c97184 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:31:37 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Instance destroyed successfully.
Nov 08 12:31:37 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Attempting rescue
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74840) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Instance directory exists: not creating {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 12:31:37 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Creating image(s)
Nov 08 12:31:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Acquiring lock "/opt/stack/data/nova/instances/a2c4fc63-0757-46da-ad00-7b6c6513deca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "/opt/stack/data/nova/instances/a2c4fc63-0757-46da-ad00-7b6c6513deca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "/opt/stack/data/nova/instances/a2c4fc63-0757-46da-ad00-7b6c6513deca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.objects.instance [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lazy-loading 'trusted_certs' on Instance uuid a2c4fc63-0757-46da-ad00-7b6c6513deca {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:31:37 user nova-compute[74840]:   <uuid>7a482219-16ac-49e2-84ad-7e2030c97184</uuid>
Nov 08 12:31:37 user nova-compute[74840]:   <name>instance-00000027</name>
Nov 08 12:31:37 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:31:37 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:31:37 user nova-compute[74840]:   <metadata>
Nov 08 12:31:37 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:31:37 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:31:37 user nova-compute[74840]:       <nova:name>tempest-TestStampPattern-server-1167917458</nova:name>
Nov 08 12:31:37 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:31:36</nova:creationTime>
Nov 08 12:31:37 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:31:37 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:31:37 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:31:37 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:31:37 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:31:37 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:31:37 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:31:37 user nova-compute[74840]:       <nova:owner>
Nov 08 12:31:37 user nova-compute[74840]:         <nova:user uuid="719ac4d31ae447a6a04c1c62c0a73191">tempest-TestStampPattern-55983118-project-member</nova:user>
Nov 08 12:31:37 user nova-compute[74840]:         <nova:project uuid="c24d52e18e8e41dfa50aa5aff1f40c6d">tempest-TestStampPattern-55983118</nova:project>
Nov 08 12:31:37 user nova-compute[74840]:       </nova:owner>
Nov 08 12:31:37 user nova-compute[74840]:       <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:31:37 user nova-compute[74840]:       <nova:ports>
Nov 08 12:31:37 user nova-compute[74840]:         <nova:port uuid="00efdc72-8528-41eb-be2b-c9b190863053">
Nov 08 12:31:37 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 12:31:37 user nova-compute[74840]:         </nova:port>
Nov 08 12:31:37 user nova-compute[74840]:       </nova:ports>
Nov 08 12:31:37 user nova-compute[74840]:     </nova:instance>
Nov 08 12:31:37 user nova-compute[74840]:   </metadata>
Nov 08 12:31:37 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:31:37 user nova-compute[74840]:     <system>
Nov 08 12:31:37 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:31:37 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:31:37 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:31:37 user nova-compute[74840]:       <entry name="serial">7a482219-16ac-49e2-84ad-7e2030c97184</entry>
Nov 08 12:31:37 user nova-compute[74840]:       <entry name="uuid">7a482219-16ac-49e2-84ad-7e2030c97184</entry>
Nov 08 12:31:37 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:31:37 user nova-compute[74840]:     </system>
Nov 08 12:31:37 user nova-compute[74840]:   </sysinfo>
Nov 08 12:31:37 user nova-compute[74840]:   <os>
Nov 08 12:31:37 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:31:37 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:31:37 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:31:37 user nova-compute[74840]:   </os>
Nov 08 12:31:37 user nova-compute[74840]:   <features>
Nov 08 12:31:37 user nova-compute[74840]:     <acpi/>
Nov 08 12:31:37 user nova-compute[74840]:     <apic/>
Nov 08 12:31:37 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:31:37 user nova-compute[74840]:   </features>
Nov 08 12:31:37 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:31:37 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:31:37 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:31:37 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:31:37 user nova-compute[74840]:   </clock>
Nov 08 12:31:37 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:31:37 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:31:37 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:31:37 user nova-compute[74840]:   </cpu>
Nov 08 12:31:37 user nova-compute[74840]:   <devices>
Nov 08 12:31:37 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:31:37 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:31:37 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/7a482219-16ac-49e2-84ad-7e2030c97184/disk"/>
Nov 08 12:31:37 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:31:37 user nova-compute[74840]:     </disk>
Nov 08 12:31:37 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:31:37 user nova-compute[74840]:       <mac address="fa:16:3e:72:4b:1f"/>
Nov 08 12:31:37 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:31:37 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:31:37 user nova-compute[74840]:       <target dev="tap00efdc72-85"/>
Nov 08 12:31:37 user nova-compute[74840]:     </interface>
Nov 08 12:31:37 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:31:37 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/7a482219-16ac-49e2-84ad-7e2030c97184/console.log" append="off"/>
Nov 08 12:31:37 user nova-compute[74840]:     </serial>
Nov 08 12:31:37 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:31:37 user nova-compute[74840]:     <video>
Nov 08 12:31:37 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:31:37 user nova-compute[74840]:     </video>
Nov 08 12:31:37 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:31:37 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:31:37 user nova-compute[74840]:     </rng>
Nov 08 12:31:37 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:31:37 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:31:37 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:31:37 user nova-compute[74840]:     </memballoon>
Nov 08 12:31:37 user nova-compute[74840]:   </devices>
Nov 08 12:31:37 user nova-compute[74840]: </domain>
Nov 08 12:31:37 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:31:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1167917458',display_name='tempest-TestStampPattern-server-1167917458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1167917458',id=39,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAifdjOvE03LGvvENDtVW5s6JmsBpHl/N8DE5nBoGW2g5OLHF4XEiYFI0Pa1nSZrBetG5b+iQnlywZCqyB795WR0LxYnf+fBshC/Pye35f17zjZfcJWjmT0YUIL12Rw9Xg==',key_name='tempest-TestStampPattern-101204523',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c24d52e18e8e41dfa50aa5aff1f40c6d',ramdisk_id='',reservation_id='r-33csrtv1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-55983118',owner_user_name='tempest-TestStampPattern-55983118-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:31:34Z,user_data=None,user_id='719ac4d31ae447a6a04c1c62c0a73191',uuid=7a482219-16ac-49e2-84ad-7e2030c97184,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00efdc72-8528-41eb-be2b-c9b190863053", "address": "fa:16:3e:72:4b:1f", "network": {"id": "7faeaea5-04e0-46e0-bb55-9426d599fb1b", "bridge": "br-int", "label": "tempest-TestStampPattern-1080763140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c24d52e18e8e41dfa50aa5aff1f40c6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00efdc72-85", "ovs_interfaceid": "00efdc72-8528-41eb-be2b-c9b190863053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Converting VIF {"id": "00efdc72-8528-41eb-be2b-c9b190863053", "address": "fa:16:3e:72:4b:1f", "network": {"id": "7faeaea5-04e0-46e0-bb55-9426d599fb1b", "bridge": "br-int", "label": "tempest-TestStampPattern-1080763140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c24d52e18e8e41dfa50aa5aff1f40c6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00efdc72-85", "ovs_interfaceid": "00efdc72-8528-41eb-be2b-c9b190863053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:4b:1f,bridge_name='br-int',has_traffic_filtering=True,id=00efdc72-8528-41eb-be2b-c9b190863053,network=Network(7faeaea5-04e0-46e0-bb55-9426d599fb1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00efdc72-85') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG os_vif [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:4b:1f,bridge_name='br-int',has_traffic_filtering=True,id=00efdc72-8528-41eb-be2b-c9b190863053,network=Network(7faeaea5-04e0-46e0-bb55-9426d599fb1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00efdc72-85') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2e419081-3d0d-5971-a9bd-9d0640d1736f', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Acquiring lock "5d26578eba85497f494c575690c4248f381a0fe6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.203s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/e3175752-45a5-43e3-a99a-9377440e7bea/disk 1073741824 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap00efdc72-85, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap00efdc72-85, col_values=(('qos', UUID('b44a1220-6b94-47f6-afc8-ee3c133407a3')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap00efdc72-85, col_values=(('external_ids', {'iface-id': '00efdc72-8528-41eb-be2b-c9b190863053', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:4b:1f', 'vm-uuid': '7a482219-16ac-49e2-84ad-7e2030c97184'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/e3175752-45a5-43e3-a99a-9377440e7bea/disk 1073741824" returned: 0 in 0.090s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.299s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.201s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:37 user nova-compute[74840]: INFO os_vif [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:4b:1f,bridge_name='br-int',has_traffic_filtering=True,id=00efdc72-8528-41eb-be2b-c9b190863053,network=Network(7faeaea5-04e0-46e0-bb55-9426d599fb1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00efdc72-85')
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] No VIF found with MAC fa:16:3e:72:4b:1f, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.221s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e3175752-45a5-43e3-a99a-9377440e7bea/disk. size=1073741824 {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3175752-45a5-43e3-a99a-9377440e7bea/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.200s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/a2c4fc63-0757-46da-ad00-7b6c6513deca/disk.rescue {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.network.neutron [req-f6abced2-4f90-48cb-b8d8-5bbc34ed31f4 req-6aa811b1-4c52-4240-95e2-33f15be5ba49 service nova] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Updated VIF entry in instance network info cache for port 00efdc72-8528-41eb-be2b-c9b190863053. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.network.neutron [req-f6abced2-4f90-48cb-b8d8-5bbc34ed31f4 req-6aa811b1-4c52-4240-95e2-33f15be5ba49 service nova] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Updating instance_info_cache with network_info: [{"id": "00efdc72-8528-41eb-be2b-c9b190863053", "address": "fa:16:3e:72:4b:1f", "network": {"id": "7faeaea5-04e0-46e0-bb55-9426d599fb1b", "bridge": "br-int", "label": "tempest-TestStampPattern-1080763140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c24d52e18e8e41dfa50aa5aff1f40c6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00efdc72-85", "ovs_interfaceid": "00efdc72-8528-41eb-be2b-c9b190863053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-f6abced2-4f90-48cb-b8d8-5bbc34ed31f4 req-6aa811b1-4c52-4240-95e2-33f15be5ba49 service nova] Releasing lock "refresh_cache-7a482219-16ac-49e2-84ad-7e2030c97184" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/a2c4fc63-0757-46da-ad00-7b6c6513deca/disk.rescue" returned: 0 in 0.080s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.objects.instance [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lazy-loading 'migration_context' on Instance uuid a2c4fc63-0757-46da-ad00-7b6c6513deca {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.objects.base [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Object Instance<a2c4fc63-0757-46da-ad00-7b6c6513deca> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Created local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Start _get_guest_xml network_info=[{"id": "4d351123-6297-4be2-808d-50cdbe9e3aa6", "address": "fa:16:3e:4e:0c:f0", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "vif_mac": "fa:16:3e:4e:0c:f0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d351123-62", "ovs_interfaceid": "4d351123-6297-4be2-808d-50cdbe9e3aa6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '4fa17706-d304-4117-a420-dab994c703dc', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.objects.instance [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lazy-loading 'resources' on Instance uuid a2c4fc63-0757-46da-ad00-7b6c6513deca {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.objects.base [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Object Instance<a2c4fc63-0757-46da-ad00-7b6c6513deca> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.objects.instance [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lazy-loading 'numa_topology' on Instance uuid a2c4fc63-0757-46da-ad00-7b6c6513deca {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.objects.base [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Object Instance<a2c4fc63-0757-46da-ad00-7b6c6513deca> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:31:37 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:31:37 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3175752-45a5-43e3-a99a-9377440e7bea/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Cannot resize image /opt/stack/data/nova/instances/e3175752-45a5-43e3-a99a-9377440e7bea/disk to a smaller size. {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Created local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Ensure instance console log exists: /opt/stack/data/nova/instances/e3175752-45a5-43e3-a99a-9377440e7bea/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Start _get_guest_xml network_info=[{"id": "e0c27d11-afc7-4e26-8024-d4c7ad9a6baf", "address": "fa:16:3e:86:18:09", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0c27d11-af", "ovs_interfaceid": "e0c27d11-afc7-4e26-8024-d4c7ad9a6baf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'image_id': '4fa17706-d304-4117-a420-dab994c703dc'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'bf16a7c6-f251-4848-9535-6d7377d85625', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cxshviGp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e3175752-45a5-43e3-a99a-9377440e7bea', 'attached_at': '', 'detached_at': '', 'volume_id': '67de400a-4361-4d2c-b9f0-a17af7822321', 'serial': '67de400a-4361-4d2c-b9f0-a17af7822321'}, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.objects.instance [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lazy-loading 'vcpu_model' on Instance uuid a2c4fc63-0757-46da-ad00-7b6c6513deca {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:31:37 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 08 12:31:37 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.objects.base [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Object Instance<a2c4fc63-0757-46da-ad00-7b6c6513deca> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:29:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1244088697',display_name='tempest-ServerRescueNegativeTestJSON-server-1244088697',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1244088697',id=36,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvyvuealSmv8oj2TiSPbJYSMimajIZY4FNDaO08P7UQK09BPjIy4vh1eS/+h4sgiVjixuStEYbu1g4HgvRzMry2Yy5U2GAE5k/tYdAAzmPsftIe0+/T6DAUds34r9j79A==',key_name='tempest-keypair-625852250',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:29:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='457d61e0588847528ef3dd42a6146599',ramdisk_id='',reservation_id='r-4gm9nthr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1814868989',owner_user_name='tempest-ServerRescueNegativeTestJSON-1814868989-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:29:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d4a3286c7d64d59b8ce2e4456db9cc2',uuid=a2c4fc63-0757-46da-ad00-7b6c6513deca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d351123-6297-4be2-808d-50cdbe9e3aa6", "address": "fa:16:3e:4e:0c:f0", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "vif_mac": "fa:16:3e:4e:0c:f0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d351123-62", "ovs_interfaceid": "4d351123-6297-4be2-808d-50cdbe9e3aa6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Converting VIF {"id": "4d351123-6297-4be2-808d-50cdbe9e3aa6", "address": "fa:16:3e:4e:0c:f0", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "vif_mac": "fa:16:3e:4e:0c:f0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d351123-62", "ovs_interfaceid": "4d351123-6297-4be2-808d-50cdbe9e3aa6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:0c:f0,bridge_name='br-int',has_traffic_filtering=True,id=4d351123-6297-4be2-808d-50cdbe9e3aa6,network=Network(5ee2626f-3d55-44da-a731-761059adfa85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d351123-62') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.objects.instance [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lazy-loading 'pci_devices' on Instance uuid a2c4fc63-0757-46da-ad00-7b6c6513deca {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.objects.instance [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lazy-loading 'vcpu_model' on Instance uuid e3175752-45a5-43e3-a99a-9377440e7bea {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.objects.base [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Object Instance<a2c4fc63-0757-46da-ad00-7b6c6513deca> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:31:37 user nova-compute[74840]:   <uuid>a2c4fc63-0757-46da-ad00-7b6c6513deca</uuid>
Nov 08 12:31:37 user nova-compute[74840]:   <name>instance-00000024</name>
Nov 08 12:31:37 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:31:37 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:31:37 user nova-compute[74840]:   <metadata>
Nov 08 12:31:37 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:31:37 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:31:37 user nova-compute[74840]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1244088697</nova:name>
Nov 08 12:31:37 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:31:37</nova:creationTime>
Nov 08 12:31:37 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:31:37 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:31:37 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:31:37 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:31:37 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:31:37 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:31:37 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:31:37 user nova-compute[74840]:       <nova:owner>
Nov 08 12:31:37 user nova-compute[74840]:         <nova:user uuid="6d4a3286c7d64d59b8ce2e4456db9cc2">tempest-ServerRescueNegativeTestJSON-1814868989-project-member</nova:user>
Nov 08 12:31:37 user nova-compute[74840]:         <nova:project uuid="457d61e0588847528ef3dd42a6146599">tempest-ServerRescueNegativeTestJSON-1814868989</nova:project>
Nov 08 12:31:37 user nova-compute[74840]:       </nova:owner>
Nov 08 12:31:37 user nova-compute[74840]:       <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:31:37 user nova-compute[74840]:       <nova:ports>
Nov 08 12:31:37 user nova-compute[74840]:         <nova:port uuid="4d351123-6297-4be2-808d-50cdbe9e3aa6">
Nov 08 12:31:37 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 12:31:37 user nova-compute[74840]:         </nova:port>
Nov 08 12:31:37 user nova-compute[74840]:       </nova:ports>
Nov 08 12:31:37 user nova-compute[74840]:     </nova:instance>
Nov 08 12:31:37 user nova-compute[74840]:   </metadata>
Nov 08 12:31:37 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:31:37 user nova-compute[74840]:     <system>
Nov 08 12:31:37 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:31:37 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:31:37 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:31:37 user nova-compute[74840]:       <entry name="serial">a2c4fc63-0757-46da-ad00-7b6c6513deca</entry>
Nov 08 12:31:37 user nova-compute[74840]:       <entry name="uuid">a2c4fc63-0757-46da-ad00-7b6c6513deca</entry>
Nov 08 12:31:37 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:31:37 user nova-compute[74840]:     </system>
Nov 08 12:31:37 user nova-compute[74840]:   </sysinfo>
Nov 08 12:31:37 user nova-compute[74840]:   <os>
Nov 08 12:31:37 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:31:37 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:31:37 user nova-compute[74840]:   </os>
Nov 08 12:31:37 user nova-compute[74840]:   <features>
Nov 08 12:31:37 user nova-compute[74840]:     <acpi/>
Nov 08 12:31:37 user nova-compute[74840]:     <apic/>
Nov 08 12:31:37 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:31:37 user nova-compute[74840]:   </features>
Nov 08 12:31:37 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:31:37 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:31:37 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:31:37 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:31:37 user nova-compute[74840]:   </clock>
Nov 08 12:31:37 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:31:37 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:31:37 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:31:37 user nova-compute[74840]:   </cpu>
Nov 08 12:31:37 user nova-compute[74840]:   <devices>
Nov 08 12:31:37 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:31:37 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:31:37 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/a2c4fc63-0757-46da-ad00-7b6c6513deca/disk.rescue"/>
Nov 08 12:31:37 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:31:37 user nova-compute[74840]:     </disk>
Nov 08 12:31:37 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:31:37 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:31:37 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/a2c4fc63-0757-46da-ad00-7b6c6513deca/disk"/>
Nov 08 12:31:37 user nova-compute[74840]:       <target dev="vdb" bus="virtio"/>
Nov 08 12:31:37 user nova-compute[74840]:     </disk>
Nov 08 12:31:37 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:31:37 user nova-compute[74840]:       <mac address="fa:16:3e:4e:0c:f0"/>
Nov 08 12:31:37 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:31:37 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:31:37 user nova-compute[74840]:       <target dev="tap4d351123-62"/>
Nov 08 12:31:37 user nova-compute[74840]:     </interface>
Nov 08 12:31:37 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:31:37 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/a2c4fc63-0757-46da-ad00-7b6c6513deca/console.log" append="off"/>
Nov 08 12:31:37 user nova-compute[74840]:     </serial>
Nov 08 12:31:37 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:31:37 user nova-compute[74840]:     <video>
Nov 08 12:31:37 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:31:37 user nova-compute[74840]:     </video>
Nov 08 12:31:37 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:31:37 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:31:37 user nova-compute[74840]:     </rng>
Nov 08 12:31:37 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:31:37 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:31:37 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:31:37 user nova-compute[74840]:     </memballoon>
Nov 08 12:31:37 user nova-compute[74840]:   </devices>
Nov 08 12:31:37 user nova-compute[74840]: </domain>
Nov 08 12:31:37 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Calling os-brick to attach iSCSI Volume {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cxshviGp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:31:37 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 12:31:37 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:31:37 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 12:31:37 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:31:37 user nova-compute[74840]: INFO os_brick.initiator.connectors.iscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 12:31:37 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 -p 172.16.0.220:3260 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:37 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Instance destroyed successfully.
Nov 08 12:31:37 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f41ad6-1f06-4886-915c-e16b768104ee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 12:31:37 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 -p 172.16.0.220:3260 --interface default --op new {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[82920087-1b28-4267-a4ab-484bb1392e40]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321] added\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321] added
Nov 08 12:31:37 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] No VIF found with MAC fa:16:3e:4e:0c:f0, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[572873ff-ae8f-4d6b-931b-8c64e4ec29ff]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdacdf3a-e157-486f-b96a-46d50b0849bd]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cxshviGp {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cxshviGp" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3972a8d2-e08c-4d28-a95a-db1afe21ec5f]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cxshviGp'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28aab8d-bf26-4fad-ac57-1c05378a32d2]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[37290fca-6ecf-4c83-9733-4b0d73d48c32]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:31:37 user nova-compute[74840]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 (non-flash)
Nov 08 12:31:37 user nova-compute[74840]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)
Nov 08 12:31:37 user nova-compute[74840]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 (non-flash)
Nov 08 12:31:37 user nova-compute[74840]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)
Nov 08 12:31:37 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:31:37 user nova-compute[74840]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 (non-flash)
Nov 08 12:31:37 user nova-compute[74840]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)
Nov 08 12:31:37 user nova-compute[74840]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 (non-flash)
Nov 08 12:31:37 user nova-compute[74840]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)
Nov 08 12:31:37 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:31:37 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 -p 172.16.0.220:3260 --login {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:38 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b8d285-594a-410d-afbc-fcc9aa0aec9a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:38 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321, portal: 172.16.0.220,3260]
Nov 08 12:31:38 user nova-compute[74840]: Login to [iface: default, target: iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321, portal: 172.16.0.220,3260] successful.
Nov 08 12:31:38 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:31:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:38 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a999476-fbf8-48c3-affc-6ee93fbfd3c5]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:38 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:31:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:38 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ed85aa-8306-4c7b-880e-7f08d0d40a9c]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:38 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:31:38 user nova-compute[74840]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 (non-flash)
Nov 08 12:31:38 user nova-compute[74840]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)
Nov 08 12:31:38 user nova-compute[74840]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 (non-flash)
Nov 08 12:31:38 user nova-compute[74840]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)
Nov 08 12:31:38 user nova-compute[74840]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 (non-flash)
Nov 08 12:31:38 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:31:38 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:31:38 user nova-compute[74840]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 (non-flash)
Nov 08 12:31:38 user nova-compute[74840]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)
Nov 08 12:31:38 user nova-compute[74840]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 (non-flash)
Nov 08 12:31:38 user nova-compute[74840]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)
Nov 08 12:31:38 user nova-compute[74840]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 (non-flash)
Nov 08 12:31:38 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:31:38 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:31:38 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Connected to 172.16.0.220:3260 {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 12:31:38 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] HCTL ('38', '-', '-', 0) found on session 39 with lun 0 {{(pid=74840) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 12:31:38 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74840) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 12:31:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:31:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:31:38 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[82fa0691-eb4c-4c66-ac4e-6fcf3ed69047]: (4, ('- - 0', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:31:38 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Searching for a device in session 39 and hctl ['38', '*', '*', 0] yield: None {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:31:38 user nova-compute[74840]: DEBUG nova.compute.manager [req-5f0f06e5-f74e-4136-b425-166e296bed0f req-68b72d3c-2b68-4eef-8366-ba0b6e073659 service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Received event network-vif-plugged-4d351123-6297-4be2-808d-50cdbe9e3aa6 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:31:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-5f0f06e5-f74e-4136-b425-166e296bed0f req-68b72d3c-2b68-4eef-8366-ba0b6e073659 service nova] Acquiring lock "a2c4fc63-0757-46da-ad00-7b6c6513deca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:31:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-5f0f06e5-f74e-4136-b425-166e296bed0f req-68b72d3c-2b68-4eef-8366-ba0b6e073659 service nova] Lock "a2c4fc63-0757-46da-ad00-7b6c6513deca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:31:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-5f0f06e5-f74e-4136-b425-166e296bed0f req-68b72d3c-2b68-4eef-8366-ba0b6e073659 service nova] Lock "a2c4fc63-0757-46da-ad00-7b6c6513deca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:31:38 user nova-compute[74840]: DEBUG nova.compute.manager [req-5f0f06e5-f74e-4136-b425-166e296bed0f req-68b72d3c-2b68-4eef-8366-ba0b6e073659 service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] No waiting events found dispatching network-vif-plugged-4d351123-6297-4be2-808d-50cdbe9e3aa6 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:31:38 user nova-compute[74840]: WARNING nova.compute.manager [req-5f0f06e5-f74e-4136-b425-166e296bed0f req-68b72d3c-2b68-4eef-8366-ba0b6e073659 service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Received unexpected event network-vif-plugged-4d351123-6297-4be2-808d-50cdbe9e3aa6 for instance with vm_state active and task_state rescuing.
Nov 08 12:31:38 user nova-compute[74840]: DEBUG nova.compute.manager [req-e8052b90-fc96-4fef-957c-4c971c07045c req-c89bd340-3df9-4356-9730-a6cb6385827a service nova] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Received event network-vif-plugged-c2a4679c-207f-4dfa-9209-f1a4d7d70834 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:31:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e8052b90-fc96-4fef-957c-4c971c07045c req-c89bd340-3df9-4356-9730-a6cb6385827a service nova] Acquiring lock "83da3dce-e270-4054-910d-c8ad28eb18da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:31:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e8052b90-fc96-4fef-957c-4c971c07045c req-c89bd340-3df9-4356-9730-a6cb6385827a service nova] Lock "83da3dce-e270-4054-910d-c8ad28eb18da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:31:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e8052b90-fc96-4fef-957c-4c971c07045c req-c89bd340-3df9-4356-9730-a6cb6385827a service nova] Lock "83da3dce-e270-4054-910d-c8ad28eb18da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:31:38 user nova-compute[74840]: DEBUG nova.compute.manager [req-e8052b90-fc96-4fef-957c-4c971c07045c req-c89bd340-3df9-4356-9730-a6cb6385827a service nova] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] No waiting events found dispatching network-vif-plugged-c2a4679c-207f-4dfa-9209-f1a4d7d70834 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:31:38 user nova-compute[74840]: WARNING nova.compute.manager [req-e8052b90-fc96-4fef-957c-4c971c07045c req-c89bd340-3df9-4356-9730-a6cb6385827a service nova] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Received unexpected event network-vif-plugged-c2a4679c-207f-4dfa-9209-f1a4d7d70834 for instance with vm_state building and task_state spawning.
Nov 08 12:31:38 user nova-compute[74840]: DEBUG nova.compute.manager [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:31:38 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:31:38 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Instance spawned successfully.
Nov 08 12:31:38 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:31:38 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Found default for hw_cdrom_bus of ide {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:31:38 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Found default for hw_disk_bus of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:31:38 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:31:38 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:31:38 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Found default for hw_video_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:31:38 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Found default for hw_vif_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:31:38 user nova-compute[74840]: INFO nova.compute.manager [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Took 6.86 seconds to spawn the instance on the hypervisor.
Nov 08 12:31:38 user nova-compute[74840]: DEBUG nova.compute.manager [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:31:39 user nova-compute[74840]: INFO nova.compute.manager [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Took 33.76 seconds to build instance.
Nov 08 12:31:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-74ea5a04-3aae-4118-aa26-ce3acabdee03 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "83da3dce-e270-4054-910d-c8ad28eb18da" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 33.861s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:31:39 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Searching for a device in session 39 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:31:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cxshviGp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 12:31:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:31:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '26665346136653130', 'path': '/dev/sdg'} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:31:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665346136653130', 'path': '/dev/sdg'} {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 12:31:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T12:28:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-199314448',display_name='tempest-ServerActionsTestOtherA-server-137189190',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-199314448',id=35,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSNrYheJ8Lzn3ZHvNUQvlNC/AEkaeIt4FFfFZ6MDZZKThsvIjNiHNZVHlAFC+XE6iHCrr/eoF+btmdxSZwQV3WJpatsIGdnvZUn9Tn2nZPQiFTZnNkVsedEjHcwcaa0jw==',key_name='tempest-keypair-1203623053',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:28:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5e47ef156b3649839ff728eaf23121da',ramdisk_id='',reservation_id='r-qttfimk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-401855506',owner_user_name='tempest-ServerActionsTestOtherA-401855506-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:31:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a49f88cb74c47bdb9a35883adbae454',uuid=e3175752-45a5-43e3-a99a-9377440e7bea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e0c27d11-afc7-4e26-8024-d4c7ad9a6baf", "address": "fa:16:3e:86:18:09", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0c27d11-af", "ovs_interfaceid": "e0c27d11-afc7-4e26-8024-d4c7ad9a6baf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:31:39 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Converting VIF {"id": "e0c27d11-afc7-4e26-8024-d4c7ad9a6baf", "address": "fa:16:3e:86:18:09", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0c27d11-af", "ovs_interfaceid": "e0c27d11-afc7-4e26-8024-d4c7ad9a6baf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:31:39 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:18:09,bridge_name='br-int',has_traffic_filtering=True,id=e0c27d11-afc7-4e26-8024-d4c7ad9a6baf,network=Network(e92448c4-9bc0-424b-a07f-a398ac46fada),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0c27d11-af') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:31:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:31:39 user nova-compute[74840]:   <uuid>e3175752-45a5-43e3-a99a-9377440e7bea</uuid>
Nov 08 12:31:39 user nova-compute[74840]:   <name>instance-00000023</name>
Nov 08 12:31:39 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:31:39 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:31:39 user nova-compute[74840]:   <metadata>
Nov 08 12:31:39 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:31:39 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:31:39 user nova-compute[74840]:       <nova:name>tempest-ServerActionsTestOtherA-server-137189190</nova:name>
Nov 08 12:31:39 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:31:37</nova:creationTime>
Nov 08 12:31:39 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:31:39 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:31:39 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:31:39 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:31:39 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:31:39 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:31:39 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:31:39 user nova-compute[74840]:       <nova:owner>
Nov 08 12:31:39 user nova-compute[74840]:         <nova:user uuid="9a49f88cb74c47bdb9a35883adbae454">tempest-ServerActionsTestOtherA-401855506-project-member</nova:user>
Nov 08 12:31:39 user nova-compute[74840]:         <nova:project uuid="5e47ef156b3649839ff728eaf23121da">tempest-ServerActionsTestOtherA-401855506</nova:project>
Nov 08 12:31:39 user nova-compute[74840]:       </nova:owner>
Nov 08 12:31:39 user nova-compute[74840]:       <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:31:39 user nova-compute[74840]:       <nova:ports>
Nov 08 12:31:39 user nova-compute[74840]:         <nova:port uuid="e0c27d11-afc7-4e26-8024-d4c7ad9a6baf">
Nov 08 12:31:39 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 08 12:31:39 user nova-compute[74840]:         </nova:port>
Nov 08 12:31:39 user nova-compute[74840]:       </nova:ports>
Nov 08 12:31:39 user nova-compute[74840]:     </nova:instance>
Nov 08 12:31:39 user nova-compute[74840]:   </metadata>
Nov 08 12:31:39 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:31:39 user nova-compute[74840]:     <system>
Nov 08 12:31:39 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:31:39 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:31:39 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:31:39 user nova-compute[74840]:       <entry name="serial">e3175752-45a5-43e3-a99a-9377440e7bea</entry>
Nov 08 12:31:39 user nova-compute[74840]:       <entry name="uuid">e3175752-45a5-43e3-a99a-9377440e7bea</entry>
Nov 08 12:31:39 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:31:39 user nova-compute[74840]:     </system>
Nov 08 12:31:39 user nova-compute[74840]:   </sysinfo>
Nov 08 12:31:39 user nova-compute[74840]:   <os>
Nov 08 12:31:39 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:31:39 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:31:39 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:31:39 user nova-compute[74840]:   </os>
Nov 08 12:31:39 user nova-compute[74840]:   <features>
Nov 08 12:31:39 user nova-compute[74840]:     <acpi/>
Nov 08 12:31:39 user nova-compute[74840]:     <apic/>
Nov 08 12:31:39 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:31:39 user nova-compute[74840]:   </features>
Nov 08 12:31:39 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:31:39 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:31:39 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:31:39 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:31:39 user nova-compute[74840]:   </clock>
Nov 08 12:31:39 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:31:39 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:31:39 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:31:39 user nova-compute[74840]:   </cpu>
Nov 08 12:31:39 user nova-compute[74840]:   <devices>
Nov 08 12:31:39 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:31:39 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:31:39 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/e3175752-45a5-43e3-a99a-9377440e7bea/disk"/>
Nov 08 12:31:39 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:31:39 user nova-compute[74840]:     </disk>
Nov 08 12:31:39 user nova-compute[74840]:     <disk type="block" device="disk">
Nov 08 12:31:39 user nova-compute[74840]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:31:39 user nova-compute[74840]:       <source dev="/dev/sdg"/>
Nov 08 12:31:39 user nova-compute[74840]:       <target dev="vdb" bus="virtio"/>
Nov 08 12:31:39 user nova-compute[74840]:       <serial>67de400a-4361-4d2c-b9f0-a17af7822321</serial>
Nov 08 12:31:39 user nova-compute[74840]:     </disk>
Nov 08 12:31:39 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:31:39 user nova-compute[74840]:       <mac address="fa:16:3e:86:18:09"/>
Nov 08 12:31:39 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:31:39 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:31:39 user nova-compute[74840]:       <target dev="tape0c27d11-af"/>
Nov 08 12:31:39 user nova-compute[74840]:     </interface>
Nov 08 12:31:39 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:31:39 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/e3175752-45a5-43e3-a99a-9377440e7bea/console.log" append="off"/>
Nov 08 12:31:39 user nova-compute[74840]:     </serial>
Nov 08 12:31:39 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:31:39 user nova-compute[74840]:     <video>
Nov 08 12:31:39 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:31:39 user nova-compute[74840]:     </video>
Nov 08 12:31:39 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:31:39 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:31:39 user nova-compute[74840]:     </rng>
Nov 08 12:31:39 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:31:39 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:31:39 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:31:39 user nova-compute[74840]:     </memballoon>
Nov 08 12:31:39 user nova-compute[74840]:   </devices>
Nov 08 12:31:39 user nova-compute[74840]: </domain>
Nov 08 12:31:39 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:31:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T12:28:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-199314448',display_name='tempest-ServerActionsTestOtherA-server-137189190',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-199314448',id=35,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSNrYheJ8Lzn3ZHvNUQvlNC/AEkaeIt4FFfFZ6MDZZKThsvIjNiHNZVHlAFC+XE6iHCrr/eoF+btmdxSZwQV3WJpatsIGdnvZUn9Tn2nZPQiFTZnNkVsedEjHcwcaa0jw==',key_name='tempest-keypair-1203623053',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:28:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5e47ef156b3649839ff728eaf23121da',ramdisk_id='',reservation_id='r-qttfimk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-401855506',owner_user_name='tempest-ServerActionsTestOtherA-401855506-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:31:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a49f88cb74c47bdb9a35883adbae454',uuid=e3175752-45a5-43e3-a99a-9377440e7bea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e0c27d11-afc7-4e26-8024-d4c7ad9a6baf", "address": "fa:16:3e:86:18:09", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0c27d11-af", "ovs_interfaceid": "e0c27d11-afc7-4e26-8024-d4c7ad9a6baf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:31:39 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Converting VIF {"id": "e0c27d11-afc7-4e26-8024-d4c7ad9a6baf", "address": "fa:16:3e:86:18:09", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0c27d11-af", "ovs_interfaceid": "e0c27d11-afc7-4e26-8024-d4c7ad9a6baf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:31:39 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:18:09,bridge_name='br-int',has_traffic_filtering=True,id=e0c27d11-afc7-4e26-8024-d4c7ad9a6baf,network=Network(e92448c4-9bc0-424b-a07f-a398ac46fada),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0c27d11-af') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:31:39 user nova-compute[74840]: DEBUG os_vif [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:18:09,bridge_name='br-int',has_traffic_filtering=True,id=e0c27d11-afc7-4e26-8024-d4c7ad9a6baf,network=Network(e92448c4-9bc0-424b-a07f-a398ac46fada),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0c27d11-af') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:31:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:31:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:31:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8df3d3ef-4770-5e1a-b3b5-abd96b837941', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:31:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:31:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape0c27d11-af, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:31:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape0c27d11-af, col_values=(('qos', UUID('64b565a1-088c-4e3f-b53e-5a17d8b8f6ea')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:31:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape0c27d11-af, col_values=(('external_ids', {'iface-id': 'e0c27d11-afc7-4e26-8024-d4c7ad9a6baf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:18:09', 'vm-uuid': 'e3175752-45a5-43e3-a99a-9377440e7bea'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:31:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:31:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:39 user nova-compute[74840]: INFO os_vif [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:18:09,bridge_name='br-int',has_traffic_filtering=True,id=e0c27d11-afc7-4e26-8024-d4c7ad9a6baf,network=Network(e92448c4-9bc0-424b-a07f-a398ac46fada),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0c27d11-af')
Nov 08 12:31:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:31:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:31:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] No VIF found with MAC fa:16:3e:86:18:09, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:31:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:40 user nova-compute[74840]: DEBUG nova.compute.manager [req-822a38c4-2afb-4a78-8553-d0ab7b6aa70b req-e409a73b-9856-4e06-bebf-3832d49100f2 service nova] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Received event network-vif-plugged-00efdc72-8528-41eb-be2b-c9b190863053 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:31:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-822a38c4-2afb-4a78-8553-d0ab7b6aa70b req-e409a73b-9856-4e06-bebf-3832d49100f2 service nova] Acquiring lock "7a482219-16ac-49e2-84ad-7e2030c97184-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:31:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-822a38c4-2afb-4a78-8553-d0ab7b6aa70b req-e409a73b-9856-4e06-bebf-3832d49100f2 service nova] Lock "7a482219-16ac-49e2-84ad-7e2030c97184-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:31:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-822a38c4-2afb-4a78-8553-d0ab7b6aa70b req-e409a73b-9856-4e06-bebf-3832d49100f2 service nova] Lock "7a482219-16ac-49e2-84ad-7e2030c97184-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:31:40 user nova-compute[74840]: DEBUG nova.compute.manager [req-822a38c4-2afb-4a78-8553-d0ab7b6aa70b req-e409a73b-9856-4e06-bebf-3832d49100f2 service nova] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] No waiting events found dispatching network-vif-plugged-00efdc72-8528-41eb-be2b-c9b190863053 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:31:40 user nova-compute[74840]: WARNING nova.compute.manager [req-822a38c4-2afb-4a78-8553-d0ab7b6aa70b req-e409a73b-9856-4e06-bebf-3832d49100f2 service nova] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Received unexpected event network-vif-plugged-00efdc72-8528-41eb-be2b-c9b190863053 for instance with vm_state building and task_state spawning.
Nov 08 12:31:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:41 user nova-compute[74840]: DEBUG nova.compute.manager [req-0f33aa64-9874-4960-9ecc-2b916a5e0ad1 req-61a14c16-35b1-4c49-ab87-653b85034e16 service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Received event network-vif-plugged-4d351123-6297-4be2-808d-50cdbe9e3aa6 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:31:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0f33aa64-9874-4960-9ecc-2b916a5e0ad1 req-61a14c16-35b1-4c49-ab87-653b85034e16 service nova] Acquiring lock "a2c4fc63-0757-46da-ad00-7b6c6513deca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:31:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0f33aa64-9874-4960-9ecc-2b916a5e0ad1 req-61a14c16-35b1-4c49-ab87-653b85034e16 service nova] Lock "a2c4fc63-0757-46da-ad00-7b6c6513deca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:31:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0f33aa64-9874-4960-9ecc-2b916a5e0ad1 req-61a14c16-35b1-4c49-ab87-653b85034e16 service nova] Lock "a2c4fc63-0757-46da-ad00-7b6c6513deca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:31:41 user nova-compute[74840]: DEBUG nova.compute.manager [req-0f33aa64-9874-4960-9ecc-2b916a5e0ad1 req-61a14c16-35b1-4c49-ab87-653b85034e16 service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] No waiting events found dispatching network-vif-plugged-4d351123-6297-4be2-808d-50cdbe9e3aa6 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:31:41 user nova-compute[74840]: WARNING nova.compute.manager [req-0f33aa64-9874-4960-9ecc-2b916a5e0ad1 req-61a14c16-35b1-4c49-ab87-653b85034e16 service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Received unexpected event network-vif-plugged-4d351123-6297-4be2-808d-50cdbe9e3aa6 for instance with vm_state active and task_state rescuing.
Nov 08 12:31:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:42 user nova-compute[74840]: DEBUG nova.compute.manager [req-c7dfc9f0-aac5-4592-b7dd-83c5caac25a3 req-93727519-80ae-49f3-9f5d-5dc913935ddc service nova] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Received event network-vif-plugged-00efdc72-8528-41eb-be2b-c9b190863053 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:31:42 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-c7dfc9f0-aac5-4592-b7dd-83c5caac25a3 req-93727519-80ae-49f3-9f5d-5dc913935ddc service nova] Acquiring lock "7a482219-16ac-49e2-84ad-7e2030c97184-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:31:42 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-c7dfc9f0-aac5-4592-b7dd-83c5caac25a3 req-93727519-80ae-49f3-9f5d-5dc913935ddc service nova] Lock "7a482219-16ac-49e2-84ad-7e2030c97184-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:31:42 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-c7dfc9f0-aac5-4592-b7dd-83c5caac25a3 req-93727519-80ae-49f3-9f5d-5dc913935ddc service nova] Lock "7a482219-16ac-49e2-84ad-7e2030c97184-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:31:42 user nova-compute[74840]: DEBUG nova.compute.manager [req-c7dfc9f0-aac5-4592-b7dd-83c5caac25a3 req-93727519-80ae-49f3-9f5d-5dc913935ddc service nova] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] No waiting events found dispatching network-vif-plugged-00efdc72-8528-41eb-be2b-c9b190863053 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:31:42 user nova-compute[74840]: WARNING nova.compute.manager [req-c7dfc9f0-aac5-4592-b7dd-83c5caac25a3 req-93727519-80ae-49f3-9f5d-5dc913935ddc service nova] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Received unexpected event network-vif-plugged-00efdc72-8528-41eb-be2b-c9b190863053 for instance with vm_state building and task_state spawning.
Nov 08 12:31:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:43 user nova-compute[74840]: DEBUG nova.compute.manager [req-c4716e64-2b26-4d5a-baf5-45786c5a38bb req-fb8c7e13-7f90-427a-a897-9bbd439b400c service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Received event network-vif-plugged-4d351123-6297-4be2-808d-50cdbe9e3aa6 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:31:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-c4716e64-2b26-4d5a-baf5-45786c5a38bb req-fb8c7e13-7f90-427a-a897-9bbd439b400c service nova] Acquiring lock "a2c4fc63-0757-46da-ad00-7b6c6513deca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:31:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-c4716e64-2b26-4d5a-baf5-45786c5a38bb req-fb8c7e13-7f90-427a-a897-9bbd439b400c service nova] Lock "a2c4fc63-0757-46da-ad00-7b6c6513deca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:31:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-c4716e64-2b26-4d5a-baf5-45786c5a38bb req-fb8c7e13-7f90-427a-a897-9bbd439b400c service nova] Lock "a2c4fc63-0757-46da-ad00-7b6c6513deca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:31:43 user nova-compute[74840]: DEBUG nova.compute.manager [req-c4716e64-2b26-4d5a-baf5-45786c5a38bb req-fb8c7e13-7f90-427a-a897-9bbd439b400c service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] No waiting events found dispatching network-vif-plugged-4d351123-6297-4be2-808d-50cdbe9e3aa6 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:31:43 user nova-compute[74840]: WARNING nova.compute.manager [req-c4716e64-2b26-4d5a-baf5-45786c5a38bb req-fb8c7e13-7f90-427a-a897-9bbd439b400c service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Received unexpected event network-vif-plugged-4d351123-6297-4be2-808d-50cdbe9e3aa6 for instance with vm_state active and task_state rescuing.
Nov 08 12:31:44 user nova-compute[74840]: DEBUG nova.compute.manager [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:31:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:31:44 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Instance spawned successfully.
Nov 08 12:31:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:31:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Found default for hw_cdrom_bus of ide {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:31:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Found default for hw_disk_bus of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:31:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:31:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:31:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Found default for hw_video_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:31:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Found default for hw_vif_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:31:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:44 user nova-compute[74840]: INFO nova.compute.manager [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Took 9.91 seconds to spawn the instance on the hypervisor.
Nov 08 12:31:44 user nova-compute[74840]: DEBUG nova.compute.manager [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:31:44 user nova-compute[74840]: DEBUG nova.compute.manager [req-a5d5c718-928a-4697-ac5d-8d8473cc44c7 req-eeafffad-fb19-45b0-b459-53aa389c9458 service nova] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Received event network-vif-plugged-e0c27d11-afc7-4e26-8024-d4c7ad9a6baf {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:31:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a5d5c718-928a-4697-ac5d-8d8473cc44c7 req-eeafffad-fb19-45b0-b459-53aa389c9458 service nova] Acquiring lock "e3175752-45a5-43e3-a99a-9377440e7bea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:31:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a5d5c718-928a-4697-ac5d-8d8473cc44c7 req-eeafffad-fb19-45b0-b459-53aa389c9458 service nova] Lock "e3175752-45a5-43e3-a99a-9377440e7bea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:31:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a5d5c718-928a-4697-ac5d-8d8473cc44c7 req-eeafffad-fb19-45b0-b459-53aa389c9458 service nova] Lock "e3175752-45a5-43e3-a99a-9377440e7bea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:31:44 user nova-compute[74840]: DEBUG nova.compute.manager [req-a5d5c718-928a-4697-ac5d-8d8473cc44c7 req-eeafffad-fb19-45b0-b459-53aa389c9458 service nova] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] No waiting events found dispatching network-vif-plugged-e0c27d11-afc7-4e26-8024-d4c7ad9a6baf {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:31:44 user nova-compute[74840]: WARNING nova.compute.manager [req-a5d5c718-928a-4697-ac5d-8d8473cc44c7 req-eeafffad-fb19-45b0-b459-53aa389c9458 service nova] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Received unexpected event network-vif-plugged-e0c27d11-afc7-4e26-8024-d4c7ad9a6baf for instance with vm_state active and task_state rebuild_spawning.
Nov 08 12:31:44 user nova-compute[74840]: DEBUG nova.compute.manager [req-a5d5c718-928a-4697-ac5d-8d8473cc44c7 req-eeafffad-fb19-45b0-b459-53aa389c9458 service nova] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Received event network-vif-plugged-e0c27d11-afc7-4e26-8024-d4c7ad9a6baf {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:31:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a5d5c718-928a-4697-ac5d-8d8473cc44c7 req-eeafffad-fb19-45b0-b459-53aa389c9458 service nova] Acquiring lock "e3175752-45a5-43e3-a99a-9377440e7bea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:31:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a5d5c718-928a-4697-ac5d-8d8473cc44c7 req-eeafffad-fb19-45b0-b459-53aa389c9458 service nova] Lock "e3175752-45a5-43e3-a99a-9377440e7bea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:31:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a5d5c718-928a-4697-ac5d-8d8473cc44c7 req-eeafffad-fb19-45b0-b459-53aa389c9458 service nova] Lock "e3175752-45a5-43e3-a99a-9377440e7bea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:31:44 user nova-compute[74840]: DEBUG nova.compute.manager [req-a5d5c718-928a-4697-ac5d-8d8473cc44c7 req-eeafffad-fb19-45b0-b459-53aa389c9458 service nova] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] No waiting events found dispatching network-vif-plugged-e0c27d11-afc7-4e26-8024-d4c7ad9a6baf {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:31:44 user nova-compute[74840]: WARNING nova.compute.manager [req-a5d5c718-928a-4697-ac5d-8d8473cc44c7 req-eeafffad-fb19-45b0-b459-53aa389c9458 service nova] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Received unexpected event network-vif-plugged-e0c27d11-afc7-4e26-8024-d4c7ad9a6baf for instance with vm_state active and task_state rebuild_spawning.
Nov 08 12:31:44 user nova-compute[74840]: INFO nova.compute.manager [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Took 10.80 seconds to build instance.
Nov 08 12:31:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-93b2c61f-8d20-4639-8bf0-981f984ab32b tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "7a482219-16ac-49e2-84ad-7e2030c97184" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.915s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:31:44 user nova-compute[74840]: DEBUG nova.compute.manager [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:31:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:31:44 user nova-compute[74840]: DEBUG nova.compute.manager [None req-44a76c29-dd2b-4b11-a3e7-5f0627559fa8 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:31:44 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Instance spawned successfully.
Nov 08 12:31:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:31:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Found default for hw_cdrom_bus of ide {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:31:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Found default for hw_disk_bus of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:31:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:31:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:31:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Found default for hw_video_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:31:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Found default for hw_vif_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:31:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-47c0864b-5720-4a80-aedc-1f3fcb7d7382 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Acquiring lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:31:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-47c0864b-5720-4a80-aedc-1f3fcb7d7382 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:31:44 user nova-compute[74840]: DEBUG nova.compute.manager [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:31:44 user nova-compute[74840]: INFO nova.compute.manager [None req-47c0864b-5720-4a80-aedc-1f3fcb7d7382 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Detaching volume 596bd9e9-a02d-4b9d-95dd-87127daf8a60
Nov 08 12:31:44 user nova-compute[74840]: INFO nova.virt.block_device [None req-47c0864b-5720-4a80-aedc-1f3fcb7d7382 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Attempting to driver detach volume 596bd9e9-a02d-4b9d-95dd-87127daf8a60 from mountpoint /dev/vdc
Nov 08 12:31:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:31:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:31:44 user nova-compute[74840]: DEBUG nova.objects.instance [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74840) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 08 12:31:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-47c0864b-5720-4a80-aedc-1f3fcb7d7382 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Attempting to detach device vdc from instance 4dcf7b89-a5ca-47ab-a4c9-878f53086de1 from the persistent domain config. {{(pid=74840) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 12:31:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-47c0864b-5720-4a80-aedc-1f3fcb7d7382 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 12:31:44 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:31:44 user nova-compute[74840]:   <source dev="/dev/sdb"/>
Nov 08 12:31:44 user nova-compute[74840]:   <target dev="vdc" bus="virtio"/>
Nov 08 12:31:44 user nova-compute[74840]:   <serial>596bd9e9-a02d-4b9d-95dd-87127daf8a60</serial>
Nov 08 12:31:44 user nova-compute[74840]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 12:31:44 user nova-compute[74840]: </disk>
Nov 08 12:31:44 user nova-compute[74840]:  {{(pid=74840) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 12:31:44 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-47c0864b-5720-4a80-aedc-1f3fcb7d7382 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Successfully detached device vdc from instance 4dcf7b89-a5ca-47ab-a4c9-878f53086de1 from the persistent domain config.
Nov 08 12:31:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-47c0864b-5720-4a80-aedc-1f3fcb7d7382 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 4dcf7b89-a5ca-47ab-a4c9-878f53086de1 from the live domain config. {{(pid=74840) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 12:31:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-47c0864b-5720-4a80-aedc-1f3fcb7d7382 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 12:31:44 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:31:44 user nova-compute[74840]:   <source dev="/dev/sdb"/>
Nov 08 12:31:44 user nova-compute[74840]:   <target dev="vdc" bus="virtio"/>
Nov 08 12:31:44 user nova-compute[74840]:   <serial>596bd9e9-a02d-4b9d-95dd-87127daf8a60</serial>
Nov 08 12:31:44 user nova-compute[74840]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 12:31:44 user nova-compute[74840]: </disk>
Nov 08 12:31:44 user nova-compute[74840]:  {{(pid=74840) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 12:31:45 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0744f4ca-38b7-4a7a-bd94-c670e50ba1b1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.110s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:31:45 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-47c0864b-5720-4a80-aedc-1f3fcb7d7382 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 4dcf7b89-a5ca-47ab-a4c9-878f53086de1 {{(pid=74840) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 12:31:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:54 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:31:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:31:59 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:32:01 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:32:01 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:32:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "refresh_cache-10c42516-62ba-4aa9-bc5a-d94499bd6b65" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:32:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquired lock "refresh_cache-10c42516-62ba-4aa9-bc5a-d94499bd6b65" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:32:01 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Forcefully refreshing network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 12:32:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:32:02 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Updating instance_info_cache with network_info: [{"id": "7cf349fa-e382-4526-af9d-f60a53d870cb", "address": "fa:16:3e:97:67:76", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cf349fa-e3", "ovs_interfaceid": "7cf349fa-e382-4526-af9d-f60a53d870cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:32:02 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Releasing lock "refresh_cache-10c42516-62ba-4aa9-bc5a-d94499bd6b65" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:32:02 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Updated the network info_cache for instance {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 12:32:02 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:32:02 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:32:02 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:32:02 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:32:02 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:32:03 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:32:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:32:04 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:32:05 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-47c0864b-5720-4a80-aedc-1f3fcb7d7382 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 4dcf7b89-a5ca-47ab-a4c9-878f53086de1 is timed out.
Nov 08 12:32:05 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-47c0864b-5720-4a80-aedc-1f3fcb7d7382 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Successfully detached device vdc from instance 4dcf7b89-a5ca-47ab-a4c9-878f53086de1 from the live domain config.
Nov 08 12:32:05 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47c0864b-5720-4a80-aedc-1f3fcb7d7382 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 12:32:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c0864b-5720-4a80-aedc-1f3fcb7d7382 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gwHTmAna', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:32:05 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-47c0864b-5720-4a80-aedc-1f3fcb7d7382 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:32:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-47c0864b-5720-4a80-aedc-1f3fcb7d7382 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:32:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-47c0864b-5720-4a80-aedc-1f3fcb7d7382 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:32:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:32:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:32:05 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[70bb3d67-d55e-4033-a436-7764c94e85eb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:32:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c0864b-5720-4a80-aedc-1f3fcb7d7382 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 12:32:05 user nova-compute[74840]: No targets found.
Nov 08 12:32:05 user nova-compute[74840]: iSNS:
Nov 08 12:32:05 user nova-compute[74840]: No targets found.
Nov 08 12:32:05 user nova-compute[74840]: STATIC:
Nov 08 12:32:05 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2
Nov 08 12:32:05 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:32:05 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:32:05 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c
Nov 08 12:32:05 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:32:05 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:32:05 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4
Nov 08 12:32:05 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:32:05 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:32:05 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b
Nov 08 12:32:05 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:32:05 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:32:05 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321
Nov 08 12:32:05 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:32:05 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:32:05 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60
Nov 08 12:32:05 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:32:05 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:32:05 user nova-compute[74840]: FIRMWARE:
Nov 08 12:32:05 user nova-compute[74840]: No targets found.
Nov 08 12:32:05 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:32:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c0864b-5720-4a80-aedc-1f3fcb7d7382 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 12:32:05 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 12:32:05 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 12:32:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c0864b-5720-4a80-aedc-1f3fcb7d7382 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 12:32:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:32:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:32:05 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd465a24-b136-40a2-a2b8-647348bc54b5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:32:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:32:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:32:05 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1fb4d0-6ffe-406d-b93f-10de0d5017c8]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:32:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c0864b-5720-4a80-aedc-1f3fcb7d7382 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:32:05 user nova-compute[74840]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 (non-flash)
Nov 08 12:32:05 user nova-compute[74840]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)
Nov 08 12:32:05 user nova-compute[74840]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 (non-flash)
Nov 08 12:32:05 user nova-compute[74840]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)
Nov 08 12:32:05 user nova-compute[74840]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 (non-flash)
Nov 08 12:32:05 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:32:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c0864b-5720-4a80-aedc-1f3fcb7d7382 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:32:05 user nova-compute[74840]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 (non-flash)
Nov 08 12:32:05 user nova-compute[74840]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)
Nov 08 12:32:05 user nova-compute[74840]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 (non-flash)
Nov 08 12:32:05 user nova-compute[74840]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)
Nov 08 12:32:05 user nova-compute[74840]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 (non-flash)
Nov 08 12:32:05 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:32:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c0864b-5720-4a80-aedc-1f3fcb7d7382 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7d446a320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60'): ({'sdb'}, set())}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 12:32:05 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-47c0864b-5720-4a80-aedc-1f3fcb7d7382 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Removing single pathed devices sdb {{(pid=74840) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 12:32:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:32:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:32:05 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd60f6e-9f30-466a-8aad-ad33f61eb44d]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:32:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:32:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:32:05 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8075f5ab-592c-4efe-9907-4c10d86bd70f]: (4, ('ok\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:32:05 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-47c0864b-5720-4a80-aedc-1f3fcb7d7382 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Flushing IO for device /dev/sdb {{(pid=74840) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 12:32:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:32:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:32:05 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a301e278-2eab-467a-9e6d-c5b936d16eb9]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:32:05 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-47c0864b-5720-4a80-aedc-1f3fcb7d7382 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74840) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 12:32:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:32:05 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:32:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:32:05 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[53773c43-89f1-4dc4-93fc-224c4526fbd6]: (4, ('1', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:32:05 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-47c0864b-5720-4a80-aedc-1f3fcb7d7382 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 12:32:05 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-47c0864b-5720-4a80-aedc-1f3fcb7d7382 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] SCSI volumes sdb have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 12:32:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c0864b-5720-4a80-aedc-1f3fcb7d7382 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60')] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 12:32:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:32:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:32:05 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[18435ba3-45b0-4248-970f-bfb1cbe5aba5]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:32:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c0864b-5720-4a80-aedc-1f3fcb7d7382 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:32:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 -p 172.16.0.220:3260 --logout {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:32:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:32:05 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ddbcc1-fe6a-4fd4-b4ce-67143f83f515]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:32:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c0864b-5720-4a80-aedc-1f3fcb7d7382 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60, portal: 172.16.0.220,3260]
Nov 08 12:32:05 user nova-compute[74840]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60, portal: 172.16.0.220,3260] successful.
Nov 08 12:32:05 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:32:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 -p 172.16.0.220:3260 --op delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:32:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:596bd9e9-a02d-4b9d-95dd-87127daf8a60 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:32:05 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed973b9-a975-4df1-a17f-27bcf6e41eb0]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:32:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c0864b-5720-4a80-aedc-1f3fcb7d7382 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:32:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-47c0864b-5720-4a80-aedc-1f3fcb7d7382 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:32:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c0864b-5720-4a80-aedc-1f3fcb7d7382 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] <== disconnect_volume: return (341ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:32:05 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47c0864b-5720-4a80-aedc-1f3fcb7d7382 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 12:32:06 user nova-compute[74840]: DEBUG nova.objects.instance [None req-47c0864b-5720-4a80-aedc-1f3fcb7d7382 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lazy-loading 'flavor' on Instance uuid 4dcf7b89-a5ca-47ab-a4c9-878f53086de1 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:32:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-47c0864b-5720-4a80-aedc-1f3fcb7d7382 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.047s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:32:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:32:08 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:32:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:32:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:32:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:32:08 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:32:08 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:32:08 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:32:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a482219-16ac-49e2-84ad-7e2030c97184/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:32:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a482219-16ac-49e2-84ad-7e2030c97184/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:32:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a482219-16ac-49e2-84ad-7e2030c97184/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:32:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:32:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a482219-16ac-49e2-84ad-7e2030c97184/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:32:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c4fc63-0757-46da-ad00-7b6c6513deca/disk.rescue --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:32:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c4fc63-0757-46da-ad00-7b6c6513deca/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:32:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c4fc63-0757-46da-ad00-7b6c6513deca/disk.rescue --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:32:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c4fc63-0757-46da-ad00-7b6c6513deca/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:32:09 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /opt/stack/data/nova/instances/a2c4fc63-0757-46da-ad00-7b6c6513deca/disk (vdb) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:32:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:32:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:32:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:32:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:32:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:32:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:32:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:32:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:32:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:32:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:32:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:32:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:32:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:32:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:32:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:32:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:32:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcf7b89-a5ca-47ab-a4c9-878f53086de1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:32:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcf7b89-a5ca-47ab-a4c9-878f53086de1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:32:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcf7b89-a5ca-47ab-a4c9-878f53086de1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:32:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dcf7b89-a5ca-47ab-a4c9-878f53086de1/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:32:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3175752-45a5-43e3-a99a-9377440e7bea/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:32:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3175752-45a5-43e3-a99a-9377440e7bea/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:32:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3175752-45a5-43e3-a99a-9377440e7bea/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:32:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:32:12 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3175752-45a5-43e3-a99a-9377440e7bea/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:32:12 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:32:12 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:32:12 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:32:12 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:32:12 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:32:12 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:32:12 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:32:12 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:32:12 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:32:12 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:32:13 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:32:13 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:32:13 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=7363MB free_disk=24.83920669555664GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:32:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:32:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:32:13 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance d3e8efc6-7146-46ef-8433-380d7e69120c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:32:13 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance ffe50042-29bf-4ef3-a148-8698bc75233b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:32:13 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 8b7c490e-4c78-4e07-bc8a-3be2328963d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:32:13 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 832a6445-84ee-43a8-a5bc-a07670602912 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:32:13 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 10c42516-62ba-4aa9-bc5a-d94499bd6b65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:32:13 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 9991e7b4-aaf8-4485-b658-e1af634925de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:32:13 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance e3175752-45a5-43e3-a99a-9377440e7bea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:32:13 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 4dcf7b89-a5ca-47ab-a4c9-878f53086de1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:32:13 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance a2c4fc63-0757-46da-ad00-7b6c6513deca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:32:13 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:32:13 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 83da3dce-e270-4054-910d-c8ad28eb18da actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:32:13 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 7a482219-16ac-49e2-84ad-7e2030c97184 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:32:13 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:32:13 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:32:13 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:32:13 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:32:13 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:32:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.566s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:32:14 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:32:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:32:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:32:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:32:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:32:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 12:32:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:32:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:32:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:32:29 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:32:29 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:32:29 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 12:32:29 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:32:29 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:32:29 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:32:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:32:34 user nova-compute[74840]: INFO nova.compute.manager [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Rescuing
Nov 08 12:32:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquiring lock "refresh_cache-b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:32:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquired lock "refresh_cache-b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:32:34 user nova-compute[74840]: DEBUG nova.network.neutron [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:32:35 user nova-compute[74840]: DEBUG nova.network.neutron [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Updating instance_info_cache with network_info: [{"id": "8fd26752-a3a0-4b97-a43f-73454925abea", "address": "fa:16:3e:2a:e1:f9", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd26752-a3", "ovs_interfaceid": "8fd26752-a3a0-4b97-a43f-73454925abea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:32:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Releasing lock "refresh_cache-b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:32:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:32:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fff891bf-93d0-44e4-855f-28f31cd1d8bc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Acquiring lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:32:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fff891bf-93d0-44e4-855f-28f31cd1d8bc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:32:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fff891bf-93d0-44e4-855f-28f31cd1d8bc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Acquiring lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:32:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fff891bf-93d0-44e4-855f-28f31cd1d8bc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:32:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fff891bf-93d0-44e4-855f-28f31cd1d8bc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:32:35 user nova-compute[74840]: INFO nova.compute.manager [None req-fff891bf-93d0-44e4-855f-28f31cd1d8bc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Terminating instance
Nov 08 12:32:35 user nova-compute[74840]: DEBUG nova.compute.manager [None req-fff891bf-93d0-44e4-855f-28f31cd1d8bc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Start destroying the instance on the hypervisor. {{(pid=74840) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 12:32:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:32:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:32:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:32:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:32:35 user nova-compute[74840]: DEBUG nova.compute.manager [req-921aa695-bb4b-454d-86e2-058e2eba42cd req-dbc3ae80-23c1-4afb-88b5-0d2a1c88e853 service nova] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Received event network-vif-unplugged-8fd26752-a3a0-4b97-a43f-73454925abea {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:32:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-921aa695-bb4b-454d-86e2-058e2eba42cd req-dbc3ae80-23c1-4afb-88b5-0d2a1c88e853 service nova] Acquiring lock "b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:32:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-921aa695-bb4b-454d-86e2-058e2eba42cd req-dbc3ae80-23c1-4afb-88b5-0d2a1c88e853 service nova] Lock "b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:32:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-921aa695-bb4b-454d-86e2-058e2eba42cd req-dbc3ae80-23c1-4afb-88b5-0d2a1c88e853 service nova] Lock "b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:32:35 user nova-compute[74840]: DEBUG nova.compute.manager [req-921aa695-bb4b-454d-86e2-058e2eba42cd req-dbc3ae80-23c1-4afb-88b5-0d2a1c88e853 service nova] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] No waiting events found dispatching network-vif-unplugged-8fd26752-a3a0-4b97-a43f-73454925abea {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:32:35 user nova-compute[74840]: WARNING nova.compute.manager [req-921aa695-bb4b-454d-86e2-058e2eba42cd req-dbc3ae80-23c1-4afb-88b5-0d2a1c88e853 service nova] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Received unexpected event network-vif-unplugged-8fd26752-a3a0-4b97-a43f-73454925abea for instance with vm_state active and task_state rescuing.
Nov 08 12:32:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:32:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:32:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:32:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:32:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:32:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:32:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:32:36 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Instance destroyed successfully.
Nov 08 12:32:36 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Attempting a stable device rescue
Nov 08 12:32:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:32:36 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Instance destroyed successfully.
Nov 08 12:32:36 user nova-compute[74840]: DEBUG nova.objects.instance [None req-fff891bf-93d0-44e4-855f-28f31cd1d8bc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lazy-loading 'resources' on Instance uuid 4dcf7b89-a5ca-47ab-a4c9-878f53086de1 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:32:36 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-fff891bf-93d0-44e4-855f-28f31cd1d8bc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T12:25:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-391869052',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-391869052',id=32,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrGy7EpmCBYTbWiiHXAUW34ziKvgVFQxqUXholjrggD3zzCzFnJaLmcpIi16aC0dgaBENrhZl/DCndvcoRIFslJq5F6SEzu3+3GzYY2+JpNAzefU+twGFUUtMYhD5mdUw==',key_name='tempest-keypair-1869051926',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:30:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='93a05cda834445fb94e71f6cac02f198',ramdisk_id='',reservation_id='r-ovc6od6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1958698266',owner_user_name='tempest-AttachVolumeShelveTestJSON-1958698266-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:30:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='afc4e8483a1f4e08b3f81a9b9323be84',uuid=4dcf7b89-a5ca-47ab-a4c9-878f53086de1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0b1fa9b-7ace-4c3b-af97-f62a085e0076", "address": "fa:16:3e:56:2a:9f", "network": {"id": "918d8aed-1f09-4cfb-9c7f-48f002ad6ba3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-927886396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a05cda834445fb94e71f6cac02f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b1fa9b-7a", "ovs_interfaceid": "f0b1fa9b-7ace-4c3b-af97-f62a085e0076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:32:36 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-fff891bf-93d0-44e4-855f-28f31cd1d8bc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Converting VIF {"id": "f0b1fa9b-7ace-4c3b-af97-f62a085e0076", "address": "fa:16:3e:56:2a:9f", "network": {"id": "918d8aed-1f09-4cfb-9c7f-48f002ad6ba3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-927886396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a05cda834445fb94e71f6cac02f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0b1fa9b-7a", "ovs_interfaceid": "f0b1fa9b-7ace-4c3b-af97-f62a085e0076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:32:36 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-fff891bf-93d0-44e4-855f-28f31cd1d8bc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:2a:9f,bridge_name='br-int',has_traffic_filtering=True,id=f0b1fa9b-7ace-4c3b-af97-f62a085e0076,network=Network(918d8aed-1f09-4cfb-9c7f-48f002ad6ba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b1fa9b-7a') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:32:36 user nova-compute[74840]: DEBUG os_vif [None req-fff891bf-93d0-44e4-855f-28f31cd1d8bc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:2a:9f,bridge_name='br-int',has_traffic_filtering=True,id=f0b1fa9b-7ace-4c3b-af97-f62a085e0076,network=Network(918d8aed-1f09-4cfb-9c7f-48f002ad6ba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b1fa9b-7a') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:32:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:32:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0b1fa9b-7a, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:32:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:32:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:32:36 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74840) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 12:32:36 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Instance directory exists: not creating {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 12:32:36 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Creating image(s)
Nov 08 12:32:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquiring lock "/opt/stack/data/nova/instances/b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:32:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "/opt/stack/data/nova/instances/b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:32:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "/opt/stack/data/nova/instances/b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:32:36 user nova-compute[74840]: DEBUG nova.objects.instance [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lazy-loading 'trusted_certs' on Instance uuid b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:32:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:32:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:32:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b3444da9-ac6b-4a0b-9ced-5720057e6c95) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:32:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:32:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:32:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquiring lock "f8d5ecd30fc6a8e40b2f178f4547e549d7189869" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:32:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "f8d5ecd30fc6a8e40b2f178f4547e549d7189869" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:32:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:32:37 user nova-compute[74840]: INFO os_vif [None req-fff891bf-93d0-44e4-855f-28f31cd1d8bc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:2a:9f,bridge_name='br-int',has_traffic_filtering=True,id=f0b1fa9b-7ace-4c3b-af97-f62a085e0076,network=Network(918d8aed-1f09-4cfb-9c7f-48f002ad6ba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0b1fa9b-7a')
Nov 08 12:32:37 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-fff891bf-93d0-44e4-855f-28f31cd1d8bc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Deleting instance files /opt/stack/data/nova/instances/4dcf7b89-a5ca-47ab-a4c9-878f53086de1_del
Nov 08 12:32:37 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-fff891bf-93d0-44e4-855f-28f31cd1d8bc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Deletion of /opt/stack/data/nova/instances/4dcf7b89-a5ca-47ab-a4c9-878f53086de1_del complete
Nov 08 12:32:37 user nova-compute[74840]: INFO nova.compute.manager [None req-fff891bf-93d0-44e4-855f-28f31cd1d8bc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Took 1.83 seconds to destroy the instance on the hypervisor.
Nov 08 12:32:37 user nova-compute[74840]: DEBUG oslo.service.loopingcall [None req-fff891bf-93d0-44e4-855f-28f31cd1d8bc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74840) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 12:32:37 user nova-compute[74840]: DEBUG nova.compute.manager [-] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Deallocating network for instance {{(pid=74840) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 12:32:37 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] deallocate_for_instance() {{(pid=74840) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 12:32:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8d5ecd30fc6a8e40b2f178f4547e549d7189869.part --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:32:38 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:32:38 user nova-compute[74840]: DEBUG nova.compute.manager [req-12d1b632-ed15-4668-9817-30de017c2e70 req-113bdbca-fdbd-4e9c-a41c-58b2fcb0cfdc service nova] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Received event network-vif-plugged-8fd26752-a3a0-4b97-a43f-73454925abea {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:32:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-12d1b632-ed15-4668-9817-30de017c2e70 req-113bdbca-fdbd-4e9c-a41c-58b2fcb0cfdc service nova] Acquiring lock "b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:32:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-12d1b632-ed15-4668-9817-30de017c2e70 req-113bdbca-fdbd-4e9c-a41c-58b2fcb0cfdc service nova] Lock "b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:32:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-12d1b632-ed15-4668-9817-30de017c2e70 req-113bdbca-fdbd-4e9c-a41c-58b2fcb0cfdc service nova] Lock "b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:32:38 user nova-compute[74840]: DEBUG nova.compute.manager [req-12d1b632-ed15-4668-9817-30de017c2e70 req-113bdbca-fdbd-4e9c-a41c-58b2fcb0cfdc service nova] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] No waiting events found dispatching network-vif-plugged-8fd26752-a3a0-4b97-a43f-73454925abea {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:32:38 user nova-compute[74840]: WARNING nova.compute.manager [req-12d1b632-ed15-4668-9817-30de017c2e70 req-113bdbca-fdbd-4e9c-a41c-58b2fcb0cfdc service nova] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Received unexpected event network-vif-plugged-8fd26752-a3a0-4b97-a43f-73454925abea for instance with vm_state active and task_state rescuing.
Nov 08 12:32:38 user nova-compute[74840]: DEBUG nova.compute.manager [req-12d1b632-ed15-4668-9817-30de017c2e70 req-113bdbca-fdbd-4e9c-a41c-58b2fcb0cfdc service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Received event network-vif-unplugged-f0b1fa9b-7ace-4c3b-af97-f62a085e0076 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:32:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-12d1b632-ed15-4668-9817-30de017c2e70 req-113bdbca-fdbd-4e9c-a41c-58b2fcb0cfdc service nova] Acquiring lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:32:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-12d1b632-ed15-4668-9817-30de017c2e70 req-113bdbca-fdbd-4e9c-a41c-58b2fcb0cfdc service nova] Lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:32:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-12d1b632-ed15-4668-9817-30de017c2e70 req-113bdbca-fdbd-4e9c-a41c-58b2fcb0cfdc service nova] Lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:32:38 user nova-compute[74840]: DEBUG nova.compute.manager [req-12d1b632-ed15-4668-9817-30de017c2e70 req-113bdbca-fdbd-4e9c-a41c-58b2fcb0cfdc service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] No waiting events found dispatching network-vif-unplugged-f0b1fa9b-7ace-4c3b-af97-f62a085e0076 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:32:38 user nova-compute[74840]: DEBUG nova.compute.manager [req-12d1b632-ed15-4668-9817-30de017c2e70 req-113bdbca-fdbd-4e9c-a41c-58b2fcb0cfdc service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Received event network-vif-unplugged-f0b1fa9b-7ace-4c3b-af97-f62a085e0076 for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:32:38 user nova-compute[74840]: DEBUG nova.compute.manager [req-12d1b632-ed15-4668-9817-30de017c2e70 req-113bdbca-fdbd-4e9c-a41c-58b2fcb0cfdc service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Received event network-vif-plugged-f0b1fa9b-7ace-4c3b-af97-f62a085e0076 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:32:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-12d1b632-ed15-4668-9817-30de017c2e70 req-113bdbca-fdbd-4e9c-a41c-58b2fcb0cfdc service nova] Acquiring lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:32:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-12d1b632-ed15-4668-9817-30de017c2e70 req-113bdbca-fdbd-4e9c-a41c-58b2fcb0cfdc service nova] Lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:32:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-12d1b632-ed15-4668-9817-30de017c2e70 req-113bdbca-fdbd-4e9c-a41c-58b2fcb0cfdc service nova] Lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:32:38 user nova-compute[74840]: DEBUG nova.compute.manager [req-12d1b632-ed15-4668-9817-30de017c2e70 req-113bdbca-fdbd-4e9c-a41c-58b2fcb0cfdc service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] No waiting events found dispatching network-vif-plugged-f0b1fa9b-7ace-4c3b-af97-f62a085e0076 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:32:38 user nova-compute[74840]: WARNING nova.compute.manager [req-12d1b632-ed15-4668-9817-30de017c2e70 req-113bdbca-fdbd-4e9c-a41c-58b2fcb0cfdc service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Received unexpected event network-vif-plugged-f0b1fa9b-7ace-4c3b-af97-f62a085e0076 for instance with vm_state active and task_state deleting.
Nov 08 12:32:38 user nova-compute[74840]: DEBUG nova.compute.manager [req-12d1b632-ed15-4668-9817-30de017c2e70 req-113bdbca-fdbd-4e9c-a41c-58b2fcb0cfdc service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Received event network-vif-plugged-f0b1fa9b-7ace-4c3b-af97-f62a085e0076 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:32:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-12d1b632-ed15-4668-9817-30de017c2e70 req-113bdbca-fdbd-4e9c-a41c-58b2fcb0cfdc service nova] Acquiring lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:32:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-12d1b632-ed15-4668-9817-30de017c2e70 req-113bdbca-fdbd-4e9c-a41c-58b2fcb0cfdc service nova] Lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:32:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-12d1b632-ed15-4668-9817-30de017c2e70 req-113bdbca-fdbd-4e9c-a41c-58b2fcb0cfdc service nova] Lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:32:38 user nova-compute[74840]: DEBUG nova.compute.manager [req-12d1b632-ed15-4668-9817-30de017c2e70 req-113bdbca-fdbd-4e9c-a41c-58b2fcb0cfdc service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] No waiting events found dispatching network-vif-plugged-f0b1fa9b-7ace-4c3b-af97-f62a085e0076 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:32:38 user nova-compute[74840]: WARNING nova.compute.manager [req-12d1b632-ed15-4668-9817-30de017c2e70 req-113bdbca-fdbd-4e9c-a41c-58b2fcb0cfdc service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Received unexpected event network-vif-plugged-f0b1fa9b-7ace-4c3b-af97-f62a085e0076 for instance with vm_state active and task_state deleting.
Nov 08 12:32:38 user nova-compute[74840]: DEBUG nova.compute.manager [req-12d1b632-ed15-4668-9817-30de017c2e70 req-113bdbca-fdbd-4e9c-a41c-58b2fcb0cfdc service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Received event network-vif-plugged-f0b1fa9b-7ace-4c3b-af97-f62a085e0076 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:32:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-12d1b632-ed15-4668-9817-30de017c2e70 req-113bdbca-fdbd-4e9c-a41c-58b2fcb0cfdc service nova] Acquiring lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:32:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-12d1b632-ed15-4668-9817-30de017c2e70 req-113bdbca-fdbd-4e9c-a41c-58b2fcb0cfdc service nova] Lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:32:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-12d1b632-ed15-4668-9817-30de017c2e70 req-113bdbca-fdbd-4e9c-a41c-58b2fcb0cfdc service nova] Lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:32:38 user nova-compute[74840]: DEBUG nova.compute.manager [req-12d1b632-ed15-4668-9817-30de017c2e70 req-113bdbca-fdbd-4e9c-a41c-58b2fcb0cfdc service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] No waiting events found dispatching network-vif-plugged-f0b1fa9b-7ace-4c3b-af97-f62a085e0076 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:32:38 user nova-compute[74840]: WARNING nova.compute.manager [req-12d1b632-ed15-4668-9817-30de017c2e70 req-113bdbca-fdbd-4e9c-a41c-58b2fcb0cfdc service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Received unexpected event network-vif-plugged-f0b1fa9b-7ace-4c3b-af97-f62a085e0076 for instance with vm_state active and task_state deleting.
Nov 08 12:32:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8d5ecd30fc6a8e40b2f178f4547e549d7189869.part --force-share --output=json" returned: 0 in 0.188s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:32:38 user nova-compute[74840]: DEBUG nova.virt.images [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] d57c224a-2920-4379-8115-4ef22ba94cf6 was qcow2, converting to raw {{(pid=74840) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 12:32:38 user nova-compute[74840]: DEBUG nova.privsep.utils [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74840) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 12:32:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f8d5ecd30fc6a8e40b2f178f4547e549d7189869.part /opt/stack/data/nova/instances/_base/f8d5ecd30fc6a8e40b2f178f4547e549d7189869.converted {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:32:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f8d5ecd30fc6a8e40b2f178f4547e549d7189869.part /opt/stack/data/nova/instances/_base/f8d5ecd30fc6a8e40b2f178f4547e549d7189869.converted" returned: 0 in 0.538s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:32:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8d5ecd30fc6a8e40b2f178f4547e549d7189869.converted --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:32:38 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:32:38 user nova-compute[74840]: INFO nova.compute.manager [-] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Took 1.92 seconds to deallocate network for instance.
Nov 08 12:32:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8d5ecd30fc6a8e40b2f178f4547e549d7189869.converted --force-share --output=json" returned: 0 in 0.194s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "f8d5ecd30fc6a8e40b2f178f4547e549d7189869" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.427s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquiring lock "f8d5ecd30fc6a8e40b2f178f4547e549d7189869" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "f8d5ecd30fc6a8e40b2f178f4547e549d7189869" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8d5ecd30fc6a8e40b2f178f4547e549d7189869 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fff891bf-93d0-44e4-855f-28f31cd1d8bc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fff891bf-93d0-44e4-855f-28f31cd1d8bc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8d5ecd30fc6a8e40b2f178f4547e549d7189869 --force-share --output=json" returned: 0 in 0.182s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f8d5ecd30fc6a8e40b2f178f4547e549d7189869,backing_fmt=raw /opt/stack/data/nova/instances/b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c/disk.rescue {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f8d5ecd30fc6a8e40b2f178f4547e549d7189869,backing_fmt=raw /opt/stack/data/nova/instances/b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c/disk.rescue" returned: 0 in 0.057s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "f8d5ecd30fc6a8e40b2f178f4547e549d7189869" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG nova.objects.instance [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lazy-loading 'migration_context' on Instance uuid b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG nova.objects.base [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Object Instance<b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Created local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Start _get_guest_xml network_info=[{"id": "8fd26752-a3a0-4b97-a43f-73454925abea", "address": "fa:16:3e:2a:e1:f9", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "vif_mac": "fa:16:3e:2a:e1:f9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd26752-a3", "ovs_interfaceid": "8fd26752-a3a0-4b97-a43f-73454925abea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd57c224a-2920-4379-8115-4ef22ba94cf6', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '659d54ea-7eaa-42f5-a51d-0a8be27ff3e1', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KvbyqZVG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c', 'attached_at': '', 'detached_at': '', 'volume_id': 'c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c', 'serial': 'c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c'}, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG nova.objects.instance [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lazy-loading 'resources' on Instance uuid b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG nova.objects.base [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Object Instance<b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG nova.objects.instance [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lazy-loading 'numa_topology' on Instance uuid b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG nova.objects.base [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Object Instance<b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:32:39 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:32:39 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:32:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG nova.objects.instance [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lazy-loading 'vcpu_model' on Instance uuid b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG nova.objects.base [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Object Instance<b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Calling os-brick to attach iSCSI Volume {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KvbyqZVG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:32:39 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:32:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:32:39 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:32:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:32:39 user nova-compute[74840]: INFO os_brick.initiator.connectors.iscsi [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 12:32:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c -p 172.16.0.220:3260 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c -p 172.16.0.220:3260" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e833683-c6d1-4465-a6bb-637cfd2c17b2]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = KvbyqZVG\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 08 12:32:39 user nova-compute[74840]: node.name = iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c
Nov 08 12:32:39 user nova-compute[74840]: node.tpgt = -1
Nov 08 12:32:39 user nova-compute[74840]: node.startup = automatic
Nov 08 12:32:39 user nova-compute[74840]: node.leading_login = No
Nov 08 12:32:39 user nova-compute[74840]: iface.iscsi_ifacename = default
Nov 08 12:32:39 user nova-compute[74840]: iface.net_ifacename = <empty>
Nov 08 12:32:39 user nova-compute[74840]: iface.ipaddress = <empty>
Nov 08 12:32:39 user nova-compute[74840]: iface.prefix_len = 0
Nov 08 12:32:39 user nova-compute[74840]: iface.hwaddress = <empty>
Nov 08 12:32:39 user nova-compute[74840]: iface.transport_name = tcp
Nov 08 12:32:39 user nova-compute[74840]: iface.initiatorname = <empty>
Nov 08 12:32:39 user nova-compute[74840]: iface.state = <empty>
Nov 08 12:32:39 user nova-compute[74840]: iface.vlan_id = 0
Nov 08 12:32:39 user nova-compute[74840]: iface.vlan_priority = 0
Nov 08 12:32:39 user nova-compute[74840]: iface.vlan_state = <empty>
Nov 08 12:32:39 user nova-compute[74840]: iface.iface_num = 0
Nov 08 12:32:39 user nova-compute[74840]: iface.mtu = 0
Nov 08 12:32:39 user nova-compute[74840]: iface.port = 0
Nov 08 12:32:39 user nova-compute[74840]: iface.bootproto = <empty>
Nov 08 12:32:39 user nova-compute[74840]: iface.subnet_mask = <empty>
Nov 08 12:32:39 user nova-compute[74840]: iface.gateway = <empty>
Nov 08 12:32:39 user nova-compute[74840]: iface.dhcp_alt_client_id_state = <empty>
Nov 08 12:32:39 user nova-compute[74840]: iface.dhcp_alt_client_id = <empty>
Nov 08 12:32:39 user nova-compute[74840]: iface.dhcp_dns = <empty>
Nov 08 12:32:39 user nova-compute[74840]: iface.dhcp_learn_iqn = <empty>
Nov 08 12:32:39 user nova-compute[74840]: iface.dhcp_req_vendor_id_state = <empty>
Nov 08 12:32:39 user nova-compute[74840]: iface.dhcp_vendor_id_state = <empty>
Nov 08 12:32:39 user nova-compute[74840]: iface.dhcp_vendor_id = <empty>
Nov 08 12:32:39 user nova-compute[74840]: iface.dhcp_slp_da = <empty>
Nov 08 12:32:39 user nova-compute[74840]: iface.fragmentation = <empty>
Nov 08 12:32:39 user nova-compute[74840]: iface.gratuitous_arp = <empty>
Nov 08 12:32:39 user nova-compute[74840]: iface.incoming_forwarding = <empty>
Nov 08 12:32:39 user nova-compute[74840]: iface.tos_state = <empty>
Nov 08 12:32:39 user nova-compute[74840]: iface.tos = 0
Nov 08 12:32:39 user nova-compute[74840]: iface.ttl = 0
Nov 08 12:32:39 user nova-compute[74840]: iface.delayed_ack = <empty>
Nov 08 12:32:39 user nova-compute[74840]: iface.tcp_nagle = <empty>
Nov 08 12:32:39 user nova-compute[74840]: iface.tcp_wsf_state = <empty>
Nov 08 12:32:39 user nova-compute[74840]: iface.tcp_wsf = 0
Nov 08 12:32:39 user nova-compute[74840]: iface.tcp_timer_scale = 0
Nov 08 12:32:39 user nova-compute[74840]: iface.tcp_timestamp = <empty>
Nov 08 12:32:39 user nova-compute[74840]: iface.redirect = <empty>
Nov 08 12:32:39 user nova-compute[74840]: iface.def_task_mgmt_timeout = 0
Nov 08 12:32:39 user nova-compute[74840]: iface.header_digest = <empty>
Nov 08 12:32:39 user nova-compute[74840]: iface.data_digest = <empty>
Nov 08 12:32:39 user nova-compute[74840]: iface.immediate_data = <empty>
Nov 08 12:32:39 user nova-compute[74840]: iface.initial_r2t = <empty>
Nov 08 12:32:39 user nova-compute[74840]: iface.data_seq_inorder = <empty>
Nov 08 12:32:39 user nova-compute[74840]: iface.data_pdu_inorder = <empty>
Nov 08 12:32:39 user nova-compute[74840]: iface.erl = 0
Nov 08 12:32:39 user nova-compute[74840]: iface.max_receive_data_len = 0
Nov 08 12:32:39 user nova-compute[74840]: iface.first_burst_len = 0
Nov 08 12:32:39 user nova-compute[74840]: iface.max_outstanding_r2t = 0
Nov 08 12:32:39 user nova-compute[74840]: iface.max_burst_len = 0
Nov 08 12:32:39 user nova-compute[74840]: iface.chap_auth = <empty>
Nov 08 12:32:39 user nova-compute[74840]: iface.bidi_chap = <empty>
Nov 08 12:32:39 user nova-compute[74840]: iface.strict_login_compliance = <empty>
Nov 08 12:32:39 user nova-compute[74840]: iface.discovery_auth = <empty>
Nov 08 12:32:39 user nova-compute[74840]: iface.discovery_logout = <empty>
Nov 08 12:32:39 user nova-compute[74840]: node.discovery_address = <empty>
Nov 08 12:32:39 user nova-compute[74840]: node.discovery_port = 0
Nov 08 12:32:39 user nova-compute[74840]: node.discovery_type = static
Nov 08 12:32:39 user nova-compute[74840]: node.session.initial_cmdsn = 0
Nov 08 12:32:39 user nova-compute[74840]: node.session.initial_login_retry_max = 8
Nov 08 12:32:39 user nova-compute[74840]: node.session.xmit_thread_priority = -20
Nov 08 12:32:39 user nova-compute[74840]: node.session.cmds_max = 128
Nov 08 12:32:39 user nova-compute[74840]: node.session.queue_depth = 32
Nov 08 12:32:39 user nova-compute[74840]: node.session.nr_sessions = 1
Nov 08 12:32:39 user nova-compute[74840]: node.session.auth.authmethod = CHAP
Nov 08 12:32:39 user nova-compute[74840]: node.session.auth.username = KvbyqZVG
Nov 08 12:32:39 user nova-compute[74840]: node.session.auth.password = ***
Nov 08 12:32:39 user nova-compute[74840]: node.session.auth.username_in = <empty>
Nov 08 12:32:39 user nova-compute[74840]: node.session.auth.password_in = <empty>
Nov 08 12:32:39 user nova-compute[74840]: node.session.auth.chap_algs = MD5
Nov 08 12:32:39 user nova-compute[74840]: node.session.timeo.replacement_timeout = 120
Nov 08 12:32:39 user nova-compute[74840]: node.session.err_timeo.abort_timeout = 15
Nov 08 12:32:39 user nova-compute[74840]: node.session.err_timeo.lu_reset_timeout = 30
Nov 08 12:32:39 user nova-compute[74840]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 08 12:32:39 user nova-compute[74840]: node.session.err_timeo.host_reset_timeout = 60
Nov 08 12:32:39 user nova-compute[74840]: node.session.iscsi.FastAbort = Yes
Nov 08 12:32:39 user nova-compute[74840]: node.session.iscsi.InitialR2T = No
Nov 08 12:32:39 user nova-compute[74840]: node.session.iscsi.ImmediateData = Yes
Nov 08 12:32:39 user nova-compute[74840]: node.session.iscsi.FirstBurstLength = 262144
Nov 08 12:32:39 user nova-compute[74840]: node.session.iscsi.MaxBurstLength = 16776192
Nov 08 12:32:39 user nova-compute[74840]: node.session.iscsi.DefaultTime2Retain = 0
Nov 08 12:32:39 user nova-compute[74840]: node.session.iscsi.DefaultTime2Wait = 2
Nov 08 12:32:39 user nova-compute[74840]: node.session.iscsi.MaxConnections = 1
Nov 08 12:32:39 user nova-compute[74840]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 08 12:32:39 user nova-compute[74840]: node.session.iscsi.ERL = 0
Nov 08 12:32:39 user nova-compute[74840]: node.session.scan = manual
Nov 08 12:32:39 user nova-compute[74840]: node.session.reopen_max = 0
Nov 08 12:32:39 user nova-compute[74840]: node.conn[0].address = 172.16.0.220
Nov 08 12:32:39 user nova-compute[74840]: node.conn[0].port = 3260
Nov 08 12:32:39 user nova-compute[74840]: node.conn[0].startup = manual
Nov 08 12:32:39 user nova-compute[74840]: node.conn[0].tcp.window_size = 524288
Nov 08 12:32:39 user nova-compute[74840]: node.conn[0].tcp.type_of_service = 0
Nov 08 12:32:39 user nova-compute[74840]: node.conn[0].timeo.logout_timeout = 15
Nov 08 12:32:39 user nova-compute[74840]: node.conn[0].timeo.login_timeout = 15
Nov 08 12:32:39 user nova-compute[74840]: node.conn[0].timeo.auth_timeout = 45
Nov 08 12:32:39 user nova-compute[74840]: node.conn[0].timeo.noop_out_interval = 5
Nov 08 12:32:39 user nova-compute[74840]: node.conn[0].timeo.noop_out_timeout = 5
Nov 08 12:32:39 user nova-compute[74840]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 08 12:32:39 user nova-compute[74840]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 08 12:32:39 user nova-compute[74840]: node.conn[0].iscsi.HeaderDigest = None
Nov 08 12:32:39 user nova-compute[74840]: node.conn[0].iscsi.DataDigest = None
Nov 08 12:32:39 user nova-compute[74840]: node.conn[0].iscsi.IFMarker = No
Nov 08 12:32:39 user nova-compute[74840]: node.conn[0].iscsi.OFMarker = No
Nov 08 12:32:39 user nova-compute[74840]: # END RECORD
Nov 08 12:32:39 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-fff891bf-93d0-44e4-855f-28f31cd1d8bc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3435346a-4dec-4dfe-a4d3-3704eeaa52b5]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-fff891bf-93d0-44e4-855f-28f31cd1d8bc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f0ea9b-9d7f-41c0-a0e6-80961ab168a7]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KvbyqZVG {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fff891bf-93d0-44e4-855f-28f31cd1d8bc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.589s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KvbyqZVG" returned: 0 in 0.162s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[255e2801-3c90-4f9e-983e-6a89716a2a2a]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KvbyqZVG'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e5fc94-1db0-4222-bff4-69e507c4e94d]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:32:39 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-fff891bf-93d0-44e4-855f-28f31cd1d8bc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Deleted allocations for instance 4dcf7b89-a5ca-47ab-a4c9-878f53086de1
Nov 08 12:32:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ae6044-929f-41d4-acb4-0c202c4f9d2d]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:32:39 user nova-compute[74840]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)
Nov 08 12:32:39 user nova-compute[74840]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 (non-flash)
Nov 08 12:32:39 user nova-compute[74840]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)
Nov 08 12:32:39 user nova-compute[74840]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 (non-flash)
Nov 08 12:32:39 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:32:39 user nova-compute[74840]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)
Nov 08 12:32:39 user nova-compute[74840]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 (non-flash)
Nov 08 12:32:39 user nova-compute[74840]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)
Nov 08 12:32:39 user nova-compute[74840]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 (non-flash)
Nov 08 12:32:39 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Connected to 172.16.0.220:3260 {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] HCTL ('34', '0', '0', 0) found on session 35 with lun 0 {{(pid=74840) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=74840) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b0da13-5271-430c-9466-19ff2127eae9]: (4, ('0 0 0', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Searching for a device in session 35 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KvbyqZVG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.345s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] <== connect_volume: return (347ms) {'type': 'block', 'scsi_wwn': '23061366631656539', 'path': '/dev/sdc'} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061366631656539', 'path': '/dev/sdc'} {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG nova.compute.manager [req-a5a45700-96ea-440d-bbd5-b33af4704d44 req-b8c0b6a3-546e-4489-9e17-287212ab1fae service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Received event network-vif-unplugged-f0b1fa9b-7ace-4c3b-af97-f62a085e0076 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a5a45700-96ea-440d-bbd5-b33af4704d44 req-b8c0b6a3-546e-4489-9e17-287212ab1fae service nova] Acquiring lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a5a45700-96ea-440d-bbd5-b33af4704d44 req-b8c0b6a3-546e-4489-9e17-287212ab1fae service nova] Lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a5a45700-96ea-440d-bbd5-b33af4704d44 req-b8c0b6a3-546e-4489-9e17-287212ab1fae service nova] Lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG nova.compute.manager [req-a5a45700-96ea-440d-bbd5-b33af4704d44 req-b8c0b6a3-546e-4489-9e17-287212ab1fae service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] No waiting events found dispatching network-vif-unplugged-f0b1fa9b-7ace-4c3b-af97-f62a085e0076 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:32:39 user nova-compute[74840]: WARNING nova.compute.manager [req-a5a45700-96ea-440d-bbd5-b33af4704d44 req-b8c0b6a3-546e-4489-9e17-287212ab1fae service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Received unexpected event network-vif-unplugged-f0b1fa9b-7ace-4c3b-af97-f62a085e0076 for instance with vm_state deleted and task_state None.
Nov 08 12:32:39 user nova-compute[74840]: DEBUG nova.compute.manager [req-a5a45700-96ea-440d-bbd5-b33af4704d44 req-b8c0b6a3-546e-4489-9e17-287212ab1fae service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Received event network-vif-plugged-f0b1fa9b-7ace-4c3b-af97-f62a085e0076 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a5a45700-96ea-440d-bbd5-b33af4704d44 req-b8c0b6a3-546e-4489-9e17-287212ab1fae service nova] Acquiring lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a5a45700-96ea-440d-bbd5-b33af4704d44 req-b8c0b6a3-546e-4489-9e17-287212ab1fae service nova] Lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a5a45700-96ea-440d-bbd5-b33af4704d44 req-b8c0b6a3-546e-4489-9e17-287212ab1fae service nova] Lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG nova.compute.manager [req-a5a45700-96ea-440d-bbd5-b33af4704d44 req-b8c0b6a3-546e-4489-9e17-287212ab1fae service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] No waiting events found dispatching network-vif-plugged-f0b1fa9b-7ace-4c3b-af97-f62a085e0076 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:32:39 user nova-compute[74840]: WARNING nova.compute.manager [req-a5a45700-96ea-440d-bbd5-b33af4704d44 req-b8c0b6a3-546e-4489-9e17-287212ab1fae service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Received unexpected event network-vif-plugged-f0b1fa9b-7ace-4c3b-af97-f62a085e0076 for instance with vm_state deleted and task_state None.
Nov 08 12:32:39 user nova-compute[74840]: DEBUG nova.compute.manager [req-a5a45700-96ea-440d-bbd5-b33af4704d44 req-b8c0b6a3-546e-4489-9e17-287212ab1fae service nova] [instance: 4dcf7b89-a5ca-47ab-a4c9-878f53086de1] Received event network-vif-deleted-f0b1fa9b-7ace-4c3b-af97-f62a085e0076 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:29:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-997398221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-997398221',id=37,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:30:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72c97c47ab144ef3a8d5e9ee1ecc059e',ramdisk_id='',reservation_id='r-oxi3426h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-297593405',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:30:47Z,user_data=None,user_id='275e3d340c9d4d9e90b579e4bc0bfe0b',uuid=b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8fd26752-a3a0-4b97-a43f-73454925abea", "address": "fa:16:3e:2a:e1:f9", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "vif_mac": "fa:16:3e:2a:e1:f9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd26752-a3", "ovs_interfaceid": "8fd26752-a3a0-4b97-a43f-73454925abea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Converting VIF {"id": "8fd26752-a3a0-4b97-a43f-73454925abea", "address": "fa:16:3e:2a:e1:f9", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "vif_mac": "fa:16:3e:2a:e1:f9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd26752-a3", "ovs_interfaceid": "8fd26752-a3a0-4b97-a43f-73454925abea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:e1:f9,bridge_name='br-int',has_traffic_filtering=True,id=8fd26752-a3a0-4b97-a43f-73454925abea,network=Network(8388eafb-b115-49c7-82cd-0d85d0ee12e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fd26752-a3') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG nova.objects.instance [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lazy-loading 'pci_devices' on Instance uuid b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fff891bf-93d0-44e4-855f-28f31cd1d8bc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "4dcf7b89-a5ca-47ab-a4c9-878f53086de1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.595s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG nova.objects.base [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Object Instance<b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:32:39 user nova-compute[74840]:   <uuid>b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c</uuid>
Nov 08 12:32:39 user nova-compute[74840]:   <name>instance-00000025</name>
Nov 08 12:32:39 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:32:39 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:32:39 user nova-compute[74840]:   <metadata>
Nov 08 12:32:39 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:32:39 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:32:39 user nova-compute[74840]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-997398221</nova:name>
Nov 08 12:32:39 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:32:39</nova:creationTime>
Nov 08 12:32:39 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:32:39 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:32:39 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:32:39 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:32:39 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:32:39 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:32:39 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:32:39 user nova-compute[74840]:       <nova:owner>
Nov 08 12:32:39 user nova-compute[74840]:         <nova:user uuid="275e3d340c9d4d9e90b579e4bc0bfe0b">tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member</nova:user>
Nov 08 12:32:39 user nova-compute[74840]:         <nova:project uuid="72c97c47ab144ef3a8d5e9ee1ecc059e">tempest-ServerBootFromVolumeStableRescueTest-297593405</nova:project>
Nov 08 12:32:39 user nova-compute[74840]:       </nova:owner>
Nov 08 12:32:39 user nova-compute[74840]:       <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:32:39 user nova-compute[74840]:       <nova:ports>
Nov 08 12:32:39 user nova-compute[74840]:         <nova:port uuid="8fd26752-a3a0-4b97-a43f-73454925abea">
Nov 08 12:32:39 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 08 12:32:39 user nova-compute[74840]:         </nova:port>
Nov 08 12:32:39 user nova-compute[74840]:       </nova:ports>
Nov 08 12:32:39 user nova-compute[74840]:     </nova:instance>
Nov 08 12:32:39 user nova-compute[74840]:   </metadata>
Nov 08 12:32:39 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:32:39 user nova-compute[74840]:     <system>
Nov 08 12:32:39 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:32:39 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:32:39 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:32:39 user nova-compute[74840]:       <entry name="serial">b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c</entry>
Nov 08 12:32:39 user nova-compute[74840]:       <entry name="uuid">b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c</entry>
Nov 08 12:32:39 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:32:39 user nova-compute[74840]:     </system>
Nov 08 12:32:39 user nova-compute[74840]:   </sysinfo>
Nov 08 12:32:39 user nova-compute[74840]:   <os>
Nov 08 12:32:39 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:32:39 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:32:39 user nova-compute[74840]:   </os>
Nov 08 12:32:39 user nova-compute[74840]:   <features>
Nov 08 12:32:39 user nova-compute[74840]:     <acpi/>
Nov 08 12:32:39 user nova-compute[74840]:     <apic/>
Nov 08 12:32:39 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:32:39 user nova-compute[74840]:   </features>
Nov 08 12:32:39 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:32:39 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:32:39 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:32:39 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:32:39 user nova-compute[74840]:   </clock>
Nov 08 12:32:39 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:32:39 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:32:39 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:32:39 user nova-compute[74840]:   </cpu>
Nov 08 12:32:39 user nova-compute[74840]:   <devices>
Nov 08 12:32:39 user nova-compute[74840]:     <disk type="block" device="disk">
Nov 08 12:32:39 user nova-compute[74840]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:32:39 user nova-compute[74840]:       <source dev="/dev/sdc"/>
Nov 08 12:32:39 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:32:39 user nova-compute[74840]:       <serial>c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c</serial>
Nov 08 12:32:39 user nova-compute[74840]:     </disk>
Nov 08 12:32:39 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:32:39 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:32:39 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c/disk.rescue"/>
Nov 08 12:32:39 user nova-compute[74840]:       <target dev="vdb" bus="virtio"/>
Nov 08 12:32:39 user nova-compute[74840]:       <boot order="1"/>
Nov 08 12:32:39 user nova-compute[74840]:     </disk>
Nov 08 12:32:39 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:32:39 user nova-compute[74840]:       <mac address="fa:16:3e:2a:e1:f9"/>
Nov 08 12:32:39 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:32:39 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:32:39 user nova-compute[74840]:       <target dev="tap8fd26752-a3"/>
Nov 08 12:32:39 user nova-compute[74840]:     </interface>
Nov 08 12:32:39 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:32:39 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c/console.log" append="off"/>
Nov 08 12:32:39 user nova-compute[74840]:     </serial>
Nov 08 12:32:39 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:32:39 user nova-compute[74840]:     <video>
Nov 08 12:32:39 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:32:39 user nova-compute[74840]:     </video>
Nov 08 12:32:39 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:32:39 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:32:39 user nova-compute[74840]:     </rng>
Nov 08 12:32:39 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:32:39 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:32:39 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:32:39 user nova-compute[74840]:     </memballoon>
Nov 08 12:32:39 user nova-compute[74840]:   </devices>
Nov 08 12:32:39 user nova-compute[74840]: </domain>
Nov 08 12:32:39 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:32:39 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Instance destroyed successfully.
Nov 08 12:32:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:32:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] No VIF found with MAC fa:16:3e:2a:e1:f9, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:32:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:32:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:32:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:32:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:32:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:32:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:32:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:32:41 user nova-compute[74840]: DEBUG nova.compute.manager [req-d5c36a3c-52f2-4e66-8692-f5dc8b219795 req-3be52dcd-c8f9-467f-ab94-6b0ab9db34b8 service nova] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Received event network-vif-plugged-8fd26752-a3a0-4b97-a43f-73454925abea {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:32:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-d5c36a3c-52f2-4e66-8692-f5dc8b219795 req-3be52dcd-c8f9-467f-ab94-6b0ab9db34b8 service nova] Acquiring lock "b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:32:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-d5c36a3c-52f2-4e66-8692-f5dc8b219795 req-3be52dcd-c8f9-467f-ab94-6b0ab9db34b8 service nova] Lock "b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:32:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-d5c36a3c-52f2-4e66-8692-f5dc8b219795 req-3be52dcd-c8f9-467f-ab94-6b0ab9db34b8 service nova] Lock "b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:32:41 user nova-compute[74840]: DEBUG nova.compute.manager [req-d5c36a3c-52f2-4e66-8692-f5dc8b219795 req-3be52dcd-c8f9-467f-ab94-6b0ab9db34b8 service nova] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] No waiting events found dispatching network-vif-plugged-8fd26752-a3a0-4b97-a43f-73454925abea {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:32:41 user nova-compute[74840]: WARNING nova.compute.manager [req-d5c36a3c-52f2-4e66-8692-f5dc8b219795 req-3be52dcd-c8f9-467f-ab94-6b0ab9db34b8 service nova] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Received unexpected event network-vif-plugged-8fd26752-a3a0-4b97-a43f-73454925abea for instance with vm_state active and task_state rescuing.
Nov 08 12:32:41 user nova-compute[74840]: DEBUG nova.compute.manager [req-d5c36a3c-52f2-4e66-8692-f5dc8b219795 req-3be52dcd-c8f9-467f-ab94-6b0ab9db34b8 service nova] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Received event network-vif-plugged-8fd26752-a3a0-4b97-a43f-73454925abea {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:32:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-d5c36a3c-52f2-4e66-8692-f5dc8b219795 req-3be52dcd-c8f9-467f-ab94-6b0ab9db34b8 service nova] Acquiring lock "b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:32:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-d5c36a3c-52f2-4e66-8692-f5dc8b219795 req-3be52dcd-c8f9-467f-ab94-6b0ab9db34b8 service nova] Lock "b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:32:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-d5c36a3c-52f2-4e66-8692-f5dc8b219795 req-3be52dcd-c8f9-467f-ab94-6b0ab9db34b8 service nova] Lock "b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:32:41 user nova-compute[74840]: DEBUG nova.compute.manager [req-d5c36a3c-52f2-4e66-8692-f5dc8b219795 req-3be52dcd-c8f9-467f-ab94-6b0ab9db34b8 service nova] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] No waiting events found dispatching network-vif-plugged-8fd26752-a3a0-4b97-a43f-73454925abea {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:32:41 user nova-compute[74840]: WARNING nova.compute.manager [req-d5c36a3c-52f2-4e66-8692-f5dc8b219795 req-3be52dcd-c8f9-467f-ab94-6b0ab9db34b8 service nova] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Received unexpected event network-vif-plugged-8fd26752-a3a0-4b97-a43f-73454925abea for instance with vm_state active and task_state rescuing.
Nov 08 12:32:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:32:43 user nova-compute[74840]: DEBUG nova.compute.manager [None req-0796bcac-0780-4a05-aea2-5806655047b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:32:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:32:51 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:32:53 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:32:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:32:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:32:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:32:57 user nova-compute[74840]: DEBUG nova.compute.manager [req-ee9ccd23-05cc-41a8-ba9f-11b4d039562b req-5440ce26-2b95-4cc2-8a54-4033087899ef service nova] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Received event network-changed-c2a4679c-207f-4dfa-9209-f1a4d7d70834 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:32:57 user nova-compute[74840]: DEBUG nova.compute.manager [req-ee9ccd23-05cc-41a8-ba9f-11b4d039562b req-5440ce26-2b95-4cc2-8a54-4033087899ef service nova] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Refreshing instance network info cache due to event network-changed-c2a4679c-207f-4dfa-9209-f1a4d7d70834. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:32:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-ee9ccd23-05cc-41a8-ba9f-11b4d039562b req-5440ce26-2b95-4cc2-8a54-4033087899ef service nova] Acquiring lock "refresh_cache-83da3dce-e270-4054-910d-c8ad28eb18da" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:32:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-ee9ccd23-05cc-41a8-ba9f-11b4d039562b req-5440ce26-2b95-4cc2-8a54-4033087899ef service nova] Acquired lock "refresh_cache-83da3dce-e270-4054-910d-c8ad28eb18da" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:32:57 user nova-compute[74840]: DEBUG nova.network.neutron [req-ee9ccd23-05cc-41a8-ba9f-11b4d039562b req-5440ce26-2b95-4cc2-8a54-4033087899ef service nova] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Refreshing network info cache for port c2a4679c-207f-4dfa-9209-f1a4d7d70834 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:32:58 user nova-compute[74840]: DEBUG nova.network.neutron [req-ee9ccd23-05cc-41a8-ba9f-11b4d039562b req-5440ce26-2b95-4cc2-8a54-4033087899ef service nova] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Updated VIF entry in instance network info cache for port c2a4679c-207f-4dfa-9209-f1a4d7d70834. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:32:58 user nova-compute[74840]: DEBUG nova.network.neutron [req-ee9ccd23-05cc-41a8-ba9f-11b4d039562b req-5440ce26-2b95-4cc2-8a54-4033087899ef service nova] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Updating instance_info_cache with network_info: [{"id": "c2a4679c-207f-4dfa-9209-f1a4d7d70834", "address": "fa:16:3e:4e:da:51", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a4679c-20", "ovs_interfaceid": "c2a4679c-207f-4dfa-9209-f1a4d7d70834", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:32:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-ee9ccd23-05cc-41a8-ba9f-11b4d039562b req-5440ce26-2b95-4cc2-8a54-4033087899ef service nova] Releasing lock "refresh_cache-83da3dce-e270-4054-910d-c8ad28eb18da" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:33:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:02 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:02 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:06 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:33:06 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:33:06 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:33:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "refresh_cache-9991e7b4-aaf8-4485-b658-e1af634925de" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:33:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquired lock "refresh_cache-9991e7b4-aaf8-4485-b658-e1af634925de" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:33:06 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Forcefully refreshing network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 12:33:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:07 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Updating instance_info_cache with network_info: [{"id": "fe5dab01-dd0f-4772-ab5b-1b089b47c565", "address": "fa:16:3e:9b:27:ee", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe5dab01-dd", "ovs_interfaceid": "fe5dab01-dd0f-4772-ab5b-1b089b47c565", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:33:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Releasing lock "refresh_cache-9991e7b4-aaf8-4485-b658-e1af634925de" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:33:07 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Updated the network info_cache for instance {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 12:33:07 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:33:07 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:33:07 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:33:07 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:33:07 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:33:07 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:33:07 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:33:09 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:33:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:33:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:33:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:33:09 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:33:09 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:33:09 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c/disk.rescue --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:33:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:33:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c/disk.rescue --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:33:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:33:10 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:33:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a482219-16ac-49e2-84ad-7e2030c97184/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:33:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a482219-16ac-49e2-84ad-7e2030c97184/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:33:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a482219-16ac-49e2-84ad-7e2030c97184/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:33:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a482219-16ac-49e2-84ad-7e2030c97184/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:33:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c4fc63-0757-46da-ad00-7b6c6513deca/disk.rescue --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:33:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c4fc63-0757-46da-ad00-7b6c6513deca/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:33:10 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c4fc63-0757-46da-ad00-7b6c6513deca/disk.rescue --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:33:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c4fc63-0757-46da-ad00-7b6c6513deca/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:33:11 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /opt/stack/data/nova/instances/a2c4fc63-0757-46da-ad00-7b6c6513deca/disk (vdb) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:33:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:33:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:33:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:33:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:33:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:33:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:33:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:33:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:33:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:33:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:12 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:33:12 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:33:12 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:33:12 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:33:12 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:33:12 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:33:12 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:33:12 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3175752-45a5-43e3-a99a-9377440e7bea/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:33:12 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3175752-45a5-43e3-a99a-9377440e7bea/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:33:12 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3175752-45a5-43e3-a99a-9377440e7bea/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:33:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3175752-45a5-43e3-a99a-9377440e7bea/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:33:13 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:33:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:33:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:33:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:33:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:33:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:33:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:33:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:33:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:33:13 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:33:14 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:33:14 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:33:14 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=7511MB free_disk=24.749961853027344GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:33:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:33:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:33:14 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance d3e8efc6-7146-46ef-8433-380d7e69120c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:33:14 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance ffe50042-29bf-4ef3-a148-8698bc75233b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:33:14 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 8b7c490e-4c78-4e07-bc8a-3be2328963d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:33:14 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 832a6445-84ee-43a8-a5bc-a07670602912 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:33:14 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 10c42516-62ba-4aa9-bc5a-d94499bd6b65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:33:14 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 9991e7b4-aaf8-4485-b658-e1af634925de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:33:14 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance e3175752-45a5-43e3-a99a-9377440e7bea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:33:14 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance a2c4fc63-0757-46da-ad00-7b6c6513deca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:33:14 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:33:14 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 83da3dce-e270-4054-910d-c8ad28eb18da actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:33:14 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 7a482219-16ac-49e2-84ad-7e2030c97184 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:33:14 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:33:14 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:33:14 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:33:14 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:33:14 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:33:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.555s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:33:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:33:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:33:17 user nova-compute[74840]: DEBUG nova.compute.manager [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Starting instance... {{(pid=74840) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 12:33:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:33:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:33:17 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:33:17 user nova-compute[74840]: INFO nova.compute.claims [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Claim successful on node user
Nov 08 12:33:17 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:33:17 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:33:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.446s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:33:17 user nova-compute[74840]: DEBUG nova.compute.manager [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Start building networks asynchronously for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 12:33:17 user nova-compute[74840]: DEBUG nova.compute.manager [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Allocating IP information in the background. {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 12:33:17 user nova-compute[74840]: DEBUG nova.network.neutron [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 12:33:17 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 12:33:17 user nova-compute[74840]: DEBUG nova.compute.manager [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Start building block device mappings for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 12:33:18 user nova-compute[74840]: DEBUG nova.policy [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '794c0281e1bf48f79117efdc3907e661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1250106b55ae44b0b303849df7781ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 12:33:18 user nova-compute[74840]: INFO nova.virt.block_device [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Booting with volume bbde86c3-d678-411a-b903-d997dc3780e4 at /dev/vda
Nov 08 12:33:18 user nova-compute[74840]: DEBUG os_brick.utils [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:33:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:33:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:33:18 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3a39d8-152e-4f77-8f3a-22950161a232]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c8228a11e03c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:33:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:33:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:33:18 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[47100006-58a3-448f-bd22-f874caf9578a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:33:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:33:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:33:18 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ba31af-5bdf-4819-b8c7-bd0f567b29ee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:33:18 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab475b81-344b-4e99-a96c-551590c6e6e9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:33:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Running cmd (subprocess): nvme version {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:33:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] 'nvme version' failed. Not Retrying. {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:33:18 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] nvme not present on system {{(pid=74840) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 12:33:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:33:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:33:18 user nova-compute[74840]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 12:33:18 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[78658a2b-53dd-47a9-b4c3-21fc1119f323]: (4, '') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:33:18 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74840) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 12:33:18 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 12:33:18 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] LIGHTOS: no hostnqn found. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 12:33:18 user nova-compute[74840]: DEBUG os_brick.utils [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c8228a11e03c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:33:18 user nova-compute[74840]: DEBUG nova.virt.block_device [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Updating existing volume attachment record: cce038f7-afb3-4b94-b5aa-0e875aac79fe {{(pid=74840) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 12:33:18 user nova-compute[74840]: DEBUG nova.network.neutron [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Successfully created port: d8b090c7-4d0d-43d0-8fa3-4c4d489862a7 {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:33:19 user nova-compute[74840]: DEBUG nova.network.neutron [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Successfully updated port: d8b090c7-4d0d-43d0-8fa3-4c4d489862a7 {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:33:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "refresh_cache-e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:33:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquired lock "refresh_cache-e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:33:19 user nova-compute[74840]: DEBUG nova.network.neutron [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:33:19 user nova-compute[74840]: DEBUG nova.compute.manager [req-2dc7edc6-486b-4e80-a5e5-d203e28cf840 req-4e7dcb34-a995-422a-9b12-3f6e1f4baf71 service nova] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Received event network-changed-d8b090c7-4d0d-43d0-8fa3-4c4d489862a7 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:33:19 user nova-compute[74840]: DEBUG nova.compute.manager [req-2dc7edc6-486b-4e80-a5e5-d203e28cf840 req-4e7dcb34-a995-422a-9b12-3f6e1f4baf71 service nova] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Refreshing instance network info cache due to event network-changed-d8b090c7-4d0d-43d0-8fa3-4c4d489862a7. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:33:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2dc7edc6-486b-4e80-a5e5-d203e28cf840 req-4e7dcb34-a995-422a-9b12-3f6e1f4baf71 service nova] Acquiring lock "refresh_cache-e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:33:19 user nova-compute[74840]: DEBUG nova.network.neutron [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:33:19 user nova-compute[74840]: DEBUG nova.network.neutron [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Updating instance_info_cache with network_info: [{"id": "d8b090c7-4d0d-43d0-8fa3-4c4d489862a7", "address": "fa:16:3e:ae:e2:dc", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b090c7-4d", "ovs_interfaceid": "d8b090c7-4d0d-43d0-8fa3-4c4d489862a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:33:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Releasing lock "refresh_cache-e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:33:20 user nova-compute[74840]: DEBUG nova.compute.manager [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Instance network_info: |[{"id": "d8b090c7-4d0d-43d0-8fa3-4c4d489862a7", "address": "fa:16:3e:ae:e2:dc", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b090c7-4d", "ovs_interfaceid": "d8b090c7-4d0d-43d0-8fa3-4c4d489862a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 12:33:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2dc7edc6-486b-4e80-a5e5-d203e28cf840 req-4e7dcb34-a995-422a-9b12-3f6e1f4baf71 service nova] Acquired lock "refresh_cache-e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:33:20 user nova-compute[74840]: DEBUG nova.network.neutron [req-2dc7edc6-486b-4e80-a5e5-d203e28cf840 req-4e7dcb34-a995-422a-9b12-3f6e1f4baf71 service nova] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Refreshing network info cache for port d8b090c7-4d0d-43d0-8fa3-4c4d489862a7 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:33:20 user nova-compute[74840]: DEBUG nova.network.neutron [req-2dc7edc6-486b-4e80-a5e5-d203e28cf840 req-4e7dcb34-a995-422a-9b12-3f6e1f4baf71 service nova] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Updated VIF entry in instance network info cache for port d8b090c7-4d0d-43d0-8fa3-4c4d489862a7. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:33:20 user nova-compute[74840]: DEBUG nova.network.neutron [req-2dc7edc6-486b-4e80-a5e5-d203e28cf840 req-4e7dcb34-a995-422a-9b12-3f6e1f4baf71 service nova] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Updating instance_info_cache with network_info: [{"id": "d8b090c7-4d0d-43d0-8fa3-4c4d489862a7", "address": "fa:16:3e:ae:e2:dc", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b090c7-4d", "ovs_interfaceid": "d8b090c7-4d0d-43d0-8fa3-4c4d489862a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:33:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2dc7edc6-486b-4e80-a5e5-d203e28cf840 req-4e7dcb34-a995-422a-9b12-3f6e1f4baf71 service nova] Releasing lock "refresh_cache-e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:33:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:22 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Acquiring lock "550f8fed-4652-46fe-a440-974ee8f88196" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:33:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Lock "550f8fed-4652-46fe-a440-974ee8f88196" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:33:22 user nova-compute[74840]: DEBUG nova.compute.manager [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Starting instance... {{(pid=74840) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 12:33:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:33:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:33:22 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:33:22 user nova-compute[74840]: INFO nova.compute.claims [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Claim successful on node user
Nov 08 12:33:23 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:33:23 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:33:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.450s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:33:23 user nova-compute[74840]: DEBUG nova.compute.manager [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Start building networks asynchronously for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 12:33:23 user nova-compute[74840]: DEBUG nova.compute.manager [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Allocating IP information in the background. {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 12:33:23 user nova-compute[74840]: DEBUG nova.network.neutron [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 12:33:23 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 12:33:23 user nova-compute[74840]: DEBUG nova.compute.manager [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Start building block device mappings for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 12:33:23 user nova-compute[74840]: INFO nova.virt.block_device [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Booting with volume 177df23a-e5d3-41e7-ac17-e0959f15e616 at /dev/vda
Nov 08 12:33:23 user nova-compute[74840]: DEBUG nova.policy [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ff68af4357024f75888b6f8bd6ada9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa486cd37a9c498ba6f800d2dbd415ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 12:33:23 user nova-compute[74840]: DEBUG os_brick.utils [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:33:23 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:33:23 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:33:23 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7c08d7-bd60-436e-a2ff-4e80eab9a913]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c8228a11e03c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:33:23 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:33:23 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:33:23 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c917047c-2c12-4093-8441-64334fdd079d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:33:23 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:33:23 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:33:23 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[92be5e53-8f54-4beb-9fb8-193c6bc17bd8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:33:23 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3336a1c8-1174-48e4-97f9-efd5ffd20123]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:33:23 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Running cmd (subprocess): nvme version {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:33:23 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] 'nvme version' failed. Not Retrying. {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:33:23 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.nvmeof [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] nvme not present on system {{(pid=74840) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 12:33:23 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:33:23 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:33:23 user nova-compute[74840]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 12:33:23 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7369114a-d591-4000-8159-0476915578ea]: (4, '') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:33:23 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74840) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 12:33:23 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 12:33:23 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] LIGHTOS: no hostnqn found. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 12:33:23 user nova-compute[74840]: DEBUG os_brick.utils [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c8228a11e03c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:33:23 user nova-compute[74840]: DEBUG nova.virt.block_device [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Updating existing volume attachment record: e377e3c0-d2e9-4326-b33e-7d39c9090cd6 {{(pid=74840) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 12:33:24 user nova-compute[74840]: DEBUG nova.network.neutron [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Successfully created port: daa004c9-f48f-4997-8260-7e1f394c3a7c {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:33:24 user nova-compute[74840]: DEBUG nova.network.neutron [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Successfully updated port: daa004c9-f48f-4997-8260-7e1f394c3a7c {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:33:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Acquiring lock "refresh_cache-550f8fed-4652-46fe-a440-974ee8f88196" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:33:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Acquired lock "refresh_cache-550f8fed-4652-46fe-a440-974ee8f88196" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:33:24 user nova-compute[74840]: DEBUG nova.network.neutron [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:33:24 user nova-compute[74840]: DEBUG nova.compute.manager [req-0e031fad-e7aa-45e1-864e-3d826070b413 req-d3b4edc0-2e20-4e7b-a120-a49cb4264d43 service nova] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Received event network-changed-daa004c9-f48f-4997-8260-7e1f394c3a7c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:33:24 user nova-compute[74840]: DEBUG nova.compute.manager [req-0e031fad-e7aa-45e1-864e-3d826070b413 req-d3b4edc0-2e20-4e7b-a120-a49cb4264d43 service nova] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Refreshing instance network info cache due to event network-changed-daa004c9-f48f-4997-8260-7e1f394c3a7c. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:33:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0e031fad-e7aa-45e1-864e-3d826070b413 req-d3b4edc0-2e20-4e7b-a120-a49cb4264d43 service nova] Acquiring lock "refresh_cache-550f8fed-4652-46fe-a440-974ee8f88196" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:33:24 user nova-compute[74840]: DEBUG nova.network.neutron [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:33:25 user nova-compute[74840]: DEBUG nova.network.neutron [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Updating instance_info_cache with network_info: [{"id": "daa004c9-f48f-4997-8260-7e1f394c3a7c", "address": "fa:16:3e:e1:a6:9b", "network": {"id": "5d8710f7-82f1-4670-b564-9ef14312dc8e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1266284233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa486cd37a9c498ba6f800d2dbd415ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaa004c9-f4", "ovs_interfaceid": "daa004c9-f48f-4997-8260-7e1f394c3a7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:33:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Releasing lock "refresh_cache-550f8fed-4652-46fe-a440-974ee8f88196" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:33:25 user nova-compute[74840]: DEBUG nova.compute.manager [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Instance network_info: |[{"id": "daa004c9-f48f-4997-8260-7e1f394c3a7c", "address": "fa:16:3e:e1:a6:9b", "network": {"id": "5d8710f7-82f1-4670-b564-9ef14312dc8e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1266284233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa486cd37a9c498ba6f800d2dbd415ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaa004c9-f4", "ovs_interfaceid": "daa004c9-f48f-4997-8260-7e1f394c3a7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 12:33:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0e031fad-e7aa-45e1-864e-3d826070b413 req-d3b4edc0-2e20-4e7b-a120-a49cb4264d43 service nova] Acquired lock "refresh_cache-550f8fed-4652-46fe-a440-974ee8f88196" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:33:25 user nova-compute[74840]: DEBUG nova.network.neutron [req-0e031fad-e7aa-45e1-864e-3d826070b413 req-d3b4edc0-2e20-4e7b-a120-a49cb4264d43 service nova] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Refreshing network info cache for port daa004c9-f48f-4997-8260-7e1f394c3a7c {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:33:25 user nova-compute[74840]: DEBUG nova.network.neutron [req-0e031fad-e7aa-45e1-864e-3d826070b413 req-d3b4edc0-2e20-4e7b-a120-a49cb4264d43 service nova] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Updated VIF entry in instance network info cache for port daa004c9-f48f-4997-8260-7e1f394c3a7c. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:33:25 user nova-compute[74840]: DEBUG nova.network.neutron [req-0e031fad-e7aa-45e1-864e-3d826070b413 req-d3b4edc0-2e20-4e7b-a120-a49cb4264d43 service nova] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Updating instance_info_cache with network_info: [{"id": "daa004c9-f48f-4997-8260-7e1f394c3a7c", "address": "fa:16:3e:e1:a6:9b", "network": {"id": "5d8710f7-82f1-4670-b564-9ef14312dc8e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1266284233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa486cd37a9c498ba6f800d2dbd415ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaa004c9-f4", "ovs_interfaceid": "daa004c9-f48f-4997-8260-7e1f394c3a7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:33:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0e031fad-e7aa-45e1-864e-3d826070b413 req-d3b4edc0-2e20-4e7b-a120-a49cb4264d43 service nova] Releasing lock "refresh_cache-550f8fed-4652-46fe-a440-974ee8f88196" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:33:25 user nova-compute[74840]: DEBUG nova.compute.manager [req-4622a89a-f769-45ad-8707-4ef83329e438 req-219dd254-7e70-409e-abf9-a59fe24837b5 service nova] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Received event network-changed-00efdc72-8528-41eb-be2b-c9b190863053 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:33:25 user nova-compute[74840]: DEBUG nova.compute.manager [req-4622a89a-f769-45ad-8707-4ef83329e438 req-219dd254-7e70-409e-abf9-a59fe24837b5 service nova] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Refreshing instance network info cache due to event network-changed-00efdc72-8528-41eb-be2b-c9b190863053. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:33:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4622a89a-f769-45ad-8707-4ef83329e438 req-219dd254-7e70-409e-abf9-a59fe24837b5 service nova] Acquiring lock "refresh_cache-7a482219-16ac-49e2-84ad-7e2030c97184" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:33:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4622a89a-f769-45ad-8707-4ef83329e438 req-219dd254-7e70-409e-abf9-a59fe24837b5 service nova] Acquired lock "refresh_cache-7a482219-16ac-49e2-84ad-7e2030c97184" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:33:25 user nova-compute[74840]: DEBUG nova.network.neutron [req-4622a89a-f769-45ad-8707-4ef83329e438 req-219dd254-7e70-409e-abf9-a59fe24837b5 service nova] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Refreshing network info cache for port 00efdc72-8528-41eb-be2b-c9b190863053 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:33:26 user nova-compute[74840]: INFO nova.compute.manager [None req-cb9e8477-2974-46d8-a224-38df7ef5fdfb tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Unrescuing
Nov 08 12:33:26 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cb9e8477-2974-46d8-a224-38df7ef5fdfb tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Acquiring lock "refresh_cache-a2c4fc63-0757-46da-ad00-7b6c6513deca" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:33:26 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cb9e8477-2974-46d8-a224-38df7ef5fdfb tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Acquired lock "refresh_cache-a2c4fc63-0757-46da-ad00-7b6c6513deca" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:33:26 user nova-compute[74840]: DEBUG nova.network.neutron [None req-cb9e8477-2974-46d8-a224-38df7ef5fdfb tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:33:26 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-51e700d9-9919-42ba-b692-df23d147228d tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Acquiring lock "7a482219-16ac-49e2-84ad-7e2030c97184" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:33:26 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-51e700d9-9919-42ba-b692-df23d147228d tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "7a482219-16ac-49e2-84ad-7e2030c97184" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:33:26 user nova-compute[74840]: DEBUG nova.objects.instance [None req-51e700d9-9919-42ba-b692-df23d147228d tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lazy-loading 'flavor' on Instance uuid 7a482219-16ac-49e2-84ad-7e2030c97184 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:33:26 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-51e700d9-9919-42ba-b692-df23d147228d tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "7a482219-16ac-49e2-84ad-7e2030c97184" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:33:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:26 user nova-compute[74840]: DEBUG nova.network.neutron [req-4622a89a-f769-45ad-8707-4ef83329e438 req-219dd254-7e70-409e-abf9-a59fe24837b5 service nova] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Updated VIF entry in instance network info cache for port 00efdc72-8528-41eb-be2b-c9b190863053. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:33:26 user nova-compute[74840]: DEBUG nova.network.neutron [req-4622a89a-f769-45ad-8707-4ef83329e438 req-219dd254-7e70-409e-abf9-a59fe24837b5 service nova] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Updating instance_info_cache with network_info: [{"id": "00efdc72-8528-41eb-be2b-c9b190863053", "address": "fa:16:3e:72:4b:1f", "network": {"id": "7faeaea5-04e0-46e0-bb55-9426d599fb1b", "bridge": "br-int", "label": "tempest-TestStampPattern-1080763140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c24d52e18e8e41dfa50aa5aff1f40c6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00efdc72-85", "ovs_interfaceid": "00efdc72-8528-41eb-be2b-c9b190863053", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:33:26 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4622a89a-f769-45ad-8707-4ef83329e438 req-219dd254-7e70-409e-abf9-a59fe24837b5 service nova] Releasing lock "refresh_cache-7a482219-16ac-49e2-84ad-7e2030c97184" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:33:26 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-51e700d9-9919-42ba-b692-df23d147228d tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Acquiring lock "7a482219-16ac-49e2-84ad-7e2030c97184" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:33:26 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-51e700d9-9919-42ba-b692-df23d147228d tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "7a482219-16ac-49e2-84ad-7e2030c97184" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:33:26 user nova-compute[74840]: INFO nova.compute.manager [None req-51e700d9-9919-42ba-b692-df23d147228d tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Attaching volume 7d3984bc-b442-400e-8396-9ac7d028cf96 to /dev/vdb
Nov 08 12:33:26 user nova-compute[74840]: DEBUG nova.network.neutron [None req-cb9e8477-2974-46d8-a224-38df7ef5fdfb tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Updating instance_info_cache with network_info: [{"id": "4d351123-6297-4be2-808d-50cdbe9e3aa6", "address": "fa:16:3e:4e:0c:f0", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d351123-62", "ovs_interfaceid": "4d351123-6297-4be2-808d-50cdbe9e3aa6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:33:26 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-cb9e8477-2974-46d8-a224-38df7ef5fdfb tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Releasing lock "refresh_cache-a2c4fc63-0757-46da-ad00-7b6c6513deca" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:33:26 user nova-compute[74840]: DEBUG nova.objects.instance [None req-cb9e8477-2974-46d8-a224-38df7ef5fdfb tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lazy-loading 'flavor' on Instance uuid a2c4fc63-0757-46da-ad00-7b6c6513deca {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:33:26 user nova-compute[74840]: DEBUG os_brick.utils [None req-51e700d9-9919-42ba-b692-df23d147228d tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:33:26 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:33:26 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:33:26 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6d5a9b-f216-4281-b5d4-9bfa3412ab0b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c8228a11e03c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:33:26 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:33:26 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:33:26 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f72c6c-43b6-4289-b7ca-4ca05c74dc22]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:33:26 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:33:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:26 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:33:26 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce2d1c8-8e7a-4cd3-ad7d-270acc36740e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:33:26 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee5ec1f-657e-4e51-a4d3-4fc4b6eee26c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:33:26 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-51e700d9-9919-42ba-b692-df23d147228d tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Running cmd (subprocess): nvme version {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:33:26 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-51e700d9-9919-42ba-b692-df23d147228d tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] 'nvme version' failed. Not Retrying. {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:33:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:27 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:33:27 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.nvmeof [None req-51e700d9-9919-42ba-b692-df23d147228d tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] nvme not present on system {{(pid=74840) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 12:33:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:33:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:33:27 user nova-compute[74840]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 12:33:27 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18b35a1-0c33-4af7-b436-a10004190105]: (4, '') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:33:27 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-51e700d9-9919-42ba-b692-df23d147228d tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74840) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 12:33:27 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-51e700d9-9919-42ba-b692-df23d147228d tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 12:33:27 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-51e700d9-9919-42ba-b692-df23d147228d tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] LIGHTOS: no hostnqn found. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 12:33:27 user nova-compute[74840]: DEBUG os_brick.utils [None req-51e700d9-9919-42ba-b692-df23d147228d tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c8228a11e03c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:33:27 user nova-compute[74840]: DEBUG nova.virt.block_device [None req-51e700d9-9919-42ba-b692-df23d147228d tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Updating existing volume attachment record: e53e7f00-2ac1-452e-9df4-c5302c744ccf {{(pid=74840) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 12:33:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:27 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Instance destroyed successfully.
Nov 08 12:33:27 user nova-compute[74840]: DEBUG nova.compute.manager [req-0b70ced4-6f42-4bd0-b9ea-01b434ae3350 req-eb6a6928-a2cd-4aea-bd21-d97fdb59bfaa service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Received event network-vif-unplugged-4d351123-6297-4be2-808d-50cdbe9e3aa6 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:33:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0b70ced4-6f42-4bd0-b9ea-01b434ae3350 req-eb6a6928-a2cd-4aea-bd21-d97fdb59bfaa service nova] Acquiring lock "a2c4fc63-0757-46da-ad00-7b6c6513deca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:33:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0b70ced4-6f42-4bd0-b9ea-01b434ae3350 req-eb6a6928-a2cd-4aea-bd21-d97fdb59bfaa service nova] Lock "a2c4fc63-0757-46da-ad00-7b6c6513deca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:33:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0b70ced4-6f42-4bd0-b9ea-01b434ae3350 req-eb6a6928-a2cd-4aea-bd21-d97fdb59bfaa service nova] Lock "a2c4fc63-0757-46da-ad00-7b6c6513deca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:33:27 user nova-compute[74840]: DEBUG nova.compute.manager [req-0b70ced4-6f42-4bd0-b9ea-01b434ae3350 req-eb6a6928-a2cd-4aea-bd21-d97fdb59bfaa service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] No waiting events found dispatching network-vif-unplugged-4d351123-6297-4be2-808d-50cdbe9e3aa6 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:33:27 user nova-compute[74840]: WARNING nova.compute.manager [req-0b70ced4-6f42-4bd0-b9ea-01b434ae3350 req-eb6a6928-a2cd-4aea-bd21-d97fdb59bfaa service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Received unexpected event network-vif-unplugged-4d351123-6297-4be2-808d-50cdbe9e3aa6 for instance with vm_state rescued and task_state unrescuing.
Nov 08 12:33:27 user nova-compute[74840]: DEBUG nova.compute.manager [req-0b70ced4-6f42-4bd0-b9ea-01b434ae3350 req-eb6a6928-a2cd-4aea-bd21-d97fdb59bfaa service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Received event network-vif-plugged-4d351123-6297-4be2-808d-50cdbe9e3aa6 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:33:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0b70ced4-6f42-4bd0-b9ea-01b434ae3350 req-eb6a6928-a2cd-4aea-bd21-d97fdb59bfaa service nova] Acquiring lock "a2c4fc63-0757-46da-ad00-7b6c6513deca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:33:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0b70ced4-6f42-4bd0-b9ea-01b434ae3350 req-eb6a6928-a2cd-4aea-bd21-d97fdb59bfaa service nova] Lock "a2c4fc63-0757-46da-ad00-7b6c6513deca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:33:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0b70ced4-6f42-4bd0-b9ea-01b434ae3350 req-eb6a6928-a2cd-4aea-bd21-d97fdb59bfaa service nova] Lock "a2c4fc63-0757-46da-ad00-7b6c6513deca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:33:27 user nova-compute[74840]: DEBUG nova.compute.manager [req-0b70ced4-6f42-4bd0-b9ea-01b434ae3350 req-eb6a6928-a2cd-4aea-bd21-d97fdb59bfaa service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] No waiting events found dispatching network-vif-plugged-4d351123-6297-4be2-808d-50cdbe9e3aa6 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:33:27 user nova-compute[74840]: WARNING nova.compute.manager [req-0b70ced4-6f42-4bd0-b9ea-01b434ae3350 req-eb6a6928-a2cd-4aea-bd21-d97fdb59bfaa service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Received unexpected event network-vif-plugged-4d351123-6297-4be2-808d-50cdbe9e3aa6 for instance with vm_state rescued and task_state unrescuing.
Nov 08 12:33:28 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:28 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:29 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:29 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:29 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:29 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:29 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:29 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Acquiring lock "6156dbbc-6539-4de3-8ba0-16db61cd7dce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:33:29 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "6156dbbc-6539-4de3-8ba0-16db61cd7dce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:33:29 user nova-compute[74840]: DEBUG nova.compute.manager [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Starting instance... {{(pid=74840) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 12:33:30 user nova-compute[74840]: DEBUG nova.compute.manager [req-9359a761-195d-43f9-b8dd-0c1b87b48af7 req-0a7713e6-4f0e-4abb-b386-d86da7d41c59 service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Received event network-vif-plugged-4d351123-6297-4be2-808d-50cdbe9e3aa6 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:33:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9359a761-195d-43f9-b8dd-0c1b87b48af7 req-0a7713e6-4f0e-4abb-b386-d86da7d41c59 service nova] Acquiring lock "a2c4fc63-0757-46da-ad00-7b6c6513deca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:33:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9359a761-195d-43f9-b8dd-0c1b87b48af7 req-0a7713e6-4f0e-4abb-b386-d86da7d41c59 service nova] Lock "a2c4fc63-0757-46da-ad00-7b6c6513deca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:33:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9359a761-195d-43f9-b8dd-0c1b87b48af7 req-0a7713e6-4f0e-4abb-b386-d86da7d41c59 service nova] Lock "a2c4fc63-0757-46da-ad00-7b6c6513deca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:33:30 user nova-compute[74840]: DEBUG nova.compute.manager [req-9359a761-195d-43f9-b8dd-0c1b87b48af7 req-0a7713e6-4f0e-4abb-b386-d86da7d41c59 service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] No waiting events found dispatching network-vif-plugged-4d351123-6297-4be2-808d-50cdbe9e3aa6 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:33:30 user nova-compute[74840]: WARNING nova.compute.manager [req-9359a761-195d-43f9-b8dd-0c1b87b48af7 req-0a7713e6-4f0e-4abb-b386-d86da7d41c59 service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Received unexpected event network-vif-plugged-4d351123-6297-4be2-808d-50cdbe9e3aa6 for instance with vm_state rescued and task_state unrescuing.
Nov 08 12:33:30 user nova-compute[74840]: DEBUG nova.compute.manager [req-9359a761-195d-43f9-b8dd-0c1b87b48af7 req-0a7713e6-4f0e-4abb-b386-d86da7d41c59 service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Received event network-vif-plugged-4d351123-6297-4be2-808d-50cdbe9e3aa6 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:33:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9359a761-195d-43f9-b8dd-0c1b87b48af7 req-0a7713e6-4f0e-4abb-b386-d86da7d41c59 service nova] Acquiring lock "a2c4fc63-0757-46da-ad00-7b6c6513deca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:33:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9359a761-195d-43f9-b8dd-0c1b87b48af7 req-0a7713e6-4f0e-4abb-b386-d86da7d41c59 service nova] Lock "a2c4fc63-0757-46da-ad00-7b6c6513deca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:33:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9359a761-195d-43f9-b8dd-0c1b87b48af7 req-0a7713e6-4f0e-4abb-b386-d86da7d41c59 service nova] Lock "a2c4fc63-0757-46da-ad00-7b6c6513deca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:33:30 user nova-compute[74840]: DEBUG nova.compute.manager [req-9359a761-195d-43f9-b8dd-0c1b87b48af7 req-0a7713e6-4f0e-4abb-b386-d86da7d41c59 service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] No waiting events found dispatching network-vif-plugged-4d351123-6297-4be2-808d-50cdbe9e3aa6 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:33:30 user nova-compute[74840]: WARNING nova.compute.manager [req-9359a761-195d-43f9-b8dd-0c1b87b48af7 req-0a7713e6-4f0e-4abb-b386-d86da7d41c59 service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Received unexpected event network-vif-plugged-4d351123-6297-4be2-808d-50cdbe9e3aa6 for instance with vm_state rescued and task_state unrescuing.
Nov 08 12:33:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:33:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:33:30 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:33:30 user nova-compute[74840]: INFO nova.compute.claims [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Claim successful on node user
Nov 08 12:33:30 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:33:30 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:33:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.581s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:33:30 user nova-compute[74840]: DEBUG nova.compute.manager [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Start building networks asynchronously for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 12:33:30 user nova-compute[74840]: DEBUG nova.compute.manager [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Allocating IP information in the background. {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 12:33:30 user nova-compute[74840]: DEBUG nova.network.neutron [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 12:33:30 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 12:33:30 user nova-compute[74840]: DEBUG nova.compute.manager [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Start building block device mappings for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 12:33:30 user nova-compute[74840]: DEBUG nova.policy [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'afc4e8483a1f4e08b3f81a9b9323be84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a05cda834445fb94e71f6cac02f198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 12:33:30 user nova-compute[74840]: DEBUG nova.compute.manager [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Start spawning the instance on the hypervisor. {{(pid=74840) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 12:33:30 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:33:30 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Creating image(s)
Nov 08 12:33:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Acquiring lock "/opt/stack/data/nova/instances/6156dbbc-6539-4de3-8ba0-16db61cd7dce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:33:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "/opt/stack/data/nova/instances/6156dbbc-6539-4de3-8ba0-16db61cd7dce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:33:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "/opt/stack/data/nova/instances/6156dbbc-6539-4de3-8ba0-16db61cd7dce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:33:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:33:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.185s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:33:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Acquiring lock "5d26578eba85497f494c575690c4248f381a0fe6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:33:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:33:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:33:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.173s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:33:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/6156dbbc-6539-4de3-8ba0-16db61cd7dce/disk 1073741824 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:33:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/6156dbbc-6539-4de3-8ba0-16db61cd7dce/disk 1073741824" returned: 0 in 0.053s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:33:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:33:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:33:31 user nova-compute[74840]: DEBUG nova.compute.manager [None req-cb9e8477-2974-46d8-a224-38df7ef5fdfb tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:33:31 user nova-compute[74840]: DEBUG nova.network.neutron [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Successfully created port: 0c5dbe98-66f5-492a-8da2-8eca6cf38de5 {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:33:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.225s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:33:31 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6156dbbc-6539-4de3-8ba0-16db61cd7dce/disk. size=1073741824 {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 12:33:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6156dbbc-6539-4de3-8ba0-16db61cd7dce/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:33:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6156dbbc-6539-4de3-8ba0-16db61cd7dce/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:33:31 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Cannot resize image /opt/stack/data/nova/instances/6156dbbc-6539-4de3-8ba0-16db61cd7dce/disk to a smaller size. {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 12:33:31 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Created local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 12:33:31 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Ensure instance console log exists: /opt/stack/data/nova/instances/6156dbbc-6539-4de3-8ba0-16db61cd7dce/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:33:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:33:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:33:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG nova.network.neutron [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Successfully updated port: 0c5dbe98-66f5-492a-8da2-8eca6cf38de5 {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Acquiring lock "refresh_cache-6156dbbc-6539-4de3-8ba0-16db61cd7dce" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Acquired lock "refresh_cache-6156dbbc-6539-4de3-8ba0-16db61cd7dce" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG nova.network.neutron [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG nova.compute.manager [req-bb774f65-1fb9-49e1-b413-7e91d95b229c req-9cf6606c-9c05-4c90-909c-55f6687b6c70 service nova] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Received event network-changed-0c5dbe98-66f5-492a-8da2-8eca6cf38de5 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG nova.compute.manager [req-bb774f65-1fb9-49e1-b413-7e91d95b229c req-9cf6606c-9c05-4c90-909c-55f6687b6c70 service nova] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Refreshing instance network info cache due to event network-changed-0c5dbe98-66f5-492a-8da2-8eca6cf38de5. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-bb774f65-1fb9-49e1-b413-7e91d95b229c req-9cf6606c-9c05-4c90-909c-55f6687b6c70 service nova] Acquiring lock "refresh_cache-6156dbbc-6539-4de3-8ba0-16db61cd7dce" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG nova.network.neutron [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG nova.network.neutron [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Updating instance_info_cache with network_info: [{"id": "0c5dbe98-66f5-492a-8da2-8eca6cf38de5", "address": "fa:16:3e:ab:15:81", "network": {"id": "918d8aed-1f09-4cfb-9c7f-48f002ad6ba3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-927886396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a05cda834445fb94e71f6cac02f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5dbe98-66", "ovs_interfaceid": "0c5dbe98-66f5-492a-8da2-8eca6cf38de5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Releasing lock "refresh_cache-6156dbbc-6539-4de3-8ba0-16db61cd7dce" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG nova.compute.manager [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Instance network_info: |[{"id": "0c5dbe98-66f5-492a-8da2-8eca6cf38de5", "address": "fa:16:3e:ab:15:81", "network": {"id": "918d8aed-1f09-4cfb-9c7f-48f002ad6ba3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-927886396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a05cda834445fb94e71f6cac02f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5dbe98-66", "ovs_interfaceid": "0c5dbe98-66f5-492a-8da2-8eca6cf38de5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-bb774f65-1fb9-49e1-b413-7e91d95b229c req-9cf6606c-9c05-4c90-909c-55f6687b6c70 service nova] Acquired lock "refresh_cache-6156dbbc-6539-4de3-8ba0-16db61cd7dce" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG nova.network.neutron [req-bb774f65-1fb9-49e1-b413-7e91d95b229c req-9cf6606c-9c05-4c90-909c-55f6687b6c70 service nova] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Refreshing network info cache for port 0c5dbe98-66f5-492a-8da2-8eca6cf38de5 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Start _get_guest_xml network_info=[{"id": "0c5dbe98-66f5-492a-8da2-8eca6cf38de5", "address": "fa:16:3e:ab:15:81", "network": {"id": "918d8aed-1f09-4cfb-9c7f-48f002ad6ba3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-927886396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a05cda834445fb94e71f6cac02f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5dbe98-66", "ovs_interfaceid": "0c5dbe98-66f5-492a-8da2-8eca6cf38de5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'image_id': '4fa17706-d304-4117-a420-dab994c703dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:33:32 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:33:32 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:33:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:33:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1903705906',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1903705906',id=42,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFyOqyXoJE6A6khVhOqKm6eVWT5lVBOlj4aL8lXGOedklADnjHYeCbyRzst0jVwSHeyseYsI5B6BggkYstW9mP1b77U3gf+VYtK1KZlTE1fMpYwW88X38s9nwM8iJQzsg==',key_name='tempest-keypair-1939521876',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93a05cda834445fb94e71f6cac02f198',ramdisk_id='',reservation_id='r-wqqsoqk3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1958698266',owner_user_name='tempest-AttachVolumeShelveTestJSON-1958698266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:33:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='afc4e8483a1f4e08b3f81a9b9323be84',uuid=6156dbbc-6539-4de3-8ba0-16db61cd7dce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c5dbe98-66f5-492a-8da2-8eca6cf38de5", "address": "fa:16:3e:ab:15:81", "network": {"id": "918d8aed-1f09-4cfb-9c7f-48f002ad6ba3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-927886396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a05cda834445fb94e71f6cac02f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5dbe98-66", "ovs_interfaceid": "0c5dbe98-66f5-492a-8da2-8eca6cf38de5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Converting VIF {"id": "0c5dbe98-66f5-492a-8da2-8eca6cf38de5", "address": "fa:16:3e:ab:15:81", "network": {"id": "918d8aed-1f09-4cfb-9c7f-48f002ad6ba3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-927886396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a05cda834445fb94e71f6cac02f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5dbe98-66", "ovs_interfaceid": "0c5dbe98-66f5-492a-8da2-8eca6cf38de5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:15:81,bridge_name='br-int',has_traffic_filtering=True,id=0c5dbe98-66f5-492a-8da2-8eca6cf38de5,network=Network(918d8aed-1f09-4cfb-9c7f-48f002ad6ba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5dbe98-66') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG nova.objects.instance [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lazy-loading 'pci_devices' on Instance uuid 6156dbbc-6539-4de3-8ba0-16db61cd7dce {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:33:32 user nova-compute[74840]:   <uuid>6156dbbc-6539-4de3-8ba0-16db61cd7dce</uuid>
Nov 08 12:33:32 user nova-compute[74840]:   <name>instance-0000002a</name>
Nov 08 12:33:32 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:33:32 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:33:32 user nova-compute[74840]:   <metadata>
Nov 08 12:33:32 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:33:32 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:33:32 user nova-compute[74840]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1903705906</nova:name>
Nov 08 12:33:32 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:33:32</nova:creationTime>
Nov 08 12:33:32 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:33:32 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:33:32 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:33:32 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:33:32 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:33:32 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:33:32 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:33:32 user nova-compute[74840]:       <nova:owner>
Nov 08 12:33:32 user nova-compute[74840]:         <nova:user uuid="afc4e8483a1f4e08b3f81a9b9323be84">tempest-AttachVolumeShelveTestJSON-1958698266-project-member</nova:user>
Nov 08 12:33:32 user nova-compute[74840]:         <nova:project uuid="93a05cda834445fb94e71f6cac02f198">tempest-AttachVolumeShelveTestJSON-1958698266</nova:project>
Nov 08 12:33:32 user nova-compute[74840]:       </nova:owner>
Nov 08 12:33:32 user nova-compute[74840]:       <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:33:32 user nova-compute[74840]:       <nova:ports>
Nov 08 12:33:32 user nova-compute[74840]:         <nova:port uuid="0c5dbe98-66f5-492a-8da2-8eca6cf38de5">
Nov 08 12:33:32 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 12:33:32 user nova-compute[74840]:         </nova:port>
Nov 08 12:33:32 user nova-compute[74840]:       </nova:ports>
Nov 08 12:33:32 user nova-compute[74840]:     </nova:instance>
Nov 08 12:33:32 user nova-compute[74840]:   </metadata>
Nov 08 12:33:32 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:33:32 user nova-compute[74840]:     <system>
Nov 08 12:33:32 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:33:32 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:33:32 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:33:32 user nova-compute[74840]:       <entry name="serial">6156dbbc-6539-4de3-8ba0-16db61cd7dce</entry>
Nov 08 12:33:32 user nova-compute[74840]:       <entry name="uuid">6156dbbc-6539-4de3-8ba0-16db61cd7dce</entry>
Nov 08 12:33:32 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:33:32 user nova-compute[74840]:     </system>
Nov 08 12:33:32 user nova-compute[74840]:   </sysinfo>
Nov 08 12:33:32 user nova-compute[74840]:   <os>
Nov 08 12:33:32 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:33:32 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:33:32 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:33:32 user nova-compute[74840]:   </os>
Nov 08 12:33:32 user nova-compute[74840]:   <features>
Nov 08 12:33:32 user nova-compute[74840]:     <acpi/>
Nov 08 12:33:32 user nova-compute[74840]:     <apic/>
Nov 08 12:33:32 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:33:32 user nova-compute[74840]:   </features>
Nov 08 12:33:32 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:33:32 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:33:32 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:33:32 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:33:32 user nova-compute[74840]:   </clock>
Nov 08 12:33:32 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:33:32 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:33:32 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:33:32 user nova-compute[74840]:   </cpu>
Nov 08 12:33:32 user nova-compute[74840]:   <devices>
Nov 08 12:33:32 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:33:32 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:33:32 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/6156dbbc-6539-4de3-8ba0-16db61cd7dce/disk"/>
Nov 08 12:33:32 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:33:32 user nova-compute[74840]:     </disk>
Nov 08 12:33:32 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:33:32 user nova-compute[74840]:       <mac address="fa:16:3e:ab:15:81"/>
Nov 08 12:33:32 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:33:32 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:33:32 user nova-compute[74840]:       <target dev="tap0c5dbe98-66"/>
Nov 08 12:33:32 user nova-compute[74840]:     </interface>
Nov 08 12:33:32 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:33:32 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/6156dbbc-6539-4de3-8ba0-16db61cd7dce/console.log" append="off"/>
Nov 08 12:33:32 user nova-compute[74840]:     </serial>
Nov 08 12:33:32 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:33:32 user nova-compute[74840]:     <video>
Nov 08 12:33:32 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:33:32 user nova-compute[74840]:     </video>
Nov 08 12:33:32 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:33:32 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:33:32 user nova-compute[74840]:     </rng>
Nov 08 12:33:32 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:33:32 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:33:32 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:33:32 user nova-compute[74840]:     </memballoon>
Nov 08 12:33:32 user nova-compute[74840]:   </devices>
Nov 08 12:33:32 user nova-compute[74840]: </domain>
Nov 08 12:33:32 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:33:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1903705906',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1903705906',id=42,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFyOqyXoJE6A6khVhOqKm6eVWT5lVBOlj4aL8lXGOedklADnjHYeCbyRzst0jVwSHeyseYsI5B6BggkYstW9mP1b77U3gf+VYtK1KZlTE1fMpYwW88X38s9nwM8iJQzsg==',key_name='tempest-keypair-1939521876',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93a05cda834445fb94e71f6cac02f198',ramdisk_id='',reservation_id='r-wqqsoqk3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1958698266',owner_user_name='tempest-AttachVolumeShelveTestJSON-1958698266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:33:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='afc4e8483a1f4e08b3f81a9b9323be84',uuid=6156dbbc-6539-4de3-8ba0-16db61cd7dce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c5dbe98-66f5-492a-8da2-8eca6cf38de5", "address": "fa:16:3e:ab:15:81", "network": {"id": "918d8aed-1f09-4cfb-9c7f-48f002ad6ba3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-927886396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a05cda834445fb94e71f6cac02f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5dbe98-66", "ovs_interfaceid": "0c5dbe98-66f5-492a-8da2-8eca6cf38de5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Converting VIF {"id": "0c5dbe98-66f5-492a-8da2-8eca6cf38de5", "address": "fa:16:3e:ab:15:81", "network": {"id": "918d8aed-1f09-4cfb-9c7f-48f002ad6ba3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-927886396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a05cda834445fb94e71f6cac02f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5dbe98-66", "ovs_interfaceid": "0c5dbe98-66f5-492a-8da2-8eca6cf38de5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:15:81,bridge_name='br-int',has_traffic_filtering=True,id=0c5dbe98-66f5-492a-8da2-8eca6cf38de5,network=Network(918d8aed-1f09-4cfb-9c7f-48f002ad6ba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5dbe98-66') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG os_vif [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:15:81,bridge_name='br-int',has_traffic_filtering=True,id=0c5dbe98-66f5-492a-8da2-8eca6cf38de5,network=Network(918d8aed-1f09-4cfb-9c7f-48f002ad6ba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5dbe98-66') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f59aa083-a44e-5bd3-95cb-9c51c714b2dc', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c5dbe98-66, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0c5dbe98-66, col_values=(('qos', UUID('051daeef-d2af-4e3b-92bc-736d808fe9ee')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0c5dbe98-66, col_values=(('external_ids', {'iface-id': '0c5dbe98-66f5-492a-8da2-8eca6cf38de5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:15:81', 'vm-uuid': '6156dbbc-6539-4de3-8ba0-16db61cd7dce'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:33:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:32 user nova-compute[74840]: INFO os_vif [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:15:81,bridge_name='br-int',has_traffic_filtering=True,id=0c5dbe98-66f5-492a-8da2-8eca6cf38de5,network=Network(918d8aed-1f09-4cfb-9c7f-48f002ad6ba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5dbe98-66')
Nov 08 12:33:33 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:33:33 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] No VIF found with MAC fa:16:3e:ab:15:81, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:33:33 user nova-compute[74840]: DEBUG nova.network.neutron [req-bb774f65-1fb9-49e1-b413-7e91d95b229c req-9cf6606c-9c05-4c90-909c-55f6687b6c70 service nova] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Updated VIF entry in instance network info cache for port 0c5dbe98-66f5-492a-8da2-8eca6cf38de5. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:33:33 user nova-compute[74840]: DEBUG nova.network.neutron [req-bb774f65-1fb9-49e1-b413-7e91d95b229c req-9cf6606c-9c05-4c90-909c-55f6687b6c70 service nova] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Updating instance_info_cache with network_info: [{"id": "0c5dbe98-66f5-492a-8da2-8eca6cf38de5", "address": "fa:16:3e:ab:15:81", "network": {"id": "918d8aed-1f09-4cfb-9c7f-48f002ad6ba3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-927886396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a05cda834445fb94e71f6cac02f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5dbe98-66", "ovs_interfaceid": "0c5dbe98-66f5-492a-8da2-8eca6cf38de5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:33:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-bb774f65-1fb9-49e1-b413-7e91d95b229c req-9cf6606c-9c05-4c90-909c-55f6687b6c70 service nova] Releasing lock "refresh_cache-6156dbbc-6539-4de3-8ba0-16db61cd7dce" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:33:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:34 user nova-compute[74840]: DEBUG nova.compute.manager [req-4f04c077-2a94-4664-87d1-eb10e0ac10c8 req-8e6cc7ed-0584-45e6-ad3f-dd3c2253f67e service nova] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Received event network-vif-plugged-0c5dbe98-66f5-492a-8da2-8eca6cf38de5 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:33:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4f04c077-2a94-4664-87d1-eb10e0ac10c8 req-8e6cc7ed-0584-45e6-ad3f-dd3c2253f67e service nova] Acquiring lock "6156dbbc-6539-4de3-8ba0-16db61cd7dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:33:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4f04c077-2a94-4664-87d1-eb10e0ac10c8 req-8e6cc7ed-0584-45e6-ad3f-dd3c2253f67e service nova] Lock "6156dbbc-6539-4de3-8ba0-16db61cd7dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:33:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4f04c077-2a94-4664-87d1-eb10e0ac10c8 req-8e6cc7ed-0584-45e6-ad3f-dd3c2253f67e service nova] Lock "6156dbbc-6539-4de3-8ba0-16db61cd7dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:33:34 user nova-compute[74840]: DEBUG nova.compute.manager [req-4f04c077-2a94-4664-87d1-eb10e0ac10c8 req-8e6cc7ed-0584-45e6-ad3f-dd3c2253f67e service nova] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] No waiting events found dispatching network-vif-plugged-0c5dbe98-66f5-492a-8da2-8eca6cf38de5 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:33:34 user nova-compute[74840]: WARNING nova.compute.manager [req-4f04c077-2a94-4664-87d1-eb10e0ac10c8 req-8e6cc7ed-0584-45e6-ad3f-dd3c2253f67e service nova] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Received unexpected event network-vif-plugged-0c5dbe98-66f5-492a-8da2-8eca6cf38de5 for instance with vm_state building and task_state spawning.
Nov 08 12:33:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:36 user nova-compute[74840]: DEBUG nova.compute.manager [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:33:36 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:33:36 user nova-compute[74840]: DEBUG nova.compute.manager [req-c7778957-b848-4c13-9a01-e104e29fae9d req-ee8e3191-ac86-43a2-bc59-081876b8df25 service nova] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Received event network-vif-plugged-0c5dbe98-66f5-492a-8da2-8eca6cf38de5 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:33:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-c7778957-b848-4c13-9a01-e104e29fae9d req-ee8e3191-ac86-43a2-bc59-081876b8df25 service nova] Acquiring lock "6156dbbc-6539-4de3-8ba0-16db61cd7dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:33:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-c7778957-b848-4c13-9a01-e104e29fae9d req-ee8e3191-ac86-43a2-bc59-081876b8df25 service nova] Lock "6156dbbc-6539-4de3-8ba0-16db61cd7dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:33:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-c7778957-b848-4c13-9a01-e104e29fae9d req-ee8e3191-ac86-43a2-bc59-081876b8df25 service nova] Lock "6156dbbc-6539-4de3-8ba0-16db61cd7dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:33:36 user nova-compute[74840]: DEBUG nova.compute.manager [req-c7778957-b848-4c13-9a01-e104e29fae9d req-ee8e3191-ac86-43a2-bc59-081876b8df25 service nova] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] No waiting events found dispatching network-vif-plugged-0c5dbe98-66f5-492a-8da2-8eca6cf38de5 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:33:36 user nova-compute[74840]: WARNING nova.compute.manager [req-c7778957-b848-4c13-9a01-e104e29fae9d req-ee8e3191-ac86-43a2-bc59-081876b8df25 service nova] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Received unexpected event network-vif-plugged-0c5dbe98-66f5-492a-8da2-8eca6cf38de5 for instance with vm_state building and task_state spawning.
Nov 08 12:33:36 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Instance spawned successfully.
Nov 08 12:33:36 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:33:36 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Found default for hw_cdrom_bus of ide {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:33:36 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Found default for hw_disk_bus of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:33:36 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:33:36 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:33:36 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Found default for hw_video_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:33:36 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Found default for hw_vif_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:33:36 user nova-compute[74840]: INFO nova.compute.manager [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Took 5.98 seconds to spawn the instance on the hypervisor.
Nov 08 12:33:36 user nova-compute[74840]: DEBUG nova.compute.manager [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:33:36 user nova-compute[74840]: INFO nova.compute.manager [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Took 6.89 seconds to build instance.
Nov 08 12:33:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b46efe40-31f7-4890-8c1f-25c2ec531625 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "6156dbbc-6539-4de3-8ba0-16db61cd7dce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.047s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:33:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG nova.compute.manager [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Start spawning the instance on the hypervisor. {{(pid=74840) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:33:44 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Creating image(s)
Nov 08 12:33:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Did not create local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Ensure instance console log exists: /opt/stack/data/nova/instances/e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Start _get_guest_xml network_info=[{"id": "d8b090c7-4d0d-43d0-8fa3-4c4d489862a7", "address": "fa:16:3e:ae:e2:dc", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b090c7-4d", "ovs_interfaceid": "d8b090c7-4d0d-43d0-8fa3-4c4d489862a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'cce038f7-afb3-4b94-b5aa-0e875aac79fe', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hrUSyEIu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e', 'attached_at': '', 'detached_at': '', 'volume_id': 'bbde86c3-d678-411a-b903-d997dc3780e4', 'serial': 'bbde86c3-d678-411a-b903-d997dc3780e4'}, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:33:44 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:33:44 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:33:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Calling os-brick to attach iSCSI Volume {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hrUSyEIu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:33:44 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:33:44 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:33:44 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:33:44 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:33:44 user nova-compute[74840]: INFO os_brick.initiator.connectors.iscsi [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 12:33:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4 -p 172.16.0.220:3260 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f34b08-cef3-4824-b58e-837815a2d6ca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 12:33:44 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[265ebc14-f570-4411-9516-43b33e8fff32]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4] added\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4] added
Nov 08 12:33:44 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b612c5-ee44-44d7-a6bb-091351baf10d]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfa3cac-c4a2-42e3-b8c9-5e64682d8f9a]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hrUSyEIu {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hrUSyEIu" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ba9e44-4686-4bd9-9925-5281031ff43a]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hrUSyEIu'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e804df1-cead-42df-972a-f28b1d8807b4]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[008546c9-a6a4-4fd5-ae44-8a89e3726e0c]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:33:44 user nova-compute[74840]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)
Nov 08 12:33:44 user nova-compute[74840]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 (non-flash)
Nov 08 12:33:44 user nova-compute[74840]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)
Nov 08 12:33:44 user nova-compute[74840]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 (non-flash)
Nov 08 12:33:44 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:33:44 user nova-compute[74840]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)
Nov 08 12:33:44 user nova-compute[74840]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 (non-flash)
Nov 08 12:33:44 user nova-compute[74840]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)
Nov 08 12:33:44 user nova-compute[74840]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 (non-flash)
Nov 08 12:33:44 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4 -p 172.16.0.220:3260 --login {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[68de6fb0-6926-4142-9f32-136d3a9c6a02]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4, portal: 172.16.0.220,3260]
Nov 08 12:33:44 user nova-compute[74840]: Login to [iface: default, target: iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4, portal: 172.16.0.220,3260] successful.
Nov 08 12:33:44 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8fd136-882f-4969-ac82-b96f33f44fef]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[2414286f-2ed3-4df7-9b31-9dcdbfaa7008]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:33:44 user nova-compute[74840]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)
Nov 08 12:33:44 user nova-compute[74840]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 (non-flash)
Nov 08 12:33:44 user nova-compute[74840]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)
Nov 08 12:33:44 user nova-compute[74840]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 (non-flash)
Nov 08 12:33:44 user nova-compute[74840]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4 (non-flash)
Nov 08 12:33:44 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:33:44 user nova-compute[74840]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)
Nov 08 12:33:44 user nova-compute[74840]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 (non-flash)
Nov 08 12:33:44 user nova-compute[74840]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)
Nov 08 12:33:44 user nova-compute[74840]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 (non-flash)
Nov 08 12:33:44 user nova-compute[74840]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4 (non-flash)
Nov 08 12:33:44 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Connected to 172.16.0.220:3260 {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=74840) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74840) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[722fc495-c44e-40f8-ad2a-275670eec129]: (4, ('- - 0', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:33:44 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hrUSyEIu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 12:33:45 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:33:45 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '23535316535363639', 'path': '/dev/sdb'} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:33:45 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23535316535363639', 'path': '/dev/sdb'} {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 12:33:45 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:33:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1332370978',display_name='tempest-TestVolumeBootPattern-server-1332370978',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1332370978',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDnf/rgNeauxsdXCuQeVAa6oJl7IvXSpNN83Cdo1qtwT4P0g8IuWhFw/l+HOo44zetcJEHbPUEQ14N2qnoFV4I4QWYhF+y8Gsgf65CRdUjmUlU4hjQG+QvZzqapWj/SBg==',key_name='tempest-TestVolumeBootPattern-1773717711',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1250106b55ae44b0b303849df7781ffb',ramdisk_id='',reservation_id='r-if9aa5ih',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-77780905',owner_user_name='tempest-TestVolumeBootPattern-77780905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:33:18Z,user_data=None,user_id='794c0281e1bf48f79117efdc3907e661',uuid=e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8b090c7-4d0d-43d0-8fa3-4c4d489862a7", "address": "fa:16:3e:ae:e2:dc", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b090c7-4d", "ovs_interfaceid": "d8b090c7-4d0d-43d0-8fa3-4c4d489862a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:33:45 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Converting VIF {"id": "d8b090c7-4d0d-43d0-8fa3-4c4d489862a7", "address": "fa:16:3e:ae:e2:dc", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b090c7-4d", "ovs_interfaceid": "d8b090c7-4d0d-43d0-8fa3-4c4d489862a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:33:45 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:e2:dc,bridge_name='br-int',has_traffic_filtering=True,id=d8b090c7-4d0d-43d0-8fa3-4c4d489862a7,network=Network(174da5e9-78cc-426f-87fb-1d3b23b8b459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8b090c7-4d') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:33:45 user nova-compute[74840]: DEBUG nova.objects.instance [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lazy-loading 'pci_devices' on Instance uuid e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:33:45 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:33:45 user nova-compute[74840]:   <uuid>e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e</uuid>
Nov 08 12:33:45 user nova-compute[74840]:   <name>instance-00000028</name>
Nov 08 12:33:45 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:33:45 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:33:45 user nova-compute[74840]:   <metadata>
Nov 08 12:33:45 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:33:45 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:33:45 user nova-compute[74840]:       <nova:name>tempest-TestVolumeBootPattern-server-1332370978</nova:name>
Nov 08 12:33:45 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:33:44</nova:creationTime>
Nov 08 12:33:45 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:33:45 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:33:45 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:33:45 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:33:45 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:33:45 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:33:45 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:33:45 user nova-compute[74840]:       <nova:owner>
Nov 08 12:33:45 user nova-compute[74840]:         <nova:user uuid="794c0281e1bf48f79117efdc3907e661">tempest-TestVolumeBootPattern-77780905-project-member</nova:user>
Nov 08 12:33:45 user nova-compute[74840]:         <nova:project uuid="1250106b55ae44b0b303849df7781ffb">tempest-TestVolumeBootPattern-77780905</nova:project>
Nov 08 12:33:45 user nova-compute[74840]:       </nova:owner>
Nov 08 12:33:45 user nova-compute[74840]:       <nova:ports>
Nov 08 12:33:45 user nova-compute[74840]:         <nova:port uuid="d8b090c7-4d0d-43d0-8fa3-4c4d489862a7">
Nov 08 12:33:45 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 12:33:45 user nova-compute[74840]:         </nova:port>
Nov 08 12:33:45 user nova-compute[74840]:       </nova:ports>
Nov 08 12:33:45 user nova-compute[74840]:     </nova:instance>
Nov 08 12:33:45 user nova-compute[74840]:   </metadata>
Nov 08 12:33:45 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:33:45 user nova-compute[74840]:     <system>
Nov 08 12:33:45 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:33:45 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:33:45 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:33:45 user nova-compute[74840]:       <entry name="serial">e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e</entry>
Nov 08 12:33:45 user nova-compute[74840]:       <entry name="uuid">e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e</entry>
Nov 08 12:33:45 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:33:45 user nova-compute[74840]:     </system>
Nov 08 12:33:45 user nova-compute[74840]:   </sysinfo>
Nov 08 12:33:45 user nova-compute[74840]:   <os>
Nov 08 12:33:45 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:33:45 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:33:45 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:33:45 user nova-compute[74840]:   </os>
Nov 08 12:33:45 user nova-compute[74840]:   <features>
Nov 08 12:33:45 user nova-compute[74840]:     <acpi/>
Nov 08 12:33:45 user nova-compute[74840]:     <apic/>
Nov 08 12:33:45 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:33:45 user nova-compute[74840]:   </features>
Nov 08 12:33:45 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:33:45 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:33:45 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:33:45 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:33:45 user nova-compute[74840]:   </clock>
Nov 08 12:33:45 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:33:45 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:33:45 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:33:45 user nova-compute[74840]:   </cpu>
Nov 08 12:33:45 user nova-compute[74840]:   <devices>
Nov 08 12:33:45 user nova-compute[74840]:     <disk type="block" device="disk">
Nov 08 12:33:45 user nova-compute[74840]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:33:45 user nova-compute[74840]:       <source dev="/dev/sdb"/>
Nov 08 12:33:45 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:33:45 user nova-compute[74840]:       <serial>bbde86c3-d678-411a-b903-d997dc3780e4</serial>
Nov 08 12:33:45 user nova-compute[74840]:     </disk>
Nov 08 12:33:45 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:33:45 user nova-compute[74840]:       <mac address="fa:16:3e:ae:e2:dc"/>
Nov 08 12:33:45 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:33:45 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:33:45 user nova-compute[74840]:       <target dev="tapd8b090c7-4d"/>
Nov 08 12:33:45 user nova-compute[74840]:     </interface>
Nov 08 12:33:45 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:33:45 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e/console.log" append="off"/>
Nov 08 12:33:45 user nova-compute[74840]:     </serial>
Nov 08 12:33:45 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:33:45 user nova-compute[74840]:     <video>
Nov 08 12:33:45 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:33:45 user nova-compute[74840]:     </video>
Nov 08 12:33:45 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:33:45 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:33:45 user nova-compute[74840]:     </rng>
Nov 08 12:33:45 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:33:45 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:33:45 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:33:45 user nova-compute[74840]:     </memballoon>
Nov 08 12:33:45 user nova-compute[74840]:   </devices>
Nov 08 12:33:45 user nova-compute[74840]: </domain>
Nov 08 12:33:45 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:33:45 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:33:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1332370978',display_name='tempest-TestVolumeBootPattern-server-1332370978',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1332370978',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDnf/rgNeauxsdXCuQeVAa6oJl7IvXSpNN83Cdo1qtwT4P0g8IuWhFw/l+HOo44zetcJEHbPUEQ14N2qnoFV4I4QWYhF+y8Gsgf65CRdUjmUlU4hjQG+QvZzqapWj/SBg==',key_name='tempest-TestVolumeBootPattern-1773717711',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1250106b55ae44b0b303849df7781ffb',ramdisk_id='',reservation_id='r-if9aa5ih',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-77780905',owner_user_name='tempest-TestVolumeBootPattern-77780905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:33:18Z,user_data=None,user_id='794c0281e1bf48f79117efdc3907e661',uuid=e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8b090c7-4d0d-43d0-8fa3-4c4d489862a7", "address": "fa:16:3e:ae:e2:dc", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b090c7-4d", "ovs_interfaceid": "d8b090c7-4d0d-43d0-8fa3-4c4d489862a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:33:45 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Converting VIF {"id": "d8b090c7-4d0d-43d0-8fa3-4c4d489862a7", "address": "fa:16:3e:ae:e2:dc", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b090c7-4d", "ovs_interfaceid": "d8b090c7-4d0d-43d0-8fa3-4c4d489862a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:33:45 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:e2:dc,bridge_name='br-int',has_traffic_filtering=True,id=d8b090c7-4d0d-43d0-8fa3-4c4d489862a7,network=Network(174da5e9-78cc-426f-87fb-1d3b23b8b459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8b090c7-4d') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:33:45 user nova-compute[74840]: DEBUG os_vif [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:e2:dc,bridge_name='br-int',has_traffic_filtering=True,id=d8b090c7-4d0d-43d0-8fa3-4c4d489862a7,network=Network(174da5e9-78cc-426f-87fb-1d3b23b8b459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8b090c7-4d') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:33:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:33:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:33:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c244b69f-de8b-5623-8b54-4a586e88ee69', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:33:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:33:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd8b090c7-4d, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:33:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd8b090c7-4d, col_values=(('qos', UUID('e0516db2-9e2c-4509-a08d-9ea59a450d06')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:33:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd8b090c7-4d, col_values=(('external_ids', {'iface-id': 'd8b090c7-4d0d-43d0-8fa3-4c4d489862a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:e2:dc', 'vm-uuid': 'e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:33:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:33:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:45 user nova-compute[74840]: INFO os_vif [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:e2:dc,bridge_name='br-int',has_traffic_filtering=True,id=d8b090c7-4d0d-43d0-8fa3-4c4d489862a7,network=Network(174da5e9-78cc-426f-87fb-1d3b23b8b459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8b090c7-4d')
Nov 08 12:33:46 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:33:46 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] No VIF found with MAC fa:16:3e:ae:e2:dc, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:33:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:47 user nova-compute[74840]: DEBUG nova.compute.manager [req-fa8f1dc8-e4f2-4b84-a568-4ef36235c427 req-32c56995-1cdc-48f1-9eca-1081f7633a64 service nova] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Received event network-vif-plugged-d8b090c7-4d0d-43d0-8fa3-4c4d489862a7 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:33:47 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-fa8f1dc8-e4f2-4b84-a568-4ef36235c427 req-32c56995-1cdc-48f1-9eca-1081f7633a64 service nova] Acquiring lock "e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:33:47 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-fa8f1dc8-e4f2-4b84-a568-4ef36235c427 req-32c56995-1cdc-48f1-9eca-1081f7633a64 service nova] Lock "e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:33:47 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-fa8f1dc8-e4f2-4b84-a568-4ef36235c427 req-32c56995-1cdc-48f1-9eca-1081f7633a64 service nova] Lock "e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:33:47 user nova-compute[74840]: DEBUG nova.compute.manager [req-fa8f1dc8-e4f2-4b84-a568-4ef36235c427 req-32c56995-1cdc-48f1-9eca-1081f7633a64 service nova] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] No waiting events found dispatching network-vif-plugged-d8b090c7-4d0d-43d0-8fa3-4c4d489862a7 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:33:47 user nova-compute[74840]: WARNING nova.compute.manager [req-fa8f1dc8-e4f2-4b84-a568-4ef36235c427 req-32c56995-1cdc-48f1-9eca-1081f7633a64 service nova] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Received unexpected event network-vif-plugged-d8b090c7-4d0d-43d0-8fa3-4c4d489862a7 for instance with vm_state building and task_state spawning.
Nov 08 12:33:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:49 user nova-compute[74840]: DEBUG nova.compute.manager [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:33:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:33:49 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Instance spawned successfully.
Nov 08 12:33:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:33:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Found default for hw_cdrom_bus of ide {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:33:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Found default for hw_disk_bus of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:33:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:33:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:33:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Found default for hw_video_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:33:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Found default for hw_vif_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:33:49 user nova-compute[74840]: INFO nova.compute.manager [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Took 5.09 seconds to spawn the instance on the hypervisor.
Nov 08 12:33:49 user nova-compute[74840]: DEBUG nova.compute.manager [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:33:49 user nova-compute[74840]: DEBUG nova.compute.manager [req-bfaa9de9-0bbc-4692-860d-51b1f201163f req-26134b21-689d-4444-b83f-fa287aa2d3c5 service nova] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Received event network-vif-plugged-d8b090c7-4d0d-43d0-8fa3-4c4d489862a7 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:33:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-bfaa9de9-0bbc-4692-860d-51b1f201163f req-26134b21-689d-4444-b83f-fa287aa2d3c5 service nova] Acquiring lock "e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:33:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-bfaa9de9-0bbc-4692-860d-51b1f201163f req-26134b21-689d-4444-b83f-fa287aa2d3c5 service nova] Lock "e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:33:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-bfaa9de9-0bbc-4692-860d-51b1f201163f req-26134b21-689d-4444-b83f-fa287aa2d3c5 service nova] Lock "e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:33:49 user nova-compute[74840]: DEBUG nova.compute.manager [req-bfaa9de9-0bbc-4692-860d-51b1f201163f req-26134b21-689d-4444-b83f-fa287aa2d3c5 service nova] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] No waiting events found dispatching network-vif-plugged-d8b090c7-4d0d-43d0-8fa3-4c4d489862a7 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:33:49 user nova-compute[74840]: WARNING nova.compute.manager [req-bfaa9de9-0bbc-4692-860d-51b1f201163f req-26134b21-689d-4444-b83f-fa287aa2d3c5 service nova] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Received unexpected event network-vif-plugged-d8b090c7-4d0d-43d0-8fa3-4c4d489862a7 for instance with vm_state building and task_state spawning.
Nov 08 12:33:49 user nova-compute[74840]: INFO nova.compute.manager [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Took 32.19 seconds to build instance.
Nov 08 12:33:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ec7f9967-5796-42ec-9be9-033c7adadd45 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 32.298s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:33:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-daf1cc16-846e-4be6-a211-76ab608a460a tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "e3175752-45a5-43e3-a99a-9377440e7bea" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:33:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-daf1cc16-846e-4be6-a211-76ab608a460a tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "e3175752-45a5-43e3-a99a-9377440e7bea" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:33:55 user nova-compute[74840]: INFO nova.compute.manager [None req-daf1cc16-846e-4be6-a211-76ab608a460a tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Detaching volume 67de400a-4361-4d2c-b9f0-a17af7822321
Nov 08 12:33:55 user nova-compute[74840]: INFO nova.virt.block_device [None req-daf1cc16-846e-4be6-a211-76ab608a460a tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Attempting to driver detach volume 67de400a-4361-4d2c-b9f0-a17af7822321 from mountpoint /dev/vdb
Nov 08 12:33:55 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-daf1cc16-846e-4be6-a211-76ab608a460a tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Attempting to detach device vdb from instance e3175752-45a5-43e3-a99a-9377440e7bea from the persistent domain config. {{(pid=74840) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 12:33:55 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-daf1cc16-846e-4be6-a211-76ab608a460a tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 12:33:55 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:33:55 user nova-compute[74840]:   <source dev="/dev/sdg"/>
Nov 08 12:33:55 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:33:55 user nova-compute[74840]:   <serial>67de400a-4361-4d2c-b9f0-a17af7822321</serial>
Nov 08 12:33:55 user nova-compute[74840]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 12:33:55 user nova-compute[74840]: </disk>
Nov 08 12:33:55 user nova-compute[74840]:  {{(pid=74840) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 12:33:55 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-daf1cc16-846e-4be6-a211-76ab608a460a tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Successfully detached device vdb from instance e3175752-45a5-43e3-a99a-9377440e7bea from the persistent domain config.
Nov 08 12:33:55 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-daf1cc16-846e-4be6-a211-76ab608a460a tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e3175752-45a5-43e3-a99a-9377440e7bea from the live domain config. {{(pid=74840) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 12:33:55 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-daf1cc16-846e-4be6-a211-76ab608a460a tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 12:33:55 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:33:55 user nova-compute[74840]:   <source dev="/dev/sdg"/>
Nov 08 12:33:55 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:33:55 user nova-compute[74840]:   <serial>67de400a-4361-4d2c-b9f0-a17af7822321</serial>
Nov 08 12:33:55 user nova-compute[74840]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 12:33:55 user nova-compute[74840]: </disk>
Nov 08 12:33:55 user nova-compute[74840]:  {{(pid=74840) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 12:33:55 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-daf1cc16-846e-4be6-a211-76ab608a460a tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e3175752-45a5-43e3-a99a-9377440e7bea {{(pid=74840) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 12:33:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:33:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:01 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:34:01 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:34:01 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Rebuilding the list of instances to heal {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 12:34:01 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Skipping network cache update for instance because it is Building. {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 08 12:34:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "refresh_cache-d3e8efc6-7146-46ef-8433-380d7e69120c" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:34:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquired lock "refresh_cache-d3e8efc6-7146-46ef-8433-380d7e69120c" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:34:01 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Forcefully refreshing network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 12:34:01 user nova-compute[74840]: DEBUG nova.objects.instance [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lazy-loading 'info_cache' on Instance uuid d3e8efc6-7146-46ef-8433-380d7e69120c {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:34:02 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:02 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Updating instance_info_cache with network_info: [{"id": "5c942bb3-846b-4319-961f-42aed0e55bdf", "address": "fa:16:3e:29:6a:cd", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c942bb3-84", "ovs_interfaceid": "5c942bb3-846b-4319-961f-42aed0e55bdf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:34:02 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Releasing lock "refresh_cache-d3e8efc6-7146-46ef-8433-380d7e69120c" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:34:02 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Updated the network info_cache for instance {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 12:34:02 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:34:04 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:34:04 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:34:05 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:34:05 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:34:05 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:34:05 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:34:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:08 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:34:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:11 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:34:11 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:34:11 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:34:11 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:34:11 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:34:11 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:34:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c/disk.rescue --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:12 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:12 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c/disk.rescue --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:12 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:12 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:34:12 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a482219-16ac-49e2-84ad-7e2030c97184/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:12 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a482219-16ac-49e2-84ad-7e2030c97184/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:12 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a482219-16ac-49e2-84ad-7e2030c97184/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:12 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a482219-16ac-49e2-84ad-7e2030c97184/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:12 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c4fc63-0757-46da-ad00-7b6c6513deca/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:12 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c4fc63-0757-46da-ad00-7b6c6513deca/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:12 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c4fc63-0757-46da-ad00-7b6c6513deca/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:12 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c4fc63-0757-46da-ad00-7b6c6513deca/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:12 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:34:12 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51e700d9-9919-42ba-b692-df23d147228d tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Calling os-brick to attach iSCSI Volume {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e700d9-9919-42ba-b692-df23d147228d tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OpWDjYTZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:34:13 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-51e700d9-9919-42ba-b692-df23d147228d tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:34:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-51e700d9-9919-42ba-b692-df23d147228d tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-51e700d9-9919-42ba-b692-df23d147228d tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:34:13 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-51e700d9-9919-42ba-b692-df23d147228d tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:34:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-51e700d9-9919-42ba-b692-df23d147228d tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-51e700d9-9919-42ba-b692-df23d147228d tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:34:13 user nova-compute[74840]: INFO os_brick.initiator.connectors.iscsi [None req-51e700d9-9919-42ba-b692-df23d147228d tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 12:34:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96 -p 172.16.0.220:3260 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[68447f2a-3c09-4960-9cb4-627b7dbb5a3b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e700d9-9919-42ba-b692-df23d147228d tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 12:34:13 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96 -p 172.16.0.220:3260 --interface default --op new {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[365615e9-809e-4443-9821-1ac9cefed320]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96] added\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e700d9-9919-42ba-b692-df23d147228d tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96] added
Nov 08 12:34:13 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG nova.compute.manager [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Start spawning the instance on the hypervisor. {{(pid=74840) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:34:13 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Creating image(s)
Nov 08 12:34:13 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Did not create local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Ensure instance console log exists: /opt/stack/data/nova/instances/550f8fed-4652-46fe-a440-974ee8f88196/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Start _get_guest_xml network_info=[{"id": "daa004c9-f48f-4997-8260-7e1f394c3a7c", "address": "fa:16:3e:e1:a6:9b", "network": {"id": "5d8710f7-82f1-4670-b564-9ef14312dc8e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1266284233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa486cd37a9c498ba6f800d2dbd415ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaa004c9-f4", "ovs_interfaceid": "daa004c9-f48f-4997-8260-7e1f394c3a7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'e377e3c0-d2e9-4326-b33e-7d39c9090cd6', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'txbpOwNW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '550f8fed-4652-46fe-a440-974ee8f88196', 'attached_at': '', 'detached_at': '', 'volume_id': '177df23a-e5d3-41e7-ac17-e0959f15e616', 'serial': '177df23a-e5d3-41e7-ac17-e0959f15e616'}, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[701ad2fc-3a66-4d0a-ac5b-0eaf7bcb3805]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e700d9-9919-42ba-b692-df23d147228d tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:13 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:34:13 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:34:13 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Calling os-brick to attach iSCSI Volume {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'txbpOwNW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:34:13 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:34:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbda27fd-8ccd-44f4-ae94-c3c22ffc78fb]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e700d9-9919-42ba-b692-df23d147228d tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OpWDjYTZ {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OpWDjYTZ" returned: 0 in 0.025s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7c8ff7-3fc7-4162-873d-819046aaa72f]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e700d9-9919-42ba-b692-df23d147228d tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OpWDjYTZ'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a72c30-b1cf-407c-9e5e-f67ad775ebf1]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e700d9-9919-42ba-b692-df23d147228d tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:34:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:14 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:14 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7af238-12ad-4bb4-84fd-b10fb72feec3]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:34:14 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e700d9-9919-42ba-b692-df23d147228d tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:34:14 user nova-compute[74840]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)
Nov 08 12:34:14 user nova-compute[74840]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 (non-flash)
Nov 08 12:34:14 user nova-compute[74840]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)
Nov 08 12:34:14 user nova-compute[74840]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 (non-flash)
Nov 08 12:34:14 user nova-compute[74840]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4 (non-flash)
Nov 08 12:34:14 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:34:14 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e700d9-9919-42ba-b692-df23d147228d tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:34:14 user nova-compute[74840]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)
Nov 08 12:34:14 user nova-compute[74840]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 (non-flash)
Nov 08 12:34:14 user nova-compute[74840]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)
Nov 08 12:34:14 user nova-compute[74840]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 (non-flash)
Nov 08 12:34:14 user nova-compute[74840]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4 (non-flash)
Nov 08 12:34:14 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:34:14 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96 -p 172.16.0.220:3260 --login {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:14 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:14 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:14 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:14 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6275f515-5aea-40d0-b8a4-495fbf5e09ac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:34:14 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e700d9-9919-42ba-b692-df23d147228d tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96, portal: 172.16.0.220,3260]
Nov 08 12:34:14 user nova-compute[74840]: Login to [iface: default, target: iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96, portal: 172.16.0.220,3260] successful.
Nov 08 12:34:14 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:34:14 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:14 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:14 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7637a958-7c1d-4e20-8b6d-f57fd1ef95ca]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:34:14 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e700d9-9919-42ba-b692-df23d147228d tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:34:14 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:14 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:14 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1883289c-bef3-4dd1-9665-cd17f811f5d7]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:34:14 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e700d9-9919-42ba-b692-df23d147228d tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:34:14 user nova-compute[74840]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)
Nov 08 12:34:14 user nova-compute[74840]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 (non-flash)
Nov 08 12:34:14 user nova-compute[74840]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)
Nov 08 12:34:14 user nova-compute[74840]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 (non-flash)
Nov 08 12:34:14 user nova-compute[74840]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4 (non-flash)
Nov 08 12:34:14 user nova-compute[74840]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96 (non-flash)
Nov 08 12:34:14 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:34:14 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e700d9-9919-42ba-b692-df23d147228d tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:34:14 user nova-compute[74840]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)
Nov 08 12:34:14 user nova-compute[74840]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 (non-flash)
Nov 08 12:34:14 user nova-compute[74840]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)
Nov 08 12:34:14 user nova-compute[74840]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 (non-flash)
Nov 08 12:34:14 user nova-compute[74840]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4 (non-flash)
Nov 08 12:34:14 user nova-compute[74840]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96 (non-flash)
Nov 08 12:34:14 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:34:14 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-51e700d9-9919-42ba-b692-df23d147228d tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.425s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:34:14 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e700d9-9919-42ba-b692-df23d147228d tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Connected to 172.16.0.220:3260 {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 12:34:14 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-51e700d9-9919-42ba-b692-df23d147228d tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] HCTL ('39', '-', '-', 0) found on session 41 with lun 0 {{(pid=74840) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 12:34:14 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-51e700d9-9919-42ba-b692-df23d147228d tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74840) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 12:34:14 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:14 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.015s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:14 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[715a0df5-ebe6-48eb-b1c3-e27ba9e960c2]: (4, ('- - 0', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:34:14 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-51e700d9-9919-42ba-b692-df23d147228d tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Searching for a device in session 41 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:34:14 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e700d9-9919-42ba-b692-df23d147228d tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OpWDjYTZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 12:34:14 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:14 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:14 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:14 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6156dbbc-6539-4de3-8ba0-16db61cd7dce/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:14 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6156dbbc-6539-4de3-8ba0-16db61cd7dce/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:14 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6156dbbc-6539-4de3-8ba0-16db61cd7dce/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:14 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6156dbbc-6539-4de3-8ba0-16db61cd7dce/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:14 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:34:14 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3175752-45a5-43e3-a99a-9377440e7bea/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3175752-45a5-43e3-a99a-9377440e7bea/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3175752-45a5-43e3-a99a-9377440e7bea/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3175752-45a5-43e3-a99a-9377440e7bea/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-51e700d9-9919-42ba-b692-df23d147228d tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.491s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e700d9-9919-42ba-b692-df23d147228d tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] <== connect_volume: return (1495ms) {'type': 'block', 'scsi_wwn': '23863646230656632', 'path': '/dev/sdh'} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51e700d9-9919-42ba-b692-df23d147228d tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863646230656632', 'path': '/dev/sdh'} {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.345s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:34:15 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:34:15 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:34:15 user nova-compute[74840]: INFO os_brick.initiator.connectors.iscsi [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 12:34:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 -p 172.16.0.220:3260 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG nova.objects.instance [None req-51e700d9-9919-42ba-b692-df23d147228d tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lazy-loading 'flavor' on Instance uuid 7a482219-16ac-49e2-84ad-7e2030c97184 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[282301f4-40c2-4390-baae-c084620e14f1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 12:34:15 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 -p 172.16.0.220:3260 --interface default --op new {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-51e700d9-9919-42ba-b692-df23d147228d tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 12:34:15 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:34:15 user nova-compute[74840]:   <source dev="/dev/sdh"/>
Nov 08 12:34:15 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:34:15 user nova-compute[74840]:   <serial>7d3984bc-b442-400e-8396-9ac7d028cf96</serial>
Nov 08 12:34:15 user nova-compute[74840]: </disk>
Nov 08 12:34:15 user nova-compute[74840]:  {{(pid=74840) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[feab52e8-8eb4-46e5-a62c-4b0dd4525982]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616] added\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616] added
Nov 08 12:34:15 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf77e74-d646-4686-ac23-9db05cb69eeb]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2867f6-a817-4ec4-b84e-2156e9a22bfb]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v txbpOwNW {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v txbpOwNW" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ecf1bc-4c48-48ea-8ef8-8c1dd8923bf4]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'txbpOwNW'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6a87c9-c880-4f19-bf1f-53e3d4c8b8ee]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[09161f9c-ca5e-4e45-9fcb-b5b95581bdca]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:34:15 user nova-compute[74840]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)
Nov 08 12:34:15 user nova-compute[74840]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 (non-flash)
Nov 08 12:34:15 user nova-compute[74840]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)
Nov 08 12:34:15 user nova-compute[74840]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 (non-flash)
Nov 08 12:34:15 user nova-compute[74840]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4 (non-flash)
Nov 08 12:34:15 user nova-compute[74840]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96 (non-flash)
Nov 08 12:34:15 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:34:15 user nova-compute[74840]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)
Nov 08 12:34:15 user nova-compute[74840]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 (non-flash)
Nov 08 12:34:15 user nova-compute[74840]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)
Nov 08 12:34:15 user nova-compute[74840]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 (non-flash)
Nov 08 12:34:15 user nova-compute[74840]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4 (non-flash)
Nov 08 12:34:15 user nova-compute[74840]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96 (non-flash)
Nov 08 12:34:15 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 -p 172.16.0.220:3260 --login {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cb2bb7-8ad9-4591-8ff8-ac842aceed5f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616, portal: 172.16.0.220,3260]
Nov 08 12:34:15 user nova-compute[74840]: Login to [iface: default, target: iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616, portal: 172.16.0.220,3260] successful.
Nov 08 12:34:15 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[bacf18fe-2eea-4781-9dff-50e3f642372b]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6700f16-bef8-49f3-9749-f21d2107ffe3]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:34:15 user nova-compute[74840]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)
Nov 08 12:34:15 user nova-compute[74840]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 (non-flash)
Nov 08 12:34:15 user nova-compute[74840]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)
Nov 08 12:34:15 user nova-compute[74840]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 (non-flash)
Nov 08 12:34:15 user nova-compute[74840]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4 (non-flash)
Nov 08 12:34:15 user nova-compute[74840]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96 (non-flash)
Nov 08 12:34:15 user nova-compute[74840]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 (non-flash)
Nov 08 12:34:15 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:34:15 user nova-compute[74840]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)
Nov 08 12:34:15 user nova-compute[74840]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 (non-flash)
Nov 08 12:34:15 user nova-compute[74840]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)
Nov 08 12:34:15 user nova-compute[74840]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 (non-flash)
Nov 08 12:34:15 user nova-compute[74840]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4 (non-flash)
Nov 08 12:34:15 user nova-compute[74840]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96 (non-flash)
Nov 08 12:34:15 user nova-compute[74840]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 (non-flash)
Nov 08 12:34:15 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.422s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Connected to 172.16.0.220:3260 {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] HCTL ('40', '-', '-', 0) found on session 42 with lun 0 {{(pid=74840) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=74840) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be58b7b-84ed-4a68-92a8-d327442e6101]: (4, ('- - 0', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Searching for a device in session 42 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'txbpOwNW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-51e700d9-9919-42ba-b692-df23d147228d tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-51e700d9-9919-42ba-b692-df23d147228d tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-51e700d9-9919-42ba-b692-df23d147228d tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] No VIF found with MAC fa:16:3e:72:4b:1f, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:15 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-daf1cc16-846e-4be6-a211-76ab608a460a tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e3175752-45a5-43e3-a99a-9377440e7bea is timed out.
Nov 08 12:34:15 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-daf1cc16-846e-4be6-a211-76ab608a460a tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Successfully detached device vdb from instance e3175752-45a5-43e3-a99a-9377440e7bea from the live domain config.
Nov 08 12:34:15 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daf1cc16-846e-4be6-a211-76ab608a460a tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf1cc16-846e-4be6-a211-76ab608a460a tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cxshviGp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:34:15 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-daf1cc16-846e-4be6-a211-76ab608a460a tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:34:15 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-daf1cc16-846e-4be6-a211-76ab608a460a tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-51e700d9-9919-42ba-b692-df23d147228d tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "7a482219-16ac-49e2-84ad-7e2030c97184" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 49.130s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:15 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:34:16 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:34:16 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:34:16 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=7252MB free_disk=24.709300994873047GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance d3e8efc6-7146-46ef-8433-380d7e69120c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance ffe50042-29bf-4ef3-a148-8698bc75233b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 8b7c490e-4c78-4e07-bc8a-3be2328963d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 832a6445-84ee-43a8-a5bc-a07670602912 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 10c42516-62ba-4aa9-bc5a-d94499bd6b65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 9991e7b4-aaf8-4485-b658-e1af634925de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance e3175752-45a5-43e3-a99a-9377440e7bea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance a2c4fc63-0757-46da-ad00-7b6c6513deca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 83da3dce-e270-4054-910d-c8ad28eb18da actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 7a482219-16ac-49e2-84ad-7e2030c97184 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 550f8fed-4652-46fe-a440-974ee8f88196 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 6156dbbc-6539-4de3-8ba0-16db61cd7dce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.468s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] <== connect_volume: return (2813ms) {'type': 'block', 'scsi_wwn': '26432663365323362', 'path': '/dev/sdi'} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432663365323362', 'path': '/dev/sdi'} {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-daf1cc16-846e-4be6-a211-76ab608a460a tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.839s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[53088f6e-4584-4bf2-8628-8c4e0f9ab52b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf1cc16-846e-4be6-a211-76ab608a460a tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 12:34:16 user nova-compute[74840]: No targets found.
Nov 08 12:34:16 user nova-compute[74840]: iSNS:
Nov 08 12:34:16 user nova-compute[74840]: No targets found.
Nov 08 12:34:16 user nova-compute[74840]: STATIC:
Nov 08 12:34:16 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2
Nov 08 12:34:16 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:34:16 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:34:16 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616
Nov 08 12:34:16 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:34:16 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:34:16 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c
Nov 08 12:34:16 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:34:16 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:34:16 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4
Nov 08 12:34:16 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:34:16 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:34:16 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4
Nov 08 12:34:16 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:34:16 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:34:16 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b
Nov 08 12:34:16 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:34:16 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:34:16 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321
Nov 08 12:34:16 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:34:16 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:34:16 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96
Nov 08 12:34:16 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:34:16 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:34:16 user nova-compute[74840]: FIRMWARE:
Nov 08 12:34:16 user nova-compute[74840]: No targets found.
Nov 08 12:34:16 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf1cc16-846e-4be6-a211-76ab608a460a tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 12:34:16 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 12:34:16 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf1cc16-846e-4be6-a211-76ab608a460a tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:33:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1581355820',display_name='tempest-TestShelveInstance-server-1581355820',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1581355820',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMa4hvb8cWjBz4jMMa+/lZwnWtFqszzwskJtEIpqap//CbH421Hhd++cesn8avpj6IUxUQoy6rfFajaUge6h3UgyQ7k3b8nofngq0aAHrZpvXyuczTPqMuSft/WEq95F1g==',key_name='tempest-TestShelveInstance-850605026',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa486cd37a9c498ba6f800d2dbd415ab',ramdisk_id='',reservation_id='r-o5fknux2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1716375711',owner_user_name='tempest-TestShelveInstance-1716375711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:33:23Z,user_data=None,user_id='ff68af4357024f75888b6f8bd6ada9e5',uuid=550f8fed-4652-46fe-a440-974ee8f88196,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "daa004c9-f48f-4997-8260-7e1f394c3a7c", "address": "fa:16:3e:e1:a6:9b", "network": {"id": "5d8710f7-82f1-4670-b564-9ef14312dc8e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1266284233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa486cd37a9c498ba6f800d2dbd415ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaa004c9-f4", "ovs_interfaceid": "daa004c9-f48f-4997-8260-7e1f394c3a7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Converting VIF {"id": "daa004c9-f48f-4997-8260-7e1f394c3a7c", "address": "fa:16:3e:e1:a6:9b", "network": {"id": "5d8710f7-82f1-4670-b564-9ef14312dc8e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1266284233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa486cd37a9c498ba6f800d2dbd415ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaa004c9-f4", "ovs_interfaceid": "daa004c9-f48f-4997-8260-7e1f394c3a7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:a6:9b,bridge_name='br-int',has_traffic_filtering=True,id=daa004c9-f48f-4997-8260-7e1f394c3a7c,network=Network(5d8710f7-82f1-4670-b564-9ef14312dc8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaa004c9-f4') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG nova.objects.instance [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Lazy-loading 'pci_devices' on Instance uuid 550f8fed-4652-46fe-a440-974ee8f88196 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:34:16 user nova-compute[74840]:   <uuid>550f8fed-4652-46fe-a440-974ee8f88196</uuid>
Nov 08 12:34:16 user nova-compute[74840]:   <name>instance-00000029</name>
Nov 08 12:34:16 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:34:16 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:34:16 user nova-compute[74840]:   <metadata>
Nov 08 12:34:16 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:34:16 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:34:16 user nova-compute[74840]:       <nova:name>tempest-TestShelveInstance-server-1581355820</nova:name>
Nov 08 12:34:16 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:34:13</nova:creationTime>
Nov 08 12:34:16 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:34:16 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:34:16 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:34:16 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:34:16 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:34:16 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:34:16 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:34:16 user nova-compute[74840]:       <nova:owner>
Nov 08 12:34:16 user nova-compute[74840]:         <nova:user uuid="ff68af4357024f75888b6f8bd6ada9e5">tempest-TestShelveInstance-1716375711-project-member</nova:user>
Nov 08 12:34:16 user nova-compute[74840]:         <nova:project uuid="fa486cd37a9c498ba6f800d2dbd415ab">tempest-TestShelveInstance-1716375711</nova:project>
Nov 08 12:34:16 user nova-compute[74840]:       </nova:owner>
Nov 08 12:34:16 user nova-compute[74840]:       <nova:ports>
Nov 08 12:34:16 user nova-compute[74840]:         <nova:port uuid="daa004c9-f48f-4997-8260-7e1f394c3a7c">
Nov 08 12:34:16 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 08 12:34:16 user nova-compute[74840]:         </nova:port>
Nov 08 12:34:16 user nova-compute[74840]:       </nova:ports>
Nov 08 12:34:16 user nova-compute[74840]:     </nova:instance>
Nov 08 12:34:16 user nova-compute[74840]:   </metadata>
Nov 08 12:34:16 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:34:16 user nova-compute[74840]:     <system>
Nov 08 12:34:16 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:34:16 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:34:16 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:34:16 user nova-compute[74840]:       <entry name="serial">550f8fed-4652-46fe-a440-974ee8f88196</entry>
Nov 08 12:34:16 user nova-compute[74840]:       <entry name="uuid">550f8fed-4652-46fe-a440-974ee8f88196</entry>
Nov 08 12:34:16 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:34:16 user nova-compute[74840]:     </system>
Nov 08 12:34:16 user nova-compute[74840]:   </sysinfo>
Nov 08 12:34:16 user nova-compute[74840]:   <os>
Nov 08 12:34:16 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:34:16 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:34:16 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:34:16 user nova-compute[74840]:   </os>
Nov 08 12:34:16 user nova-compute[74840]:   <features>
Nov 08 12:34:16 user nova-compute[74840]:     <acpi/>
Nov 08 12:34:16 user nova-compute[74840]:     <apic/>
Nov 08 12:34:16 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:34:16 user nova-compute[74840]:   </features>
Nov 08 12:34:16 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:34:16 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:34:16 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:34:16 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:34:16 user nova-compute[74840]:   </clock>
Nov 08 12:34:16 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:34:16 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:34:16 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:34:16 user nova-compute[74840]:   </cpu>
Nov 08 12:34:16 user nova-compute[74840]:   <devices>
Nov 08 12:34:16 user nova-compute[74840]:     <disk type="block" device="disk">
Nov 08 12:34:16 user nova-compute[74840]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:34:16 user nova-compute[74840]:       <source dev="/dev/sdi"/>
Nov 08 12:34:16 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:34:16 user nova-compute[74840]:       <serial>177df23a-e5d3-41e7-ac17-e0959f15e616</serial>
Nov 08 12:34:16 user nova-compute[74840]:     </disk>
Nov 08 12:34:16 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:34:16 user nova-compute[74840]:       <mac address="fa:16:3e:e1:a6:9b"/>
Nov 08 12:34:16 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:34:16 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:34:16 user nova-compute[74840]:       <target dev="tapdaa004c9-f4"/>
Nov 08 12:34:16 user nova-compute[74840]:     </interface>
Nov 08 12:34:16 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:34:16 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/550f8fed-4652-46fe-a440-974ee8f88196/console.log" append="off"/>
Nov 08 12:34:16 user nova-compute[74840]:     </serial>
Nov 08 12:34:16 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:34:16 user nova-compute[74840]:     <video>
Nov 08 12:34:16 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:34:16 user nova-compute[74840]:     </video>
Nov 08 12:34:16 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:34:16 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:34:16 user nova-compute[74840]:     </rng>
Nov 08 12:34:16 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:34:16 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:34:16 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:34:16 user nova-compute[74840]:     </memballoon>
Nov 08 12:34:16 user nova-compute[74840]:   </devices>
Nov 08 12:34:16 user nova-compute[74840]: </domain>
Nov 08 12:34:16 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:33:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1581355820',display_name='tempest-TestShelveInstance-server-1581355820',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1581355820',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMa4hvb8cWjBz4jMMa+/lZwnWtFqszzwskJtEIpqap//CbH421Hhd++cesn8avpj6IUxUQoy6rfFajaUge6h3UgyQ7k3b8nofngq0aAHrZpvXyuczTPqMuSft/WEq95F1g==',key_name='tempest-TestShelveInstance-850605026',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa486cd37a9c498ba6f800d2dbd415ab',ramdisk_id='',reservation_id='r-o5fknux2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1716375711',owner_user_name='tempest-TestShelveInstance-1716375711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:33:23Z,user_data=None,user_id='ff68af4357024f75888b6f8bd6ada9e5',uuid=550f8fed-4652-46fe-a440-974ee8f88196,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "daa004c9-f48f-4997-8260-7e1f394c3a7c", "address": "fa:16:3e:e1:a6:9b", "network": {"id": "5d8710f7-82f1-4670-b564-9ef14312dc8e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1266284233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa486cd37a9c498ba6f800d2dbd415ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaa004c9-f4", "ovs_interfaceid": "daa004c9-f48f-4997-8260-7e1f394c3a7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Converting VIF {"id": "daa004c9-f48f-4997-8260-7e1f394c3a7c", "address": "fa:16:3e:e1:a6:9b", "network": {"id": "5d8710f7-82f1-4670-b564-9ef14312dc8e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1266284233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa486cd37a9c498ba6f800d2dbd415ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaa004c9-f4", "ovs_interfaceid": "daa004c9-f48f-4997-8260-7e1f394c3a7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:a6:9b,bridge_name='br-int',has_traffic_filtering=True,id=daa004c9-f48f-4997-8260-7e1f394c3a7c,network=Network(5d8710f7-82f1-4670-b564-9ef14312dc8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaa004c9-f4') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG os_vif [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:a6:9b,bridge_name='br-int',has_traffic_filtering=True,id=daa004c9-f48f-4997-8260-7e1f394c3a7c,network=Network(5d8710f7-82f1-4670-b564-9ef14312dc8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaa004c9-f4') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9438f870-5e2b-43e7-a48a-59b59d1e1181]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '91552544-6998-54d2-9f37-b8e18d2d8efb', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdaa004c9-f4, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdaa004c9-f4, col_values=(('qos', UUID('23eb3e03-e5c0-4dd3-ac0f-0566d65e8b1f')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdaa004c9-f4, col_values=(('external_ids', {'iface-id': 'daa004c9-f48f-4997-8260-7e1f394c3a7c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:a6:9b', 'vm-uuid': '550f8fed-4652-46fe-a440-974ee8f88196'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:16 user nova-compute[74840]: INFO os_vif [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:a6:9b,bridge_name='br-int',has_traffic_filtering=True,id=daa004c9-f48f-4997-8260-7e1f394c3a7c,network=Network(5d8710f7-82f1-4670-b564-9ef14312dc8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaa004c9-f4')
Nov 08 12:34:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67a50b2-3c21-4ef2-b0cb-cb9542557085]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf1cc16-846e-4be6-a211-76ab608a460a tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:34:16 user nova-compute[74840]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)
Nov 08 12:34:16 user nova-compute[74840]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 (non-flash)
Nov 08 12:34:16 user nova-compute[74840]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)
Nov 08 12:34:16 user nova-compute[74840]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 (non-flash)
Nov 08 12:34:16 user nova-compute[74840]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4 (non-flash)
Nov 08 12:34:16 user nova-compute[74840]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96 (non-flash)
Nov 08 12:34:16 user nova-compute[74840]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 (non-flash)
Nov 08 12:34:16 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf1cc16-846e-4be6-a211-76ab608a460a tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:34:16 user nova-compute[74840]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)
Nov 08 12:34:16 user nova-compute[74840]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 (non-flash)
Nov 08 12:34:16 user nova-compute[74840]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)
Nov 08 12:34:16 user nova-compute[74840]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 (non-flash)
Nov 08 12:34:16 user nova-compute[74840]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4 (non-flash)
Nov 08 12:34:16 user nova-compute[74840]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96 (non-flash)
Nov 08 12:34:16 user nova-compute[74840]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 (non-flash)
Nov 08 12:34:16 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf1cc16-846e-4be6-a211-76ab608a460a tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7f80d1d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321'): ({'sdg'}, set())}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-daf1cc16-846e-4be6-a211-76ab608a460a tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Removing single pathed devices sdg {{(pid=74840) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9dcc7d-dc7e-461d-8a09-783ef3045fb3]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] No VIF found with MAC fa:16:3e:e1:a6:9b, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe40761-785c-40cc-9cfe-9b6a28249ae7]: (4, ('ok\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-daf1cc16-846e-4be6-a211-76ab608a460a tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Flushing IO for device /dev/sdg {{(pid=74840) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b1348f-bbef-4625-8046-38d4f7c13ec8]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-daf1cc16-846e-4be6-a211-76ab608a460a tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74840) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.051s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ded5e4-736f-4601-ac35-8abc42c531c2]: (4, ('1', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-daf1cc16-846e-4be6-a211-76ab608a460a tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-daf1cc16-846e-4be6-a211-76ab608a460a tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] SCSI volumes sdg have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf1cc16-846e-4be6-a211-76ab608a460a tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321')] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.592s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:34:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:17 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a70038-e30e-49e0-9b3b-0e49c1880900]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:34:17 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf1cc16-846e-4be6-a211-76ab608a460a tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:34:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 -p 172.16.0.220:3260 --logout {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:17 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25e319e-6c8f-464b-b819-6bafed778b75]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:34:17 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf1cc16-846e-4be6-a211-76ab608a460a tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321, portal: 172.16.0.220,3260]
Nov 08 12:34:17 user nova-compute[74840]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321, portal: 172.16.0.220,3260] successful.
Nov 08 12:34:17 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:34:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 -p 172.16.0.220:3260 --op delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67de400a-4361-4d2c-b9f0-a17af7822321 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:17 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd400597-b885-4dbe-bec4-3dec3d3d6277]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:34:17 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf1cc16-846e-4be6-a211-76ab608a460a tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:34:17 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-daf1cc16-846e-4be6-a211-76ab608a460a tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.398s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:34:17 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-daf1cc16-846e-4be6-a211-76ab608a460a tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] <== disconnect_volume: return (1236ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:34:17 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daf1cc16-846e-4be6-a211-76ab608a460a tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 12:34:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:18 user nova-compute[74840]: DEBUG nova.objects.instance [None req-daf1cc16-846e-4be6-a211-76ab608a460a tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lazy-loading 'flavor' on Instance uuid e3175752-45a5-43e3-a99a-9377440e7bea {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:34:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-70602967-394e-4101-a1e2-11617a2a7b09 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Acquiring lock "7a482219-16ac-49e2-84ad-7e2030c97184" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:34:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-70602967-394e-4101-a1e2-11617a2a7b09 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "7a482219-16ac-49e2-84ad-7e2030c97184" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:34:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:18 user nova-compute[74840]: INFO nova.compute.manager [None req-70602967-394e-4101-a1e2-11617a2a7b09 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Detaching volume 7d3984bc-b442-400e-8396-9ac7d028cf96
Nov 08 12:34:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-daf1cc16-846e-4be6-a211-76ab608a460a tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "e3175752-45a5-43e3-a99a-9377440e7bea" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.018s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:34:18 user nova-compute[74840]: INFO nova.virt.block_device [None req-70602967-394e-4101-a1e2-11617a2a7b09 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Attempting to driver detach volume 7d3984bc-b442-400e-8396-9ac7d028cf96 from mountpoint /dev/vdb
Nov 08 12:34:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-70602967-394e-4101-a1e2-11617a2a7b09 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Attempting to detach device vdb from instance 7a482219-16ac-49e2-84ad-7e2030c97184 from the persistent domain config. {{(pid=74840) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 12:34:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-70602967-394e-4101-a1e2-11617a2a7b09 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 12:34:18 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:34:18 user nova-compute[74840]:   <source dev="/dev/sdh"/>
Nov 08 12:34:18 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:34:18 user nova-compute[74840]:   <serial>7d3984bc-b442-400e-8396-9ac7d028cf96</serial>
Nov 08 12:34:18 user nova-compute[74840]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 12:34:18 user nova-compute[74840]: </disk>
Nov 08 12:34:18 user nova-compute[74840]:  {{(pid=74840) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 12:34:18 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-70602967-394e-4101-a1e2-11617a2a7b09 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Successfully detached device vdb from instance 7a482219-16ac-49e2-84ad-7e2030c97184 from the persistent domain config.
Nov 08 12:34:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-70602967-394e-4101-a1e2-11617a2a7b09 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7a482219-16ac-49e2-84ad-7e2030c97184 from the live domain config. {{(pid=74840) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 12:34:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-70602967-394e-4101-a1e2-11617a2a7b09 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 12:34:18 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:34:18 user nova-compute[74840]:   <source dev="/dev/sdh"/>
Nov 08 12:34:18 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:34:18 user nova-compute[74840]:   <serial>7d3984bc-b442-400e-8396-9ac7d028cf96</serial>
Nov 08 12:34:18 user nova-compute[74840]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 12:34:18 user nova-compute[74840]: </disk>
Nov 08 12:34:18 user nova-compute[74840]:  {{(pid=74840) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 12:34:18 user nova-compute[74840]: DEBUG nova.compute.manager [req-9a561f89-b407-434a-8c0e-0526d06c1d80 req-bffa0853-ff61-4546-8a38-f528fa26a2ff service nova] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Received event network-vif-plugged-daa004c9-f48f-4997-8260-7e1f394c3a7c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:34:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9a561f89-b407-434a-8c0e-0526d06c1d80 req-bffa0853-ff61-4546-8a38-f528fa26a2ff service nova] Acquiring lock "550f8fed-4652-46fe-a440-974ee8f88196-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:34:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9a561f89-b407-434a-8c0e-0526d06c1d80 req-bffa0853-ff61-4546-8a38-f528fa26a2ff service nova] Lock "550f8fed-4652-46fe-a440-974ee8f88196-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:34:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9a561f89-b407-434a-8c0e-0526d06c1d80 req-bffa0853-ff61-4546-8a38-f528fa26a2ff service nova] Lock "550f8fed-4652-46fe-a440-974ee8f88196-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:34:18 user nova-compute[74840]: DEBUG nova.compute.manager [req-9a561f89-b407-434a-8c0e-0526d06c1d80 req-bffa0853-ff61-4546-8a38-f528fa26a2ff service nova] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] No waiting events found dispatching network-vif-plugged-daa004c9-f48f-4997-8260-7e1f394c3a7c {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:34:18 user nova-compute[74840]: WARNING nova.compute.manager [req-9a561f89-b407-434a-8c0e-0526d06c1d80 req-bffa0853-ff61-4546-8a38-f528fa26a2ff service nova] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Received unexpected event network-vif-plugged-daa004c9-f48f-4997-8260-7e1f394c3a7c for instance with vm_state building and task_state spawning.
Nov 08 12:34:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-70602967-394e-4101-a1e2-11617a2a7b09 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7a482219-16ac-49e2-84ad-7e2030c97184 {{(pid=74840) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 12:34:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:20 user nova-compute[74840]: DEBUG nova.compute.manager [req-3a4ae5f7-040e-4a44-ae0a-d52d3c731801 req-47f2c4c1-b749-4afd-be71-6bbdc7f37e2c service nova] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Received event network-vif-plugged-daa004c9-f48f-4997-8260-7e1f394c3a7c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:34:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3a4ae5f7-040e-4a44-ae0a-d52d3c731801 req-47f2c4c1-b749-4afd-be71-6bbdc7f37e2c service nova] Acquiring lock "550f8fed-4652-46fe-a440-974ee8f88196-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:34:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3a4ae5f7-040e-4a44-ae0a-d52d3c731801 req-47f2c4c1-b749-4afd-be71-6bbdc7f37e2c service nova] Lock "550f8fed-4652-46fe-a440-974ee8f88196-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:34:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3a4ae5f7-040e-4a44-ae0a-d52d3c731801 req-47f2c4c1-b749-4afd-be71-6bbdc7f37e2c service nova] Lock "550f8fed-4652-46fe-a440-974ee8f88196-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:34:20 user nova-compute[74840]: DEBUG nova.compute.manager [req-3a4ae5f7-040e-4a44-ae0a-d52d3c731801 req-47f2c4c1-b749-4afd-be71-6bbdc7f37e2c service nova] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] No waiting events found dispatching network-vif-plugged-daa004c9-f48f-4997-8260-7e1f394c3a7c {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:34:20 user nova-compute[74840]: WARNING nova.compute.manager [req-3a4ae5f7-040e-4a44-ae0a-d52d3c731801 req-47f2c4c1-b749-4afd-be71-6bbdc7f37e2c service nova] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Received unexpected event network-vif-plugged-daa004c9-f48f-4997-8260-7e1f394c3a7c for instance with vm_state building and task_state spawning.
Nov 08 12:34:20 user nova-compute[74840]: DEBUG nova.compute.manager [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:34:20 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:34:20 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Instance spawned successfully.
Nov 08 12:34:20 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:34:20 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Found default for hw_cdrom_bus of ide {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:34:20 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Found default for hw_disk_bus of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:34:20 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:34:20 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:34:20 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Found default for hw_video_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:34:20 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Found default for hw_vif_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:34:20 user nova-compute[74840]: INFO nova.compute.manager [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Took 6.92 seconds to spawn the instance on the hypervisor.
Nov 08 12:34:20 user nova-compute[74840]: DEBUG nova.compute.manager [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:34:20 user nova-compute[74840]: INFO nova.compute.manager [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Took 58.10 seconds to build instance.
Nov 08 12:34:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-51f50644-e980-4be0-96ae-63845d803997 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Lock "550f8fed-4652-46fe-a440-974ee8f88196" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 58.196s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:34:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:22 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:25 user nova-compute[74840]: INFO nova.compute.manager [None req-21610046-4eb2-4185-9575-30ce8b6c55b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Unrescuing
Nov 08 12:34:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-21610046-4eb2-4185-9575-30ce8b6c55b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquiring lock "refresh_cache-b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:34:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-21610046-4eb2-4185-9575-30ce8b6c55b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquired lock "refresh_cache-b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:34:25 user nova-compute[74840]: DEBUG nova.network.neutron [None req-21610046-4eb2-4185-9575-30ce8b6c55b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:34:25 user nova-compute[74840]: DEBUG nova.network.neutron [None req-21610046-4eb2-4185-9575-30ce8b6c55b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Updating instance_info_cache with network_info: [{"id": "8fd26752-a3a0-4b97-a43f-73454925abea", "address": "fa:16:3e:2a:e1:f9", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd26752-a3", "ovs_interfaceid": "8fd26752-a3a0-4b97-a43f-73454925abea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:34:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-21610046-4eb2-4185-9575-30ce8b6c55b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Releasing lock "refresh_cache-b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:34:25 user nova-compute[74840]: DEBUG nova.objects.instance [None req-21610046-4eb2-4185-9575-30ce8b6c55b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lazy-loading 'flavor' on Instance uuid b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:34:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:26 user nova-compute[74840]: DEBUG nova.compute.manager [req-54a14c82-5581-4e9f-8fe2-0bf1f5c3ff61 req-ed729da5-0849-439f-9711-f62829f17b68 service nova] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Received event network-vif-unplugged-8fd26752-a3a0-4b97-a43f-73454925abea {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:34:26 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-54a14c82-5581-4e9f-8fe2-0bf1f5c3ff61 req-ed729da5-0849-439f-9711-f62829f17b68 service nova] Acquiring lock "b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:34:26 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-54a14c82-5581-4e9f-8fe2-0bf1f5c3ff61 req-ed729da5-0849-439f-9711-f62829f17b68 service nova] Lock "b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:34:26 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-54a14c82-5581-4e9f-8fe2-0bf1f5c3ff61 req-ed729da5-0849-439f-9711-f62829f17b68 service nova] Lock "b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:34:26 user nova-compute[74840]: DEBUG nova.compute.manager [req-54a14c82-5581-4e9f-8fe2-0bf1f5c3ff61 req-ed729da5-0849-439f-9711-f62829f17b68 service nova] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] No waiting events found dispatching network-vif-unplugged-8fd26752-a3a0-4b97-a43f-73454925abea {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:34:26 user nova-compute[74840]: WARNING nova.compute.manager [req-54a14c82-5581-4e9f-8fe2-0bf1f5c3ff61 req-ed729da5-0849-439f-9711-f62829f17b68 service nova] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Received unexpected event network-vif-unplugged-8fd26752-a3a0-4b97-a43f-73454925abea for instance with vm_state rescued and task_state unrescuing.
Nov 08 12:34:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:26 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Instance destroyed successfully.
Nov 08 12:34:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:28 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:28 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:28 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:28 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:28 user nova-compute[74840]: DEBUG nova.compute.manager [req-69538ee7-28dc-4807-b1fc-8c3da18877ad req-f1d1836b-e03e-4ff2-9e34-e581894bddb7 service nova] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Received event network-vif-plugged-8fd26752-a3a0-4b97-a43f-73454925abea {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:34:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-69538ee7-28dc-4807-b1fc-8c3da18877ad req-f1d1836b-e03e-4ff2-9e34-e581894bddb7 service nova] Acquiring lock "b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:34:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-69538ee7-28dc-4807-b1fc-8c3da18877ad req-f1d1836b-e03e-4ff2-9e34-e581894bddb7 service nova] Lock "b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:34:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-69538ee7-28dc-4807-b1fc-8c3da18877ad req-f1d1836b-e03e-4ff2-9e34-e581894bddb7 service nova] Lock "b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:34:28 user nova-compute[74840]: DEBUG nova.compute.manager [req-69538ee7-28dc-4807-b1fc-8c3da18877ad req-f1d1836b-e03e-4ff2-9e34-e581894bddb7 service nova] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] No waiting events found dispatching network-vif-plugged-8fd26752-a3a0-4b97-a43f-73454925abea {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:34:28 user nova-compute[74840]: WARNING nova.compute.manager [req-69538ee7-28dc-4807-b1fc-8c3da18877ad req-f1d1836b-e03e-4ff2-9e34-e581894bddb7 service nova] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Received unexpected event network-vif-plugged-8fd26752-a3a0-4b97-a43f-73454925abea for instance with vm_state rescued and task_state unrescuing.
Nov 08 12:34:28 user nova-compute[74840]: DEBUG nova.compute.manager [req-69538ee7-28dc-4807-b1fc-8c3da18877ad req-f1d1836b-e03e-4ff2-9e34-e581894bddb7 service nova] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Received event network-vif-plugged-8fd26752-a3a0-4b97-a43f-73454925abea {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:34:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-69538ee7-28dc-4807-b1fc-8c3da18877ad req-f1d1836b-e03e-4ff2-9e34-e581894bddb7 service nova] Acquiring lock "b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:34:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-69538ee7-28dc-4807-b1fc-8c3da18877ad req-f1d1836b-e03e-4ff2-9e34-e581894bddb7 service nova] Lock "b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:34:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-69538ee7-28dc-4807-b1fc-8c3da18877ad req-f1d1836b-e03e-4ff2-9e34-e581894bddb7 service nova] Lock "b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:34:28 user nova-compute[74840]: DEBUG nova.compute.manager [req-69538ee7-28dc-4807-b1fc-8c3da18877ad req-f1d1836b-e03e-4ff2-9e34-e581894bddb7 service nova] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] No waiting events found dispatching network-vif-plugged-8fd26752-a3a0-4b97-a43f-73454925abea {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:34:28 user nova-compute[74840]: WARNING nova.compute.manager [req-69538ee7-28dc-4807-b1fc-8c3da18877ad req-f1d1836b-e03e-4ff2-9e34-e581894bddb7 service nova] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Received unexpected event network-vif-plugged-8fd26752-a3a0-4b97-a43f-73454925abea for instance with vm_state rescued and task_state unrescuing.
Nov 08 12:34:30 user nova-compute[74840]: DEBUG nova.compute.manager [None req-21610046-4eb2-4185-9575-30ce8b6c55b6 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:34:30 user nova-compute[74840]: DEBUG nova.compute.manager [req-bb2eab2c-4a3f-457b-af71-6f05759bcee6 req-49a2be72-b74f-41ec-ae0d-177f025f13a4 service nova] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Received event network-vif-plugged-8fd26752-a3a0-4b97-a43f-73454925abea {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:34:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-bb2eab2c-4a3f-457b-af71-6f05759bcee6 req-49a2be72-b74f-41ec-ae0d-177f025f13a4 service nova] Acquiring lock "b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:34:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-bb2eab2c-4a3f-457b-af71-6f05759bcee6 req-49a2be72-b74f-41ec-ae0d-177f025f13a4 service nova] Lock "b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:34:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-bb2eab2c-4a3f-457b-af71-6f05759bcee6 req-49a2be72-b74f-41ec-ae0d-177f025f13a4 service nova] Lock "b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:34:30 user nova-compute[74840]: DEBUG nova.compute.manager [req-bb2eab2c-4a3f-457b-af71-6f05759bcee6 req-49a2be72-b74f-41ec-ae0d-177f025f13a4 service nova] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] No waiting events found dispatching network-vif-plugged-8fd26752-a3a0-4b97-a43f-73454925abea {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:34:30 user nova-compute[74840]: WARNING nova.compute.manager [req-bb2eab2c-4a3f-457b-af71-6f05759bcee6 req-49a2be72-b74f-41ec-ae0d-177f025f13a4 service nova] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Received unexpected event network-vif-plugged-8fd26752-a3a0-4b97-a43f-73454925abea for instance with vm_state active and task_state None.
Nov 08 12:34:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:38 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-70602967-394e-4101-a1e2-11617a2a7b09 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7a482219-16ac-49e2-84ad-7e2030c97184 is timed out.
Nov 08 12:34:38 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-70602967-394e-4101-a1e2-11617a2a7b09 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Successfully detached device vdb from instance 7a482219-16ac-49e2-84ad-7e2030c97184 from the live domain config.
Nov 08 12:34:38 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70602967-394e-4101-a1e2-11617a2a7b09 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 12:34:38 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-70602967-394e-4101-a1e2-11617a2a7b09 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OpWDjYTZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:34:38 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-70602967-394e-4101-a1e2-11617a2a7b09 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:34:38 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-70602967-394e-4101-a1e2-11617a2a7b09 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:34:38 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-70602967-394e-4101-a1e2-11617a2a7b09 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:34:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:38 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b36acb7-b318-47d8-830c-de2427426661]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:34:38 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-70602967-394e-4101-a1e2-11617a2a7b09 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 12:34:38 user nova-compute[74840]: No targets found.
Nov 08 12:34:38 user nova-compute[74840]: iSNS:
Nov 08 12:34:38 user nova-compute[74840]: No targets found.
Nov 08 12:34:38 user nova-compute[74840]: STATIC:
Nov 08 12:34:38 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2
Nov 08 12:34:38 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:34:38 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:34:38 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616
Nov 08 12:34:38 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:34:38 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:34:38 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c
Nov 08 12:34:38 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:34:38 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:34:38 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4
Nov 08 12:34:38 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:34:38 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:34:38 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4
Nov 08 12:34:38 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:34:38 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:34:38 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b
Nov 08 12:34:38 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:34:38 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:34:38 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96
Nov 08 12:34:38 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:34:38 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:34:38 user nova-compute[74840]: FIRMWARE:
Nov 08 12:34:38 user nova-compute[74840]: No targets found.
Nov 08 12:34:38 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:34:38 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-70602967-394e-4101-a1e2-11617a2a7b09 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 12:34:38 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 12:34:38 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 12:34:38 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-70602967-394e-4101-a1e2-11617a2a7b09 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 12:34:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:38 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff2073c-3e90-412f-9918-27394144cc6c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:34:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:38 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9022f1d9-505c-43d2-af45-7e59db9a8b66]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:34:38 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-70602967-394e-4101-a1e2-11617a2a7b09 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:34:38 user nova-compute[74840]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)
Nov 08 12:34:38 user nova-compute[74840]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 (non-flash)
Nov 08 12:34:38 user nova-compute[74840]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)
Nov 08 12:34:38 user nova-compute[74840]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4 (non-flash)
Nov 08 12:34:38 user nova-compute[74840]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96 (non-flash)
Nov 08 12:34:38 user nova-compute[74840]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 (non-flash)
Nov 08 12:34:38 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:34:38 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-70602967-394e-4101-a1e2-11617a2a7b09 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:34:38 user nova-compute[74840]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)
Nov 08 12:34:38 user nova-compute[74840]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 (non-flash)
Nov 08 12:34:38 user nova-compute[74840]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)
Nov 08 12:34:38 user nova-compute[74840]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4 (non-flash)
Nov 08 12:34:38 user nova-compute[74840]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96 (non-flash)
Nov 08 12:34:38 user nova-compute[74840]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 (non-flash)
Nov 08 12:34:38 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:34:38 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-70602967-394e-4101-a1e2-11617a2a7b09 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7d446b760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96'): ({'sdh'}, set())}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 12:34:38 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-70602967-394e-4101-a1e2-11617a2a7b09 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Removing single pathed devices sdh {{(pid=74840) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 12:34:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:38 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53b5d0f-8145-42b7-874a-c92fa12ba82c]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:34:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:38 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc56b3f7-ff04-4854-9470-3772d9b39220]: (4, ('ok\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:34:38 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-70602967-394e-4101-a1e2-11617a2a7b09 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Flushing IO for device /dev/sdh {{(pid=74840) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 12:34:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:38 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[0232f084-8303-4caf-9835-e4db94a9f2ab]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:34:38 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-70602967-394e-4101-a1e2-11617a2a7b09 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74840) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 12:34:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.043s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:38 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[455b095d-88f0-4253-a660-25f491226e4a]: (4, ('1', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:34:38 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-70602967-394e-4101-a1e2-11617a2a7b09 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 12:34:38 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-70602967-394e-4101-a1e2-11617a2a7b09 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] SCSI volumes sdh have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 12:34:38 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-70602967-394e-4101-a1e2-11617a2a7b09 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96')] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 12:34:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:39 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57079aa-8b99-49c9-a889-7c098784cf93]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:34:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-70602967-394e-4101-a1e2-11617a2a7b09 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:34:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96 -p 172.16.0.220:3260 --logout {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:39 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[31121532-d453-4c5d-bc4e-ed6d3fd010d1]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:34:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-70602967-394e-4101-a1e2-11617a2a7b09 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96, portal: 172.16.0.220,3260]
Nov 08 12:34:39 user nova-compute[74840]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96, portal: 172.16.0.220,3260] successful.
Nov 08 12:34:39 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:34:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96 -p 172.16.0.220:3260 --op delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:34:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d3984bc-b442-400e-8396-9ac7d028cf96 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:34:39 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc52747-dc4b-42fe-8bf5-6cc0f836db29]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:34:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-70602967-394e-4101-a1e2-11617a2a7b09 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:34:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-70602967-394e-4101-a1e2-11617a2a7b09 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:34:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-70602967-394e-4101-a1e2-11617a2a7b09 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] <== disconnect_volume: return (320ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:34:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70602967-394e-4101-a1e2-11617a2a7b09 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 12:34:40 user nova-compute[74840]: DEBUG nova.objects.instance [None req-70602967-394e-4101-a1e2-11617a2a7b09 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lazy-loading 'flavor' on Instance uuid 7a482219-16ac-49e2-84ad-7e2030c97184 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:34:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-70602967-394e-4101-a1e2-11617a2a7b09 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "7a482219-16ac-49e2-84ad-7e2030c97184" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.982s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:34:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:45 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-33687444-097b-4ce0-b767-7310eddbbed6 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "e3175752-45a5-43e3-a99a-9377440e7bea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:34:45 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-33687444-097b-4ce0-b767-7310eddbbed6 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "e3175752-45a5-43e3-a99a-9377440e7bea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:34:45 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-33687444-097b-4ce0-b767-7310eddbbed6 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "e3175752-45a5-43e3-a99a-9377440e7bea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:34:45 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-33687444-097b-4ce0-b767-7310eddbbed6 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "e3175752-45a5-43e3-a99a-9377440e7bea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:34:45 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-33687444-097b-4ce0-b767-7310eddbbed6 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "e3175752-45a5-43e3-a99a-9377440e7bea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:34:45 user nova-compute[74840]: INFO nova.compute.manager [None req-33687444-097b-4ce0-b767-7310eddbbed6 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Terminating instance
Nov 08 12:34:45 user nova-compute[74840]: DEBUG nova.compute.manager [None req-33687444-097b-4ce0-b767-7310eddbbed6 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Start destroying the instance on the hypervisor. {{(pid=74840) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 12:34:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:45 user nova-compute[74840]: DEBUG nova.compute.manager [req-74297bdf-2c33-4398-a752-5335566356b0 req-a1ac4ffb-42ba-4a73-bd89-f51907048121 service nova] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Received event network-vif-unplugged-e0c27d11-afc7-4e26-8024-d4c7ad9a6baf {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:34:45 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-74297bdf-2c33-4398-a752-5335566356b0 req-a1ac4ffb-42ba-4a73-bd89-f51907048121 service nova] Acquiring lock "e3175752-45a5-43e3-a99a-9377440e7bea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:34:45 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-74297bdf-2c33-4398-a752-5335566356b0 req-a1ac4ffb-42ba-4a73-bd89-f51907048121 service nova] Lock "e3175752-45a5-43e3-a99a-9377440e7bea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:34:45 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-74297bdf-2c33-4398-a752-5335566356b0 req-a1ac4ffb-42ba-4a73-bd89-f51907048121 service nova] Lock "e3175752-45a5-43e3-a99a-9377440e7bea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:34:45 user nova-compute[74840]: DEBUG nova.compute.manager [req-74297bdf-2c33-4398-a752-5335566356b0 req-a1ac4ffb-42ba-4a73-bd89-f51907048121 service nova] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] No waiting events found dispatching network-vif-unplugged-e0c27d11-afc7-4e26-8024-d4c7ad9a6baf {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:34:45 user nova-compute[74840]: DEBUG nova.compute.manager [req-74297bdf-2c33-4398-a752-5335566356b0 req-a1ac4ffb-42ba-4a73-bd89-f51907048121 service nova] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Received event network-vif-unplugged-e0c27d11-afc7-4e26-8024-d4c7ad9a6baf for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:34:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:46 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Instance destroyed successfully.
Nov 08 12:34:46 user nova-compute[74840]: DEBUG nova.objects.instance [None req-33687444-097b-4ce0-b767-7310eddbbed6 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lazy-loading 'resources' on Instance uuid e3175752-45a5-43e3-a99a-9377440e7bea {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:34:46 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-33687444-097b-4ce0-b767-7310eddbbed6 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T12:28:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-199314448',display_name='tempest-ServerActionsTestOtherA-server-137189190',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-199314448',id=35,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSNrYheJ8Lzn3ZHvNUQvlNC/AEkaeIt4FFfFZ6MDZZKThsvIjNiHNZVHlAFC+XE6iHCrr/eoF+btmdxSZwQV3WJpatsIGdnvZUn9Tn2nZPQiFTZnNkVsedEjHcwcaa0jw==',key_name='tempest-keypair-1203623053',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:31:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5e47ef156b3649839ff728eaf23121da',ramdisk_id='',reservation_id='r-qttfimk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-401855506',owner_user_name='tempest-ServerActionsTestOtherA-401855506-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:31:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a49f88cb74c47bdb9a35883adbae454',uuid=e3175752-45a5-43e3-a99a-9377440e7bea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e0c27d11-afc7-4e26-8024-d4c7ad9a6baf", "address": "fa:16:3e:86:18:09", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0c27d11-af", "ovs_interfaceid": "e0c27d11-afc7-4e26-8024-d4c7ad9a6baf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:34:46 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-33687444-097b-4ce0-b767-7310eddbbed6 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Converting VIF {"id": "e0c27d11-afc7-4e26-8024-d4c7ad9a6baf", "address": "fa:16:3e:86:18:09", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0c27d11-af", "ovs_interfaceid": "e0c27d11-afc7-4e26-8024-d4c7ad9a6baf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:34:46 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-33687444-097b-4ce0-b767-7310eddbbed6 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:18:09,bridge_name='br-int',has_traffic_filtering=True,id=e0c27d11-afc7-4e26-8024-d4c7ad9a6baf,network=Network(e92448c4-9bc0-424b-a07f-a398ac46fada),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0c27d11-af') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:34:46 user nova-compute[74840]: DEBUG os_vif [None req-33687444-097b-4ce0-b767-7310eddbbed6 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:18:09,bridge_name='br-int',has_traffic_filtering=True,id=e0c27d11-afc7-4e26-8024-d4c7ad9a6baf,network=Network(e92448c4-9bc0-424b-a07f-a398ac46fada),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0c27d11-af') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:34:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape0c27d11-af, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:34:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:34:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=64b565a1-088c-4e3f-b53e-5a17d8b8f6ea) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:34:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:46 user nova-compute[74840]: INFO os_vif [None req-33687444-097b-4ce0-b767-7310eddbbed6 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:18:09,bridge_name='br-int',has_traffic_filtering=True,id=e0c27d11-afc7-4e26-8024-d4c7ad9a6baf,network=Network(e92448c4-9bc0-424b-a07f-a398ac46fada),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0c27d11-af')
Nov 08 12:34:46 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-33687444-097b-4ce0-b767-7310eddbbed6 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Deleting instance files /opt/stack/data/nova/instances/e3175752-45a5-43e3-a99a-9377440e7bea_del
Nov 08 12:34:46 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-33687444-097b-4ce0-b767-7310eddbbed6 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Deletion of /opt/stack/data/nova/instances/e3175752-45a5-43e3-a99a-9377440e7bea_del complete
Nov 08 12:34:46 user nova-compute[74840]: INFO nova.compute.manager [None req-33687444-097b-4ce0-b767-7310eddbbed6 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 08 12:34:46 user nova-compute[74840]: DEBUG oslo.service.loopingcall [None req-33687444-097b-4ce0-b767-7310eddbbed6 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74840) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 12:34:46 user nova-compute[74840]: DEBUG nova.compute.manager [-] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Deallocating network for instance {{(pid=74840) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 12:34:46 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] deallocate_for_instance() {{(pid=74840) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 12:34:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:47 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:34:47 user nova-compute[74840]: INFO nova.compute.manager [-] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Took 0.97 seconds to deallocate network for instance.
Nov 08 12:34:47 user nova-compute[74840]: DEBUG nova.compute.manager [req-a2fa8fe4-4ce1-45c0-88e5-79f2b19fb6ee req-4b39230b-268e-4614-a41f-8b6d8d320de0 service nova] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Received event network-vif-deleted-e0c27d11-afc7-4e26-8024-d4c7ad9a6baf {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:34:47 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-33687444-097b-4ce0-b767-7310eddbbed6 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:34:47 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-33687444-097b-4ce0-b767-7310eddbbed6 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:34:47 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-33687444-097b-4ce0-b767-7310eddbbed6 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:34:47 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-33687444-097b-4ce0-b767-7310eddbbed6 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:34:47 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-33687444-097b-4ce0-b767-7310eddbbed6 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.378s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:34:47 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-33687444-097b-4ce0-b767-7310eddbbed6 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Deleted allocations for instance e3175752-45a5-43e3-a99a-9377440e7bea
Nov 08 12:34:47 user nova-compute[74840]: DEBUG nova.compute.manager [req-ac4b7a9c-5fd9-491a-8c8d-331b8e9f99ac req-cda7c0b9-4b6c-4373-9350-63e2475b276a service nova] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Received event network-vif-plugged-e0c27d11-afc7-4e26-8024-d4c7ad9a6baf {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:34:47 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-ac4b7a9c-5fd9-491a-8c8d-331b8e9f99ac req-cda7c0b9-4b6c-4373-9350-63e2475b276a service nova] Acquiring lock "e3175752-45a5-43e3-a99a-9377440e7bea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:34:47 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-ac4b7a9c-5fd9-491a-8c8d-331b8e9f99ac req-cda7c0b9-4b6c-4373-9350-63e2475b276a service nova] Lock "e3175752-45a5-43e3-a99a-9377440e7bea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:34:47 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-ac4b7a9c-5fd9-491a-8c8d-331b8e9f99ac req-cda7c0b9-4b6c-4373-9350-63e2475b276a service nova] Lock "e3175752-45a5-43e3-a99a-9377440e7bea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:34:47 user nova-compute[74840]: DEBUG nova.compute.manager [req-ac4b7a9c-5fd9-491a-8c8d-331b8e9f99ac req-cda7c0b9-4b6c-4373-9350-63e2475b276a service nova] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] No waiting events found dispatching network-vif-plugged-e0c27d11-afc7-4e26-8024-d4c7ad9a6baf {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:34:47 user nova-compute[74840]: WARNING nova.compute.manager [req-ac4b7a9c-5fd9-491a-8c8d-331b8e9f99ac req-cda7c0b9-4b6c-4373-9350-63e2475b276a service nova] [instance: e3175752-45a5-43e3-a99a-9377440e7bea] Received unexpected event network-vif-plugged-e0c27d11-afc7-4e26-8024-d4c7ad9a6baf for instance with vm_state deleted and task_state None.
Nov 08 12:34:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-33687444-097b-4ce0-b767-7310eddbbed6 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "e3175752-45a5-43e3-a99a-9377440e7bea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.409s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:34:51 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:34:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:35:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:35:02 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:35:04 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:35:04 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:35:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "refresh_cache-ffe50042-29bf-4ef3-a148-8698bc75233b" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:35:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquired lock "refresh_cache-ffe50042-29bf-4ef3-a148-8698bc75233b" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:35:05 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Forcefully refreshing network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 12:35:05 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Updating instance_info_cache with network_info: [{"id": "6169b221-7840-4cfb-ba25-e34a95b35e77", "address": "fa:16:3e:b0:6a:c2", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6169b221-78", "ovs_interfaceid": "6169b221-7840-4cfb-ba25-e34a95b35e77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:35:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Releasing lock "refresh_cache-ffe50042-29bf-4ef3-a148-8698bc75233b" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:35:05 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Updated the network info_cache for instance {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 12:35:05 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:35:05 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:35:05 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:35:05 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:35:05 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:35:05 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:35:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:35:06 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:35:06 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:35:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:35:09 user nova-compute[74840]: DEBUG nova.compute.manager [req-06dce966-df16-4f32-9924-a3349a42f8fe req-ba6a17a7-8ab5-4221-8f21-fa2757c2c768 service nova] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Received event network-changed-d8b090c7-4d0d-43d0-8fa3-4c4d489862a7 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:35:09 user nova-compute[74840]: DEBUG nova.compute.manager [req-06dce966-df16-4f32-9924-a3349a42f8fe req-ba6a17a7-8ab5-4221-8f21-fa2757c2c768 service nova] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Refreshing instance network info cache due to event network-changed-d8b090c7-4d0d-43d0-8fa3-4c4d489862a7. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:35:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-06dce966-df16-4f32-9924-a3349a42f8fe req-ba6a17a7-8ab5-4221-8f21-fa2757c2c768 service nova] Acquiring lock "refresh_cache-e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:35:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-06dce966-df16-4f32-9924-a3349a42f8fe req-ba6a17a7-8ab5-4221-8f21-fa2757c2c768 service nova] Acquired lock "refresh_cache-e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:35:09 user nova-compute[74840]: DEBUG nova.network.neutron [req-06dce966-df16-4f32-9924-a3349a42f8fe req-ba6a17a7-8ab5-4221-8f21-fa2757c2c768 service nova] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Refreshing network info cache for port d8b090c7-4d0d-43d0-8fa3-4c4d489862a7 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:35:09 user nova-compute[74840]: DEBUG nova.network.neutron [req-06dce966-df16-4f32-9924-a3349a42f8fe req-ba6a17a7-8ab5-4221-8f21-fa2757c2c768 service nova] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Updated VIF entry in instance network info cache for port d8b090c7-4d0d-43d0-8fa3-4c4d489862a7. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:35:09 user nova-compute[74840]: DEBUG nova.network.neutron [req-06dce966-df16-4f32-9924-a3349a42f8fe req-ba6a17a7-8ab5-4221-8f21-fa2757c2c768 service nova] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Updating instance_info_cache with network_info: [{"id": "d8b090c7-4d0d-43d0-8fa3-4c4d489862a7", "address": "fa:16:3e:ae:e2:dc", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b090c7-4d", "ovs_interfaceid": "d8b090c7-4d0d-43d0-8fa3-4c4d489862a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:35:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-06dce966-df16-4f32-9924-a3349a42f8fe req-ba6a17a7-8ab5-4221-8f21-fa2757c2c768 service nova] Releasing lock "refresh_cache-e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:35:09 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:35:09 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:35:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-060a09a4-ae60-4401-8f6f-375a24b35142 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:35:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-060a09a4-ae60-4401-8f6f-375a24b35142 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:35:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-060a09a4-ae60-4401-8f6f-375a24b35142 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:35:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-060a09a4-ae60-4401-8f6f-375a24b35142 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:35:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-060a09a4-ae60-4401-8f6f-375a24b35142 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:35:10 user nova-compute[74840]: INFO nova.compute.manager [None req-060a09a4-ae60-4401-8f6f-375a24b35142 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Terminating instance
Nov 08 12:35:10 user nova-compute[74840]: DEBUG nova.compute.manager [None req-060a09a4-ae60-4401-8f6f-375a24b35142 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Start destroying the instance on the hypervisor. {{(pid=74840) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 12:35:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:35:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG nova.compute.manager [req-0f9d97dc-171d-4da0-94ad-50e0158766ee req-1e8b03cf-02b1-4314-8e68-f6e28c019b09 service nova] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Received event network-changed-d8b090c7-4d0d-43d0-8fa3-4c4d489862a7 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG nova.compute.manager [req-0f9d97dc-171d-4da0-94ad-50e0158766ee req-1e8b03cf-02b1-4314-8e68-f6e28c019b09 service nova] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Refreshing instance network info cache due to event network-changed-d8b090c7-4d0d-43d0-8fa3-4c4d489862a7. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0f9d97dc-171d-4da0-94ad-50e0158766ee req-1e8b03cf-02b1-4314-8e68-f6e28c019b09 service nova] Acquiring lock "refresh_cache-e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0f9d97dc-171d-4da0-94ad-50e0158766ee req-1e8b03cf-02b1-4314-8e68-f6e28c019b09 service nova] Acquired lock "refresh_cache-e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG nova.network.neutron [req-0f9d97dc-171d-4da0-94ad-50e0158766ee req-1e8b03cf-02b1-4314-8e68-f6e28c019b09 service nova] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Refreshing network info cache for port d8b090c7-4d0d-43d0-8fa3-4c4d489862a7 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG nova.network.neutron [req-0f9d97dc-171d-4da0-94ad-50e0158766ee req-1e8b03cf-02b1-4314-8e68-f6e28c019b09 service nova] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Updated VIF entry in instance network info cache for port d8b090c7-4d0d-43d0-8fa3-4c4d489862a7. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG nova.network.neutron [req-0f9d97dc-171d-4da0-94ad-50e0158766ee req-1e8b03cf-02b1-4314-8e68-f6e28c019b09 service nova] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Updating instance_info_cache with network_info: [{"id": "d8b090c7-4d0d-43d0-8fa3-4c4d489862a7", "address": "fa:16:3e:ae:e2:dc", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b090c7-4d", "ovs_interfaceid": "d8b090c7-4d0d-43d0-8fa3-4c4d489862a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0f9d97dc-171d-4da0-94ad-50e0158766ee req-1e8b03cf-02b1-4314-8e68-f6e28c019b09 service nova] Releasing lock "refresh_cache-e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:35:11 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Instance destroyed successfully.
Nov 08 12:35:11 user nova-compute[74840]: DEBUG nova.objects.instance [None req-060a09a4-ae60-4401-8f6f-375a24b35142 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lazy-loading 'resources' on Instance uuid e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-060a09a4-ae60-4401-8f6f-375a24b35142 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:33:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1332370978',display_name='tempest-TestVolumeBootPattern-server-1332370978',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1332370978',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDnf/rgNeauxsdXCuQeVAa6oJl7IvXSpNN83Cdo1qtwT4P0g8IuWhFw/l+HOo44zetcJEHbPUEQ14N2qnoFV4I4QWYhF+y8Gsgf65CRdUjmUlU4hjQG+QvZzqapWj/SBg==',key_name='tempest-TestVolumeBootPattern-1773717711',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:33:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1250106b55ae44b0b303849df7781ffb',ramdisk_id='',reservation_id='r-if9aa5ih',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-77780905',owner_user_name='tempest-TestVolumeBootPattern-77780905-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:33:50Z,user_data=None,user_id='794c0281e1bf48f79117efdc3907e661',uuid=e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8b090c7-4d0d-43d0-8fa3-4c4d489862a7", "address": "fa:16:3e:ae:e2:dc", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b090c7-4d", "ovs_interfaceid": "d8b090c7-4d0d-43d0-8fa3-4c4d489862a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-060a09a4-ae60-4401-8f6f-375a24b35142 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Converting VIF {"id": "d8b090c7-4d0d-43d0-8fa3-4c4d489862a7", "address": "fa:16:3e:ae:e2:dc", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b090c7-4d", "ovs_interfaceid": "d8b090c7-4d0d-43d0-8fa3-4c4d489862a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-060a09a4-ae60-4401-8f6f-375a24b35142 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:e2:dc,bridge_name='br-int',has_traffic_filtering=True,id=d8b090c7-4d0d-43d0-8fa3-4c4d489862a7,network=Network(174da5e9-78cc-426f-87fb-1d3b23b8b459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8b090c7-4d') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG os_vif [None req-060a09a4-ae60-4401-8f6f-375a24b35142 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:e2:dc,bridge_name='br-int',has_traffic_filtering=True,id=d8b090c7-4d0d-43d0-8fa3-4c4d489862a7,network=Network(174da5e9-78cc-426f-87fb-1d3b23b8b459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8b090c7-4d') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd8b090c7-4d, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e0516db2-9e2c-4509-a08d-9ea59a450d06) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:35:11 user nova-compute[74840]: INFO os_vif [None req-060a09a4-ae60-4401-8f6f-375a24b35142 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:e2:dc,bridge_name='br-int',has_traffic_filtering=True,id=d8b090c7-4d0d-43d0-8fa3-4c4d489862a7,network=Network(174da5e9-78cc-426f-87fb-1d3b23b8b459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8b090c7-4d')
Nov 08 12:35:11 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-060a09a4-ae60-4401-8f6f-375a24b35142 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-060a09a4-ae60-4401-8f6f-375a24b35142 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hrUSyEIu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:35:11 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-060a09a4-ae60-4401-8f6f-375a24b35142 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:35:11 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-060a09a4-ae60-4401-8f6f-375a24b35142 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-060a09a4-ae60-4401-8f6f-375a24b35142 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[efcc3276-3e7a-438c-944b-7f4c98be9cd4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-060a09a4-ae60-4401-8f6f-375a24b35142 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 12:35:11 user nova-compute[74840]: No targets found.
Nov 08 12:35:11 user nova-compute[74840]: iSNS:
Nov 08 12:35:11 user nova-compute[74840]: No targets found.
Nov 08 12:35:11 user nova-compute[74840]: STATIC:
Nov 08 12:35:11 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2
Nov 08 12:35:11 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:35:11 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:35:11 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616
Nov 08 12:35:11 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:35:11 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:35:11 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c
Nov 08 12:35:11 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:35:11 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:35:11 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4
Nov 08 12:35:11 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:35:11 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:35:11 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4
Nov 08 12:35:11 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:35:11 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:35:11 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b
Nov 08 12:35:11 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:35:11 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:35:11 user nova-compute[74840]: FIRMWARE:
Nov 08 12:35:11 user nova-compute[74840]: No targets found.
Nov 08 12:35:11 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-060a09a4-ae60-4401-8f6f-375a24b35142 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 12:35:11 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 12:35:11 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-060a09a4-ae60-4401-8f6f-375a24b35142 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[654e1dd9-0b2e-4f24-94d4-bfd99ca386f8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d4ec3f-4074-4543-b5dd-da776f2b4a58]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-060a09a4-ae60-4401-8f6f-375a24b35142 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:35:11 user nova-compute[74840]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)
Nov 08 12:35:11 user nova-compute[74840]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 (non-flash)
Nov 08 12:35:11 user nova-compute[74840]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)
Nov 08 12:35:11 user nova-compute[74840]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4 (non-flash)
Nov 08 12:35:11 user nova-compute[74840]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 (non-flash)
Nov 08 12:35:11 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-060a09a4-ae60-4401-8f6f-375a24b35142 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:35:11 user nova-compute[74840]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)
Nov 08 12:35:11 user nova-compute[74840]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 (non-flash)
Nov 08 12:35:11 user nova-compute[74840]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)
Nov 08 12:35:11 user nova-compute[74840]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4 (non-flash)
Nov 08 12:35:11 user nova-compute[74840]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 (non-flash)
Nov 08 12:35:11 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-060a09a4-ae60-4401-8f6f-375a24b35142 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7f4266050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4'): ({'sdb'}, set())}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-060a09a4-ae60-4401-8f6f-375a24b35142 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Removing single pathed devices sdb {{(pid=74840) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[73355ee1-b5c3-4c4b-9b5d-90d24743753c]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f7c6d4-d72f-4f72-8eda-c3d3c24babb8]: (4, ('ok\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-060a09a4-ae60-4401-8f6f-375a24b35142 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Flushing IO for device /dev/sdb {{(pid=74840) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9d11dd-4e82-48eb-b1a7-9e4436c4463e]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-060a09a4-ae60-4401-8f6f-375a24b35142 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74840) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe77378e-3a38-46a7-9416-2375ef37abca]: (4, ('1', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-060a09a4-ae60-4401-8f6f-375a24b35142 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-060a09a4-ae60-4401-8f6f-375a24b35142 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] SCSI volumes sdb have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-060a09a4-ae60-4401-8f6f-375a24b35142 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4')] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6358b965-cf6e-4f40-865f-70382389e41c]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-060a09a4-ae60-4401-8f6f-375a24b35142 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4 -p 172.16.0.220:3260 --logout {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[238de3d9-baef-4175-9f38-98c65139c729]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-060a09a4-ae60-4401-8f6f-375a24b35142 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4, portal: 172.16.0.220,3260]
Nov 08 12:35:11 user nova-compute[74840]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4, portal: 172.16.0.220,3260] successful.
Nov 08 12:35:11 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4 -p 172.16.0.220:3260 --op delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbde86c3-d678-411a-b903-d997dc3780e4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6228adb3-3d32-42df-aba3-fd51e21db951]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-060a09a4-ae60-4401-8f6f-375a24b35142 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-060a09a4-ae60-4401-8f6f-375a24b35142 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-060a09a4-ae60-4401-8f6f-375a24b35142 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] <== disconnect_volume: return (341ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:35:11 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-060a09a4-ae60-4401-8f6f-375a24b35142 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 12:35:11 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-060a09a4-ae60-4401-8f6f-375a24b35142 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Deleting instance files /opt/stack/data/nova/instances/e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e_del
Nov 08 12:35:11 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-060a09a4-ae60-4401-8f6f-375a24b35142 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Deletion of /opt/stack/data/nova/instances/e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e_del complete
Nov 08 12:35:12 user nova-compute[74840]: INFO nova.compute.manager [None req-060a09a4-ae60-4401-8f6f-375a24b35142 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 08 12:35:12 user nova-compute[74840]: DEBUG oslo.service.loopingcall [None req-060a09a4-ae60-4401-8f6f-375a24b35142 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74840) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 12:35:12 user nova-compute[74840]: DEBUG nova.compute.manager [-] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Deallocating network for instance {{(pid=74840) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 12:35:12 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] deallocate_for_instance() {{(pid=74840) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 12:35:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:35:12 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:35:12 user nova-compute[74840]: INFO nova.compute.manager [-] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Took 0.51 seconds to deallocate network for instance.
Nov 08 12:35:12 user nova-compute[74840]: DEBUG nova.compute.manager [req-23814d8d-d35b-482e-9b79-5aec2a9a4671 req-93e6cb45-1571-4394-b4ac-36f348f84bc2 service nova] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Received event network-vif-deleted-d8b090c7-4d0d-43d0-8fa3-4c4d489862a7 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:35:13 user nova-compute[74840]: DEBUG nova.compute.manager [req-38acffae-8ffa-43f5-84d0-36bcf0e76fd6 req-cf09c7e3-0518-43bc-8fac-c191711ce6d3 service nova] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Received event network-vif-unplugged-d8b090c7-4d0d-43d0-8fa3-4c4d489862a7 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:35:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-38acffae-8ffa-43f5-84d0-36bcf0e76fd6 req-cf09c7e3-0518-43bc-8fac-c191711ce6d3 service nova] Acquiring lock "e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:35:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-38acffae-8ffa-43f5-84d0-36bcf0e76fd6 req-cf09c7e3-0518-43bc-8fac-c191711ce6d3 service nova] Lock "e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:35:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-38acffae-8ffa-43f5-84d0-36bcf0e76fd6 req-cf09c7e3-0518-43bc-8fac-c191711ce6d3 service nova] Lock "e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:35:13 user nova-compute[74840]: DEBUG nova.compute.manager [req-38acffae-8ffa-43f5-84d0-36bcf0e76fd6 req-cf09c7e3-0518-43bc-8fac-c191711ce6d3 service nova] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] No waiting events found dispatching network-vif-unplugged-d8b090c7-4d0d-43d0-8fa3-4c4d489862a7 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:35:13 user nova-compute[74840]: DEBUG nova.compute.manager [req-38acffae-8ffa-43f5-84d0-36bcf0e76fd6 req-cf09c7e3-0518-43bc-8fac-c191711ce6d3 service nova] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Received event network-vif-unplugged-d8b090c7-4d0d-43d0-8fa3-4c4d489862a7 for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:35:13 user nova-compute[74840]: DEBUG nova.compute.manager [req-38acffae-8ffa-43f5-84d0-36bcf0e76fd6 req-cf09c7e3-0518-43bc-8fac-c191711ce6d3 service nova] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Received event network-vif-plugged-d8b090c7-4d0d-43d0-8fa3-4c4d489862a7 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:35:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-38acffae-8ffa-43f5-84d0-36bcf0e76fd6 req-cf09c7e3-0518-43bc-8fac-c191711ce6d3 service nova] Acquiring lock "e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:35:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-38acffae-8ffa-43f5-84d0-36bcf0e76fd6 req-cf09c7e3-0518-43bc-8fac-c191711ce6d3 service nova] Lock "e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:35:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-38acffae-8ffa-43f5-84d0-36bcf0e76fd6 req-cf09c7e3-0518-43bc-8fac-c191711ce6d3 service nova] Lock "e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:35:13 user nova-compute[74840]: DEBUG nova.compute.manager [req-38acffae-8ffa-43f5-84d0-36bcf0e76fd6 req-cf09c7e3-0518-43bc-8fac-c191711ce6d3 service nova] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] No waiting events found dispatching network-vif-plugged-d8b090c7-4d0d-43d0-8fa3-4c4d489862a7 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:35:13 user nova-compute[74840]: WARNING nova.compute.manager [req-38acffae-8ffa-43f5-84d0-36bcf0e76fd6 req-cf09c7e3-0518-43bc-8fac-c191711ce6d3 service nova] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Received unexpected event network-vif-plugged-d8b090c7-4d0d-43d0-8fa3-4c4d489862a7 for instance with vm_state active and task_state deleting.
Nov 08 12:35:13 user nova-compute[74840]: INFO nova.compute.manager [None req-060a09a4-ae60-4401-8f6f-375a24b35142 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e] Took 0.95 seconds to detach 1 volumes for instance.
Nov 08 12:35:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-060a09a4-ae60-4401-8f6f-375a24b35142 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:35:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-060a09a4-ae60-4401-8f6f-375a24b35142 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:35:13 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:35:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:35:14 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-060a09a4-ae60-4401-8f6f-375a24b35142 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:35:14 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-060a09a4-ae60-4401-8f6f-375a24b35142 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:35:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-060a09a4-ae60-4401-8f6f-375a24b35142 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.517s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:35:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.387s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:35:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:35:14 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:35:14 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-060a09a4-ae60-4401-8f6f-375a24b35142 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Deleted allocations for instance e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e
Nov 08 12:35:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-060a09a4-ae60-4401-8f6f-375a24b35142 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "e47f8bf9-6cb9-4b68-b3ed-3ee0593d004e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.431s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:35:14 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:35:14 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:35:14 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a482219-16ac-49e2-84ad-7e2030c97184/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:35:14 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a482219-16ac-49e2-84ad-7e2030c97184/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:35:14 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a482219-16ac-49e2-84ad-7e2030c97184/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:35:14 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a482219-16ac-49e2-84ad-7e2030c97184/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:35:14 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:35:14 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c4fc63-0757-46da-ad00-7b6c6513deca/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:35:14 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c4fc63-0757-46da-ad00-7b6c6513deca/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:35:14 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c4fc63-0757-46da-ad00-7b6c6513deca/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:35:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2c4fc63-0757-46da-ad00-7b6c6513deca/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:35:15 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:35:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:35:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:35:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:35:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:35:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:35:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:35:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:35:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:35:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:35:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:35:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:35:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:35:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:35:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:35:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:35:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:35:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6156dbbc-6539-4de3-8ba0-16db61cd7dce/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:35:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:35:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6156dbbc-6539-4de3-8ba0-16db61cd7dce/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:35:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6156dbbc-6539-4de3-8ba0-16db61cd7dce/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:35:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6156dbbc-6539-4de3-8ba0-16db61cd7dce/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:35:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:35:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:35:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:35:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:35:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:35:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:35:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:35:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:35:17 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:35:18 user nova-compute[74840]: DEBUG nova.compute.manager [req-0476abf3-64aa-47ae-a736-7b5b15ca6643 req-31a381b9-bfc4-474d-bcca-2bcbbb1bfe40 service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Received event network-changed-4d351123-6297-4be2-808d-50cdbe9e3aa6 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:35:18 user nova-compute[74840]: DEBUG nova.compute.manager [req-0476abf3-64aa-47ae-a736-7b5b15ca6643 req-31a381b9-bfc4-474d-bcca-2bcbbb1bfe40 service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Refreshing instance network info cache due to event network-changed-4d351123-6297-4be2-808d-50cdbe9e3aa6. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:35:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0476abf3-64aa-47ae-a736-7b5b15ca6643 req-31a381b9-bfc4-474d-bcca-2bcbbb1bfe40 service nova] Acquiring lock "refresh_cache-a2c4fc63-0757-46da-ad00-7b6c6513deca" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:35:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0476abf3-64aa-47ae-a736-7b5b15ca6643 req-31a381b9-bfc4-474d-bcca-2bcbbb1bfe40 service nova] Acquired lock "refresh_cache-a2c4fc63-0757-46da-ad00-7b6c6513deca" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:35:18 user nova-compute[74840]: DEBUG nova.network.neutron [req-0476abf3-64aa-47ae-a736-7b5b15ca6643 req-31a381b9-bfc4-474d-bcca-2bcbbb1bfe40 service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Refreshing network info cache for port 4d351123-6297-4be2-808d-50cdbe9e3aa6 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:35:18 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:35:18 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:35:18 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=7437MB free_disk=24.735477447509766GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:35:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:35:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:35:18 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance d3e8efc6-7146-46ef-8433-380d7e69120c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:35:18 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance ffe50042-29bf-4ef3-a148-8698bc75233b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:35:18 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 8b7c490e-4c78-4e07-bc8a-3be2328963d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:35:18 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 832a6445-84ee-43a8-a5bc-a07670602912 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:35:18 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 10c42516-62ba-4aa9-bc5a-d94499bd6b65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:35:18 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 9991e7b4-aaf8-4485-b658-e1af634925de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:35:18 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance a2c4fc63-0757-46da-ad00-7b6c6513deca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:35:18 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:35:18 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 83da3dce-e270-4054-910d-c8ad28eb18da actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:35:18 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 7a482219-16ac-49e2-84ad-7e2030c97184 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:35:18 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 550f8fed-4652-46fe-a440-974ee8f88196 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:35:18 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 6156dbbc-6539-4de3-8ba0-16db61cd7dce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:35:18 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:35:18 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:35:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-70dd7d8e-da32-4d1c-a9ae-6c012ac351ed tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Acquiring lock "a2c4fc63-0757-46da-ad00-7b6c6513deca" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:35:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-70dd7d8e-da32-4d1c-a9ae-6c012ac351ed tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "a2c4fc63-0757-46da-ad00-7b6c6513deca" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:35:18 user nova-compute[74840]: INFO nova.compute.manager [None req-70dd7d8e-da32-4d1c-a9ae-6c012ac351ed tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Detaching volume 5cbf13b2-dd3d-45b7-b02d-45d78966d7f2
Nov 08 12:35:18 user nova-compute[74840]: INFO nova.virt.block_device [None req-70dd7d8e-da32-4d1c-a9ae-6c012ac351ed tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Attempting to driver detach volume 5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 from mountpoint /dev/vdb
Nov 08 12:35:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-70dd7d8e-da32-4d1c-a9ae-6c012ac351ed tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Attempting to detach device vdb from instance a2c4fc63-0757-46da-ad00-7b6c6513deca from the persistent domain config. {{(pid=74840) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 12:35:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-70dd7d8e-da32-4d1c-a9ae-6c012ac351ed tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 12:35:18 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:35:18 user nova-compute[74840]:   <source dev="/dev/sdd"/>
Nov 08 12:35:18 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:35:18 user nova-compute[74840]:   <serial>5cbf13b2-dd3d-45b7-b02d-45d78966d7f2</serial>
Nov 08 12:35:18 user nova-compute[74840]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 12:35:18 user nova-compute[74840]: </disk>
Nov 08 12:35:18 user nova-compute[74840]:  {{(pid=74840) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 12:35:18 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-70dd7d8e-da32-4d1c-a9ae-6c012ac351ed tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Successfully detached device vdb from instance a2c4fc63-0757-46da-ad00-7b6c6513deca from the persistent domain config.
Nov 08 12:35:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-70dd7d8e-da32-4d1c-a9ae-6c012ac351ed tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a2c4fc63-0757-46da-ad00-7b6c6513deca from the live domain config. {{(pid=74840) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 12:35:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-70dd7d8e-da32-4d1c-a9ae-6c012ac351ed tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 12:35:18 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:35:18 user nova-compute[74840]:   <source dev="/dev/sdd"/>
Nov 08 12:35:18 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:35:18 user nova-compute[74840]:   <serial>5cbf13b2-dd3d-45b7-b02d-45d78966d7f2</serial>
Nov 08 12:35:18 user nova-compute[74840]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 12:35:18 user nova-compute[74840]: </disk>
Nov 08 12:35:18 user nova-compute[74840]:  {{(pid=74840) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 12:35:18 user nova-compute[74840]: DEBUG nova.network.neutron [req-0476abf3-64aa-47ae-a736-7b5b15ca6643 req-31a381b9-bfc4-474d-bcca-2bcbbb1bfe40 service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Updated VIF entry in instance network info cache for port 4d351123-6297-4be2-808d-50cdbe9e3aa6. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:35:18 user nova-compute[74840]: DEBUG nova.network.neutron [req-0476abf3-64aa-47ae-a736-7b5b15ca6643 req-31a381b9-bfc4-474d-bcca-2bcbbb1bfe40 service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Updating instance_info_cache with network_info: [{"id": "4d351123-6297-4be2-808d-50cdbe9e3aa6", "address": "fa:16:3e:4e:0c:f0", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d351123-62", "ovs_interfaceid": "4d351123-6297-4be2-808d-50cdbe9e3aa6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:35:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0476abf3-64aa-47ae-a736-7b5b15ca6643 req-31a381b9-bfc4-474d-bcca-2bcbbb1bfe40 service nova] Releasing lock "refresh_cache-a2c4fc63-0757-46da-ad00-7b6c6513deca" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:35:18 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:35:18 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:35:18 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:35:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.589s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:35:18 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:35:18 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74840) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 12:35:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-70dd7d8e-da32-4d1c-a9ae-6c012ac351ed tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a2c4fc63-0757-46da-ad00-7b6c6513deca {{(pid=74840) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 12:35:19 user nova-compute[74840]: DEBUG nova.compute.manager [req-0f352aa6-0964-4528-9116-adcd2612e81d req-3a02fd57-76da-4af4-8f95-391db1d98175 service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Received event network-changed-4d351123-6297-4be2-808d-50cdbe9e3aa6 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:35:19 user nova-compute[74840]: DEBUG nova.compute.manager [req-0f352aa6-0964-4528-9116-adcd2612e81d req-3a02fd57-76da-4af4-8f95-391db1d98175 service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Refreshing instance network info cache due to event network-changed-4d351123-6297-4be2-808d-50cdbe9e3aa6. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:35:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0f352aa6-0964-4528-9116-adcd2612e81d req-3a02fd57-76da-4af4-8f95-391db1d98175 service nova] Acquiring lock "refresh_cache-a2c4fc63-0757-46da-ad00-7b6c6513deca" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:35:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0f352aa6-0964-4528-9116-adcd2612e81d req-3a02fd57-76da-4af4-8f95-391db1d98175 service nova] Acquired lock "refresh_cache-a2c4fc63-0757-46da-ad00-7b6c6513deca" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:35:19 user nova-compute[74840]: DEBUG nova.network.neutron [req-0f352aa6-0964-4528-9116-adcd2612e81d req-3a02fd57-76da-4af4-8f95-391db1d98175 service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Refreshing network info cache for port 4d351123-6297-4be2-808d-50cdbe9e3aa6 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:35:20 user nova-compute[74840]: DEBUG nova.network.neutron [req-0f352aa6-0964-4528-9116-adcd2612e81d req-3a02fd57-76da-4af4-8f95-391db1d98175 service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Updated VIF entry in instance network info cache for port 4d351123-6297-4be2-808d-50cdbe9e3aa6. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:35:20 user nova-compute[74840]: DEBUG nova.network.neutron [req-0f352aa6-0964-4528-9116-adcd2612e81d req-3a02fd57-76da-4af4-8f95-391db1d98175 service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Updating instance_info_cache with network_info: [{"id": "4d351123-6297-4be2-808d-50cdbe9e3aa6", "address": "fa:16:3e:4e:0c:f0", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d351123-62", "ovs_interfaceid": "4d351123-6297-4be2-808d-50cdbe9e3aa6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:35:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0f352aa6-0964-4528-9116-adcd2612e81d req-3a02fd57-76da-4af4-8f95-391db1d98175 service nova] Releasing lock "refresh_cache-a2c4fc63-0757-46da-ad00-7b6c6513deca" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:35:20 user nova-compute[74840]: DEBUG nova.compute.manager [req-bc4f550e-fce0-4a23-88a8-464083e66442 req-1f5d1e5d-aee3-4b1b-89ad-1e4126174cfa service nova] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Received event network-changed-0c5dbe98-66f5-492a-8da2-8eca6cf38de5 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:35:20 user nova-compute[74840]: DEBUG nova.compute.manager [req-bc4f550e-fce0-4a23-88a8-464083e66442 req-1f5d1e5d-aee3-4b1b-89ad-1e4126174cfa service nova] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Refreshing instance network info cache due to event network-changed-0c5dbe98-66f5-492a-8da2-8eca6cf38de5. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:35:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-bc4f550e-fce0-4a23-88a8-464083e66442 req-1f5d1e5d-aee3-4b1b-89ad-1e4126174cfa service nova] Acquiring lock "refresh_cache-6156dbbc-6539-4de3-8ba0-16db61cd7dce" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:35:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-bc4f550e-fce0-4a23-88a8-464083e66442 req-1f5d1e5d-aee3-4b1b-89ad-1e4126174cfa service nova] Acquired lock "refresh_cache-6156dbbc-6539-4de3-8ba0-16db61cd7dce" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:35:20 user nova-compute[74840]: DEBUG nova.network.neutron [req-bc4f550e-fce0-4a23-88a8-464083e66442 req-1f5d1e5d-aee3-4b1b-89ad-1e4126174cfa service nova] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Refreshing network info cache for port 0c5dbe98-66f5-492a-8da2-8eca6cf38de5 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:35:20 user nova-compute[74840]: DEBUG nova.compute.manager [None req-ff219072-af1a-49d9-8135-7d3607f3fc70 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:35:21 user nova-compute[74840]: INFO nova.compute.manager [None req-ff219072-af1a-49d9-8135-7d3607f3fc70 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] instance snapshotting
Nov 08 12:35:21 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-ff219072-af1a-49d9-8135-7d3607f3fc70 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Beginning live snapshot process
Nov 08 12:35:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-ff219072-af1a-49d9-8135-7d3607f3fc70 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a482219-16ac-49e2-84ad-7e2030c97184/disk --force-share --output=json -f qcow2 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:35:21 user nova-compute[74840]: DEBUG nova.network.neutron [req-bc4f550e-fce0-4a23-88a8-464083e66442 req-1f5d1e5d-aee3-4b1b-89ad-1e4126174cfa service nova] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Updated VIF entry in instance network info cache for port 0c5dbe98-66f5-492a-8da2-8eca6cf38de5. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:35:21 user nova-compute[74840]: DEBUG nova.network.neutron [req-bc4f550e-fce0-4a23-88a8-464083e66442 req-1f5d1e5d-aee3-4b1b-89ad-1e4126174cfa service nova] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Updating instance_info_cache with network_info: [{"id": "0c5dbe98-66f5-492a-8da2-8eca6cf38de5", "address": "fa:16:3e:ab:15:81", "network": {"id": "918d8aed-1f09-4cfb-9c7f-48f002ad6ba3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-927886396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a05cda834445fb94e71f6cac02f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5dbe98-66", "ovs_interfaceid": "0c5dbe98-66f5-492a-8da2-8eca6cf38de5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:35:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-bc4f550e-fce0-4a23-88a8-464083e66442 req-1f5d1e5d-aee3-4b1b-89ad-1e4126174cfa service nova] Releasing lock "refresh_cache-6156dbbc-6539-4de3-8ba0-16db61cd7dce" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:35:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-ff219072-af1a-49d9-8135-7d3607f3fc70 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a482219-16ac-49e2-84ad-7e2030c97184/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:35:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-ff219072-af1a-49d9-8135-7d3607f3fc70 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a482219-16ac-49e2-84ad-7e2030c97184/disk --force-share --output=json -f qcow2 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:35:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-ff219072-af1a-49d9-8135-7d3607f3fc70 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a482219-16ac-49e2-84ad-7e2030c97184/disk --force-share --output=json -f qcow2" returned: 0 in 0.174s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:35:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-ff219072-af1a-49d9-8135-7d3607f3fc70 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:35:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:35:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-ff219072-af1a-49d9-8135-7d3607f3fc70 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.174s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:35:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-ff219072-af1a-49d9-8135-7d3607f3fc70 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp_1amtl2e/8ffb1643309a46de860fa078a7363160.delta 1073741824 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:35:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-ff219072-af1a-49d9-8135-7d3607f3fc70 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp_1amtl2e/8ffb1643309a46de860fa078a7363160.delta 1073741824" returned: 0 in 0.057s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:35:21 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-ff219072-af1a-49d9-8135-7d3607f3fc70 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 08 12:35:22 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:35:22 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-ff219072-af1a-49d9-8135-7d3607f3fc70 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74840) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 12:35:23 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-ff219072-af1a-49d9-8135-7d3607f3fc70 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74840) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 12:35:23 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-ff219072-af1a-49d9-8135-7d3607f3fc70 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 08 12:35:23 user nova-compute[74840]: DEBUG nova.privsep.utils [None req-ff219072-af1a-49d9-8135-7d3607f3fc70 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74840) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 12:35:23 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-ff219072-af1a-49d9-8135-7d3607f3fc70 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp_1amtl2e/8ffb1643309a46de860fa078a7363160.delta /opt/stack/data/nova/instances/snapshots/tmp_1amtl2e/8ffb1643309a46de860fa078a7363160 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:35:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-ff219072-af1a-49d9-8135-7d3607f3fc70 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp_1amtl2e/8ffb1643309a46de860fa078a7363160.delta /opt/stack/data/nova/instances/snapshots/tmp_1amtl2e/8ffb1643309a46de860fa078a7363160" returned: 0 in 0.881s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:35:24 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-ff219072-af1a-49d9-8135-7d3607f3fc70 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Snapshot extracted, beginning image upload
Nov 08 12:35:26 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-ff219072-af1a-49d9-8135-7d3607f3fc70 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Snapshot image upload complete
Nov 08 12:35:26 user nova-compute[74840]: INFO nova.compute.manager [None req-ff219072-af1a-49d9-8135-7d3607f3fc70 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Took 5.45 seconds to snapshot the instance on the hypervisor.
Nov 08 12:35:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Triggering sync for uuid d3e8efc6-7146-46ef-8433-380d7e69120c {{(pid=74840) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Triggering sync for uuid ffe50042-29bf-4ef3-a148-8698bc75233b {{(pid=74840) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Triggering sync for uuid 8b7c490e-4c78-4e07-bc8a-3be2328963d7 {{(pid=74840) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Triggering sync for uuid 832a6445-84ee-43a8-a5bc-a07670602912 {{(pid=74840) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Triggering sync for uuid 10c42516-62ba-4aa9-bc5a-d94499bd6b65 {{(pid=74840) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Triggering sync for uuid 9991e7b4-aaf8-4485-b658-e1af634925de {{(pid=74840) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Triggering sync for uuid a2c4fc63-0757-46da-ad00-7b6c6513deca {{(pid=74840) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Triggering sync for uuid b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c {{(pid=74840) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Triggering sync for uuid 83da3dce-e270-4054-910d-c8ad28eb18da {{(pid=74840) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Triggering sync for uuid 7a482219-16ac-49e2-84ad-7e2030c97184 {{(pid=74840) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Triggering sync for uuid 550f8fed-4652-46fe-a440-974ee8f88196 {{(pid=74840) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Triggering sync for uuid 6156dbbc-6539-4de3-8ba0-16db61cd7dce {{(pid=74840) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "d3e8efc6-7146-46ef-8433-380d7e69120c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "d3e8efc6-7146-46ef-8433-380d7e69120c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "ffe50042-29bf-4ef3-a148-8698bc75233b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "ffe50042-29bf-4ef3-a148-8698bc75233b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "8b7c490e-4c78-4e07-bc8a-3be2328963d7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "8b7c490e-4c78-4e07-bc8a-3be2328963d7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "832a6445-84ee-43a8-a5bc-a07670602912" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "832a6445-84ee-43a8-a5bc-a07670602912" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "10c42516-62ba-4aa9-bc5a-d94499bd6b65" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "10c42516-62ba-4aa9-bc5a-d94499bd6b65" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "9991e7b4-aaf8-4485-b658-e1af634925de" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "9991e7b4-aaf8-4485-b658-e1af634925de" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "a2c4fc63-0757-46da-ad00-7b6c6513deca" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "83da3dce-e270-4054-910d-c8ad28eb18da" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "83da3dce-e270-4054-910d-c8ad28eb18da" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "7a482219-16ac-49e2-84ad-7e2030c97184" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "7a482219-16ac-49e2-84ad-7e2030c97184" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "550f8fed-4652-46fe-a440-974ee8f88196" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "550f8fed-4652-46fe-a440-974ee8f88196" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "6156dbbc-6539-4de3-8ba0-16db61cd7dce" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "6156dbbc-6539-4de3-8ba0-16db61cd7dce" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:35:27 user nova-compute[74840]: INFO nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] During sync_power_state the instance has a pending task (shelving). Skip.
Nov 08 12:35:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "6156dbbc-6539-4de3-8ba0-16db61cd7dce" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0002782c-512f-456f-a99e-cbb07d904e0a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Acquiring lock "6156dbbc-6539-4de3-8ba0-16db61cd7dce" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0002782c-512f-456f-a99e-cbb07d904e0a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "6156dbbc-6539-4de3-8ba0-16db61cd7dce" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:35:27 user nova-compute[74840]: INFO nova.compute.manager [None req-0002782c-512f-456f-a99e-cbb07d904e0a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Shelving
Nov 08 12:35:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "d3e8efc6-7146-46ef-8433-380d7e69120c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "ffe50042-29bf-4ef3-a148-8698bc75233b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "8b7c490e-4c78-4e07-bc8a-3be2328963d7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "832a6445-84ee-43a8-a5bc-a07670602912" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "9991e7b4-aaf8-4485-b658-e1af634925de" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "10c42516-62ba-4aa9-bc5a-d94499bd6b65" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "7a482219-16ac-49e2-84ad-7e2030c97184" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "550f8fed-4652-46fe-a440-974ee8f88196" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "83da3dce-e270-4054-910d-c8ad28eb18da" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:35:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:35:28 user nova-compute[74840]: DEBUG nova.compute.manager [req-fc58a527-5e03-4e8c-8987-0c7e4d05f671 req-016cbbb5-4685-48a0-9be7-00d108766570 service nova] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Received event network-vif-unplugged-0c5dbe98-66f5-492a-8da2-8eca6cf38de5 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:35:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-fc58a527-5e03-4e8c-8987-0c7e4d05f671 req-016cbbb5-4685-48a0-9be7-00d108766570 service nova] Acquiring lock "6156dbbc-6539-4de3-8ba0-16db61cd7dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:35:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-fc58a527-5e03-4e8c-8987-0c7e4d05f671 req-016cbbb5-4685-48a0-9be7-00d108766570 service nova] Lock "6156dbbc-6539-4de3-8ba0-16db61cd7dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:35:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-fc58a527-5e03-4e8c-8987-0c7e4d05f671 req-016cbbb5-4685-48a0-9be7-00d108766570 service nova] Lock "6156dbbc-6539-4de3-8ba0-16db61cd7dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:35:28 user nova-compute[74840]: DEBUG nova.compute.manager [req-fc58a527-5e03-4e8c-8987-0c7e4d05f671 req-016cbbb5-4685-48a0-9be7-00d108766570 service nova] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] No waiting events found dispatching network-vif-unplugged-0c5dbe98-66f5-492a-8da2-8eca6cf38de5 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:35:28 user nova-compute[74840]: WARNING nova.compute.manager [req-fc58a527-5e03-4e8c-8987-0c7e4d05f671 req-016cbbb5-4685-48a0-9be7-00d108766570 service nova] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Received unexpected event network-vif-unplugged-0c5dbe98-66f5-492a-8da2-8eca6cf38de5 for instance with vm_state active and task_state shelving.
Nov 08 12:35:28 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Instance destroyed successfully.
Nov 08 12:35:28 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-0002782c-512f-456f-a99e-cbb07d904e0a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Beginning cold snapshot process
Nov 08 12:35:28 user nova-compute[74840]: DEBUG nova.privsep.utils [None req-0002782c-512f-456f-a99e-cbb07d904e0a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74840) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 12:35:28 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-0002782c-512f-456f-a99e-cbb07d904e0a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/6156dbbc-6539-4de3-8ba0-16db61cd7dce/disk /opt/stack/data/nova/instances/snapshots/tmpqnjlfc0d/e1b4cfcc8bf143638aa71f565eabe1a4 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:35:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Acquiring lock "0cecc731-6f86-475c-8603-591de8e30412" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:35:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "0cecc731-6f86-475c-8603-591de8e30412" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:35:28 user nova-compute[74840]: DEBUG nova.compute.manager [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Starting instance... {{(pid=74840) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 12:35:29 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:35:29 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:35:29 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:35:29 user nova-compute[74840]: INFO nova.compute.claims [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Claim successful on node user
Nov 08 12:35:29 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-0002782c-512f-456f-a99e-cbb07d904e0a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/6156dbbc-6539-4de3-8ba0-16db61cd7dce/disk /opt/stack/data/nova/instances/snapshots/tmpqnjlfc0d/e1b4cfcc8bf143638aa71f565eabe1a4" returned: 0 in 0.535s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:35:29 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-0002782c-512f-456f-a99e-cbb07d904e0a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Snapshot extracted, beginning image upload
Nov 08 12:35:29 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:35:29 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:35:29 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.508s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:35:29 user nova-compute[74840]: DEBUG nova.compute.manager [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Start building networks asynchronously for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 12:35:29 user nova-compute[74840]: DEBUG nova.compute.manager [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Allocating IP information in the background. {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 12:35:29 user nova-compute[74840]: DEBUG nova.network.neutron [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 0cecc731-6f86-475c-8603-591de8e30412] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 12:35:29 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 12:35:29 user nova-compute[74840]: DEBUG nova.compute.manager [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Start building block device mappings for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 12:35:29 user nova-compute[74840]: DEBUG nova.policy [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '719ac4d31ae447a6a04c1c62c0a73191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24d52e18e8e41dfa50aa5aff1f40c6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 12:35:29 user nova-compute[74840]: DEBUG nova.compute.manager [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Start spawning the instance on the hypervisor. {{(pid=74840) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 12:35:29 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:35:29 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Creating image(s)
Nov 08 12:35:29 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Acquiring lock "/opt/stack/data/nova/instances/0cecc731-6f86-475c-8603-591de8e30412/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:35:29 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "/opt/stack/data/nova/instances/0cecc731-6f86-475c-8603-591de8e30412/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:35:29 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "/opt/stack/data/nova/instances/0cecc731-6f86-475c-8603-591de8e30412/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:35:29 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Acquiring lock "cba754e59ce029fae9f23f50fbabcb5cedcb9abb" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:35:29 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "cba754e59ce029fae9f23f50fbabcb5cedcb9abb" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:35:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cba754e59ce029fae9f23f50fbabcb5cedcb9abb.part --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:35:30 user nova-compute[74840]: DEBUG nova.compute.manager [req-583a9041-2901-4ecc-a748-a5c8063affd4 req-47331696-4ff7-4fe4-8ffe-280047c56642 service nova] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Received event network-vif-plugged-0c5dbe98-66f5-492a-8da2-8eca6cf38de5 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:35:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-583a9041-2901-4ecc-a748-a5c8063affd4 req-47331696-4ff7-4fe4-8ffe-280047c56642 service nova] Acquiring lock "6156dbbc-6539-4de3-8ba0-16db61cd7dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:35:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-583a9041-2901-4ecc-a748-a5c8063affd4 req-47331696-4ff7-4fe4-8ffe-280047c56642 service nova] Lock "6156dbbc-6539-4de3-8ba0-16db61cd7dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:35:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-583a9041-2901-4ecc-a748-a5c8063affd4 req-47331696-4ff7-4fe4-8ffe-280047c56642 service nova] Lock "6156dbbc-6539-4de3-8ba0-16db61cd7dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:35:30 user nova-compute[74840]: DEBUG nova.compute.manager [req-583a9041-2901-4ecc-a748-a5c8063affd4 req-47331696-4ff7-4fe4-8ffe-280047c56642 service nova] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] No waiting events found dispatching network-vif-plugged-0c5dbe98-66f5-492a-8da2-8eca6cf38de5 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:35:30 user nova-compute[74840]: WARNING nova.compute.manager [req-583a9041-2901-4ecc-a748-a5c8063affd4 req-47331696-4ff7-4fe4-8ffe-280047c56642 service nova] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Received unexpected event network-vif-plugged-0c5dbe98-66f5-492a-8da2-8eca6cf38de5 for instance with vm_state active and task_state shelving_image_uploading.
Nov 08 12:35:31 user nova-compute[74840]: DEBUG nova.network.neutron [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Successfully created port: 5f1cf848-e83c-454b-b5ab-d2e047ae5e84 {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:35:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cba754e59ce029fae9f23f50fbabcb5cedcb9abb.part --force-share --output=json" returned: 0 in 0.188s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:35:31 user nova-compute[74840]: DEBUG nova.virt.images [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] 9c3801ed-69ca-4405-b972-608d5f4bc4c7 was qcow2, converting to raw {{(pid=74840) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 12:35:31 user nova-compute[74840]: DEBUG nova.privsep.utils [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74840) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 12:35:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cba754e59ce029fae9f23f50fbabcb5cedcb9abb.part /opt/stack/data/nova/instances/_base/cba754e59ce029fae9f23f50fbabcb5cedcb9abb.converted {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:35:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cba754e59ce029fae9f23f50fbabcb5cedcb9abb.part /opt/stack/data/nova/instances/_base/cba754e59ce029fae9f23f50fbabcb5cedcb9abb.converted" returned: 0 in 0.271s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:35:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cba754e59ce029fae9f23f50fbabcb5cedcb9abb.converted --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:35:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cba754e59ce029fae9f23f50fbabcb5cedcb9abb.converted --force-share --output=json" returned: 0 in 0.186s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:35:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "cba754e59ce029fae9f23f50fbabcb5cedcb9abb" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.720s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:35:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cba754e59ce029fae9f23f50fbabcb5cedcb9abb --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:35:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:35:31 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:35:31 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Cleaning up deleted instances {{(pid=74840) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 12:35:31 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] There are 0 instances to clean {{(pid=74840) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 12:35:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cba754e59ce029fae9f23f50fbabcb5cedcb9abb --force-share --output=json" returned: 0 in 0.184s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:35:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Acquiring lock "cba754e59ce029fae9f23f50fbabcb5cedcb9abb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:35:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "cba754e59ce029fae9f23f50fbabcb5cedcb9abb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:35:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cba754e59ce029fae9f23f50fbabcb5cedcb9abb --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:35:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cba754e59ce029fae9f23f50fbabcb5cedcb9abb --force-share --output=json" returned: 0 in 0.176s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:35:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cba754e59ce029fae9f23f50fbabcb5cedcb9abb,backing_fmt=raw /opt/stack/data/nova/instances/0cecc731-6f86-475c-8603-591de8e30412/disk 1073741824 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cba754e59ce029fae9f23f50fbabcb5cedcb9abb,backing_fmt=raw /opt/stack/data/nova/instances/0cecc731-6f86-475c-8603-591de8e30412/disk 1073741824" returned: 0 in 0.061s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "cba754e59ce029fae9f23f50fbabcb5cedcb9abb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cba754e59ce029fae9f23f50fbabcb5cedcb9abb --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG nova.network.neutron [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Successfully updated port: 5f1cf848-e83c-454b-b5ab-d2e047ae5e84 {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Acquiring lock "refresh_cache-0cecc731-6f86-475c-8603-591de8e30412" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Acquired lock "refresh_cache-0cecc731-6f86-475c-8603-591de8e30412" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG nova.network.neutron [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cba754e59ce029fae9f23f50fbabcb5cedcb9abb --force-share --output=json" returned: 0 in 0.180s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Created local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Ensure instance console log exists: /opt/stack/data/nova/instances/0cecc731-6f86-475c-8603-591de8e30412/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG nova.network.neutron [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG nova.compute.manager [req-e9bd788c-2b57-445e-92e1-b52dbb045bde req-a6ffb0f8-507d-4830-853f-8431bccb03b1 service nova] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Received event network-changed-5f1cf848-e83c-454b-b5ab-d2e047ae5e84 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG nova.compute.manager [req-e9bd788c-2b57-445e-92e1-b52dbb045bde req-a6ffb0f8-507d-4830-853f-8431bccb03b1 service nova] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Refreshing instance network info cache due to event network-changed-5f1cf848-e83c-454b-b5ab-d2e047ae5e84. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e9bd788c-2b57-445e-92e1-b52dbb045bde req-a6ffb0f8-507d-4830-853f-8431bccb03b1 service nova] Acquiring lock "refresh_cache-0cecc731-6f86-475c-8603-591de8e30412" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:35:32 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-0002782c-512f-456f-a99e-cbb07d904e0a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Snapshot image upload complete
Nov 08 12:35:32 user nova-compute[74840]: DEBUG nova.compute.manager [None req-0002782c-512f-456f-a99e-cbb07d904e0a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:35:32 user nova-compute[74840]: INFO nova.compute.manager [None req-0002782c-512f-456f-a99e-cbb07d904e0a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Shelve offloading
Nov 08 12:35:32 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Instance destroyed successfully.
Nov 08 12:35:32 user nova-compute[74840]: DEBUG nova.compute.manager [None req-0002782c-512f-456f-a99e-cbb07d904e0a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0002782c-512f-456f-a99e-cbb07d904e0a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Acquiring lock "refresh_cache-6156dbbc-6539-4de3-8ba0-16db61cd7dce" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0002782c-512f-456f-a99e-cbb07d904e0a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Acquired lock "refresh_cache-6156dbbc-6539-4de3-8ba0-16db61cd7dce" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG nova.network.neutron [None req-0002782c-512f-456f-a99e-cbb07d904e0a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG nova.network.neutron [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Updating instance_info_cache with network_info: [{"id": "5f1cf848-e83c-454b-b5ab-d2e047ae5e84", "address": "fa:16:3e:6f:d6:9b", "network": {"id": "7faeaea5-04e0-46e0-bb55-9426d599fb1b", "bridge": "br-int", "label": "tempest-TestStampPattern-1080763140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c24d52e18e8e41dfa50aa5aff1f40c6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f1cf848-e8", "ovs_interfaceid": "5f1cf848-e83c-454b-b5ab-d2e047ae5e84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Releasing lock "refresh_cache-0cecc731-6f86-475c-8603-591de8e30412" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG nova.compute.manager [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Instance network_info: |[{"id": "5f1cf848-e83c-454b-b5ab-d2e047ae5e84", "address": "fa:16:3e:6f:d6:9b", "network": {"id": "7faeaea5-04e0-46e0-bb55-9426d599fb1b", "bridge": "br-int", "label": "tempest-TestStampPattern-1080763140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c24d52e18e8e41dfa50aa5aff1f40c6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f1cf848-e8", "ovs_interfaceid": "5f1cf848-e83c-454b-b5ab-d2e047ae5e84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e9bd788c-2b57-445e-92e1-b52dbb045bde req-a6ffb0f8-507d-4830-853f-8431bccb03b1 service nova] Acquired lock "refresh_cache-0cecc731-6f86-475c-8603-591de8e30412" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG nova.network.neutron [req-e9bd788c-2b57-445e-92e1-b52dbb045bde req-a6ffb0f8-507d-4830-853f-8431bccb03b1 service nova] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Refreshing network info cache for port 5f1cf848-e83c-454b-b5ab-d2e047ae5e84 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Start _get_guest_xml network_info=[{"id": "5f1cf848-e83c-454b-b5ab-d2e047ae5e84", "address": "fa:16:3e:6f:d6:9b", "network": {"id": "7faeaea5-04e0-46e0-bb55-9426d599fb1b", "bridge": "br-int", "label": "tempest-TestStampPattern-1080763140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c24d52e18e8e41dfa50aa5aff1f40c6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f1cf848-e8", "ovs_interfaceid": "5f1cf848-e83c-454b-b5ab-d2e047ae5e84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='15986e0556d2c7b3dbc6d4a6fba4c043',container_format='bare',created_at=2023-11-08T12:35:21Z,direct_url=<?>,disk_format='qcow2',id=9c3801ed-69ca-4405-b972-608d5f4bc4c7,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-642237500',owner='c24d52e18e8e41dfa50aa5aff1f40c6d',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T12:35:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'image_id': '9c3801ed-69ca-4405-b972-608d5f4bc4c7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:35:32 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:35:32 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:35:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='15986e0556d2c7b3dbc6d4a6fba4c043',container_format='bare',created_at=2023-11-08T12:35:21Z,direct_url=<?>,disk_format='qcow2',id=9c3801ed-69ca-4405-b972-608d5f4bc4c7,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-642237500',owner='c24d52e18e8e41dfa50aa5aff1f40c6d',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T12:35:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:35:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1688468890',display_name='tempest-TestStampPattern-server-1688468890',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1688468890',id=43,image_ref='9c3801ed-69ca-4405-b972-608d5f4bc4c7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAifdjOvE03LGvvENDtVW5s6JmsBpHl/N8DE5nBoGW2g5OLHF4XEiYFI0Pa1nSZrBetG5b+iQnlywZCqyB795WR0LxYnf+fBshC/Pye35f17zjZfcJWjmT0YUIL12Rw9Xg==',key_name='tempest-TestStampPattern-101204523',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c24d52e18e8e41dfa50aa5aff1f40c6d',ramdisk_id='',reservation_id='r-xe9fuk73',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='7a482219-16ac-49e2-84ad-7e2030c97184',image_min_disk='1',image_min_ram='0',image_owner_id='c24d52e18e8e41dfa50aa5aff1f40c6d',image_owner_project_name='tempest-TestStampPattern-55983118',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-55983118-project-member',image_user_id='719ac4d31ae447a6a04c1c62c0a73191',network_allocated='True',owner_project_name='tempest-TestStampPattern-55983118',owner_user_name='tempest-TestStampPattern-55983118-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:35:30Z,user_data=None,user_id='719ac4d31ae447a6a04c1c62c0a73191',uuid=0cecc731-6f86-475c-8603-591de8e30412,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f1cf848-e83c-454b-b5ab-d2e047ae5e84", "address": "fa:16:3e:6f:d6:9b", "network": {"id": "7faeaea5-04e0-46e0-bb55-9426d599fb1b", "bridge": "br-int", "label": "tempest-TestStampPattern-1080763140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c24d52e18e8e41dfa50aa5aff1f40c6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f1cf848-e8", "ovs_interfaceid": "5f1cf848-e83c-454b-b5ab-d2e047ae5e84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Converting VIF {"id": "5f1cf848-e83c-454b-b5ab-d2e047ae5e84", "address": "fa:16:3e:6f:d6:9b", "network": {"id": "7faeaea5-04e0-46e0-bb55-9426d599fb1b", "bridge": "br-int", "label": "tempest-TestStampPattern-1080763140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c24d52e18e8e41dfa50aa5aff1f40c6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f1cf848-e8", "ovs_interfaceid": "5f1cf848-e83c-454b-b5ab-d2e047ae5e84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:d6:9b,bridge_name='br-int',has_traffic_filtering=True,id=5f1cf848-e83c-454b-b5ab-d2e047ae5e84,network=Network(7faeaea5-04e0-46e0-bb55-9426d599fb1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f1cf848-e8') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG nova.objects.instance [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lazy-loading 'pci_devices' on Instance uuid 0cecc731-6f86-475c-8603-591de8e30412 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 0cecc731-6f86-475c-8603-591de8e30412] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:35:32 user nova-compute[74840]:   <uuid>0cecc731-6f86-475c-8603-591de8e30412</uuid>
Nov 08 12:35:32 user nova-compute[74840]:   <name>instance-0000002b</name>
Nov 08 12:35:32 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:35:32 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:35:32 user nova-compute[74840]:   <metadata>
Nov 08 12:35:32 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:35:32 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:35:32 user nova-compute[74840]:       <nova:name>tempest-TestStampPattern-server-1688468890</nova:name>
Nov 08 12:35:32 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:35:32</nova:creationTime>
Nov 08 12:35:32 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:35:32 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:35:32 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:35:32 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:35:32 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:35:32 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:35:32 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:35:32 user nova-compute[74840]:       <nova:owner>
Nov 08 12:35:32 user nova-compute[74840]:         <nova:user uuid="719ac4d31ae447a6a04c1c62c0a73191">tempest-TestStampPattern-55983118-project-member</nova:user>
Nov 08 12:35:32 user nova-compute[74840]:         <nova:project uuid="c24d52e18e8e41dfa50aa5aff1f40c6d">tempest-TestStampPattern-55983118</nova:project>
Nov 08 12:35:32 user nova-compute[74840]:       </nova:owner>
Nov 08 12:35:32 user nova-compute[74840]:       <nova:root type="image" uuid="9c3801ed-69ca-4405-b972-608d5f4bc4c7"/>
Nov 08 12:35:32 user nova-compute[74840]:       <nova:ports>
Nov 08 12:35:32 user nova-compute[74840]:         <nova:port uuid="5f1cf848-e83c-454b-b5ab-d2e047ae5e84">
Nov 08 12:35:32 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 12:35:32 user nova-compute[74840]:         </nova:port>
Nov 08 12:35:32 user nova-compute[74840]:       </nova:ports>
Nov 08 12:35:32 user nova-compute[74840]:     </nova:instance>
Nov 08 12:35:32 user nova-compute[74840]:   </metadata>
Nov 08 12:35:32 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:35:32 user nova-compute[74840]:     <system>
Nov 08 12:35:32 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:35:32 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:35:32 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:35:32 user nova-compute[74840]:       <entry name="serial">0cecc731-6f86-475c-8603-591de8e30412</entry>
Nov 08 12:35:32 user nova-compute[74840]:       <entry name="uuid">0cecc731-6f86-475c-8603-591de8e30412</entry>
Nov 08 12:35:32 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:35:32 user nova-compute[74840]:     </system>
Nov 08 12:35:32 user nova-compute[74840]:   </sysinfo>
Nov 08 12:35:32 user nova-compute[74840]:   <os>
Nov 08 12:35:32 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:35:32 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:35:32 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:35:32 user nova-compute[74840]:   </os>
Nov 08 12:35:32 user nova-compute[74840]:   <features>
Nov 08 12:35:32 user nova-compute[74840]:     <acpi/>
Nov 08 12:35:32 user nova-compute[74840]:     <apic/>
Nov 08 12:35:32 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:35:32 user nova-compute[74840]:   </features>
Nov 08 12:35:32 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:35:32 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:35:32 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:35:32 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:35:32 user nova-compute[74840]:   </clock>
Nov 08 12:35:32 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:35:32 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:35:32 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:35:32 user nova-compute[74840]:   </cpu>
Nov 08 12:35:32 user nova-compute[74840]:   <devices>
Nov 08 12:35:32 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:35:32 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:35:32 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/0cecc731-6f86-475c-8603-591de8e30412/disk"/>
Nov 08 12:35:32 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:35:32 user nova-compute[74840]:     </disk>
Nov 08 12:35:32 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:35:32 user nova-compute[74840]:       <mac address="fa:16:3e:6f:d6:9b"/>
Nov 08 12:35:32 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:35:32 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:35:32 user nova-compute[74840]:       <target dev="tap5f1cf848-e8"/>
Nov 08 12:35:32 user nova-compute[74840]:     </interface>
Nov 08 12:35:32 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:35:32 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/0cecc731-6f86-475c-8603-591de8e30412/console.log" append="off"/>
Nov 08 12:35:32 user nova-compute[74840]:     </serial>
Nov 08 12:35:32 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:35:32 user nova-compute[74840]:     <video>
Nov 08 12:35:32 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:35:32 user nova-compute[74840]:     </video>
Nov 08 12:35:32 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:35:32 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:35:32 user nova-compute[74840]:     </rng>
Nov 08 12:35:32 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:35:32 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:35:32 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:35:32 user nova-compute[74840]:     </memballoon>
Nov 08 12:35:32 user nova-compute[74840]:   </devices>
Nov 08 12:35:32 user nova-compute[74840]: </domain>
Nov 08 12:35:32 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:35:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1688468890',display_name='tempest-TestStampPattern-server-1688468890',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1688468890',id=43,image_ref='9c3801ed-69ca-4405-b972-608d5f4bc4c7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAifdjOvE03LGvvENDtVW5s6JmsBpHl/N8DE5nBoGW2g5OLHF4XEiYFI0Pa1nSZrBetG5b+iQnlywZCqyB795WR0LxYnf+fBshC/Pye35f17zjZfcJWjmT0YUIL12Rw9Xg==',key_name='tempest-TestStampPattern-101204523',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c24d52e18e8e41dfa50aa5aff1f40c6d',ramdisk_id='',reservation_id='r-xe9fuk73',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='7a482219-16ac-49e2-84ad-7e2030c97184',image_min_disk='1',image_min_ram='0',image_owner_id='c24d52e18e8e41dfa50aa5aff1f40c6d',image_owner_project_name='tempest-TestStampPattern-55983118',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-55983118-project-member',image_user_id='719ac4d31ae447a6a04c1c62c0a73191',network_allocated='True',owner_project_name='tempest-TestStampPattern-55983118',owner_user_name='tempest-TestStampPattern-55983118-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:35:30Z,user_data=None,user_id='719ac4d31ae447a6a04c1c62c0a73191',uuid=0cecc731-6f86-475c-8603-591de8e30412,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f1cf848-e83c-454b-b5ab-d2e047ae5e84", "address": "fa:16:3e:6f:d6:9b", "network": {"id": "7faeaea5-04e0-46e0-bb55-9426d599fb1b", "bridge": "br-int", "label": "tempest-TestStampPattern-1080763140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c24d52e18e8e41dfa50aa5aff1f40c6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f1cf848-e8", "ovs_interfaceid": "5f1cf848-e83c-454b-b5ab-d2e047ae5e84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Converting VIF {"id": "5f1cf848-e83c-454b-b5ab-d2e047ae5e84", "address": "fa:16:3e:6f:d6:9b", "network": {"id": "7faeaea5-04e0-46e0-bb55-9426d599fb1b", "bridge": "br-int", "label": "tempest-TestStampPattern-1080763140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c24d52e18e8e41dfa50aa5aff1f40c6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f1cf848-e8", "ovs_interfaceid": "5f1cf848-e83c-454b-b5ab-d2e047ae5e84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:d6:9b,bridge_name='br-int',has_traffic_filtering=True,id=5f1cf848-e83c-454b-b5ab-d2e047ae5e84,network=Network(7faeaea5-04e0-46e0-bb55-9426d599fb1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f1cf848-e8') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG os_vif [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:d6:9b,bridge_name='br-int',has_traffic_filtering=True,id=5f1cf848-e83c-454b-b5ab-d2e047ae5e84,network=Network(7faeaea5-04e0-46e0-bb55-9426d599fb1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f1cf848-e8') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7cd1d5b2-77cb-50f3-a108-40e21918d225', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f1cf848-e8, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5f1cf848-e8, col_values=(('qos', UUID('f399f494-91e9-4ba3-80f7-f585311d8e66')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5f1cf848-e8, col_values=(('external_ids', {'iface-id': '5f1cf848-e83c-454b-b5ab-d2e047ae5e84', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:d6:9b', 'vm-uuid': '0cecc731-6f86-475c-8603-591de8e30412'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:35:32 user nova-compute[74840]: INFO os_vif [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:d6:9b,bridge_name='br-int',has_traffic_filtering=True,id=5f1cf848-e83c-454b-b5ab-d2e047ae5e84,network=Network(7faeaea5-04e0-46e0-bb55-9426d599fb1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f1cf848-e8')
Nov 08 12:35:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] No VIF found with MAC fa:16:3e:6f:d6:9b, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG nova.network.neutron [None req-0002782c-512f-456f-a99e-cbb07d904e0a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Updating instance_info_cache with network_info: [{"id": "0c5dbe98-66f5-492a-8da2-8eca6cf38de5", "address": "fa:16:3e:ab:15:81", "network": {"id": "918d8aed-1f09-4cfb-9c7f-48f002ad6ba3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-927886396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a05cda834445fb94e71f6cac02f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5dbe98-66", "ovs_interfaceid": "0c5dbe98-66f5-492a-8da2-8eca6cf38de5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG nova.network.neutron [req-e9bd788c-2b57-445e-92e1-b52dbb045bde req-a6ffb0f8-507d-4830-853f-8431bccb03b1 service nova] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Updated VIF entry in instance network info cache for port 5f1cf848-e83c-454b-b5ab-d2e047ae5e84. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG nova.network.neutron [req-e9bd788c-2b57-445e-92e1-b52dbb045bde req-a6ffb0f8-507d-4830-853f-8431bccb03b1 service nova] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Updating instance_info_cache with network_info: [{"id": "5f1cf848-e83c-454b-b5ab-d2e047ae5e84", "address": "fa:16:3e:6f:d6:9b", "network": {"id": "7faeaea5-04e0-46e0-bb55-9426d599fb1b", "bridge": "br-int", "label": "tempest-TestStampPattern-1080763140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c24d52e18e8e41dfa50aa5aff1f40c6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f1cf848-e8", "ovs_interfaceid": "5f1cf848-e83c-454b-b5ab-d2e047ae5e84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0002782c-512f-456f-a99e-cbb07d904e0a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Releasing lock "refresh_cache-6156dbbc-6539-4de3-8ba0-16db61cd7dce" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:35:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e9bd788c-2b57-445e-92e1-b52dbb045bde req-a6ffb0f8-507d-4830-853f-8431bccb03b1 service nova] Releasing lock "refresh_cache-0cecc731-6f86-475c-8603-591de8e30412" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:35:33 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Instance destroyed successfully.
Nov 08 12:35:33 user nova-compute[74840]: DEBUG nova.objects.instance [None req-0002782c-512f-456f-a99e-cbb07d904e0a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lazy-loading 'resources' on Instance uuid 6156dbbc-6539-4de3-8ba0-16db61cd7dce {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:35:33 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-0002782c-512f-456f-a99e-cbb07d904e0a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:33:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1903705906',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1903705906',id=42,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFyOqyXoJE6A6khVhOqKm6eVWT5lVBOlj4aL8lXGOedklADnjHYeCbyRzst0jVwSHeyseYsI5B6BggkYstW9mP1b77U3gf+VYtK1KZlTE1fMpYwW88X38s9nwM8iJQzsg==',key_name='tempest-keypair-1939521876',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:33:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='93a05cda834445fb94e71f6cac02f198',ramdisk_id='',reservation_id='r-wqqsoqk3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1958698266',owner_user_name='tempest-AttachVolumeShelveTestJSON-1958698266-project-member',shelved_at='2023-11-08T12:35:32.396492',shelved_host='user',shelved_image_id='8a0092e8-d157-407b-a3e0-27e55fd04f84'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:35:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='afc4e8483a1f4e08b3f81a9b9323be84',uuid=6156dbbc-6539-4de3-8ba0-16db61cd7dce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "0c5dbe98-66f5-492a-8da2-8eca6cf38de5", "address": "fa:16:3e:ab:15:81", "network": {"id": "918d8aed-1f09-4cfb-9c7f-48f002ad6ba3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-927886396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a05cda834445fb94e71f6cac02f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5dbe98-66", "ovs_interfaceid": "0c5dbe98-66f5-492a-8da2-8eca6cf38de5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:35:33 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-0002782c-512f-456f-a99e-cbb07d904e0a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Converting VIF {"id": "0c5dbe98-66f5-492a-8da2-8eca6cf38de5", "address": "fa:16:3e:ab:15:81", "network": {"id": "918d8aed-1f09-4cfb-9c7f-48f002ad6ba3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-927886396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a05cda834445fb94e71f6cac02f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5dbe98-66", "ovs_interfaceid": "0c5dbe98-66f5-492a-8da2-8eca6cf38de5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:35:33 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-0002782c-512f-456f-a99e-cbb07d904e0a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:15:81,bridge_name='br-int',has_traffic_filtering=True,id=0c5dbe98-66f5-492a-8da2-8eca6cf38de5,network=Network(918d8aed-1f09-4cfb-9c7f-48f002ad6ba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5dbe98-66') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:35:33 user nova-compute[74840]: DEBUG os_vif [None req-0002782c-512f-456f-a99e-cbb07d904e0a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:15:81,bridge_name='br-int',has_traffic_filtering=True,id=0c5dbe98-66f5-492a-8da2-8eca6cf38de5,network=Network(918d8aed-1f09-4cfb-9c7f-48f002ad6ba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5dbe98-66') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:35:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:35:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c5dbe98-66, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:35:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:35:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:35:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:35:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:35:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=051daeef-d2af-4e3b-92bc-736d808fe9ee) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:35:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:35:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:35:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:35:33 user nova-compute[74840]: INFO os_vif [None req-0002782c-512f-456f-a99e-cbb07d904e0a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:15:81,bridge_name='br-int',has_traffic_filtering=True,id=0c5dbe98-66f5-492a-8da2-8eca6cf38de5,network=Network(918d8aed-1f09-4cfb-9c7f-48f002ad6ba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5dbe98-66')
Nov 08 12:35:33 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-0002782c-512f-456f-a99e-cbb07d904e0a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Deleting instance files /opt/stack/data/nova/instances/6156dbbc-6539-4de3-8ba0-16db61cd7dce_del
Nov 08 12:35:33 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-0002782c-512f-456f-a99e-cbb07d904e0a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Deletion of /opt/stack/data/nova/instances/6156dbbc-6539-4de3-8ba0-16db61cd7dce_del complete
Nov 08 12:35:33 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-0002782c-512f-456f-a99e-cbb07d904e0a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Deleted allocations for instance 6156dbbc-6539-4de3-8ba0-16db61cd7dce
Nov 08 12:35:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0002782c-512f-456f-a99e-cbb07d904e0a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:35:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0002782c-512f-456f-a99e-cbb07d904e0a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:35:33 user nova-compute[74840]: DEBUG nova.objects.instance [None req-0002782c-512f-456f-a99e-cbb07d904e0a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lazy-loading 'numa_topology' on Instance uuid 6156dbbc-6539-4de3-8ba0-16db61cd7dce {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:35:33 user nova-compute[74840]: DEBUG nova.objects.base [None req-0002782c-512f-456f-a99e-cbb07d904e0a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Object Instance<6156dbbc-6539-4de3-8ba0-16db61cd7dce> lazy-loaded attributes: resources,numa_topology {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:35:34 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-0002782c-512f-456f-a99e-cbb07d904e0a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:35:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:35:34 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-0002782c-512f-456f-a99e-cbb07d904e0a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:35:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:35:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:35:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0002782c-512f-456f-a99e-cbb07d904e0a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:35:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0002782c-512f-456f-a99e-cbb07d904e0a tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "6156dbbc-6539-4de3-8ba0-16db61cd7dce" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.361s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:35:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:35:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:35:34 user nova-compute[74840]: DEBUG nova.compute.manager [req-bc87be4e-1a4e-4a1b-9b69-c08811db42e3 req-42cf6390-30f8-409f-b5d1-26301d9d3523 service nova] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Received event network-vif-plugged-5f1cf848-e83c-454b-b5ab-d2e047ae5e84 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:35:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-bc87be4e-1a4e-4a1b-9b69-c08811db42e3 req-42cf6390-30f8-409f-b5d1-26301d9d3523 service nova] Acquiring lock "0cecc731-6f86-475c-8603-591de8e30412-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:35:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-bc87be4e-1a4e-4a1b-9b69-c08811db42e3 req-42cf6390-30f8-409f-b5d1-26301d9d3523 service nova] Lock "0cecc731-6f86-475c-8603-591de8e30412-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:35:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-bc87be4e-1a4e-4a1b-9b69-c08811db42e3 req-42cf6390-30f8-409f-b5d1-26301d9d3523 service nova] Lock "0cecc731-6f86-475c-8603-591de8e30412-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:35:34 user nova-compute[74840]: DEBUG nova.compute.manager [req-bc87be4e-1a4e-4a1b-9b69-c08811db42e3 req-42cf6390-30f8-409f-b5d1-26301d9d3523 service nova] [instance: 0cecc731-6f86-475c-8603-591de8e30412] No waiting events found dispatching network-vif-plugged-5f1cf848-e83c-454b-b5ab-d2e047ae5e84 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:35:34 user nova-compute[74840]: WARNING nova.compute.manager [req-bc87be4e-1a4e-4a1b-9b69-c08811db42e3 req-42cf6390-30f8-409f-b5d1-26301d9d3523 service nova] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Received unexpected event network-vif-plugged-5f1cf848-e83c-454b-b5ab-d2e047ae5e84 for instance with vm_state building and task_state spawning.
Nov 08 12:35:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:35:36 user nova-compute[74840]: DEBUG nova.compute.manager [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:35:36 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:35:36 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Instance spawned successfully.
Nov 08 12:35:36 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:35:36 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:35:36 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:35:36 user nova-compute[74840]: DEBUG nova.compute.manager [req-2df4063c-e3c0-49dd-ab02-b4d1b7f187f1 req-b6985ad3-dec8-4294-bc0e-05eb6dd634c4 service nova] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Received event network-vif-plugged-5f1cf848-e83c-454b-b5ab-d2e047ae5e84 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:35:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2df4063c-e3c0-49dd-ab02-b4d1b7f187f1 req-b6985ad3-dec8-4294-bc0e-05eb6dd634c4 service nova] Acquiring lock "0cecc731-6f86-475c-8603-591de8e30412-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:35:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2df4063c-e3c0-49dd-ab02-b4d1b7f187f1 req-b6985ad3-dec8-4294-bc0e-05eb6dd634c4 service nova] Lock "0cecc731-6f86-475c-8603-591de8e30412-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:35:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2df4063c-e3c0-49dd-ab02-b4d1b7f187f1 req-b6985ad3-dec8-4294-bc0e-05eb6dd634c4 service nova] Lock "0cecc731-6f86-475c-8603-591de8e30412-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:35:36 user nova-compute[74840]: DEBUG nova.compute.manager [req-2df4063c-e3c0-49dd-ab02-b4d1b7f187f1 req-b6985ad3-dec8-4294-bc0e-05eb6dd634c4 service nova] [instance: 0cecc731-6f86-475c-8603-591de8e30412] No waiting events found dispatching network-vif-plugged-5f1cf848-e83c-454b-b5ab-d2e047ae5e84 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:35:36 user nova-compute[74840]: WARNING nova.compute.manager [req-2df4063c-e3c0-49dd-ab02-b4d1b7f187f1 req-b6985ad3-dec8-4294-bc0e-05eb6dd634c4 service nova] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Received unexpected event network-vif-plugged-5f1cf848-e83c-454b-b5ab-d2e047ae5e84 for instance with vm_state building and task_state spawning.
Nov 08 12:35:36 user nova-compute[74840]: INFO nova.compute.manager [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Took 6.51 seconds to spawn the instance on the hypervisor.
Nov 08 12:35:36 user nova-compute[74840]: DEBUG nova.compute.manager [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:35:36 user nova-compute[74840]: INFO nova.compute.manager [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Took 7.43 seconds to build instance.
Nov 08 12:35:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-78814a11-0bdb-4f45-af3f-8596d570a9fe tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "0cecc731-6f86-475c-8603-591de8e30412" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.594s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:35:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:35:38 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:35:38 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-70dd7d8e-da32-4d1c-a9ae-6c012ac351ed tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a2c4fc63-0757-46da-ad00-7b6c6513deca is timed out.
Nov 08 12:35:38 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-70dd7d8e-da32-4d1c-a9ae-6c012ac351ed tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Successfully detached device vdb from instance a2c4fc63-0757-46da-ad00-7b6c6513deca from the live domain config.
Nov 08 12:35:38 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70dd7d8e-da32-4d1c-a9ae-6c012ac351ed tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 12:35:38 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-70dd7d8e-da32-4d1c-a9ae-6c012ac351ed tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JjnGargI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:35:38 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-70dd7d8e-da32-4d1c-a9ae-6c012ac351ed tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:35:38 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-70dd7d8e-da32-4d1c-a9ae-6c012ac351ed tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:35:38 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-70dd7d8e-da32-4d1c-a9ae-6c012ac351ed tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:35:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:35:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:35:38 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ed6dbd-8e1d-41ef-bb66-7efbf07fb14d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:35:38 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-70dd7d8e-da32-4d1c-a9ae-6c012ac351ed tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 12:35:38 user nova-compute[74840]: No targets found.
Nov 08 12:35:38 user nova-compute[74840]: iSNS:
Nov 08 12:35:38 user nova-compute[74840]: No targets found.
Nov 08 12:35:38 user nova-compute[74840]: STATIC:
Nov 08 12:35:38 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2
Nov 08 12:35:38 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:35:38 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:35:38 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616
Nov 08 12:35:38 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:35:38 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:35:38 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c
Nov 08 12:35:38 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:35:38 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:35:38 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4
Nov 08 12:35:38 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:35:38 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:35:38 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b
Nov 08 12:35:38 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:35:38 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:35:38 user nova-compute[74840]: FIRMWARE:
Nov 08 12:35:38 user nova-compute[74840]: No targets found.
Nov 08 12:35:38 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:35:38 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-70dd7d8e-da32-4d1c-a9ae-6c012ac351ed tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 12:35:38 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 12:35:38 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 12:35:38 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-70dd7d8e-da32-4d1c-a9ae-6c012ac351ed tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 12:35:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:35:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:35:38 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b5c5fb-8814-4003-81fa-00231cfeeac4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:35:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:35:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:35:38 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b8ffe7-d0c5-4cf8-a40f-c0960057d0fa]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:35:38 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-70dd7d8e-da32-4d1c-a9ae-6c012ac351ed tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:35:38 user nova-compute[74840]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)
Nov 08 12:35:38 user nova-compute[74840]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 (non-flash)
Nov 08 12:35:38 user nova-compute[74840]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)
Nov 08 12:35:38 user nova-compute[74840]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 (non-flash)
Nov 08 12:35:38 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:35:38 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-70dd7d8e-da32-4d1c-a9ae-6c012ac351ed tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:35:38 user nova-compute[74840]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)
Nov 08 12:35:38 user nova-compute[74840]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 (non-flash)
Nov 08 12:35:38 user nova-compute[74840]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)
Nov 08 12:35:38 user nova-compute[74840]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 (non-flash)
Nov 08 12:35:38 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:35:38 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-70dd7d8e-da32-4d1c-a9ae-6c012ac351ed tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7d4439630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2'): ({'sdd'}, set())}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 12:35:38 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-70dd7d8e-da32-4d1c-a9ae-6c012ac351ed tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Removing single pathed devices sdd {{(pid=74840) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 12:35:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:35:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:35:38 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5beeac-c0b6-471d-878d-bde87452a0f1]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:35:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:35:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:35:38 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[be07334c-c32b-48fe-aabb-c43687f4b2f0]: (4, ('ok\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:35:38 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-70dd7d8e-da32-4d1c-a9ae-6c012ac351ed tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Flushing IO for device /dev/sdd {{(pid=74840) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 12:35:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:35:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:35:39 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[83796fbc-9ba6-4464-a945-f7df5a03e074]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:35:39 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-70dd7d8e-da32-4d1c-a9ae-6c012ac351ed tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74840) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 12:35:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:35:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:35:39 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[428a91fd-cb0c-496c-981e-90b61b087670]: (4, ('1', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:35:39 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-70dd7d8e-da32-4d1c-a9ae-6c012ac351ed tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 12:35:39 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-70dd7d8e-da32-4d1c-a9ae-6c012ac351ed tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] SCSI volumes sdd have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 12:35:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-70dd7d8e-da32-4d1c-a9ae-6c012ac351ed tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2')] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 12:35:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:35:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:35:39 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[994d2f02-0a04-4c81-be3a-872e5a17639c]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:35:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-70dd7d8e-da32-4d1c-a9ae-6c012ac351ed tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:35:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 -p 172.16.0.220:3260 --logout {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:35:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:35:39 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7fc340b-dc5f-42db-9bd5-8de0a741ef5c]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:35:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-70dd7d8e-da32-4d1c-a9ae-6c012ac351ed tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2, portal: 172.16.0.220,3260]
Nov 08 12:35:39 user nova-compute[74840]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2, portal: 172.16.0.220,3260] successful.
Nov 08 12:35:39 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:35:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 -p 172.16.0.220:3260 --op delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:35:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cbf13b2-dd3d-45b7-b02d-45d78966d7f2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:35:39 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37ad366-ea9d-4c20-83a2-6998c0e69a2c]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:35:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-70dd7d8e-da32-4d1c-a9ae-6c012ac351ed tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:35:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-70dd7d8e-da32-4d1c-a9ae-6c012ac351ed tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:35:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-70dd7d8e-da32-4d1c-a9ae-6c012ac351ed tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] <== disconnect_volume: return (329ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:35:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70dd7d8e-da32-4d1c-a9ae-6c012ac351ed tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 12:35:40 user nova-compute[74840]: DEBUG nova.objects.instance [None req-70dd7d8e-da32-4d1c-a9ae-6c012ac351ed tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lazy-loading 'flavor' on Instance uuid a2c4fc63-0757-46da-ad00-7b6c6513deca {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:35:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-70dd7d8e-da32-4d1c-a9ae-6c012ac351ed tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "a2c4fc63-0757-46da-ad00-7b6c6513deca" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.940s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:35:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "a2c4fc63-0757-46da-ad00-7b6c6513deca" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 12.477s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:35:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "a2c4fc63-0757-46da-ad00-7b6c6513deca" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:35:43 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:35:48 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:35:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:35:53 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:35:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:35:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:36:02 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:36:02 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:36:02 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:36:02 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "refresh_cache-8b7c490e-4c78-4e07-bc8a-3be2328963d7" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:36:02 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquired lock "refresh_cache-8b7c490e-4c78-4e07-bc8a-3be2328963d7" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:36:02 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Forcefully refreshing network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 12:36:03 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Updating instance_info_cache with network_info: [{"id": "d9df071e-c4f0-4c80-9d63-3a41c849dca5", "address": "fa:16:3e:32:c4:9b", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9df071e-c4", "ovs_interfaceid": "d9df071e-c4f0-4c80-9d63-3a41c849dca5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:36:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Releasing lock "refresh_cache-8b7c490e-4c78-4e07-bc8a-3be2328963d7" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:36:03 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Updated the network info_cache for instance {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 12:36:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:36:03 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:36:04 user nova-compute[74840]: DEBUG nova.compute.manager [req-36323153-3eae-4167-bf06-2543238e2b1b req-174f94bf-7c94-4fbb-b107-64f7a54ebd17 service nova] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Received event network-changed-daa004c9-f48f-4997-8260-7e1f394c3a7c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:36:04 user nova-compute[74840]: DEBUG nova.compute.manager [req-36323153-3eae-4167-bf06-2543238e2b1b req-174f94bf-7c94-4fbb-b107-64f7a54ebd17 service nova] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Refreshing instance network info cache due to event network-changed-daa004c9-f48f-4997-8260-7e1f394c3a7c. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:36:04 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-36323153-3eae-4167-bf06-2543238e2b1b req-174f94bf-7c94-4fbb-b107-64f7a54ebd17 service nova] Acquiring lock "refresh_cache-550f8fed-4652-46fe-a440-974ee8f88196" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:36:04 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-36323153-3eae-4167-bf06-2543238e2b1b req-174f94bf-7c94-4fbb-b107-64f7a54ebd17 service nova] Acquired lock "refresh_cache-550f8fed-4652-46fe-a440-974ee8f88196" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:36:04 user nova-compute[74840]: DEBUG nova.network.neutron [req-36323153-3eae-4167-bf06-2543238e2b1b req-174f94bf-7c94-4fbb-b107-64f7a54ebd17 service nova] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Refreshing network info cache for port daa004c9-f48f-4997-8260-7e1f394c3a7c {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:36:05 user nova-compute[74840]: DEBUG nova.network.neutron [req-36323153-3eae-4167-bf06-2543238e2b1b req-174f94bf-7c94-4fbb-b107-64f7a54ebd17 service nova] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Updated VIF entry in instance network info cache for port daa004c9-f48f-4997-8260-7e1f394c3a7c. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:36:05 user nova-compute[74840]: DEBUG nova.network.neutron [req-36323153-3eae-4167-bf06-2543238e2b1b req-174f94bf-7c94-4fbb-b107-64f7a54ebd17 service nova] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Updating instance_info_cache with network_info: [{"id": "daa004c9-f48f-4997-8260-7e1f394c3a7c", "address": "fa:16:3e:e1:a6:9b", "network": {"id": "5d8710f7-82f1-4670-b564-9ef14312dc8e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1266284233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa486cd37a9c498ba6f800d2dbd415ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaa004c9-f4", "ovs_interfaceid": "daa004c9-f48f-4997-8260-7e1f394c3a7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:36:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-36323153-3eae-4167-bf06-2543238e2b1b req-174f94bf-7c94-4fbb-b107-64f7a54ebd17 service nova] Releasing lock "refresh_cache-550f8fed-4652-46fe-a440-974ee8f88196" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:36:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Acquiring lock "550f8fed-4652-46fe-a440-974ee8f88196" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:36:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Lock "550f8fed-4652-46fe-a440-974ee8f88196" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:36:05 user nova-compute[74840]: INFO nova.compute.manager [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Shelve offloading
Nov 08 12:36:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:36:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:36:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:36:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:36:06 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Instance destroyed successfully.
Nov 08 12:36:06 user nova-compute[74840]: DEBUG nova.compute.manager [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:36:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Acquiring lock "refresh_cache-550f8fed-4652-46fe-a440-974ee8f88196" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:36:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Acquired lock "refresh_cache-550f8fed-4652-46fe-a440-974ee8f88196" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:36:06 user nova-compute[74840]: DEBUG nova.network.neutron [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:36:06 user nova-compute[74840]: DEBUG nova.network.neutron [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Updating instance_info_cache with network_info: [{"id": "daa004c9-f48f-4997-8260-7e1f394c3a7c", "address": "fa:16:3e:e1:a6:9b", "network": {"id": "5d8710f7-82f1-4670-b564-9ef14312dc8e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1266284233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa486cd37a9c498ba6f800d2dbd415ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaa004c9-f4", "ovs_interfaceid": "daa004c9-f48f-4997-8260-7e1f394c3a7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:36:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Releasing lock "refresh_cache-550f8fed-4652-46fe-a440-974ee8f88196" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:36:06 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:36:06 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:36:06 user nova-compute[74840]: DEBUG nova.compute.manager [req-b21573d9-6a34-4d99-aa6e-bb39a0ae95c5 req-2c280761-ac8c-42bf-9a3e-c7156ffa85cd service nova] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Received event network-vif-unplugged-daa004c9-f48f-4997-8260-7e1f394c3a7c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:36:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-b21573d9-6a34-4d99-aa6e-bb39a0ae95c5 req-2c280761-ac8c-42bf-9a3e-c7156ffa85cd service nova] Acquiring lock "550f8fed-4652-46fe-a440-974ee8f88196-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:36:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-b21573d9-6a34-4d99-aa6e-bb39a0ae95c5 req-2c280761-ac8c-42bf-9a3e-c7156ffa85cd service nova] Lock "550f8fed-4652-46fe-a440-974ee8f88196-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:36:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-b21573d9-6a34-4d99-aa6e-bb39a0ae95c5 req-2c280761-ac8c-42bf-9a3e-c7156ffa85cd service nova] Lock "550f8fed-4652-46fe-a440-974ee8f88196-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:36:06 user nova-compute[74840]: DEBUG nova.compute.manager [req-b21573d9-6a34-4d99-aa6e-bb39a0ae95c5 req-2c280761-ac8c-42bf-9a3e-c7156ffa85cd service nova] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] No waiting events found dispatching network-vif-unplugged-daa004c9-f48f-4997-8260-7e1f394c3a7c {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:36:06 user nova-compute[74840]: WARNING nova.compute.manager [req-b21573d9-6a34-4d99-aa6e-bb39a0ae95c5 req-2c280761-ac8c-42bf-9a3e-c7156ffa85cd service nova] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Received unexpected event network-vif-unplugged-daa004c9-f48f-4997-8260-7e1f394c3a7c for instance with vm_state active and task_state shelving.
Nov 08 12:36:06 user nova-compute[74840]: DEBUG nova.compute.manager [req-b21573d9-6a34-4d99-aa6e-bb39a0ae95c5 req-2c280761-ac8c-42bf-9a3e-c7156ffa85cd service nova] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Received event network-vif-plugged-daa004c9-f48f-4997-8260-7e1f394c3a7c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:36:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-b21573d9-6a34-4d99-aa6e-bb39a0ae95c5 req-2c280761-ac8c-42bf-9a3e-c7156ffa85cd service nova] Acquiring lock "550f8fed-4652-46fe-a440-974ee8f88196-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:36:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-b21573d9-6a34-4d99-aa6e-bb39a0ae95c5 req-2c280761-ac8c-42bf-9a3e-c7156ffa85cd service nova] Lock "550f8fed-4652-46fe-a440-974ee8f88196-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:36:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-b21573d9-6a34-4d99-aa6e-bb39a0ae95c5 req-2c280761-ac8c-42bf-9a3e-c7156ffa85cd service nova] Lock "550f8fed-4652-46fe-a440-974ee8f88196-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:36:06 user nova-compute[74840]: DEBUG nova.compute.manager [req-b21573d9-6a34-4d99-aa6e-bb39a0ae95c5 req-2c280761-ac8c-42bf-9a3e-c7156ffa85cd service nova] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] No waiting events found dispatching network-vif-plugged-daa004c9-f48f-4997-8260-7e1f394c3a7c {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:36:06 user nova-compute[74840]: WARNING nova.compute.manager [req-b21573d9-6a34-4d99-aa6e-bb39a0ae95c5 req-2c280761-ac8c-42bf-9a3e-c7156ffa85cd service nova] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Received unexpected event network-vif-plugged-daa004c9-f48f-4997-8260-7e1f394c3a7c for instance with vm_state active and task_state shelving.
Nov 08 12:36:07 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Instance destroyed successfully.
Nov 08 12:36:07 user nova-compute[74840]: DEBUG nova.objects.instance [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Lazy-loading 'resources' on Instance uuid 550f8fed-4652-46fe-a440-974ee8f88196 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:33:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1581355820',display_name='tempest-TestShelveInstance-server-1581355820',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1581355820',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMa4hvb8cWjBz4jMMa+/lZwnWtFqszzwskJtEIpqap//CbH421Hhd++cesn8avpj6IUxUQoy6rfFajaUge6h3UgyQ7k3b8nofngq0aAHrZpvXyuczTPqMuSft/WEq95F1g==',key_name='tempest-TestShelveInstance-850605026',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:34:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fa486cd37a9c498ba6f800d2dbd415ab',ramdisk_id='',reservation_id='r-o5fknux2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1716375711',owner_user_name='tempest-TestShelveInstance-1716375711-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:34:21Z,user_data=None,user_id='ff68af4357024f75888b6f8bd6ada9e5',uuid=550f8fed-4652-46fe-a440-974ee8f88196,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "daa004c9-f48f-4997-8260-7e1f394c3a7c", "address": "fa:16:3e:e1:a6:9b", "network": {"id": "5d8710f7-82f1-4670-b564-9ef14312dc8e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1266284233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa486cd37a9c498ba6f800d2dbd415ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaa004c9-f4", "ovs_interfaceid": "daa004c9-f48f-4997-8260-7e1f394c3a7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Converting VIF {"id": "daa004c9-f48f-4997-8260-7e1f394c3a7c", "address": "fa:16:3e:e1:a6:9b", "network": {"id": "5d8710f7-82f1-4670-b564-9ef14312dc8e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1266284233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa486cd37a9c498ba6f800d2dbd415ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaa004c9-f4", "ovs_interfaceid": "daa004c9-f48f-4997-8260-7e1f394c3a7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:a6:9b,bridge_name='br-int',has_traffic_filtering=True,id=daa004c9-f48f-4997-8260-7e1f394c3a7c,network=Network(5d8710f7-82f1-4670-b564-9ef14312dc8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaa004c9-f4') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG os_vif [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:a6:9b,bridge_name='br-int',has_traffic_filtering=True,id=daa004c9-f48f-4997-8260-7e1f394c3a7c,network=Network(5d8710f7-82f1-4670-b564-9ef14312dc8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaa004c9-f4') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdaa004c9-f4, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=23eb3e03-e5c0-4dd3-ac0f-0566d65e8b1f) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:36:07 user nova-compute[74840]: INFO os_vif [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:a6:9b,bridge_name='br-int',has_traffic_filtering=True,id=daa004c9-f48f-4997-8260-7e1f394c3a7c,network=Network(5d8710f7-82f1-4670-b564-9ef14312dc8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaa004c9-f4')
Nov 08 12:36:07 user nova-compute[74840]: DEBUG nova.compute.manager [req-ca63d57b-0553-4547-8050-67a7ec6c13e2 req-c020f9cd-3082-48fa-aa7c-62e1524c789b service nova] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Received event network-changed-daa004c9-f48f-4997-8260-7e1f394c3a7c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG nova.compute.manager [req-ca63d57b-0553-4547-8050-67a7ec6c13e2 req-c020f9cd-3082-48fa-aa7c-62e1524c789b service nova] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Refreshing instance network info cache due to event network-changed-daa004c9-f48f-4997-8260-7e1f394c3a7c. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-ca63d57b-0553-4547-8050-67a7ec6c13e2 req-c020f9cd-3082-48fa-aa7c-62e1524c789b service nova] Acquiring lock "refresh_cache-550f8fed-4652-46fe-a440-974ee8f88196" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-ca63d57b-0553-4547-8050-67a7ec6c13e2 req-c020f9cd-3082-48fa-aa7c-62e1524c789b service nova] Acquired lock "refresh_cache-550f8fed-4652-46fe-a440-974ee8f88196" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG nova.network.neutron [req-ca63d57b-0553-4547-8050-67a7ec6c13e2 req-c020f9cd-3082-48fa-aa7c-62e1524c789b service nova] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Refreshing network info cache for port daa004c9-f48f-4997-8260-7e1f394c3a7c {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'txbpOwNW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:36:07 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:36:07 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd1e568-a0cc-400a-a39f-4f2964ecb615]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 12:36:07 user nova-compute[74840]: No targets found.
Nov 08 12:36:07 user nova-compute[74840]: iSNS:
Nov 08 12:36:07 user nova-compute[74840]: No targets found.
Nov 08 12:36:07 user nova-compute[74840]: STATIC:
Nov 08 12:36:07 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616
Nov 08 12:36:07 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:36:07 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:36:07 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c
Nov 08 12:36:07 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:36:07 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:36:07 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4
Nov 08 12:36:07 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:36:07 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:36:07 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b
Nov 08 12:36:07 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:36:07 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:36:07 user nova-compute[74840]: FIRMWARE:
Nov 08 12:36:07 user nova-compute[74840]: No targets found.
Nov 08 12:36:07 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 12:36:07 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 12:36:07 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2cd04cb-d6a6-4b16-9229-1d29b87d7251]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[093384cb-7867-48d8-a116-211fdb7e371c]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:36:07 user nova-compute[74840]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)
Nov 08 12:36:07 user nova-compute[74840]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)
Nov 08 12:36:07 user nova-compute[74840]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 (non-flash)
Nov 08 12:36:07 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:36:07 user nova-compute[74840]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)
Nov 08 12:36:07 user nova-compute[74840]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)
Nov 08 12:36:07 user nova-compute[74840]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 (non-flash)
Nov 08 12:36:07 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7d462f640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616'): ({'sdi'}, set())}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Removing single pathed devices sdi {{(pid=74840) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4a5660-6394-4897-8969-f24afc86db7e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ad75c6-f4d9-452b-b106-e9823e35f5dd]: (4, ('ok\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Flushing IO for device /dev/sdi {{(pid=74840) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2632167-302f-4b48-9884-18afef586941]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74840) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.057s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d588c7-33cc-449d-9745-820c07033217]: (4, ('1', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] SCSI volumes sdi have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616')] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.036s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40d9b75-86e9-417f-a3e2-0a01199da84b]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 -p 172.16.0.220:3260 --logout {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05af221-dc63-4e17-bd8e-2f265b5f744b]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616, portal: 172.16.0.220,3260]
Nov 08 12:36:07 user nova-compute[74840]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616, portal: 172.16.0.220,3260] successful.
Nov 08 12:36:07 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 -p 172.16.0.220:3260 --op delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fca7ca4-e81d-4277-af55-0f56233c4969]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] <== disconnect_volume: return (330ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 12:36:07 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Deleting instance files /opt/stack/data/nova/instances/550f8fed-4652-46fe-a440-974ee8f88196_del
Nov 08 12:36:07 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Deletion of /opt/stack/data/nova/instances/550f8fed-4652-46fe-a440-974ee8f88196_del complete
Nov 08 12:36:07 user nova-compute[74840]: DEBUG nova.network.neutron [req-ca63d57b-0553-4547-8050-67a7ec6c13e2 req-c020f9cd-3082-48fa-aa7c-62e1524c789b service nova] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Updated VIF entry in instance network info cache for port daa004c9-f48f-4997-8260-7e1f394c3a7c. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG nova.network.neutron [req-ca63d57b-0553-4547-8050-67a7ec6c13e2 req-c020f9cd-3082-48fa-aa7c-62e1524c789b service nova] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Updating instance_info_cache with network_info: [{"id": "daa004c9-f48f-4997-8260-7e1f394c3a7c", "address": "fa:16:3e:e1:a6:9b", "network": {"id": "5d8710f7-82f1-4670-b564-9ef14312dc8e", "bridge": null, "label": "tempest-TestShelveInstance-1266284233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa486cd37a9c498ba6f800d2dbd415ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapdaa004c9-f4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-ca63d57b-0553-4547-8050-67a7ec6c13e2 req-c020f9cd-3082-48fa-aa7c-62e1524c789b service nova] Releasing lock "refresh_cache-550f8fed-4652-46fe-a440-974ee8f88196" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:36:07 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:36:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e718225a-8db5-4a75-9d28-3d2da6c00ecd tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Acquiring lock "a2c4fc63-0757-46da-ad00-7b6c6513deca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:36:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e718225a-8db5-4a75-9d28-3d2da6c00ecd tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "a2c4fc63-0757-46da-ad00-7b6c6513deca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:36:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e718225a-8db5-4a75-9d28-3d2da6c00ecd tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Acquiring lock "a2c4fc63-0757-46da-ad00-7b6c6513deca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:36:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e718225a-8db5-4a75-9d28-3d2da6c00ecd tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "a2c4fc63-0757-46da-ad00-7b6c6513deca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:36:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e718225a-8db5-4a75-9d28-3d2da6c00ecd tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "a2c4fc63-0757-46da-ad00-7b6c6513deca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:36:08 user nova-compute[74840]: INFO nova.compute.manager [None req-e718225a-8db5-4a75-9d28-3d2da6c00ecd tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Terminating instance
Nov 08 12:36:08 user nova-compute[74840]: DEBUG nova.compute.manager [None req-e718225a-8db5-4a75-9d28-3d2da6c00ecd tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Start destroying the instance on the hypervisor. {{(pid=74840) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 12:36:08 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:36:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:36:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:36:08 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Deleted allocations for instance 550f8fed-4652-46fe-a440-974ee8f88196
Nov 08 12:36:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:36:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:36:08 user nova-compute[74840]: DEBUG nova.objects.instance [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Lazy-loading 'numa_topology' on Instance uuid 550f8fed-4652-46fe-a440-974ee8f88196 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:36:08 user nova-compute[74840]: DEBUG nova.objects.base [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Object Instance<550f8fed-4652-46fe-a440-974ee8f88196> lazy-loaded attributes: resources,numa_topology {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:36:08 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Refreshing inventories for resource provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 12:36:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:36:08 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Updating ProviderTree inventory for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 12:36:08 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Updating inventory in ProviderTree for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 12:36:08 user nova-compute[74840]: DEBUG nova.compute.manager [req-95ca778d-564f-4cdd-8467-1c7b7e6ae83c req-2b25738c-b124-48ea-98ce-c43f1f00286d service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Received event network-vif-unplugged-4d351123-6297-4be2-808d-50cdbe9e3aa6 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:36:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-95ca778d-564f-4cdd-8467-1c7b7e6ae83c req-2b25738c-b124-48ea-98ce-c43f1f00286d service nova] Acquiring lock "a2c4fc63-0757-46da-ad00-7b6c6513deca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:36:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-95ca778d-564f-4cdd-8467-1c7b7e6ae83c req-2b25738c-b124-48ea-98ce-c43f1f00286d service nova] Lock "a2c4fc63-0757-46da-ad00-7b6c6513deca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:36:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-95ca778d-564f-4cdd-8467-1c7b7e6ae83c req-2b25738c-b124-48ea-98ce-c43f1f00286d service nova] Lock "a2c4fc63-0757-46da-ad00-7b6c6513deca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:36:08 user nova-compute[74840]: DEBUG nova.compute.manager [req-95ca778d-564f-4cdd-8467-1c7b7e6ae83c req-2b25738c-b124-48ea-98ce-c43f1f00286d service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] No waiting events found dispatching network-vif-unplugged-4d351123-6297-4be2-808d-50cdbe9e3aa6 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:36:08 user nova-compute[74840]: DEBUG nova.compute.manager [req-95ca778d-564f-4cdd-8467-1c7b7e6ae83c req-2b25738c-b124-48ea-98ce-c43f1f00286d service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Received event network-vif-unplugged-4d351123-6297-4be2-808d-50cdbe9e3aa6 for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:36:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:36:08 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Refreshing aggregate associations for resource provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e, aggregates: None {{(pid=74840) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 12:36:09 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Refreshing trait associations for resource provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=74840) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 12:36:09 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:36:09 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:36:09 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Instance destroyed successfully.
Nov 08 12:36:09 user nova-compute[74840]: DEBUG nova.objects.instance [None req-e718225a-8db5-4a75-9d28-3d2da6c00ecd tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lazy-loading 'resources' on Instance uuid a2c4fc63-0757-46da-ad00-7b6c6513deca {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:36:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.532s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:36:09 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-e718225a-8db5-4a75-9d28-3d2da6c00ecd tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:29:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1244088697',display_name='tempest-ServerRescueNegativeTestJSON-server-1244088697',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1244088697',id=36,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvyvuealSmv8oj2TiSPbJYSMimajIZY4FNDaO08P7UQK09BPjIy4vh1eS/+h4sgiVjixuStEYbu1g4HgvRzMry2Yy5U2GAE5k/tYdAAzmPsftIe0+/T6DAUds34r9j79A==',key_name='tempest-keypair-625852250',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:31:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='457d61e0588847528ef3dd42a6146599',ramdisk_id='',reservation_id='r-4gm9nthr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1814868989',owner_user_name='tempest-ServerRescueNegativeTestJSON-1814868989-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:33:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6d4a3286c7d64d59b8ce2e4456db9cc2',uuid=a2c4fc63-0757-46da-ad00-7b6c6513deca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d351123-6297-4be2-808d-50cdbe9e3aa6", "address": "fa:16:3e:4e:0c:f0", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d351123-62", "ovs_interfaceid": "4d351123-6297-4be2-808d-50cdbe9e3aa6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:36:09 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-e718225a-8db5-4a75-9d28-3d2da6c00ecd tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Converting VIF {"id": "4d351123-6297-4be2-808d-50cdbe9e3aa6", "address": "fa:16:3e:4e:0c:f0", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d351123-62", "ovs_interfaceid": "4d351123-6297-4be2-808d-50cdbe9e3aa6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:36:09 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-e718225a-8db5-4a75-9d28-3d2da6c00ecd tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:0c:f0,bridge_name='br-int',has_traffic_filtering=True,id=4d351123-6297-4be2-808d-50cdbe9e3aa6,network=Network(5ee2626f-3d55-44da-a731-761059adfa85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d351123-62') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:36:09 user nova-compute[74840]: DEBUG os_vif [None req-e718225a-8db5-4a75-9d28-3d2da6c00ecd tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:0c:f0,bridge_name='br-int',has_traffic_filtering=True,id=4d351123-6297-4be2-808d-50cdbe9e3aa6,network=Network(5ee2626f-3d55-44da-a731-761059adfa85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d351123-62') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:36:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:36:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d351123-62, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:36:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:36:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:36:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:36:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=414646d1-7b89-45f9-b561-70c0ae3df655) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:36:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:36:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:36:09 user nova-compute[74840]: INFO os_vif [None req-e718225a-8db5-4a75-9d28-3d2da6c00ecd tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:0c:f0,bridge_name='br-int',has_traffic_filtering=True,id=4d351123-6297-4be2-808d-50cdbe9e3aa6,network=Network(5ee2626f-3d55-44da-a731-761059adfa85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d351123-62')
Nov 08 12:36:09 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-e718225a-8db5-4a75-9d28-3d2da6c00ecd tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Deleting instance files /opt/stack/data/nova/instances/a2c4fc63-0757-46da-ad00-7b6c6513deca_del
Nov 08 12:36:09 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-e718225a-8db5-4a75-9d28-3d2da6c00ecd tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Deletion of /opt/stack/data/nova/instances/a2c4fc63-0757-46da-ad00-7b6c6513deca_del complete
Nov 08 12:36:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-3164b5d5-124d-4265-bdde-06cb2135d923 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Lock "550f8fed-4652-46fe-a440-974ee8f88196" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.080s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:36:09 user nova-compute[74840]: INFO nova.compute.manager [None req-e718225a-8db5-4a75-9d28-3d2da6c00ecd tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 08 12:36:09 user nova-compute[74840]: DEBUG oslo.service.loopingcall [None req-e718225a-8db5-4a75-9d28-3d2da6c00ecd tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74840) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 12:36:09 user nova-compute[74840]: DEBUG nova.compute.manager [-] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Deallocating network for instance {{(pid=74840) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 12:36:09 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] deallocate_for_instance() {{(pid=74840) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 12:36:10 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:36:10 user nova-compute[74840]: INFO nova.compute.manager [-] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Took 0.79 seconds to deallocate network for instance.
Nov 08 12:36:10 user nova-compute[74840]: DEBUG nova.compute.manager [req-f2cf0a71-7884-4458-abc4-98fe5ee01edf req-200b2dfb-ecfe-457f-8e2f-0888d28643af service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Received event network-vif-deleted-4d351123-6297-4be2-808d-50cdbe9e3aa6 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:36:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e718225a-8db5-4a75-9d28-3d2da6c00ecd tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:36:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e718225a-8db5-4a75-9d28-3d2da6c00ecd tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:36:10 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-e718225a-8db5-4a75-9d28-3d2da6c00ecd tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:36:10 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-e718225a-8db5-4a75-9d28-3d2da6c00ecd tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:36:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e718225a-8db5-4a75-9d28-3d2da6c00ecd tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.360s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:36:10 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-e718225a-8db5-4a75-9d28-3d2da6c00ecd tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Deleted allocations for instance a2c4fc63-0757-46da-ad00-7b6c6513deca
Nov 08 12:36:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e718225a-8db5-4a75-9d28-3d2da6c00ecd tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "a2c4fc63-0757-46da-ad00-7b6c6513deca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.230s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:36:11 user nova-compute[74840]: DEBUG nova.compute.manager [req-d3e968c9-56b2-46ba-aba5-34340f863434 req-c8fb4ab9-1c38-4f9d-81ca-ad967a3174a6 service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Received event network-vif-plugged-4d351123-6297-4be2-808d-50cdbe9e3aa6 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:36:11 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-d3e968c9-56b2-46ba-aba5-34340f863434 req-c8fb4ab9-1c38-4f9d-81ca-ad967a3174a6 service nova] Acquiring lock "a2c4fc63-0757-46da-ad00-7b6c6513deca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:36:11 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-d3e968c9-56b2-46ba-aba5-34340f863434 req-c8fb4ab9-1c38-4f9d-81ca-ad967a3174a6 service nova] Lock "a2c4fc63-0757-46da-ad00-7b6c6513deca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:36:11 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-d3e968c9-56b2-46ba-aba5-34340f863434 req-c8fb4ab9-1c38-4f9d-81ca-ad967a3174a6 service nova] Lock "a2c4fc63-0757-46da-ad00-7b6c6513deca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:36:11 user nova-compute[74840]: DEBUG nova.compute.manager [req-d3e968c9-56b2-46ba-aba5-34340f863434 req-c8fb4ab9-1c38-4f9d-81ca-ad967a3174a6 service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] No waiting events found dispatching network-vif-plugged-4d351123-6297-4be2-808d-50cdbe9e3aa6 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:36:11 user nova-compute[74840]: WARNING nova.compute.manager [req-d3e968c9-56b2-46ba-aba5-34340f863434 req-c8fb4ab9-1c38-4f9d-81ca-ad967a3174a6 service nova] [instance: a2c4fc63-0757-46da-ad00-7b6c6513deca] Received unexpected event network-vif-plugged-4d351123-6297-4be2-808d-50cdbe9e3aa6 for instance with vm_state deleted and task_state None.
Nov 08 12:36:11 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:36:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:36:14 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:36:14 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:36:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:36:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:36:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:36:14 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:36:14 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:36:14 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:36:14 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a482219-16ac-49e2-84ad-7e2030c97184/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:36:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a482219-16ac-49e2-84ad-7e2030c97184/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:36:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a482219-16ac-49e2-84ad-7e2030c97184/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:36:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a482219-16ac-49e2-84ad-7e2030c97184/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:36:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:36:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:36:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:36:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:36:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:36:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:36:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:36:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:36:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:36:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:36:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:36:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fd4eb2b0-cd24-465c-8bc8-b3879cad2fe9 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquiring lock "b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:36:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fd4eb2b0-cd24-465c-8bc8-b3879cad2fe9 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:36:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fd4eb2b0-cd24-465c-8bc8-b3879cad2fe9 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquiring lock "b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:36:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fd4eb2b0-cd24-465c-8bc8-b3879cad2fe9 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:36:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fd4eb2b0-cd24-465c-8bc8-b3879cad2fe9 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:36:16 user nova-compute[74840]: INFO nova.compute.manager [None req-fd4eb2b0-cd24-465c-8bc8-b3879cad2fe9 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Terminating instance
Nov 08 12:36:16 user nova-compute[74840]: DEBUG nova.compute.manager [None req-fd4eb2b0-cd24-465c-8bc8-b3879cad2fe9 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Start destroying the instance on the hypervisor. {{(pid=74840) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 12:36:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:36:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:36:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:36:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:36:16 user nova-compute[74840]: DEBUG nova.compute.manager [req-2919103d-df33-4c18-bda4-111cedcee17d req-33d097e0-6025-49c9-b7e2-26cc629221c8 service nova] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Received event network-vif-unplugged-8fd26752-a3a0-4b97-a43f-73454925abea {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:36:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2919103d-df33-4c18-bda4-111cedcee17d req-33d097e0-6025-49c9-b7e2-26cc629221c8 service nova] Acquiring lock "b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:36:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2919103d-df33-4c18-bda4-111cedcee17d req-33d097e0-6025-49c9-b7e2-26cc629221c8 service nova] Lock "b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:36:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2919103d-df33-4c18-bda4-111cedcee17d req-33d097e0-6025-49c9-b7e2-26cc629221c8 service nova] Lock "b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:36:16 user nova-compute[74840]: DEBUG nova.compute.manager [req-2919103d-df33-4c18-bda4-111cedcee17d req-33d097e0-6025-49c9-b7e2-26cc629221c8 service nova] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] No waiting events found dispatching network-vif-unplugged-8fd26752-a3a0-4b97-a43f-73454925abea {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:36:16 user nova-compute[74840]: DEBUG nova.compute.manager [req-2919103d-df33-4c18-bda4-111cedcee17d req-33d097e0-6025-49c9-b7e2-26cc629221c8 service nova] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Received event network-vif-unplugged-8fd26752-a3a0-4b97-a43f-73454925abea for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:36:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:36:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:36:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:36:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:36:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:36:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cecc731-6f86-475c-8603-591de8e30412/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:36:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cecc731-6f86-475c-8603-591de8e30412/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cecc731-6f86-475c-8603-591de8e30412/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:36:17 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Instance destroyed successfully.
Nov 08 12:36:17 user nova-compute[74840]: DEBUG nova.objects.instance [None req-fd4eb2b0-cd24-465c-8bc8-b3879cad2fe9 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lazy-loading 'resources' on Instance uuid b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-fd4eb2b0-cd24-465c-8bc8-b3879cad2fe9 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:29:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-997398221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-997398221',id=37,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:32:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72c97c47ab144ef3a8d5e9ee1ecc059e',ramdisk_id='',reservation_id='r-oxi3426h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-297593405',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:34:30Z,user_data=None,user_id='275e3d340c9d4d9e90b579e4bc0bfe0b',uuid=b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8fd26752-a3a0-4b97-a43f-73454925abea", "address": "fa:16:3e:2a:e1:f9", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd26752-a3", "ovs_interfaceid": "8fd26752-a3a0-4b97-a43f-73454925abea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-fd4eb2b0-cd24-465c-8bc8-b3879cad2fe9 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Converting VIF {"id": "8fd26752-a3a0-4b97-a43f-73454925abea", "address": "fa:16:3e:2a:e1:f9", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd26752-a3", "ovs_interfaceid": "8fd26752-a3a0-4b97-a43f-73454925abea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-fd4eb2b0-cd24-465c-8bc8-b3879cad2fe9 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:e1:f9,bridge_name='br-int',has_traffic_filtering=True,id=8fd26752-a3a0-4b97-a43f-73454925abea,network=Network(8388eafb-b115-49c7-82cd-0d85d0ee12e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fd26752-a3') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG os_vif [None req-fd4eb2b0-cd24-465c-8bc8-b3879cad2fe9 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:e1:f9,bridge_name='br-int',has_traffic_filtering=True,id=8fd26752-a3a0-4b97-a43f-73454925abea,network=Network(8388eafb-b115-49c7-82cd-0d85d0ee12e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fd26752-a3') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8fd26752-a3, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d38171fa-d5f5-40b6-8fd8-63ef465885bb) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:36:17 user nova-compute[74840]: INFO os_vif [None req-fd4eb2b0-cd24-465c-8bc8-b3879cad2fe9 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:e1:f9,bridge_name='br-int',has_traffic_filtering=True,id=8fd26752-a3a0-4b97-a43f-73454925abea,network=Network(8388eafb-b115-49c7-82cd-0d85d0ee12e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fd26752-a3')
Nov 08 12:36:17 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd4eb2b0-cd24-465c-8bc8-b3879cad2fe9 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4eb2b0-cd24-465c-8bc8-b3879cad2fe9 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KvbyqZVG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:36:17 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-fd4eb2b0-cd24-465c-8bc8-b3879cad2fe9 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:36:17 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-fd4eb2b0-cd24-465c-8bc8-b3879cad2fe9 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-fd4eb2b0-cd24-465c-8bc8-b3879cad2fe9 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1463aeea-3dba-4616-b266-97fdde3f238a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4eb2b0-cd24-465c-8bc8-b3879cad2fe9 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 12:36:17 user nova-compute[74840]: No targets found.
Nov 08 12:36:17 user nova-compute[74840]: iSNS:
Nov 08 12:36:17 user nova-compute[74840]: No targets found.
Nov 08 12:36:17 user nova-compute[74840]: STATIC:
Nov 08 12:36:17 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c
Nov 08 12:36:17 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:36:17 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:36:17 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4
Nov 08 12:36:17 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:36:17 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:36:17 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b
Nov 08 12:36:17 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:36:17 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:36:17 user nova-compute[74840]: FIRMWARE:
Nov 08 12:36:17 user nova-compute[74840]: No targets found.
Nov 08 12:36:17 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4eb2b0-cd24-465c-8bc8-b3879cad2fe9 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 12:36:17 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 12:36:17 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4eb2b0-cd24-465c-8bc8-b3879cad2fe9 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[befd629b-5cfa-46cc-a048-5b31217dad58]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cecc731-6f86-475c-8603-591de8e30412/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab84d07c-68eb-4b98-b36c-312ea56f1119]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4eb2b0-cd24-465c-8bc8-b3879cad2fe9 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:36:17 user nova-compute[74840]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)
Nov 08 12:36:17 user nova-compute[74840]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)
Nov 08 12:36:17 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4eb2b0-cd24-465c-8bc8-b3879cad2fe9 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:36:17 user nova-compute[74840]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c (non-flash)
Nov 08 12:36:17 user nova-compute[74840]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)
Nov 08 12:36:17 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4eb2b0-cd24-465c-8bc8-b3879cad2fe9 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7f458e950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c'): ({'sdc'}, set())}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-fd4eb2b0-cd24-465c-8bc8-b3879cad2fe9 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Removing single pathed devices sdc {{(pid=74840) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[11349dda-21e9-45bd-885a-cc59091bf5a6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[49cca656-1ad5-4b77-b41a-640edaefaa72]: (4, ('ok\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-fd4eb2b0-cd24-465c-8bc8-b3879cad2fe9 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Flushing IO for device /dev/sdc {{(pid=74840) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc86237-da87-452b-82b0-d9f3e24d592a]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-fd4eb2b0-cd24-465c-8bc8-b3879cad2fe9 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74840) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.087s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb58dd4-60d4-40fe-ad42-f2a59c3823d3]: (4, ('1', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-fd4eb2b0-cd24-465c-8bc8-b3879cad2fe9 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-fd4eb2b0-cd24-465c-8bc8-b3879cad2fe9 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] SCSI volumes sdc have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4eb2b0-cd24-465c-8bc8-b3879cad2fe9 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c')] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d02cfe6-d744-469d-a885-bc5ec0249a92]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4eb2b0-cd24-465c-8bc8-b3879cad2fe9 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c -p 172.16.0.220:3260 --logout {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc47e4eb-1c13-49ee-aaa6-eb24a6e25a3f]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4eb2b0-cd24-465c-8bc8-b3879cad2fe9 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c, portal: 172.16.0.220,3260]
Nov 08 12:36:17 user nova-compute[74840]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c, portal: 172.16.0.220,3260] successful.
Nov 08 12:36:17 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c -p 172.16.0.220:3260 --op delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0cbeae2-f32d-4aaa-8283-b0c9749e9a4c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f677daff-fdec-4e4c-bcee-25e6ff6cfda7]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4eb2b0-cd24-465c-8bc8-b3879cad2fe9 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-fd4eb2b0-cd24-465c-8bc8-b3879cad2fe9 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.457s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd4eb2b0-cd24-465c-8bc8-b3879cad2fe9 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] <== disconnect_volume: return (460ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd4eb2b0-cd24-465c-8bc8-b3879cad2fe9 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 12:36:17 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-fd4eb2b0-cd24-465c-8bc8-b3879cad2fe9 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Deleting instance files /opt/stack/data/nova/instances/b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c_del
Nov 08 12:36:17 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-fd4eb2b0-cd24-465c-8bc8-b3879cad2fe9 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Deletion of /opt/stack/data/nova/instances/b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c_del complete
Nov 08 12:36:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:36:17 user nova-compute[74840]: INFO nova.compute.manager [None req-fd4eb2b0-cd24-465c-8bc8-b3879cad2fe9 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Took 1.40 seconds to destroy the instance on the hypervisor.
Nov 08 12:36:17 user nova-compute[74840]: DEBUG oslo.service.loopingcall [None req-fd4eb2b0-cd24-465c-8bc8-b3879cad2fe9 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74840) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG nova.compute.manager [-] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Deallocating network for instance {{(pid=74840) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] deallocate_for_instance() {{(pid=74840) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:36:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:36:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:36:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:36:18 user nova-compute[74840]: DEBUG nova.compute.manager [req-7c113076-1480-4613-ad90-9773efd4a9b0 req-c5ea862f-a8bb-44f7-b373-e72c066771f5 service nova] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Received event network-vif-deleted-8fd26752-a3a0-4b97-a43f-73454925abea {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:36:18 user nova-compute[74840]: INFO nova.compute.manager [req-7c113076-1480-4613-ad90-9773efd4a9b0 req-c5ea862f-a8bb-44f7-b373-e72c066771f5 service nova] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Neutron deleted interface 8fd26752-a3a0-4b97-a43f-73454925abea; detaching it from the instance and deleting it from the info cache
Nov 08 12:36:18 user nova-compute[74840]: DEBUG nova.network.neutron [req-7c113076-1480-4613-ad90-9773efd4a9b0 req-c5ea862f-a8bb-44f7-b373-e72c066771f5 service nova] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:36:18 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:36:18 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:36:18 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:36:18 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=7798MB free_disk=24.58731460571289GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:36:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:36:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:36:18 user nova-compute[74840]: INFO nova.compute.manager [-] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Took 0.79 seconds to deallocate network for instance.
Nov 08 12:36:18 user nova-compute[74840]: DEBUG nova.compute.manager [req-7c113076-1480-4613-ad90-9773efd4a9b0 req-c5ea862f-a8bb-44f7-b373-e72c066771f5 service nova] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Detach interface failed, port_id=8fd26752-a3a0-4b97-a43f-73454925abea, reason: Instance b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c could not be found. {{(pid=74840) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 12:36:18 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance d3e8efc6-7146-46ef-8433-380d7e69120c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:36:18 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance ffe50042-29bf-4ef3-a148-8698bc75233b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:36:18 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 8b7c490e-4c78-4e07-bc8a-3be2328963d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:36:18 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 832a6445-84ee-43a8-a5bc-a07670602912 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:36:18 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 10c42516-62ba-4aa9-bc5a-d94499bd6b65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:36:18 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 9991e7b4-aaf8-4485-b658-e1af634925de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:36:18 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:36:18 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 83da3dce-e270-4054-910d-c8ad28eb18da actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:36:18 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 7a482219-16ac-49e2-84ad-7e2030c97184 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:36:18 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 0cecc731-6f86-475c-8603-591de8e30412 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:36:18 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:36:18 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:36:18 user nova-compute[74840]: DEBUG nova.compute.manager [req-9b6dbf9c-85cd-44ec-92bd-e3ab1f0e0100 req-34d1189e-1478-4771-8942-01c8a6a4280e service nova] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Received event network-vif-plugged-8fd26752-a3a0-4b97-a43f-73454925abea {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:36:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9b6dbf9c-85cd-44ec-92bd-e3ab1f0e0100 req-34d1189e-1478-4771-8942-01c8a6a4280e service nova] Acquiring lock "b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:36:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9b6dbf9c-85cd-44ec-92bd-e3ab1f0e0100 req-34d1189e-1478-4771-8942-01c8a6a4280e service nova] Lock "b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:36:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9b6dbf9c-85cd-44ec-92bd-e3ab1f0e0100 req-34d1189e-1478-4771-8942-01c8a6a4280e service nova] Lock "b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:36:18 user nova-compute[74840]: DEBUG nova.compute.manager [req-9b6dbf9c-85cd-44ec-92bd-e3ab1f0e0100 req-34d1189e-1478-4771-8942-01c8a6a4280e service nova] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] No waiting events found dispatching network-vif-plugged-8fd26752-a3a0-4b97-a43f-73454925abea {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:36:18 user nova-compute[74840]: WARNING nova.compute.manager [req-9b6dbf9c-85cd-44ec-92bd-e3ab1f0e0100 req-34d1189e-1478-4771-8942-01c8a6a4280e service nova] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Received unexpected event network-vif-plugged-8fd26752-a3a0-4b97-a43f-73454925abea for instance with vm_state active and task_state deleting.
Nov 08 12:36:18 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:36:18 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:36:19 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:36:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.524s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:36:19 user nova-compute[74840]: INFO nova.compute.manager [None req-fd4eb2b0-cd24-465c-8bc8-b3879cad2fe9 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c] Took 0.98 seconds to detach 1 volumes for instance.
Nov 08 12:36:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fd4eb2b0-cd24-465c-8bc8-b3879cad2fe9 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:36:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fd4eb2b0-cd24-465c-8bc8-b3879cad2fe9 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:36:19 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-fd4eb2b0-cd24-465c-8bc8-b3879cad2fe9 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:36:19 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-fd4eb2b0-cd24-465c-8bc8-b3879cad2fe9 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:36:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fd4eb2b0-cd24-465c-8bc8-b3879cad2fe9 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.331s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:36:19 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-fd4eb2b0-cd24-465c-8bc8-b3879cad2fe9 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Deleted allocations for instance b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c
Nov 08 12:36:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fd4eb2b0-cd24-465c-8bc8-b3879cad2fe9 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "b1aea8a0-c0b3-42d8-bc50-dee7b4bb1a8c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.709s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:36:22 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:36:22 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:36:25 user nova-compute[74840]: DEBUG nova.compute.manager [req-700d7a83-fdff-4bcd-aaf5-0c4efb8a0374 req-80790f72-5c33-4031-8dff-856c41c78f13 service nova] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Received event network-changed-c2a4679c-207f-4dfa-9209-f1a4d7d70834 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:36:25 user nova-compute[74840]: DEBUG nova.compute.manager [req-700d7a83-fdff-4bcd-aaf5-0c4efb8a0374 req-80790f72-5c33-4031-8dff-856c41c78f13 service nova] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Refreshing instance network info cache due to event network-changed-c2a4679c-207f-4dfa-9209-f1a4d7d70834. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:36:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-700d7a83-fdff-4bcd-aaf5-0c4efb8a0374 req-80790f72-5c33-4031-8dff-856c41c78f13 service nova] Acquiring lock "refresh_cache-83da3dce-e270-4054-910d-c8ad28eb18da" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:36:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-700d7a83-fdff-4bcd-aaf5-0c4efb8a0374 req-80790f72-5c33-4031-8dff-856c41c78f13 service nova] Acquired lock "refresh_cache-83da3dce-e270-4054-910d-c8ad28eb18da" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:36:25 user nova-compute[74840]: DEBUG nova.network.neutron [req-700d7a83-fdff-4bcd-aaf5-0c4efb8a0374 req-80790f72-5c33-4031-8dff-856c41c78f13 service nova] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Refreshing network info cache for port c2a4679c-207f-4dfa-9209-f1a4d7d70834 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:36:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d5ced2b8-7068-4c11-96b6-8865114ee310 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "83da3dce-e270-4054-910d-c8ad28eb18da" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:36:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d5ced2b8-7068-4c11-96b6-8865114ee310 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "83da3dce-e270-4054-910d-c8ad28eb18da" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:36:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d5ced2b8-7068-4c11-96b6-8865114ee310 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "83da3dce-e270-4054-910d-c8ad28eb18da-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:36:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d5ced2b8-7068-4c11-96b6-8865114ee310 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "83da3dce-e270-4054-910d-c8ad28eb18da-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:36:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d5ced2b8-7068-4c11-96b6-8865114ee310 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "83da3dce-e270-4054-910d-c8ad28eb18da-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:36:25 user nova-compute[74840]: INFO nova.compute.manager [None req-d5ced2b8-7068-4c11-96b6-8865114ee310 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Terminating instance
Nov 08 12:36:25 user nova-compute[74840]: DEBUG nova.compute.manager [None req-d5ced2b8-7068-4c11-96b6-8865114ee310 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Start destroying the instance on the hypervisor. {{(pid=74840) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 12:36:25 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:36:25 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:36:25 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:36:25 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:36:25 user nova-compute[74840]: DEBUG nova.compute.manager [req-baf9183d-b8ca-4a06-8e66-3eca184c6bfe req-7e318d2c-12cf-498e-9957-9180ae8e6722 service nova] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Received event network-vif-unplugged-c2a4679c-207f-4dfa-9209-f1a4d7d70834 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:36:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-baf9183d-b8ca-4a06-8e66-3eca184c6bfe req-7e318d2c-12cf-498e-9957-9180ae8e6722 service nova] Acquiring lock "83da3dce-e270-4054-910d-c8ad28eb18da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:36:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-baf9183d-b8ca-4a06-8e66-3eca184c6bfe req-7e318d2c-12cf-498e-9957-9180ae8e6722 service nova] Lock "83da3dce-e270-4054-910d-c8ad28eb18da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:36:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-baf9183d-b8ca-4a06-8e66-3eca184c6bfe req-7e318d2c-12cf-498e-9957-9180ae8e6722 service nova] Lock "83da3dce-e270-4054-910d-c8ad28eb18da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:36:25 user nova-compute[74840]: DEBUG nova.compute.manager [req-baf9183d-b8ca-4a06-8e66-3eca184c6bfe req-7e318d2c-12cf-498e-9957-9180ae8e6722 service nova] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] No waiting events found dispatching network-vif-unplugged-c2a4679c-207f-4dfa-9209-f1a4d7d70834 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:36:25 user nova-compute[74840]: DEBUG nova.compute.manager [req-baf9183d-b8ca-4a06-8e66-3eca184c6bfe req-7e318d2c-12cf-498e-9957-9180ae8e6722 service nova] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Received event network-vif-unplugged-c2a4679c-207f-4dfa-9209-f1a4d7d70834 for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:36:25 user nova-compute[74840]: DEBUG nova.network.neutron [req-700d7a83-fdff-4bcd-aaf5-0c4efb8a0374 req-80790f72-5c33-4031-8dff-856c41c78f13 service nova] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Updated VIF entry in instance network info cache for port c2a4679c-207f-4dfa-9209-f1a4d7d70834. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:36:25 user nova-compute[74840]: DEBUG nova.network.neutron [req-700d7a83-fdff-4bcd-aaf5-0c4efb8a0374 req-80790f72-5c33-4031-8dff-856c41c78f13 service nova] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Updating instance_info_cache with network_info: [{"id": "c2a4679c-207f-4dfa-9209-f1a4d7d70834", "address": "fa:16:3e:4e:da:51", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a4679c-20", "ovs_interfaceid": "c2a4679c-207f-4dfa-9209-f1a4d7d70834", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:36:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-700d7a83-fdff-4bcd-aaf5-0c4efb8a0374 req-80790f72-5c33-4031-8dff-856c41c78f13 service nova] Releasing lock "refresh_cache-83da3dce-e270-4054-910d-c8ad28eb18da" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:36:25 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Instance destroyed successfully.
Nov 08 12:36:25 user nova-compute[74840]: DEBUG nova.objects.instance [None req-d5ced2b8-7068-4c11-96b6-8865114ee310 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lazy-loading 'resources' on Instance uuid 83da3dce-e270-4054-910d-c8ad28eb18da {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:36:25 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-d5ced2b8-7068-4c11-96b6-8865114ee310 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:31:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-52209854',display_name='tempest-TestVolumeBootPattern-server-52209854',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-52209854',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDnf/rgNeauxsdXCuQeVAa6oJl7IvXSpNN83Cdo1qtwT4P0g8IuWhFw/l+HOo44zetcJEHbPUEQ14N2qnoFV4I4QWYhF+y8Gsgf65CRdUjmUlU4hjQG+QvZzqapWj/SBg==',key_name='tempest-TestVolumeBootPattern-1773717711',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:31:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1250106b55ae44b0b303849df7781ffb',ramdisk_id='',reservation_id='r-to05psnh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-77780905',owner_user_name='tempest-TestVolumeBootPattern-77780905-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:31:39Z,user_data=None,user_id='794c0281e1bf48f79117efdc3907e661',uuid=83da3dce-e270-4054-910d-c8ad28eb18da,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2a4679c-207f-4dfa-9209-f1a4d7d70834", "address": "fa:16:3e:4e:da:51", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a4679c-20", "ovs_interfaceid": "c2a4679c-207f-4dfa-9209-f1a4d7d70834", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:36:25 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-d5ced2b8-7068-4c11-96b6-8865114ee310 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Converting VIF {"id": "c2a4679c-207f-4dfa-9209-f1a4d7d70834", "address": "fa:16:3e:4e:da:51", "network": {"id": "174da5e9-78cc-426f-87fb-1d3b23b8b459", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-729781512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1250106b55ae44b0b303849df7781ffb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2a4679c-20", "ovs_interfaceid": "c2a4679c-207f-4dfa-9209-f1a4d7d70834", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:36:25 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-d5ced2b8-7068-4c11-96b6-8865114ee310 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:da:51,bridge_name='br-int',has_traffic_filtering=True,id=c2a4679c-207f-4dfa-9209-f1a4d7d70834,network=Network(174da5e9-78cc-426f-87fb-1d3b23b8b459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2a4679c-20') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:36:25 user nova-compute[74840]: DEBUG os_vif [None req-d5ced2b8-7068-4c11-96b6-8865114ee310 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:da:51,bridge_name='br-int',has_traffic_filtering=True,id=c2a4679c-207f-4dfa-9209-f1a4d7d70834,network=Network(174da5e9-78cc-426f-87fb-1d3b23b8b459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2a4679c-20') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:36:25 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:36:25 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2a4679c-20, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:36:25 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:36:25 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:36:25 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:36:25 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c2b304be-771e-4fa3-8b2c-4741f288ca3c) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:36:25 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:36:25 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:36:25 user nova-compute[74840]: INFO os_vif [None req-d5ced2b8-7068-4c11-96b6-8865114ee310 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:da:51,bridge_name='br-int',has_traffic_filtering=True,id=c2a4679c-207f-4dfa-9209-f1a4d7d70834,network=Network(174da5e9-78cc-426f-87fb-1d3b23b8b459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2a4679c-20')
Nov 08 12:36:25 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5ced2b8-7068-4c11-96b6-8865114ee310 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 12:36:25 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ced2b8-7068-4c11-96b6-8865114ee310 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AXqwMDBP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:36:25 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-d5ced2b8-7068-4c11-96b6-8865114ee310 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:36:25 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-d5ced2b8-7068-4c11-96b6-8865114ee310 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:36:25 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-d5ced2b8-7068-4c11-96b6-8865114ee310 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:36:25 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:36:25 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:36:25 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f11798-c283-4beb-bbf9-3a818f9203a6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:36:25 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ced2b8-7068-4c11-96b6-8865114ee310 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 12:36:25 user nova-compute[74840]: No targets found.
Nov 08 12:36:25 user nova-compute[74840]: iSNS:
Nov 08 12:36:25 user nova-compute[74840]: No targets found.
Nov 08 12:36:25 user nova-compute[74840]: STATIC:
Nov 08 12:36:25 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4
Nov 08 12:36:25 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:36:25 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:36:25 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b
Nov 08 12:36:25 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:36:25 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:36:25 user nova-compute[74840]: FIRMWARE:
Nov 08 12:36:25 user nova-compute[74840]: No targets found.
Nov 08 12:36:25 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:36:25 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ced2b8-7068-4c11-96b6-8865114ee310 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 12:36:25 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 12:36:25 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 12:36:25 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ced2b8-7068-4c11-96b6-8865114ee310 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 12:36:25 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:36:25 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:36:25 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a18fe9-4b25-4014-8d48-1583d067bacb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:36:26 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:36:26 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:36:26 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64c3892-95de-49a5-a6da-ef1ec7135dd8]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:36:26 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ced2b8-7068-4c11-96b6-8865114ee310 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:36:26 user nova-compute[74840]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)
Nov 08 12:36:26 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:36:26 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ced2b8-7068-4c11-96b6-8865114ee310 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:36:26 user nova-compute[74840]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b (non-flash)
Nov 08 12:36:26 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:36:26 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ced2b8-7068-4c11-96b6-8865114ee310 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7f50260e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b'): ({'sde'}, set())}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 12:36:26 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-d5ced2b8-7068-4c11-96b6-8865114ee310 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Removing single pathed devices sde {{(pid=74840) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 12:36:26 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:36:26 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:36:26 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[390b4517-9527-4c0b-8283-2a0a4ce48751]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:36:26 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:36:26 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:36:26 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7b0ed9-0777-4d1f-af23-2c9818ad81a5]: (4, ('ok\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:36:26 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-d5ced2b8-7068-4c11-96b6-8865114ee310 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Flushing IO for device /dev/sde {{(pid=74840) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 12:36:26 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:36:26 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:36:26 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[630d652c-56a7-4a7d-b6fa-bff76f74cf27]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:36:26 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-d5ced2b8-7068-4c11-96b6-8865114ee310 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74840) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 12:36:26 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:36:26 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.032s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:36:26 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6a6ef1-7e31-4675-93a5-d32f8f3f2daf]: (4, ('1', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:36:26 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-d5ced2b8-7068-4c11-96b6-8865114ee310 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 12:36:26 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-d5ced2b8-7068-4c11-96b6-8865114ee310 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] SCSI volumes sde have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 12:36:26 user nova-compute[74840]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO3843d939-f9d3d7f79179371a', '/dev/disk/by-id/scsi-26639643364376637', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_3843d939') {{(pid=85688) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 12:36:26 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd702e88-e3a4-4ace-953e-c112e0f627bf]: (4, None) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:36:26 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ced2b8-7068-4c11-96b6-8865114ee310 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b')] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 12:36:26 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:36:26 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:36:26 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[26894c17-8365-44ab-8ffe-05f5387dd4da]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:36:26 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ced2b8-7068-4c11-96b6-8865114ee310 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:36:26 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b -p 172.16.0.220:3260 --logout {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:36:26 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:36:26 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[551e11a5-074e-4935-8c71-5b9171cd9c9e]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:36:26 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ced2b8-7068-4c11-96b6-8865114ee310 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b, portal: 172.16.0.220,3260]
Nov 08 12:36:26 user nova-compute[74840]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b, portal: 172.16.0.220,3260] successful.
Nov 08 12:36:26 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:36:26 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b -p 172.16.0.220:3260 --op delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:36:26 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3633e924-8440-44ef-8902-fdceb5a4787b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:36:26 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40e2d7c-d0f6-4bda-8e66-52694b758a03]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:36:26 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ced2b8-7068-4c11-96b6-8865114ee310 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:36:26 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-d5ced2b8-7068-4c11-96b6-8865114ee310 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:36:26 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5ced2b8-7068-4c11-96b6-8865114ee310 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] <== disconnect_volume: return (313ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:36:26 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5ced2b8-7068-4c11-96b6-8865114ee310 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 12:36:26 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-d5ced2b8-7068-4c11-96b6-8865114ee310 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Deleting instance files /opt/stack/data/nova/instances/83da3dce-e270-4054-910d-c8ad28eb18da_del
Nov 08 12:36:26 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-d5ced2b8-7068-4c11-96b6-8865114ee310 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Deletion of /opt/stack/data/nova/instances/83da3dce-e270-4054-910d-c8ad28eb18da_del complete
Nov 08 12:36:26 user nova-compute[74840]: INFO nova.compute.manager [None req-d5ced2b8-7068-4c11-96b6-8865114ee310 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 08 12:36:26 user nova-compute[74840]: DEBUG oslo.service.loopingcall [None req-d5ced2b8-7068-4c11-96b6-8865114ee310 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74840) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 12:36:26 user nova-compute[74840]: DEBUG nova.compute.manager [-] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Deallocating network for instance {{(pid=74840) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 12:36:26 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] deallocate_for_instance() {{(pid=74840) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 12:36:27 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:36:27 user nova-compute[74840]: INFO nova.compute.manager [-] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Took 0.72 seconds to deallocate network for instance.
Nov 08 12:36:27 user nova-compute[74840]: DEBUG nova.compute.manager [req-7c0182c9-4325-49c7-afb0-e30c245fb7a4 req-e3f8ca24-40ab-40cd-a12b-9f68a1e91553 service nova] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Received event network-vif-plugged-c2a4679c-207f-4dfa-9209-f1a4d7d70834 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:36:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-7c0182c9-4325-49c7-afb0-e30c245fb7a4 req-e3f8ca24-40ab-40cd-a12b-9f68a1e91553 service nova] Acquiring lock "83da3dce-e270-4054-910d-c8ad28eb18da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:36:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-7c0182c9-4325-49c7-afb0-e30c245fb7a4 req-e3f8ca24-40ab-40cd-a12b-9f68a1e91553 service nova] Lock "83da3dce-e270-4054-910d-c8ad28eb18da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:36:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-7c0182c9-4325-49c7-afb0-e30c245fb7a4 req-e3f8ca24-40ab-40cd-a12b-9f68a1e91553 service nova] Lock "83da3dce-e270-4054-910d-c8ad28eb18da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:36:27 user nova-compute[74840]: DEBUG nova.compute.manager [req-7c0182c9-4325-49c7-afb0-e30c245fb7a4 req-e3f8ca24-40ab-40cd-a12b-9f68a1e91553 service nova] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] No waiting events found dispatching network-vif-plugged-c2a4679c-207f-4dfa-9209-f1a4d7d70834 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:36:27 user nova-compute[74840]: WARNING nova.compute.manager [req-7c0182c9-4325-49c7-afb0-e30c245fb7a4 req-e3f8ca24-40ab-40cd-a12b-9f68a1e91553 service nova] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Received unexpected event network-vif-plugged-c2a4679c-207f-4dfa-9209-f1a4d7d70834 for instance with vm_state active and task_state deleting.
Nov 08 12:36:27 user nova-compute[74840]: DEBUG nova.compute.manager [req-7c0182c9-4325-49c7-afb0-e30c245fb7a4 req-e3f8ca24-40ab-40cd-a12b-9f68a1e91553 service nova] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Received event network-vif-deleted-c2a4679c-207f-4dfa-9209-f1a4d7d70834 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:36:27 user nova-compute[74840]: INFO nova.compute.manager [None req-d5ced2b8-7068-4c11-96b6-8865114ee310 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] [instance: 83da3dce-e270-4054-910d-c8ad28eb18da] Took 0.89 seconds to detach 1 volumes for instance.
Nov 08 12:36:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d5ced2b8-7068-4c11-96b6-8865114ee310 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:36:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d5ced2b8-7068-4c11-96b6-8865114ee310 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:36:28 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-d5ced2b8-7068-4c11-96b6-8865114ee310 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:36:28 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-d5ced2b8-7068-4c11-96b6-8865114ee310 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:36:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d5ced2b8-7068-4c11-96b6-8865114ee310 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.266s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:36:28 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-d5ced2b8-7068-4c11-96b6-8865114ee310 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Deleted allocations for instance 83da3dce-e270-4054-910d-c8ad28eb18da
Nov 08 12:36:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d5ced2b8-7068-4c11-96b6-8865114ee310 tempest-TestVolumeBootPattern-77780905 tempest-TestVolumeBootPattern-77780905-project-member] Lock "83da3dce-e270-4054-910d-c8ad28eb18da" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.225s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:36:30 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:36:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:36:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:36:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:36:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:36:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:36:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:36:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 12:36:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:36:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:36:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:36:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:36:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:36:55 user nova-compute[74840]: DEBUG nova.compute.manager [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Starting instance... {{(pid=74840) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 12:36:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:36:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:36:55 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:36:55 user nova-compute[74840]: INFO nova.compute.claims [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Claim successful on node user
Nov 08 12:36:55 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:36:55 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:36:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.381s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:36:55 user nova-compute[74840]: DEBUG nova.compute.manager [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Start building networks asynchronously for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 12:36:55 user nova-compute[74840]: DEBUG nova.compute.manager [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Allocating IP information in the background. {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 12:36:55 user nova-compute[74840]: DEBUG nova.network.neutron [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 12:36:55 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 12:36:55 user nova-compute[74840]: DEBUG nova.compute.manager [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Start building block device mappings for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 12:36:55 user nova-compute[74840]: DEBUG nova.policy [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9a49f88cb74c47bdb9a35883adbae454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e47ef156b3649839ff728eaf23121da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 12:36:55 user nova-compute[74840]: INFO nova.virt.block_device [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Booting with volume 9116b48b-6faa-44d9-a397-54a614016665 at /dev/vda
Nov 08 12:36:55 user nova-compute[74840]: DEBUG os_brick.utils [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:36:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:36:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:36:55 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[59dc9505-4f34-4ed2-95a6-24c744761982]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c8228a11e03c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:36:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:36:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:36:55 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[30226c62-028c-4df0-b7d9-b36ceb589a39]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:36:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:36:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:36:55 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[87977f3c-5aa8-46b9-a7f4-87859d1c147c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:36:55 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[114c5dd0-263b-4961-bcc0-247377d878c8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:36:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Running cmd (subprocess): nvme version {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:36:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] 'nvme version' failed. Not Retrying. {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:36:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:36:55 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] nvme not present on system {{(pid=74840) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 12:36:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:36:56 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:36:56 user nova-compute[74840]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 12:36:56 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b5a7e9-726e-4aa3-9e95-d9fc522d5c90]: (4, '') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:36:56 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74840) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 12:36:56 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 12:36:56 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] LIGHTOS: no hostnqn found. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 12:36:56 user nova-compute[74840]: DEBUG os_brick.utils [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c8228a11e03c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:36:56 user nova-compute[74840]: DEBUG nova.virt.block_device [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Updating existing volume attachment record: 02768545-cf9b-495a-ae3e-f790dfddd78e {{(pid=74840) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 12:36:56 user nova-compute[74840]: DEBUG nova.network.neutron [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Successfully created port: 18c0341b-6a4a-4235-993f-da29deeadcb5 {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:36:57 user nova-compute[74840]: DEBUG nova.network.neutron [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Successfully updated port: 18c0341b-6a4a-4235-993f-da29deeadcb5 {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:36:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "refresh_cache-c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:36:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquired lock "refresh_cache-c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:36:57 user nova-compute[74840]: DEBUG nova.network.neutron [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:36:57 user nova-compute[74840]: DEBUG nova.compute.manager [req-40686c76-456e-4797-bc45-084ba339b451 req-43b96dff-e792-4629-a0c4-92836b32b47d service nova] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Received event network-changed-18c0341b-6a4a-4235-993f-da29deeadcb5 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:36:57 user nova-compute[74840]: DEBUG nova.compute.manager [req-40686c76-456e-4797-bc45-084ba339b451 req-43b96dff-e792-4629-a0c4-92836b32b47d service nova] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Refreshing instance network info cache due to event network-changed-18c0341b-6a4a-4235-993f-da29deeadcb5. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:36:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-40686c76-456e-4797-bc45-084ba339b451 req-43b96dff-e792-4629-a0c4-92836b32b47d service nova] Acquiring lock "refresh_cache-c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:36:57 user nova-compute[74840]: DEBUG nova.network.neutron [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:36:57 user nova-compute[74840]: DEBUG nova.network.neutron [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Updating instance_info_cache with network_info: [{"id": "18c0341b-6a4a-4235-993f-da29deeadcb5", "address": "fa:16:3e:e7:6e:a4", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18c0341b-6a", "ovs_interfaceid": "18c0341b-6a4a-4235-993f-da29deeadcb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:36:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Releasing lock "refresh_cache-c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:36:57 user nova-compute[74840]: DEBUG nova.compute.manager [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Instance network_info: |[{"id": "18c0341b-6a4a-4235-993f-da29deeadcb5", "address": "fa:16:3e:e7:6e:a4", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18c0341b-6a", "ovs_interfaceid": "18c0341b-6a4a-4235-993f-da29deeadcb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 12:36:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-40686c76-456e-4797-bc45-084ba339b451 req-43b96dff-e792-4629-a0c4-92836b32b47d service nova] Acquired lock "refresh_cache-c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:36:57 user nova-compute[74840]: DEBUG nova.network.neutron [req-40686c76-456e-4797-bc45-084ba339b451 req-43b96dff-e792-4629-a0c4-92836b32b47d service nova] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Refreshing network info cache for port 18c0341b-6a4a-4235-993f-da29deeadcb5 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:36:57 user nova-compute[74840]: DEBUG nova.network.neutron [req-40686c76-456e-4797-bc45-084ba339b451 req-43b96dff-e792-4629-a0c4-92836b32b47d service nova] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Updated VIF entry in instance network info cache for port 18c0341b-6a4a-4235-993f-da29deeadcb5. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:36:57 user nova-compute[74840]: DEBUG nova.network.neutron [req-40686c76-456e-4797-bc45-084ba339b451 req-43b96dff-e792-4629-a0c4-92836b32b47d service nova] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Updating instance_info_cache with network_info: [{"id": "18c0341b-6a4a-4235-993f-da29deeadcb5", "address": "fa:16:3e:e7:6e:a4", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18c0341b-6a", "ovs_interfaceid": "18c0341b-6a4a-4235-993f-da29deeadcb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:36:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-40686c76-456e-4797-bc45-084ba339b451 req-43b96dff-e792-4629-a0c4-92836b32b47d service nova] Releasing lock "refresh_cache-c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:36:59 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:37:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-807b8008-5c46-4ae6-92c9-3649934bd5db tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquiring lock "9991e7b4-aaf8-4485-b658-e1af634925de" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:37:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-807b8008-5c46-4ae6-92c9-3649934bd5db tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "9991e7b4-aaf8-4485-b658-e1af634925de" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:37:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-807b8008-5c46-4ae6-92c9-3649934bd5db tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquiring lock "9991e7b4-aaf8-4485-b658-e1af634925de-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:37:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-807b8008-5c46-4ae6-92c9-3649934bd5db tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "9991e7b4-aaf8-4485-b658-e1af634925de-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:37:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-807b8008-5c46-4ae6-92c9-3649934bd5db tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "9991e7b4-aaf8-4485-b658-e1af634925de-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:37:07 user nova-compute[74840]: INFO nova.compute.manager [None req-807b8008-5c46-4ae6-92c9-3649934bd5db tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Terminating instance
Nov 08 12:37:07 user nova-compute[74840]: DEBUG nova.compute.manager [None req-807b8008-5c46-4ae6-92c9-3649934bd5db tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Start destroying the instance on the hypervisor. {{(pid=74840) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 12:37:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:07 user nova-compute[74840]: DEBUG nova.compute.manager [req-c36a5cf6-0bde-4ccd-911c-947ca0e6c523 req-ce5bdbfd-8d1d-4a71-a30b-7076296f0314 service nova] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Received event network-vif-unplugged-fe5dab01-dd0f-4772-ab5b-1b089b47c565 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:37:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-c36a5cf6-0bde-4ccd-911c-947ca0e6c523 req-ce5bdbfd-8d1d-4a71-a30b-7076296f0314 service nova] Acquiring lock "9991e7b4-aaf8-4485-b658-e1af634925de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:37:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-c36a5cf6-0bde-4ccd-911c-947ca0e6c523 req-ce5bdbfd-8d1d-4a71-a30b-7076296f0314 service nova] Lock "9991e7b4-aaf8-4485-b658-e1af634925de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:37:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-c36a5cf6-0bde-4ccd-911c-947ca0e6c523 req-ce5bdbfd-8d1d-4a71-a30b-7076296f0314 service nova] Lock "9991e7b4-aaf8-4485-b658-e1af634925de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:37:07 user nova-compute[74840]: DEBUG nova.compute.manager [req-c36a5cf6-0bde-4ccd-911c-947ca0e6c523 req-ce5bdbfd-8d1d-4a71-a30b-7076296f0314 service nova] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] No waiting events found dispatching network-vif-unplugged-fe5dab01-dd0f-4772-ab5b-1b089b47c565 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:37:07 user nova-compute[74840]: DEBUG nova.compute.manager [req-c36a5cf6-0bde-4ccd-911c-947ca0e6c523 req-ce5bdbfd-8d1d-4a71-a30b-7076296f0314 service nova] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Received event network-vif-unplugged-fe5dab01-dd0f-4772-ab5b-1b089b47c565 for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:37:07 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Instance destroyed successfully.
Nov 08 12:37:07 user nova-compute[74840]: DEBUG nova.objects.instance [None req-807b8008-5c46-4ae6-92c9-3649934bd5db tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lazy-loading 'resources' on Instance uuid 9991e7b4-aaf8-4485-b658-e1af634925de {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:37:07 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-807b8008-5c46-4ae6-92c9-3649934bd5db tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:26:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1020744170',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1020744170',id=33,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:27:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72c97c47ab144ef3a8d5e9ee1ecc059e',ramdisk_id='',reservation_id='r-43t01ksq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-297593405',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:28:51Z,user_data=None,user_id='275e3d340c9d4d9e90b579e4bc0bfe0b',uuid=9991e7b4-aaf8-4485-b658-e1af634925de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe5dab01-dd0f-4772-ab5b-1b089b47c565", "address": "fa:16:3e:9b:27:ee", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe5dab01-dd", "ovs_interfaceid": "fe5dab01-dd0f-4772-ab5b-1b089b47c565", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:37:07 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-807b8008-5c46-4ae6-92c9-3649934bd5db tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Converting VIF {"id": "fe5dab01-dd0f-4772-ab5b-1b089b47c565", "address": "fa:16:3e:9b:27:ee", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe5dab01-dd", "ovs_interfaceid": "fe5dab01-dd0f-4772-ab5b-1b089b47c565", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:37:07 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-807b8008-5c46-4ae6-92c9-3649934bd5db tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:27:ee,bridge_name='br-int',has_traffic_filtering=True,id=fe5dab01-dd0f-4772-ab5b-1b089b47c565,network=Network(8388eafb-b115-49c7-82cd-0d85d0ee12e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe5dab01-dd') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:37:07 user nova-compute[74840]: DEBUG os_vif [None req-807b8008-5c46-4ae6-92c9-3649934bd5db tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:27:ee,bridge_name='br-int',has_traffic_filtering=True,id=fe5dab01-dd0f-4772-ab5b-1b089b47c565,network=Network(8388eafb-b115-49c7-82cd-0d85d0ee12e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe5dab01-dd') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:37:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe5dab01-dd, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:37:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:37:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e219f723-6174-4b57-96b4-f7962cbeb69c) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:37:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:07 user nova-compute[74840]: INFO os_vif [None req-807b8008-5c46-4ae6-92c9-3649934bd5db tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:27:ee,bridge_name='br-int',has_traffic_filtering=True,id=fe5dab01-dd0f-4772-ab5b-1b089b47c565,network=Network(8388eafb-b115-49c7-82cd-0d85d0ee12e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe5dab01-dd')
Nov 08 12:37:07 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-807b8008-5c46-4ae6-92c9-3649934bd5db tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Deleting instance files /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de_del
Nov 08 12:37:07 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-807b8008-5c46-4ae6-92c9-3649934bd5db tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Deletion of /opt/stack/data/nova/instances/9991e7b4-aaf8-4485-b658-e1af634925de_del complete
Nov 08 12:37:08 user nova-compute[74840]: INFO nova.compute.manager [None req-807b8008-5c46-4ae6-92c9-3649934bd5db tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Took 0.74 seconds to destroy the instance on the hypervisor.
Nov 08 12:37:08 user nova-compute[74840]: DEBUG oslo.service.loopingcall [None req-807b8008-5c46-4ae6-92c9-3649934bd5db tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74840) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 12:37:08 user nova-compute[74840]: DEBUG nova.compute.manager [-] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Deallocating network for instance {{(pid=74840) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 12:37:08 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] deallocate_for_instance() {{(pid=74840) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 12:37:08 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:37:08 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:37:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "refresh_cache-832a6445-84ee-43a8-a5bc-a07670602912" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:37:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquired lock "refresh_cache-832a6445-84ee-43a8-a5bc-a07670602912" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:37:08 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Forcefully refreshing network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 12:37:08 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:37:08 user nova-compute[74840]: DEBUG nova.compute.manager [req-4dc678d8-e6fd-4519-a684-652fa84939a4 req-087652ab-b1d7-4463-a11e-e379dd4a072a service nova] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Received event network-vif-deleted-fe5dab01-dd0f-4772-ab5b-1b089b47c565 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:37:08 user nova-compute[74840]: INFO nova.compute.manager [req-4dc678d8-e6fd-4519-a684-652fa84939a4 req-087652ab-b1d7-4463-a11e-e379dd4a072a service nova] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Neutron deleted interface fe5dab01-dd0f-4772-ab5b-1b089b47c565; detaching it from the instance and deleting it from the info cache
Nov 08 12:37:08 user nova-compute[74840]: DEBUG nova.network.neutron [req-4dc678d8-e6fd-4519-a684-652fa84939a4 req-087652ab-b1d7-4463-a11e-e379dd4a072a service nova] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:37:08 user nova-compute[74840]: INFO nova.compute.manager [-] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Took 0.52 seconds to deallocate network for instance.
Nov 08 12:37:08 user nova-compute[74840]: DEBUG nova.compute.manager [req-4dc678d8-e6fd-4519-a684-652fa84939a4 req-087652ab-b1d7-4463-a11e-e379dd4a072a service nova] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Detach interface failed, port_id=fe5dab01-dd0f-4772-ab5b-1b089b47c565, reason: Instance 9991e7b4-aaf8-4485-b658-e1af634925de could not be found. {{(pid=74840) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 12:37:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-807b8008-5c46-4ae6-92c9-3649934bd5db tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:37:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-807b8008-5c46-4ae6-92c9-3649934bd5db tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:37:08 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Updating instance_info_cache with network_info: [{"id": "48ba3111-f22a-4a29-8183-ccd94efa9086", "address": "fa:16:3e:83:fc:39", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ba3111-f2", "ovs_interfaceid": "48ba3111-f22a-4a29-8183-ccd94efa9086", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:37:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Releasing lock "refresh_cache-832a6445-84ee-43a8-a5bc-a07670602912" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:37:08 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Updated the network info_cache for instance {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 12:37:08 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:37:08 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:37:08 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:37:08 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:37:08 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-807b8008-5c46-4ae6-92c9-3649934bd5db tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:37:08 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-807b8008-5c46-4ae6-92c9-3649934bd5db tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:37:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-807b8008-5c46-4ae6-92c9-3649934bd5db tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.322s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:37:08 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-807b8008-5c46-4ae6-92c9-3649934bd5db tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Deleted allocations for instance 9991e7b4-aaf8-4485-b658-e1af634925de
Nov 08 12:37:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-807b8008-5c46-4ae6-92c9-3649934bd5db tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "9991e7b4-aaf8-4485-b658-e1af634925de" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.764s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:37:09 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:37:09 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:37:09 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:37:09 user nova-compute[74840]: DEBUG nova.compute.manager [req-2e2f7597-c2da-426c-ae29-5857b02e72bc req-6a33602d-bfc6-48d7-abae-cb01923dbca8 service nova] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Received event network-vif-plugged-fe5dab01-dd0f-4772-ab5b-1b089b47c565 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:37:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2e2f7597-c2da-426c-ae29-5857b02e72bc req-6a33602d-bfc6-48d7-abae-cb01923dbca8 service nova] Acquiring lock "9991e7b4-aaf8-4485-b658-e1af634925de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:37:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2e2f7597-c2da-426c-ae29-5857b02e72bc req-6a33602d-bfc6-48d7-abae-cb01923dbca8 service nova] Lock "9991e7b4-aaf8-4485-b658-e1af634925de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:37:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2e2f7597-c2da-426c-ae29-5857b02e72bc req-6a33602d-bfc6-48d7-abae-cb01923dbca8 service nova] Lock "9991e7b4-aaf8-4485-b658-e1af634925de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:37:09 user nova-compute[74840]: DEBUG nova.compute.manager [req-2e2f7597-c2da-426c-ae29-5857b02e72bc req-6a33602d-bfc6-48d7-abae-cb01923dbca8 service nova] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] No waiting events found dispatching network-vif-plugged-fe5dab01-dd0f-4772-ab5b-1b089b47c565 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:37:09 user nova-compute[74840]: WARNING nova.compute.manager [req-2e2f7597-c2da-426c-ae29-5857b02e72bc req-6a33602d-bfc6-48d7-abae-cb01923dbca8 service nova] [instance: 9991e7b4-aaf8-4485-b658-e1af634925de] Received unexpected event network-vif-plugged-fe5dab01-dd0f-4772-ab5b-1b089b47c565 for instance with vm_state deleted and task_state None.
Nov 08 12:37:12 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:37:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:15 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:37:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:37:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:37:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:37:15 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:37:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a482219-16ac-49e2-84ad-7e2030c97184/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a482219-16ac-49e2-84ad-7e2030c97184/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a482219-16ac-49e2-84ad-7e2030c97184/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a482219-16ac-49e2-84ad-7e2030c97184/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cecc731-6f86-475c-8603-591de8e30412/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cecc731-6f86-475c-8603-591de8e30412/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cecc731-6f86-475c-8603-591de8e30412/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cecc731-6f86-475c-8603-591de8e30412/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:37:19 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:37:19 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:37:19 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=8151MB free_disk=24.71047592163086GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:37:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:37:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:37:19 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance d3e8efc6-7146-46ef-8433-380d7e69120c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:37:19 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance ffe50042-29bf-4ef3-a148-8698bc75233b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:37:19 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 8b7c490e-4c78-4e07-bc8a-3be2328963d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:37:19 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 832a6445-84ee-43a8-a5bc-a07670602912 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:37:19 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 10c42516-62ba-4aa9-bc5a-d94499bd6b65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:37:19 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 7a482219-16ac-49e2-84ad-7e2030c97184 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:37:19 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 0cecc731-6f86-475c-8603-591de8e30412 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:37:19 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:37:19 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:37:19 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:37:19 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:37:19 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:37:19 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:37:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.453s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG nova.compute.manager [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Start spawning the instance on the hypervisor. {{(pid=74840) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:37:20 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Creating image(s)
Nov 08 12:37:20 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Did not create local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Ensure instance console log exists: /opt/stack/data/nova/instances/c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Start _get_guest_xml network_info=[{"id": "18c0341b-6a4a-4235-993f-da29deeadcb5", "address": "fa:16:3e:e7:6e:a4", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18c0341b-6a", "ovs_interfaceid": "18c0341b-6a4a-4235-993f-da29deeadcb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '02768545-cf9b-495a-ae3e-f790dfddd78e', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gAtTOrZz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a', 'attached_at': '', 'detached_at': '', 'volume_id': '9116b48b-6faa-44d9-a397-54a614016665', 'serial': '9116b48b-6faa-44d9-a397-54a614016665'}, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:37:20 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:37:20 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:37:20 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Calling os-brick to attach iSCSI Volume {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gAtTOrZz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:37:20 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:37:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:37:20 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:37:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:37:20 user nova-compute[74840]: INFO os_brick.initiator.connectors.iscsi [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 12:37:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 -p 172.16.0.220:3260 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dae3e13-b1ef-4209-be8b-057072765f69]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 12:37:20 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 -p 172.16.0.220:3260 --interface default --op new {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e579f9-506e-4fa7-9715-b59c8df36189]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665] added\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665] added
Nov 08 12:37:20 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c564f38c-c757-4a4a-a25c-7e194faa3dac]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b18690-f152-43cb-ae99-af98fe480d60]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gAtTOrZz {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gAtTOrZz" returned: 0 in 0.029s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0a150e-0ab2-4c33-8bb2-de98038499f0]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gAtTOrZz'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3caf3e5-1b5b-4ed7-bbb5-23119e1bee1d]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ec1f7c-bf78-4581-9e84-28e6901d4897]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:37:20 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:37:20 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 -p 172.16.0.220:3260 --login {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb74f191-a1ac-4f78-ba64-ab846f57ad3d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665, portal: 172.16.0.220,3260]
Nov 08 12:37:20 user nova-compute[74840]: Login to [iface: default, target: iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665, portal: 172.16.0.220,3260] successful.
Nov 08 12:37:20 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21b0807-87c9-4a62-bb7a-840f2852b996]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b3089b-6303-4ac8-a2f7-fcbe171e4a94]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:37:20 user nova-compute[74840]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 (non-flash)
Nov 08 12:37:20 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:37:20 user nova-compute[74840]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 (non-flash)
Nov 08 12:37:20 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Connected to 172.16.0.220:3260 {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=74840) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74840) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efb7490-a5d2-4e06-a8cc-57765fb10d6c]: (4, ('- - 0', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: None {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Acquiring lock "6156dbbc-6539-4de3-8ba0-16db61cd7dce" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "6156dbbc-6539-4de3-8ba0-16db61cd7dce" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:37:20 user nova-compute[74840]: INFO nova.compute.manager [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Unshelving
Nov 08 12:37:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG nova.objects.instance [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lazy-loading 'pci_requests' on Instance uuid 6156dbbc-6539-4de3-8ba0-16db61cd7dce {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG nova.objects.instance [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lazy-loading 'numa_topology' on Instance uuid 6156dbbc-6539-4de3-8ba0-16db61cd7dce {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:37:20 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:37:20 user nova-compute[74840]: INFO nova.compute.claims [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Claim successful on node user
Nov 08 12:37:21 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:37:21 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:37:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.509s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:37:21 user nova-compute[74840]: DEBUG nova.compute.manager [req-c27dc33a-bf7d-48b7-a124-eebbafb769b3 req-b0639181-5960-48b6-b13b-e346af10bbce service nova] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Received event network-changed-5f1cf848-e83c-454b-b5ab-d2e047ae5e84 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:37:21 user nova-compute[74840]: DEBUG nova.compute.manager [req-c27dc33a-bf7d-48b7-a124-eebbafb769b3 req-b0639181-5960-48b6-b13b-e346af10bbce service nova] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Refreshing instance network info cache due to event network-changed-5f1cf848-e83c-454b-b5ab-d2e047ae5e84. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:37:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-c27dc33a-bf7d-48b7-a124-eebbafb769b3 req-b0639181-5960-48b6-b13b-e346af10bbce service nova] Acquiring lock "refresh_cache-0cecc731-6f86-475c-8603-591de8e30412" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:37:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-c27dc33a-bf7d-48b7-a124-eebbafb769b3 req-b0639181-5960-48b6-b13b-e346af10bbce service nova] Acquired lock "refresh_cache-0cecc731-6f86-475c-8603-591de8e30412" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:37:21 user nova-compute[74840]: DEBUG nova.network.neutron [req-c27dc33a-bf7d-48b7-a124-eebbafb769b3 req-b0639181-5960-48b6-b13b-e346af10bbce service nova] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Refreshing network info cache for port 5f1cf848-e83c-454b-b5ab-d2e047ae5e84 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:37:21 user nova-compute[74840]: INFO nova.network.neutron [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Updating port 0c5dbe98-66f5-492a-8da2-8eca6cf38de5 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 08 12:37:21 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:37:21 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gAtTOrZz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 12:37:21 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:37:21 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '23835383362326464', 'path': '/dev/sdb'} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:37:21 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835383362326464', 'path': '/dev/sdb'} {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 12:37:21 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:36:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1685775036',display_name='tempest-ServerActionsTestOtherA-server-1685775036',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1685775036',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAmkFC6dPojPaRdPJh94q0/wuvRVxh1HPsrsmItydl0iUnCu6UdbkD5pi9CgzgYpLamuUC6eRZK4fPtOQ5ReX7Sfuo5mKd9gSajCUuWaRBqISYVRzAbikSahnbP3hsO0g==',key_name='tempest-keypair-428361338',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e47ef156b3649839ff728eaf23121da',ramdisk_id='',reservation_id='r-od43glui',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-401855506',owner_user_name='tempest-ServerActionsTestOtherA-401855506-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:36:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a49f88cb74c47bdb9a35883adbae454',uuid=c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18c0341b-6a4a-4235-993f-da29deeadcb5", "address": "fa:16:3e:e7:6e:a4", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18c0341b-6a", "ovs_interfaceid": "18c0341b-6a4a-4235-993f-da29deeadcb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:37:21 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Converting VIF {"id": "18c0341b-6a4a-4235-993f-da29deeadcb5", "address": "fa:16:3e:e7:6e:a4", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18c0341b-6a", "ovs_interfaceid": "18c0341b-6a4a-4235-993f-da29deeadcb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:37:21 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:6e:a4,bridge_name='br-int',has_traffic_filtering=True,id=18c0341b-6a4a-4235-993f-da29deeadcb5,network=Network(e92448c4-9bc0-424b-a07f-a398ac46fada),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18c0341b-6a') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:37:21 user nova-compute[74840]: DEBUG nova.objects.instance [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lazy-loading 'pci_devices' on Instance uuid c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:37:21 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:37:21 user nova-compute[74840]:   <uuid>c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a</uuid>
Nov 08 12:37:21 user nova-compute[74840]:   <name>instance-0000002c</name>
Nov 08 12:37:21 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:37:21 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:37:21 user nova-compute[74840]:   <metadata>
Nov 08 12:37:21 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:37:21 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:37:21 user nova-compute[74840]:       <nova:name>tempest-ServerActionsTestOtherA-server-1685775036</nova:name>
Nov 08 12:37:21 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:37:20</nova:creationTime>
Nov 08 12:37:21 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:37:21 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:37:21 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:37:21 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:37:21 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:37:21 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:37:21 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:37:21 user nova-compute[74840]:       <nova:owner>
Nov 08 12:37:21 user nova-compute[74840]:         <nova:user uuid="9a49f88cb74c47bdb9a35883adbae454">tempest-ServerActionsTestOtherA-401855506-project-member</nova:user>
Nov 08 12:37:21 user nova-compute[74840]:         <nova:project uuid="5e47ef156b3649839ff728eaf23121da">tempest-ServerActionsTestOtherA-401855506</nova:project>
Nov 08 12:37:21 user nova-compute[74840]:       </nova:owner>
Nov 08 12:37:21 user nova-compute[74840]:       <nova:ports>
Nov 08 12:37:21 user nova-compute[74840]:         <nova:port uuid="18c0341b-6a4a-4235-993f-da29deeadcb5">
Nov 08 12:37:21 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 12:37:21 user nova-compute[74840]:         </nova:port>
Nov 08 12:37:21 user nova-compute[74840]:       </nova:ports>
Nov 08 12:37:21 user nova-compute[74840]:     </nova:instance>
Nov 08 12:37:21 user nova-compute[74840]:   </metadata>
Nov 08 12:37:21 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:37:21 user nova-compute[74840]:     <system>
Nov 08 12:37:21 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:37:21 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:37:21 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:37:21 user nova-compute[74840]:       <entry name="serial">c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a</entry>
Nov 08 12:37:21 user nova-compute[74840]:       <entry name="uuid">c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a</entry>
Nov 08 12:37:21 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:37:21 user nova-compute[74840]:     </system>
Nov 08 12:37:21 user nova-compute[74840]:   </sysinfo>
Nov 08 12:37:21 user nova-compute[74840]:   <os>
Nov 08 12:37:21 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:37:21 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:37:21 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:37:21 user nova-compute[74840]:   </os>
Nov 08 12:37:21 user nova-compute[74840]:   <features>
Nov 08 12:37:21 user nova-compute[74840]:     <acpi/>
Nov 08 12:37:21 user nova-compute[74840]:     <apic/>
Nov 08 12:37:21 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:37:21 user nova-compute[74840]:   </features>
Nov 08 12:37:21 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:37:21 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:37:21 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:37:21 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:37:21 user nova-compute[74840]:   </clock>
Nov 08 12:37:21 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:37:21 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:37:21 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:37:21 user nova-compute[74840]:   </cpu>
Nov 08 12:37:21 user nova-compute[74840]:   <devices>
Nov 08 12:37:21 user nova-compute[74840]:     <disk type="block" device="disk">
Nov 08 12:37:21 user nova-compute[74840]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:37:21 user nova-compute[74840]:       <source dev="/dev/sdb"/>
Nov 08 12:37:21 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:37:21 user nova-compute[74840]:       <serial>9116b48b-6faa-44d9-a397-54a614016665</serial>
Nov 08 12:37:21 user nova-compute[74840]:     </disk>
Nov 08 12:37:21 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:37:21 user nova-compute[74840]:       <mac address="fa:16:3e:e7:6e:a4"/>
Nov 08 12:37:21 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:37:21 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:37:21 user nova-compute[74840]:       <target dev="tap18c0341b-6a"/>
Nov 08 12:37:21 user nova-compute[74840]:     </interface>
Nov 08 12:37:21 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:37:21 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a/console.log" append="off"/>
Nov 08 12:37:21 user nova-compute[74840]:     </serial>
Nov 08 12:37:21 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:37:21 user nova-compute[74840]:     <video>
Nov 08 12:37:21 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:37:21 user nova-compute[74840]:     </video>
Nov 08 12:37:21 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:37:21 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:37:21 user nova-compute[74840]:     </rng>
Nov 08 12:37:21 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:37:21 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:37:21 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:37:21 user nova-compute[74840]:     </memballoon>
Nov 08 12:37:21 user nova-compute[74840]:   </devices>
Nov 08 12:37:21 user nova-compute[74840]: </domain>
Nov 08 12:37:21 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:37:21 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:36:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1685775036',display_name='tempest-ServerActionsTestOtherA-server-1685775036',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1685775036',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAmkFC6dPojPaRdPJh94q0/wuvRVxh1HPsrsmItydl0iUnCu6UdbkD5pi9CgzgYpLamuUC6eRZK4fPtOQ5ReX7Sfuo5mKd9gSajCUuWaRBqISYVRzAbikSahnbP3hsO0g==',key_name='tempest-keypair-428361338',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e47ef156b3649839ff728eaf23121da',ramdisk_id='',reservation_id='r-od43glui',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-401855506',owner_user_name='tempest-ServerActionsTestOtherA-401855506-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:36:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a49f88cb74c47bdb9a35883adbae454',uuid=c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18c0341b-6a4a-4235-993f-da29deeadcb5", "address": "fa:16:3e:e7:6e:a4", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18c0341b-6a", "ovs_interfaceid": "18c0341b-6a4a-4235-993f-da29deeadcb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:37:21 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Converting VIF {"id": "18c0341b-6a4a-4235-993f-da29deeadcb5", "address": "fa:16:3e:e7:6e:a4", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18c0341b-6a", "ovs_interfaceid": "18c0341b-6a4a-4235-993f-da29deeadcb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:37:21 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:6e:a4,bridge_name='br-int',has_traffic_filtering=True,id=18c0341b-6a4a-4235-993f-da29deeadcb5,network=Network(e92448c4-9bc0-424b-a07f-a398ac46fada),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18c0341b-6a') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:37:21 user nova-compute[74840]: DEBUG os_vif [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:6e:a4,bridge_name='br-int',has_traffic_filtering=True,id=18c0341b-6a4a-4235-993f-da29deeadcb5,network=Network(e92448c4-9bc0-424b-a07f-a398ac46fada),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18c0341b-6a') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:37:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:37:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:37:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ccacf72c-a4b8-5d42-9bcf-d5de7c5584e5', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:37:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:37:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18c0341b-6a, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:37:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap18c0341b-6a, col_values=(('qos', UUID('208c3b02-5066-4942-b83d-12a477f69b05')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:37:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap18c0341b-6a, col_values=(('external_ids', {'iface-id': '18c0341b-6a4a-4235-993f-da29deeadcb5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:6e:a4', 'vm-uuid': 'c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:37:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:37:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:21 user nova-compute[74840]: INFO os_vif [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:6e:a4,bridge_name='br-int',has_traffic_filtering=True,id=18c0341b-6a4a-4235-993f-da29deeadcb5,network=Network(e92448c4-9bc0-424b-a07f-a398ac46fada),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18c0341b-6a')
Nov 08 12:37:21 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:37:21 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] No VIF found with MAC fa:16:3e:e7:6e:a4, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:37:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Acquiring lock "0cecc731-6f86-475c-8603-591de8e30412" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:37:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "0cecc731-6f86-475c-8603-591de8e30412" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:37:21 user nova-compute[74840]: DEBUG nova.objects.instance [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lazy-loading 'flavor' on Instance uuid 0cecc731-6f86-475c-8603-591de8e30412 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:37:22 user nova-compute[74840]: DEBUG nova.network.neutron [req-c27dc33a-bf7d-48b7-a124-eebbafb769b3 req-b0639181-5960-48b6-b13b-e346af10bbce service nova] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Updated VIF entry in instance network info cache for port 5f1cf848-e83c-454b-b5ab-d2e047ae5e84. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:37:22 user nova-compute[74840]: DEBUG nova.network.neutron [req-c27dc33a-bf7d-48b7-a124-eebbafb769b3 req-b0639181-5960-48b6-b13b-e346af10bbce service nova] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Updating instance_info_cache with network_info: [{"id": "5f1cf848-e83c-454b-b5ab-d2e047ae5e84", "address": "fa:16:3e:6f:d6:9b", "network": {"id": "7faeaea5-04e0-46e0-bb55-9426d599fb1b", "bridge": "br-int", "label": "tempest-TestStampPattern-1080763140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c24d52e18e8e41dfa50aa5aff1f40c6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f1cf848-e8", "ovs_interfaceid": "5f1cf848-e83c-454b-b5ab-d2e047ae5e84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:37:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-c27dc33a-bf7d-48b7-a124-eebbafb769b3 req-b0639181-5960-48b6-b13b-e346af10bbce service nova] Releasing lock "refresh_cache-0cecc731-6f86-475c-8603-591de8e30412" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:37:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "0cecc731-6f86-475c-8603-591de8e30412" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:37:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Acquiring lock "refresh_cache-6156dbbc-6539-4de3-8ba0-16db61cd7dce" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:37:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Acquired lock "refresh_cache-6156dbbc-6539-4de3-8ba0-16db61cd7dce" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:37:22 user nova-compute[74840]: DEBUG nova.network.neutron [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:37:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Acquiring lock "0cecc731-6f86-475c-8603-591de8e30412" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:37:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "0cecc731-6f86-475c-8603-591de8e30412" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:37:22 user nova-compute[74840]: INFO nova.compute.manager [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Attaching volume 09a74a9e-3fd0-4d3f-ac36-7689df100881 to /dev/vdb
Nov 08 12:37:22 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:22 user nova-compute[74840]: DEBUG os_brick.utils [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:37:22 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:22 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:22 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93aaf1c-ac1f-43f8-92ae-16045156a116]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c8228a11e03c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:37:22 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:22 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:22 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[648de074-ecda-4aa0-bd93-aedcc5e7c1d0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:37:22 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:22 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:22 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[127f0219-c76e-482a-8ad8-b6866fbc7b08]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:37:22 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[80db6a12-eda8-4bfb-8a3e-b6af79adeea8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:37:22 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Running cmd (subprocess): nvme version {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:22 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] 'nvme version' failed. Not Retrying. {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:37:22 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] nvme not present on system {{(pid=74840) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 12:37:22 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:22 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:37:22 user nova-compute[74840]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 12:37:22 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[16dd9819-d8f4-498f-9309-efa8ab31e299]: (4, '') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:37:22 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74840) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 12:37:22 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 12:37:22 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] LIGHTOS: no hostnqn found. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 12:37:22 user nova-compute[74840]: DEBUG os_brick.utils [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c8228a11e03c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:37:22 user nova-compute[74840]: DEBUG nova.virt.block_device [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Updating existing volume attachment record: ae009dba-197c-4816-9d8c-7fdf34984e4f {{(pid=74840) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 12:37:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f7d5dccc-2734-4f72-a738-62cc5abfcd31 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Acquiring lock "832a6445-84ee-43a8-a5bc-a07670602912" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:37:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f7d5dccc-2734-4f72-a738-62cc5abfcd31 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "832a6445-84ee-43a8-a5bc-a07670602912" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:37:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f7d5dccc-2734-4f72-a738-62cc5abfcd31 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Acquiring lock "832a6445-84ee-43a8-a5bc-a07670602912-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:37:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f7d5dccc-2734-4f72-a738-62cc5abfcd31 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "832a6445-84ee-43a8-a5bc-a07670602912-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:37:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f7d5dccc-2734-4f72-a738-62cc5abfcd31 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "832a6445-84ee-43a8-a5bc-a07670602912-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:37:22 user nova-compute[74840]: INFO nova.compute.manager [None req-f7d5dccc-2734-4f72-a738-62cc5abfcd31 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Terminating instance
Nov 08 12:37:22 user nova-compute[74840]: DEBUG nova.compute.manager [None req-f7d5dccc-2734-4f72-a738-62cc5abfcd31 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Start destroying the instance on the hypervisor. {{(pid=74840) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 12:37:22 user nova-compute[74840]: DEBUG nova.network.neutron [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Updating instance_info_cache with network_info: [{"id": "0c5dbe98-66f5-492a-8da2-8eca6cf38de5", "address": "fa:16:3e:ab:15:81", "network": {"id": "918d8aed-1f09-4cfb-9c7f-48f002ad6ba3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-927886396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a05cda834445fb94e71f6cac02f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5dbe98-66", "ovs_interfaceid": "0c5dbe98-66f5-492a-8da2-8eca6cf38de5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:37:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Releasing lock "refresh_cache-6156dbbc-6539-4de3-8ba0-16db61cd7dce" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:37:22 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:37:22 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Creating image(s)
Nov 08 12:37:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Acquiring lock "/opt/stack/data/nova/instances/6156dbbc-6539-4de3-8ba0-16db61cd7dce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:37:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "/opt/stack/data/nova/instances/6156dbbc-6539-4de3-8ba0-16db61cd7dce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:37:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "/opt/stack/data/nova/instances/6156dbbc-6539-4de3-8ba0-16db61cd7dce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:37:22 user nova-compute[74840]: DEBUG nova.objects.instance [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6156dbbc-6539-4de3-8ba0-16db61cd7dce {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:37:22 user nova-compute[74840]: DEBUG nova.objects.base [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Object Instance<6156dbbc-6539-4de3-8ba0-16db61cd7dce> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:37:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Acquiring lock "60e08fe0addd41deea40c877b9fd77e748d85727" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:37:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "60e08fe0addd41deea40c877b9fd77e748d85727" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:37:22 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:22 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:23 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60e08fe0addd41deea40c877b9fd77e748d85727.part --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:23 user nova-compute[74840]: DEBUG nova.compute.manager [req-08ea6f6a-db5d-4b7a-9d7f-f7db2eeed780 req-00af1a0e-ffed-43bf-bb02-b3f445e1c7ff service nova] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Received event network-vif-unplugged-48ba3111-f22a-4a29-8183-ccd94efa9086 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:37:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-08ea6f6a-db5d-4b7a-9d7f-f7db2eeed780 req-00af1a0e-ffed-43bf-bb02-b3f445e1c7ff service nova] Acquiring lock "832a6445-84ee-43a8-a5bc-a07670602912-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:37:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-08ea6f6a-db5d-4b7a-9d7f-f7db2eeed780 req-00af1a0e-ffed-43bf-bb02-b3f445e1c7ff service nova] Lock "832a6445-84ee-43a8-a5bc-a07670602912-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:37:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-08ea6f6a-db5d-4b7a-9d7f-f7db2eeed780 req-00af1a0e-ffed-43bf-bb02-b3f445e1c7ff service nova] Lock "832a6445-84ee-43a8-a5bc-a07670602912-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:37:23 user nova-compute[74840]: DEBUG nova.compute.manager [req-08ea6f6a-db5d-4b7a-9d7f-f7db2eeed780 req-00af1a0e-ffed-43bf-bb02-b3f445e1c7ff service nova] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] No waiting events found dispatching network-vif-unplugged-48ba3111-f22a-4a29-8183-ccd94efa9086 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:37:23 user nova-compute[74840]: DEBUG nova.compute.manager [req-08ea6f6a-db5d-4b7a-9d7f-f7db2eeed780 req-00af1a0e-ffed-43bf-bb02-b3f445e1c7ff service nova] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Received event network-vif-unplugged-48ba3111-f22a-4a29-8183-ccd94efa9086 for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:37:23 user nova-compute[74840]: DEBUG nova.compute.manager [req-c5769ea4-c2d3-4d52-8ab3-8bde711cce7b req-49841502-9c89-4ed2-8652-4ac7bd28d5fa service nova] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Received event network-vif-plugged-18c0341b-6a4a-4235-993f-da29deeadcb5 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:37:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-c5769ea4-c2d3-4d52-8ab3-8bde711cce7b req-49841502-9c89-4ed2-8652-4ac7bd28d5fa service nova] Acquiring lock "c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:37:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-c5769ea4-c2d3-4d52-8ab3-8bde711cce7b req-49841502-9c89-4ed2-8652-4ac7bd28d5fa service nova] Lock "c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:37:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-c5769ea4-c2d3-4d52-8ab3-8bde711cce7b req-49841502-9c89-4ed2-8652-4ac7bd28d5fa service nova] Lock "c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:37:23 user nova-compute[74840]: DEBUG nova.compute.manager [req-c5769ea4-c2d3-4d52-8ab3-8bde711cce7b req-49841502-9c89-4ed2-8652-4ac7bd28d5fa service nova] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] No waiting events found dispatching network-vif-plugged-18c0341b-6a4a-4235-993f-da29deeadcb5 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:37:23 user nova-compute[74840]: WARNING nova.compute.manager [req-c5769ea4-c2d3-4d52-8ab3-8bde711cce7b req-49841502-9c89-4ed2-8652-4ac7bd28d5fa service nova] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Received unexpected event network-vif-plugged-18c0341b-6a4a-4235-993f-da29deeadcb5 for instance with vm_state building and task_state spawning.
Nov 08 12:37:23 user nova-compute[74840]: DEBUG nova.compute.manager [req-5e526bad-eeae-4eb6-9999-22d6633dd8e6 req-c23bf397-8ebc-4b5f-abdd-f53fd8f6dae8 service nova] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Received event network-changed-0c5dbe98-66f5-492a-8da2-8eca6cf38de5 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:37:23 user nova-compute[74840]: DEBUG nova.compute.manager [req-5e526bad-eeae-4eb6-9999-22d6633dd8e6 req-c23bf397-8ebc-4b5f-abdd-f53fd8f6dae8 service nova] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Refreshing instance network info cache due to event network-changed-0c5dbe98-66f5-492a-8da2-8eca6cf38de5. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:37:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-5e526bad-eeae-4eb6-9999-22d6633dd8e6 req-c23bf397-8ebc-4b5f-abdd-f53fd8f6dae8 service nova] Acquiring lock "refresh_cache-6156dbbc-6539-4de3-8ba0-16db61cd7dce" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:37:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-5e526bad-eeae-4eb6-9999-22d6633dd8e6 req-c23bf397-8ebc-4b5f-abdd-f53fd8f6dae8 service nova] Acquired lock "refresh_cache-6156dbbc-6539-4de3-8ba0-16db61cd7dce" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:37:23 user nova-compute[74840]: DEBUG nova.network.neutron [req-5e526bad-eeae-4eb6-9999-22d6633dd8e6 req-c23bf397-8ebc-4b5f-abdd-f53fd8f6dae8 service nova] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Refreshing network info cache for port 0c5dbe98-66f5-492a-8da2-8eca6cf38de5 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:37:23 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Instance destroyed successfully.
Nov 08 12:37:23 user nova-compute[74840]: DEBUG nova.objects.instance [None req-f7d5dccc-2734-4f72-a738-62cc5abfcd31 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lazy-loading 'resources' on Instance uuid 832a6445-84ee-43a8-a5bc-a07670602912 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:37:23 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-f7d5dccc-2734-4f72-a738-62cc5abfcd31 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:20:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-859288350',display_name='tempest-ServerRescueNegativeTestJSON-server-859288350',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-859288350',id=26,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:22:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='457d61e0588847528ef3dd42a6146599',ramdisk_id='',reservation_id='r-o8yv1yn5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1814868989',owner_user_name='tempest-ServerRescueNegativeTestJSON-1814868989-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:22:28Z,user_data=None,user_id='6d4a3286c7d64d59b8ce2e4456db9cc2',uuid=832a6445-84ee-43a8-a5bc-a07670602912,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "48ba3111-f22a-4a29-8183-ccd94efa9086", "address": "fa:16:3e:83:fc:39", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ba3111-f2", "ovs_interfaceid": "48ba3111-f22a-4a29-8183-ccd94efa9086", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:37:23 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-f7d5dccc-2734-4f72-a738-62cc5abfcd31 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Converting VIF {"id": "48ba3111-f22a-4a29-8183-ccd94efa9086", "address": "fa:16:3e:83:fc:39", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48ba3111-f2", "ovs_interfaceid": "48ba3111-f22a-4a29-8183-ccd94efa9086", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:37:23 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-f7d5dccc-2734-4f72-a738-62cc5abfcd31 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:fc:39,bridge_name='br-int',has_traffic_filtering=True,id=48ba3111-f22a-4a29-8183-ccd94efa9086,network=Network(5ee2626f-3d55-44da-a731-761059adfa85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48ba3111-f2') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:37:24 user nova-compute[74840]: DEBUG os_vif [None req-f7d5dccc-2734-4f72-a738-62cc5abfcd31 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:fc:39,bridge_name='br-int',has_traffic_filtering=True,id=48ba3111-f22a-4a29-8183-ccd94efa9086,network=Network(5ee2626f-3d55-44da-a731-761059adfa85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48ba3111-f2') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:37:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap48ba3111-f2, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:37:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60e08fe0addd41deea40c877b9fd77e748d85727.part --force-share --output=json" returned: 0 in 0.195s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:24 user nova-compute[74840]: DEBUG nova.virt.images [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] 8a0092e8-d157-407b-a3e0-27e55fd04f84 was qcow2, converting to raw {{(pid=74840) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 12:37:24 user nova-compute[74840]: DEBUG nova.privsep.utils [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74840) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 12:37:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/60e08fe0addd41deea40c877b9fd77e748d85727.part /opt/stack/data/nova/instances/_base/60e08fe0addd41deea40c877b9fd77e748d85727.converted {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:37:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5b8eb24f-2e74-4514-8c6d-b072a2b4611c) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:37:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:24 user nova-compute[74840]: INFO os_vif [None req-f7d5dccc-2734-4f72-a738-62cc5abfcd31 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:fc:39,bridge_name='br-int',has_traffic_filtering=True,id=48ba3111-f22a-4a29-8183-ccd94efa9086,network=Network(5ee2626f-3d55-44da-a731-761059adfa85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48ba3111-f2')
Nov 08 12:37:24 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-f7d5dccc-2734-4f72-a738-62cc5abfcd31 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Deleting instance files /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912_del
Nov 08 12:37:24 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-f7d5dccc-2734-4f72-a738-62cc5abfcd31 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Deletion of /opt/stack/data/nova/instances/832a6445-84ee-43a8-a5bc-a07670602912_del complete
Nov 08 12:37:24 user nova-compute[74840]: INFO nova.compute.manager [None req-f7d5dccc-2734-4f72-a738-62cc5abfcd31 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Took 1.65 seconds to destroy the instance on the hypervisor.
Nov 08 12:37:24 user nova-compute[74840]: DEBUG oslo.service.loopingcall [None req-f7d5dccc-2734-4f72-a738-62cc5abfcd31 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74840) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 12:37:24 user nova-compute[74840]: DEBUG nova.compute.manager [-] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Deallocating network for instance {{(pid=74840) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 12:37:24 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] deallocate_for_instance() {{(pid=74840) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 12:37:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/60e08fe0addd41deea40c877b9fd77e748d85727.part /opt/stack/data/nova/instances/_base/60e08fe0addd41deea40c877b9fd77e748d85727.converted" returned: 0 in 0.277s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60e08fe0addd41deea40c877b9fd77e748d85727.converted --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:24 user nova-compute[74840]: DEBUG nova.network.neutron [req-5e526bad-eeae-4eb6-9999-22d6633dd8e6 req-c23bf397-8ebc-4b5f-abdd-f53fd8f6dae8 service nova] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Updated VIF entry in instance network info cache for port 0c5dbe98-66f5-492a-8da2-8eca6cf38de5. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:37:24 user nova-compute[74840]: DEBUG nova.network.neutron [req-5e526bad-eeae-4eb6-9999-22d6633dd8e6 req-c23bf397-8ebc-4b5f-abdd-f53fd8f6dae8 service nova] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Updating instance_info_cache with network_info: [{"id": "0c5dbe98-66f5-492a-8da2-8eca6cf38de5", "address": "fa:16:3e:ab:15:81", "network": {"id": "918d8aed-1f09-4cfb-9c7f-48f002ad6ba3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-927886396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a05cda834445fb94e71f6cac02f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5dbe98-66", "ovs_interfaceid": "0c5dbe98-66f5-492a-8da2-8eca6cf38de5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:37:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-5e526bad-eeae-4eb6-9999-22d6633dd8e6 req-c23bf397-8ebc-4b5f-abdd-f53fd8f6dae8 service nova] Releasing lock "refresh_cache-6156dbbc-6539-4de3-8ba0-16db61cd7dce" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:37:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60e08fe0addd41deea40c877b9fd77e748d85727.converted --force-share --output=json" returned: 0 in 0.176s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "60e08fe0addd41deea40c877b9fd77e748d85727" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.867s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:37:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60e08fe0addd41deea40c877b9fd77e748d85727 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60e08fe0addd41deea40c877b9fd77e748d85727 --force-share --output=json" returned: 0 in 0.172s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Acquiring lock "60e08fe0addd41deea40c877b9fd77e748d85727" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:37:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "60e08fe0addd41deea40c877b9fd77e748d85727" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:37:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60e08fe0addd41deea40c877b9fd77e748d85727 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:24 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:37:24 user nova-compute[74840]: INFO nova.compute.manager [-] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Took 0.53 seconds to deallocate network for instance.
Nov 08 12:37:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f7d5dccc-2734-4f72-a738-62cc5abfcd31 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:37:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f7d5dccc-2734-4f72-a738-62cc5abfcd31 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:37:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60e08fe0addd41deea40c877b9fd77e748d85727 --force-share --output=json" returned: 0 in 0.192s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60e08fe0addd41deea40c877b9fd77e748d85727,backing_fmt=raw /opt/stack/data/nova/instances/6156dbbc-6539-4de3-8ba0-16db61cd7dce/disk 1073741824 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:24 user nova-compute[74840]: DEBUG nova.compute.manager [req-582a9b70-9659-4af4-abcb-54ae9f593cde req-6aa07d0b-9909-4427-87d9-ba81024bc733 service nova] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Received event network-vif-plugged-48ba3111-f22a-4a29-8183-ccd94efa9086 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:37:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-582a9b70-9659-4af4-abcb-54ae9f593cde req-6aa07d0b-9909-4427-87d9-ba81024bc733 service nova] Acquiring lock "832a6445-84ee-43a8-a5bc-a07670602912-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:37:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-582a9b70-9659-4af4-abcb-54ae9f593cde req-6aa07d0b-9909-4427-87d9-ba81024bc733 service nova] Lock "832a6445-84ee-43a8-a5bc-a07670602912-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:37:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-582a9b70-9659-4af4-abcb-54ae9f593cde req-6aa07d0b-9909-4427-87d9-ba81024bc733 service nova] Lock "832a6445-84ee-43a8-a5bc-a07670602912-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:37:24 user nova-compute[74840]: DEBUG nova.compute.manager [req-582a9b70-9659-4af4-abcb-54ae9f593cde req-6aa07d0b-9909-4427-87d9-ba81024bc733 service nova] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] No waiting events found dispatching network-vif-plugged-48ba3111-f22a-4a29-8183-ccd94efa9086 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:37:24 user nova-compute[74840]: WARNING nova.compute.manager [req-582a9b70-9659-4af4-abcb-54ae9f593cde req-6aa07d0b-9909-4427-87d9-ba81024bc733 service nova] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Received unexpected event network-vif-plugged-48ba3111-f22a-4a29-8183-ccd94efa9086 for instance with vm_state deleted and task_state None.
Nov 08 12:37:24 user nova-compute[74840]: DEBUG nova.compute.manager [req-582a9b70-9659-4af4-abcb-54ae9f593cde req-6aa07d0b-9909-4427-87d9-ba81024bc733 service nova] [instance: 832a6445-84ee-43a8-a5bc-a07670602912] Received event network-vif-deleted-48ba3111-f22a-4a29-8183-ccd94efa9086 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:37:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60e08fe0addd41deea40c877b9fd77e748d85727,backing_fmt=raw /opt/stack/data/nova/instances/6156dbbc-6539-4de3-8ba0-16db61cd7dce/disk 1073741824" returned: 0 in 0.070s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "60e08fe0addd41deea40c877b9fd77e748d85727" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:37:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60e08fe0addd41deea40c877b9fd77e748d85727 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:25 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60e08fe0addd41deea40c877b9fd77e748d85727 --force-share --output=json" returned: 0 in 0.199s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:25 user nova-compute[74840]: DEBUG nova.objects.instance [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lazy-loading 'migration_context' on Instance uuid 6156dbbc-6539-4de3-8ba0-16db61cd7dce {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:37:25 user nova-compute[74840]: DEBUG nova.objects.base [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Object Instance<6156dbbc-6539-4de3-8ba0-16db61cd7dce> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:37:25 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Rebasing disk image.
Nov 08 12:37:25 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:25 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-f7d5dccc-2734-4f72-a738-62cc5abfcd31 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:37:25 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-f7d5dccc-2734-4f72-a738-62cc5abfcd31 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:37:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f7d5dccc-2734-4f72-a738-62cc5abfcd31 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.512s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:37:25 user nova-compute[74840]: DEBUG nova.compute.manager [req-011005c9-3fea-48b3-9656-413fab5e2b46 req-968f15af-292f-49e9-a934-859af8c7107f service nova] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Received event network-vif-plugged-18c0341b-6a4a-4235-993f-da29deeadcb5 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:37:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-011005c9-3fea-48b3-9656-413fab5e2b46 req-968f15af-292f-49e9-a934-859af8c7107f service nova] Acquiring lock "c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:37:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-011005c9-3fea-48b3-9656-413fab5e2b46 req-968f15af-292f-49e9-a934-859af8c7107f service nova] Lock "c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:37:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-011005c9-3fea-48b3-9656-413fab5e2b46 req-968f15af-292f-49e9-a934-859af8c7107f service nova] Lock "c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:37:25 user nova-compute[74840]: DEBUG nova.compute.manager [req-011005c9-3fea-48b3-9656-413fab5e2b46 req-968f15af-292f-49e9-a934-859af8c7107f service nova] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] No waiting events found dispatching network-vif-plugged-18c0341b-6a4a-4235-993f-da29deeadcb5 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:37:25 user nova-compute[74840]: WARNING nova.compute.manager [req-011005c9-3fea-48b3-9656-413fab5e2b46 req-968f15af-292f-49e9-a934-859af8c7107f service nova] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Received unexpected event network-vif-plugged-18c0341b-6a4a-4235-993f-da29deeadcb5 for instance with vm_state building and task_state spawning.
Nov 08 12:37:25 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.192s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:25 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 -F raw /opt/stack/data/nova/instances/6156dbbc-6539-4de3-8ba0-16db61cd7dce/disk {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:25 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-f7d5dccc-2734-4f72-a738-62cc5abfcd31 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Deleted allocations for instance 832a6445-84ee-43a8-a5bc-a07670602912
Nov 08 12:37:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f7d5dccc-2734-4f72-a738-62cc5abfcd31 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "832a6445-84ee-43a8-a5bc-a07670602912" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.947s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:37:25 user nova-compute[74840]: DEBUG nova.compute.manager [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:37:25 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:37:25 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Instance spawned successfully.
Nov 08 12:37:25 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:37:25 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Found default for hw_cdrom_bus of ide {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:37:25 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Found default for hw_disk_bus of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:37:25 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:37:25 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:37:25 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Found default for hw_video_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:37:25 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Found default for hw_vif_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:37:26 user nova-compute[74840]: INFO nova.compute.manager [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Took 5.97 seconds to spawn the instance on the hypervisor.
Nov 08 12:37:26 user nova-compute[74840]: DEBUG nova.compute.manager [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:37:26 user nova-compute[74840]: INFO nova.compute.manager [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Took 30.96 seconds to build instance.
Nov 08 12:37:26 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-a153e9db-fa76-43c5-98f1-61286ae6ee99 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.063s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:37:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 -F raw /opt/stack/data/nova/instances/6156dbbc-6539-4de3-8ba0-16db61cd7dce/disk" returned: 0 in 2.356s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:27 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Created local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 12:37:27 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Ensure instance console log exists: /opt/stack/data/nova/instances/6156dbbc-6539-4de3-8ba0-16db61cd7dce/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:37:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:37:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:37:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:37:27 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Start _get_guest_xml network_info=[{"id": "0c5dbe98-66f5-492a-8da2-8eca6cf38de5", "address": "fa:16:3e:ab:15:81", "network": {"id": "918d8aed-1f09-4cfb-9c7f-48f002ad6ba3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-927886396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a05cda834445fb94e71f6cac02f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5dbe98-66", "ovs_interfaceid": "0c5dbe98-66f5-492a-8da2-8eca6cf38de5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='43e1dad0b1633a1131f079c3259eaf34',container_format='bare',created_at=2023-11-08T12:35:28Z,direct_url=<?>,disk_format='qcow2',id=8a0092e8-d157-407b-a3e0-27e55fd04f84,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1903705906-shelved',owner='93a05cda834445fb94e71f6cac02f198',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T12:35:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'image_id': '4fa17706-d304-4117-a420-dab994c703dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:37:27 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:37:27 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:37:27 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:37:27 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:37:27 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:37:27 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:37:27 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:37:27 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='43e1dad0b1633a1131f079c3259eaf34',container_format='bare',created_at=2023-11-08T12:35:28Z,direct_url=<?>,disk_format='qcow2',id=8a0092e8-d157-407b-a3e0-27e55fd04f84,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1903705906-shelved',owner='93a05cda834445fb94e71f6cac02f198',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T12:35:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:37:27 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:37:27 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:37:27 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:37:27 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:37:27 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:37:27 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:37:27 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:37:27 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:37:27 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:37:27 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:37:27 user nova-compute[74840]: DEBUG nova.objects.instance [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6156dbbc-6539-4de3-8ba0-16db61cd7dce {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:37:27 user nova-compute[74840]: DEBUG nova.objects.base [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Object Instance<6156dbbc-6539-4de3-8ba0-16db61cd7dce> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:37:27 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T12:33:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1903705906',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1903705906',id=42,image_ref='8a0092e8-d157-407b-a3e0-27e55fd04f84',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1939521876',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:33:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='93a05cda834445fb94e71f6cac02f198',ramdisk_id='',reservation_id='r-wqqsoqk3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1958698266',owner_user_name='tempest-AttachVolumeShelveTestJSON-1958698266-project-member',shelved_at='2023-11-08T12:35:32.396492',shelved_host='user',shelved_image_id='8a0092e8-d157-407b-a3e0-27e55fd04f84'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:37:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='afc4e8483a1f4e08b3f81a9b9323be84',uuid=6156dbbc-6539-4de3-8ba0-16db61cd7dce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0c5dbe98-66f5-492a-8da2-8eca6cf38de5", "address": "fa:16:3e:ab:15:81", "network": {"id": "918d8aed-1f09-4cfb-9c7f-48f002ad6ba3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-927886396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a05cda834445fb94e71f6cac02f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5dbe98-66", "ovs_interfaceid": "0c5dbe98-66f5-492a-8da2-8eca6cf38de5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:37:27 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Converting VIF {"id": "0c5dbe98-66f5-492a-8da2-8eca6cf38de5", "address": "fa:16:3e:ab:15:81", "network": {"id": "918d8aed-1f09-4cfb-9c7f-48f002ad6ba3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-927886396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a05cda834445fb94e71f6cac02f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5dbe98-66", "ovs_interfaceid": "0c5dbe98-66f5-492a-8da2-8eca6cf38de5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:37:27 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:15:81,bridge_name='br-int',has_traffic_filtering=True,id=0c5dbe98-66f5-492a-8da2-8eca6cf38de5,network=Network(918d8aed-1f09-4cfb-9c7f-48f002ad6ba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5dbe98-66') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:37:27 user nova-compute[74840]: DEBUG nova.objects.instance [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lazy-loading 'pci_devices' on Instance uuid 6156dbbc-6539-4de3-8ba0-16db61cd7dce {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:37:27 user nova-compute[74840]: DEBUG nova.objects.base [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Object Instance<6156dbbc-6539-4de3-8ba0-16db61cd7dce> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:37:27 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:37:27 user nova-compute[74840]:   <uuid>6156dbbc-6539-4de3-8ba0-16db61cd7dce</uuid>
Nov 08 12:37:27 user nova-compute[74840]:   <name>instance-0000002a</name>
Nov 08 12:37:27 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:37:27 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:37:27 user nova-compute[74840]:   <metadata>
Nov 08 12:37:27 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:37:27 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:37:27 user nova-compute[74840]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1903705906</nova:name>
Nov 08 12:37:27 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:37:27</nova:creationTime>
Nov 08 12:37:27 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:37:27 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:37:27 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:37:27 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:37:27 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:37:27 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:37:27 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:37:27 user nova-compute[74840]:       <nova:owner>
Nov 08 12:37:27 user nova-compute[74840]:         <nova:user uuid="afc4e8483a1f4e08b3f81a9b9323be84">tempest-AttachVolumeShelveTestJSON-1958698266-project-member</nova:user>
Nov 08 12:37:27 user nova-compute[74840]:         <nova:project uuid="93a05cda834445fb94e71f6cac02f198">tempest-AttachVolumeShelveTestJSON-1958698266</nova:project>
Nov 08 12:37:27 user nova-compute[74840]:       </nova:owner>
Nov 08 12:37:27 user nova-compute[74840]:       <nova:root type="image" uuid="8a0092e8-d157-407b-a3e0-27e55fd04f84"/>
Nov 08 12:37:27 user nova-compute[74840]:       <nova:ports>
Nov 08 12:37:27 user nova-compute[74840]:         <nova:port uuid="0c5dbe98-66f5-492a-8da2-8eca6cf38de5">
Nov 08 12:37:27 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 12:37:27 user nova-compute[74840]:         </nova:port>
Nov 08 12:37:27 user nova-compute[74840]:       </nova:ports>
Nov 08 12:37:27 user nova-compute[74840]:     </nova:instance>
Nov 08 12:37:27 user nova-compute[74840]:   </metadata>
Nov 08 12:37:27 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:37:27 user nova-compute[74840]:     <system>
Nov 08 12:37:27 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:37:27 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:37:27 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:37:27 user nova-compute[74840]:       <entry name="serial">6156dbbc-6539-4de3-8ba0-16db61cd7dce</entry>
Nov 08 12:37:27 user nova-compute[74840]:       <entry name="uuid">6156dbbc-6539-4de3-8ba0-16db61cd7dce</entry>
Nov 08 12:37:27 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:37:27 user nova-compute[74840]:     </system>
Nov 08 12:37:27 user nova-compute[74840]:   </sysinfo>
Nov 08 12:37:27 user nova-compute[74840]:   <os>
Nov 08 12:37:27 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:37:27 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:37:27 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:37:27 user nova-compute[74840]:   </os>
Nov 08 12:37:27 user nova-compute[74840]:   <features>
Nov 08 12:37:27 user nova-compute[74840]:     <acpi/>
Nov 08 12:37:27 user nova-compute[74840]:     <apic/>
Nov 08 12:37:27 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:37:27 user nova-compute[74840]:   </features>
Nov 08 12:37:27 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:37:27 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:37:27 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:37:27 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:37:27 user nova-compute[74840]:   </clock>
Nov 08 12:37:27 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:37:27 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:37:27 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:37:27 user nova-compute[74840]:   </cpu>
Nov 08 12:37:27 user nova-compute[74840]:   <devices>
Nov 08 12:37:27 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:37:27 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:37:27 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/6156dbbc-6539-4de3-8ba0-16db61cd7dce/disk"/>
Nov 08 12:37:27 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:37:27 user nova-compute[74840]:     </disk>
Nov 08 12:37:27 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:37:27 user nova-compute[74840]:       <mac address="fa:16:3e:ab:15:81"/>
Nov 08 12:37:27 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:37:27 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:37:27 user nova-compute[74840]:       <target dev="tap0c5dbe98-66"/>
Nov 08 12:37:27 user nova-compute[74840]:     </interface>
Nov 08 12:37:27 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:37:27 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/6156dbbc-6539-4de3-8ba0-16db61cd7dce/console.log" append="off"/>
Nov 08 12:37:27 user nova-compute[74840]:     </serial>
Nov 08 12:37:27 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:37:27 user nova-compute[74840]:     <video>
Nov 08 12:37:27 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:37:27 user nova-compute[74840]:     </video>
Nov 08 12:37:27 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:37:27 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:37:27 user nova-compute[74840]:     </rng>
Nov 08 12:37:27 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:37:27 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:37:27 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:37:27 user nova-compute[74840]:     </memballoon>
Nov 08 12:37:27 user nova-compute[74840]:   </devices>
Nov 08 12:37:27 user nova-compute[74840]: </domain>
Nov 08 12:37:27 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:37:27 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T12:33:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1903705906',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1903705906',id=42,image_ref='8a0092e8-d157-407b-a3e0-27e55fd04f84',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1939521876',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:33:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='93a05cda834445fb94e71f6cac02f198',ramdisk_id='',reservation_id='r-wqqsoqk3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1958698266',owner_user_name='tempest-AttachVolumeShelveTestJSON-1958698266-project-member',shelved_at='2023-11-08T12:35:32.396492',shelved_host='user',shelved_image_id='8a0092e8-d157-407b-a3e0-27e55fd04f84'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:37:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='afc4e8483a1f4e08b3f81a9b9323be84',uuid=6156dbbc-6539-4de3-8ba0-16db61cd7dce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0c5dbe98-66f5-492a-8da2-8eca6cf38de5", "address": "fa:16:3e:ab:15:81", "network": {"id": "918d8aed-1f09-4cfb-9c7f-48f002ad6ba3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-927886396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a05cda834445fb94e71f6cac02f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5dbe98-66", "ovs_interfaceid": "0c5dbe98-66f5-492a-8da2-8eca6cf38de5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:37:27 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Converting VIF {"id": "0c5dbe98-66f5-492a-8da2-8eca6cf38de5", "address": "fa:16:3e:ab:15:81", "network": {"id": "918d8aed-1f09-4cfb-9c7f-48f002ad6ba3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-927886396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a05cda834445fb94e71f6cac02f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5dbe98-66", "ovs_interfaceid": "0c5dbe98-66f5-492a-8da2-8eca6cf38de5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:37:27 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:15:81,bridge_name='br-int',has_traffic_filtering=True,id=0c5dbe98-66f5-492a-8da2-8eca6cf38de5,network=Network(918d8aed-1f09-4cfb-9c7f-48f002ad6ba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5dbe98-66') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:37:27 user nova-compute[74840]: DEBUG os_vif [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:15:81,bridge_name='br-int',has_traffic_filtering=True,id=0c5dbe98-66f5-492a-8da2-8eca6cf38de5,network=Network(918d8aed-1f09-4cfb-9c7f-48f002ad6ba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5dbe98-66') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:37:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:37:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:37:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f59aa083-a44e-5bd3-95cb-9c51c714b2dc', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:37:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c5dbe98-66, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:37:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0c5dbe98-66, col_values=(('qos', UUID('61a976ba-ab62-46c6-8c88-c2281790bdfb')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:37:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0c5dbe98-66, col_values=(('external_ids', {'iface-id': '0c5dbe98-66f5-492a-8da2-8eca6cf38de5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:15:81', 'vm-uuid': '6156dbbc-6539-4de3-8ba0-16db61cd7dce'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:37:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:37:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:27 user nova-compute[74840]: INFO os_vif [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:15:81,bridge_name='br-int',has_traffic_filtering=True,id=0c5dbe98-66f5-492a-8da2-8eca6cf38de5,network=Network(918d8aed-1f09-4cfb-9c7f-48f002ad6ba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5dbe98-66')
Nov 08 12:37:27 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:37:27 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] No VIF found with MAC fa:16:3e:ab:15:81, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:37:29 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:29 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:29 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:29 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:29 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:37:29 user nova-compute[74840]: DEBUG nova.compute.manager [req-4d6958c6-5d1d-4b47-8048-3bc4a3cb5041 req-bf6ef164-6ee9-4f4e-b521-3e224c3493df service nova] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Received event network-vif-plugged-0c5dbe98-66f5-492a-8da2-8eca6cf38de5 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:37:29 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4d6958c6-5d1d-4b47-8048-3bc4a3cb5041 req-bf6ef164-6ee9-4f4e-b521-3e224c3493df service nova] Acquiring lock "6156dbbc-6539-4de3-8ba0-16db61cd7dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:37:29 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4d6958c6-5d1d-4b47-8048-3bc4a3cb5041 req-bf6ef164-6ee9-4f4e-b521-3e224c3493df service nova] Lock "6156dbbc-6539-4de3-8ba0-16db61cd7dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:37:29 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4d6958c6-5d1d-4b47-8048-3bc4a3cb5041 req-bf6ef164-6ee9-4f4e-b521-3e224c3493df service nova] Lock "6156dbbc-6539-4de3-8ba0-16db61cd7dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:37:29 user nova-compute[74840]: DEBUG nova.compute.manager [req-4d6958c6-5d1d-4b47-8048-3bc4a3cb5041 req-bf6ef164-6ee9-4f4e-b521-3e224c3493df service nova] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] No waiting events found dispatching network-vif-plugged-0c5dbe98-66f5-492a-8da2-8eca6cf38de5 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:37:29 user nova-compute[74840]: WARNING nova.compute.manager [req-4d6958c6-5d1d-4b47-8048-3bc4a3cb5041 req-bf6ef164-6ee9-4f4e-b521-3e224c3493df service nova] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Received unexpected event network-vif-plugged-0c5dbe98-66f5-492a-8da2-8eca6cf38de5 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 08 12:37:30 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:30 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:30 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:30 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:31 user nova-compute[74840]: DEBUG nova.compute.manager [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:37:31 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:37:31 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Instance spawned successfully.
Nov 08 12:37:31 user nova-compute[74840]: DEBUG nova.compute.manager [req-113cf6e9-faf6-470d-bd98-45f63b34dfd3 req-c5e2b073-770c-472c-ae29-107b851269e5 service nova] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Received event network-vif-plugged-0c5dbe98-66f5-492a-8da2-8eca6cf38de5 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:37:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-113cf6e9-faf6-470d-bd98-45f63b34dfd3 req-c5e2b073-770c-472c-ae29-107b851269e5 service nova] Acquiring lock "6156dbbc-6539-4de3-8ba0-16db61cd7dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:37:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-113cf6e9-faf6-470d-bd98-45f63b34dfd3 req-c5e2b073-770c-472c-ae29-107b851269e5 service nova] Lock "6156dbbc-6539-4de3-8ba0-16db61cd7dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:37:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-113cf6e9-faf6-470d-bd98-45f63b34dfd3 req-c5e2b073-770c-472c-ae29-107b851269e5 service nova] Lock "6156dbbc-6539-4de3-8ba0-16db61cd7dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:37:31 user nova-compute[74840]: DEBUG nova.compute.manager [req-113cf6e9-faf6-470d-bd98-45f63b34dfd3 req-c5e2b073-770c-472c-ae29-107b851269e5 service nova] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] No waiting events found dispatching network-vif-plugged-0c5dbe98-66f5-492a-8da2-8eca6cf38de5 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:37:31 user nova-compute[74840]: WARNING nova.compute.manager [req-113cf6e9-faf6-470d-bd98-45f63b34dfd3 req-c5e2b073-770c-472c-ae29-107b851269e5 service nova] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Received unexpected event network-vif-plugged-0c5dbe98-66f5-492a-8da2-8eca6cf38de5 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 08 12:37:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:31 user nova-compute[74840]: DEBUG nova.compute.manager [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:37:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ef53a414-f53e-48cf-8965-8a5cb73a32dc tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "6156dbbc-6539-4de3-8ba0-16db61cd7dce" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.228s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:37:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Calling os-brick to attach iSCSI Volume {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'boJeuUdc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:37:47 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:37:47 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:37:47 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:37:47 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:37:47 user nova-compute[74840]: INFO os_brick.initiator.connectors.iscsi [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 12:37:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881 -p 172.16.0.220:3260 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[94eb1d20-d61e-451a-8d54-23dc5041396a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 12:37:47 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881 -p 172.16.0.220:3260 --interface default --op new {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20d2f87-419e-4182-b8e5-d1686d9a81f6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881] added\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881] added
Nov 08 12:37:47 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f521696d-89f3-4cab-aebd-d2902a2c50ac]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d803da2-fcd0-48ed-8d72-ca1cf82c6951]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v boJeuUdc {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v boJeuUdc" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e5e9e3-0360-4970-9770-72d2cfa3f28f]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'boJeuUdc'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a37711-fbda-496a-b658-42bc4da0f16f]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b017fb4-d908-4bdf-af9e-3cc6ed66d137]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:37:47 user nova-compute[74840]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 (non-flash)
Nov 08 12:37:47 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:37:47 user nova-compute[74840]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 (non-flash)
Nov 08 12:37:47 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881 -p 172.16.0.220:3260 --login {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[35fa2e72-b248-49ee-8e1b-c94ada0cecee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881, portal: 172.16.0.220,3260]
Nov 08 12:37:47 user nova-compute[74840]: Login to [iface: default, target: iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881, portal: 172.16.0.220,3260] successful.
Nov 08 12:37:47 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[0451fcc6-07f4-4c9b-9407-1e4f99efe832]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c89b23-8353-4292-ac21-da8c41909a6d]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:37:47 user nova-compute[74840]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 (non-flash)
Nov 08 12:37:47 user nova-compute[74840]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881 (non-flash)
Nov 08 12:37:47 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:37:47 user nova-compute[74840]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 (non-flash)
Nov 08 12:37:47 user nova-compute[74840]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881 (non-flash)
Nov 08 12:37:47 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Connected to 172.16.0.220:3260 {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=74840) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74840) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[663bcb34-f520-4133-bf7a-1d8914f67d84]: (4, ('- - 0', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: None {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:37:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:48 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:37:48 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'boJeuUdc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 12:37:48 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:37:48 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '26237313430383638', 'path': '/dev/sdc'} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:37:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237313430383638', 'path': '/dev/sdc'} {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 12:37:48 user nova-compute[74840]: DEBUG nova.objects.instance [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lazy-loading 'flavor' on Instance uuid 0cecc731-6f86-475c-8603-591de8e30412 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:37:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 12:37:48 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:37:48 user nova-compute[74840]:   <source dev="/dev/sdc"/>
Nov 08 12:37:48 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:37:48 user nova-compute[74840]:   <serial>09a74a9e-3fd0-4d3f-ac36-7689df100881</serial>
Nov 08 12:37:48 user nova-compute[74840]: </disk>
Nov 08 12:37:48 user nova-compute[74840]:  {{(pid=74840) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 12:37:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:37:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:37:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] No VIF found with MAC fa:16:3e:6f:d6:9b, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:37:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f20ab1fa-d7fe-4eba-8bda-d8ec2c42f3b9 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "0cecc731-6f86-475c-8603-591de8e30412" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.824s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:37:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e6766600-5702-4f7f-a033-6056c25ff570 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Acquiring lock "0cecc731-6f86-475c-8603-591de8e30412" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:37:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e6766600-5702-4f7f-a033-6056c25ff570 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "0cecc731-6f86-475c-8603-591de8e30412" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:37:50 user nova-compute[74840]: INFO nova.compute.manager [None req-e6766600-5702-4f7f-a033-6056c25ff570 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Detaching volume 09a74a9e-3fd0-4d3f-ac36-7689df100881
Nov 08 12:37:50 user nova-compute[74840]: INFO nova.virt.block_device [None req-e6766600-5702-4f7f-a033-6056c25ff570 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Attempting to driver detach volume 09a74a9e-3fd0-4d3f-ac36-7689df100881 from mountpoint /dev/vdb
Nov 08 12:37:50 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-e6766600-5702-4f7f-a033-6056c25ff570 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Attempting to detach device vdb from instance 0cecc731-6f86-475c-8603-591de8e30412 from the persistent domain config. {{(pid=74840) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 12:37:50 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-e6766600-5702-4f7f-a033-6056c25ff570 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 12:37:50 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:37:50 user nova-compute[74840]:   <source dev="/dev/sdc"/>
Nov 08 12:37:50 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:37:50 user nova-compute[74840]:   <serial>09a74a9e-3fd0-4d3f-ac36-7689df100881</serial>
Nov 08 12:37:50 user nova-compute[74840]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 12:37:50 user nova-compute[74840]: </disk>
Nov 08 12:37:50 user nova-compute[74840]:  {{(pid=74840) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 12:37:50 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-e6766600-5702-4f7f-a033-6056c25ff570 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Successfully detached device vdb from instance 0cecc731-6f86-475c-8603-591de8e30412 from the persistent domain config.
Nov 08 12:37:50 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-e6766600-5702-4f7f-a033-6056c25ff570 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0cecc731-6f86-475c-8603-591de8e30412 from the live domain config. {{(pid=74840) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 12:37:50 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-e6766600-5702-4f7f-a033-6056c25ff570 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 12:37:50 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:37:50 user nova-compute[74840]:   <source dev="/dev/sdc"/>
Nov 08 12:37:50 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:37:50 user nova-compute[74840]:   <serial>09a74a9e-3fd0-4d3f-ac36-7689df100881</serial>
Nov 08 12:37:50 user nova-compute[74840]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 12:37:50 user nova-compute[74840]: </disk>
Nov 08 12:37:50 user nova-compute[74840]:  {{(pid=74840) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 12:37:51 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-e6766600-5702-4f7f-a033-6056c25ff570 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0cecc731-6f86-475c-8603-591de8e30412 {{(pid=74840) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 12:37:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Acquiring lock "550f8fed-4652-46fe-a440-974ee8f88196" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:37:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Lock "550f8fed-4652-46fe-a440-974ee8f88196" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:37:57 user nova-compute[74840]: INFO nova.compute.manager [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Unshelving
Nov 08 12:37:57 user nova-compute[74840]: INFO nova.virt.block_device [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Booting with volume 177df23a-e5d3-41e7-ac17-e0959f15e616 at /dev/vda
Nov 08 12:37:57 user nova-compute[74840]: DEBUG os_brick.utils [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:37:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:57 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[24cb3872-7870-4695-ab64-4b89c85c82f9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c8228a11e03c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:37:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:57 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafddef2-822d-4e3b-9c90-dff1f3b1302b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:37:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:57 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1188b3d9-111a-494d-8cd0-67dd2646a302]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:37:57 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a7a064-8a76-45c7-a033-6a5920c0f433]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:37:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Running cmd (subprocess): nvme version {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] 'nvme version' failed. Not Retrying. {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:37:57 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] nvme not present on system {{(pid=74840) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 12:37:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:37:57 user nova-compute[74840]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 12:37:57 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23dacae-caf1-4bbb-bca9-5d70dbaed657]: (4, '') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:37:57 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74840) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 12:37:57 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 12:37:57 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] LIGHTOS: no hostnqn found. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 12:37:57 user nova-compute[74840]: DEBUG os_brick.utils [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c8228a11e03c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:37:57 user nova-compute[74840]: DEBUG nova.virt.block_device [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Updating existing volume attachment record: 2a302fd0-da4d-4fc4-9978-51fa68e747a8 {{(pid=74840) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 12:37:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c801062e-0555-48cc-8d19-d035530a34a2 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquiring lock "ffe50042-29bf-4ef3-a148-8698bc75233b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:37:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c801062e-0555-48cc-8d19-d035530a34a2 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "ffe50042-29bf-4ef3-a148-8698bc75233b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:37:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c801062e-0555-48cc-8d19-d035530a34a2 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquiring lock "ffe50042-29bf-4ef3-a148-8698bc75233b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:37:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c801062e-0555-48cc-8d19-d035530a34a2 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "ffe50042-29bf-4ef3-a148-8698bc75233b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:37:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c801062e-0555-48cc-8d19-d035530a34a2 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "ffe50042-29bf-4ef3-a148-8698bc75233b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:37:58 user nova-compute[74840]: INFO nova.compute.manager [None req-c801062e-0555-48cc-8d19-d035530a34a2 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Terminating instance
Nov 08 12:37:58 user nova-compute[74840]: DEBUG nova.compute.manager [None req-c801062e-0555-48cc-8d19-d035530a34a2 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Start destroying the instance on the hypervisor. {{(pid=74840) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 12:37:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:58 user nova-compute[74840]: DEBUG nova.compute.manager [req-752935c7-96d7-48bd-91c5-6aed5ce31ed3 req-0ee29dba-a065-40bf-89b2-a415a8f948cc service nova] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Received event network-vif-unplugged-6169b221-7840-4cfb-ba25-e34a95b35e77 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:37:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-752935c7-96d7-48bd-91c5-6aed5ce31ed3 req-0ee29dba-a065-40bf-89b2-a415a8f948cc service nova] Acquiring lock "ffe50042-29bf-4ef3-a148-8698bc75233b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:37:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-752935c7-96d7-48bd-91c5-6aed5ce31ed3 req-0ee29dba-a065-40bf-89b2-a415a8f948cc service nova] Lock "ffe50042-29bf-4ef3-a148-8698bc75233b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:37:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-752935c7-96d7-48bd-91c5-6aed5ce31ed3 req-0ee29dba-a065-40bf-89b2-a415a8f948cc service nova] Lock "ffe50042-29bf-4ef3-a148-8698bc75233b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:37:58 user nova-compute[74840]: DEBUG nova.compute.manager [req-752935c7-96d7-48bd-91c5-6aed5ce31ed3 req-0ee29dba-a065-40bf-89b2-a415a8f948cc service nova] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] No waiting events found dispatching network-vif-unplugged-6169b221-7840-4cfb-ba25-e34a95b35e77 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:37:58 user nova-compute[74840]: DEBUG nova.compute.manager [req-752935c7-96d7-48bd-91c5-6aed5ce31ed3 req-0ee29dba-a065-40bf-89b2-a415a8f948cc service nova] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Received event network-vif-unplugged-6169b221-7840-4cfb-ba25-e34a95b35e77 for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:37:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:58 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Instance destroyed successfully.
Nov 08 12:37:58 user nova-compute[74840]: DEBUG nova.objects.instance [None req-c801062e-0555-48cc-8d19-d035530a34a2 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lazy-loading 'resources' on Instance uuid ffe50042-29bf-4ef3-a148-8698bc75233b {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:37:58 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-c801062e-0555-48cc-8d19-d035530a34a2 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:20:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1225300234',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1225300234',id=24,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:23:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72c97c47ab144ef3a8d5e9ee1ecc059e',ramdisk_id='',reservation_id='r-pfesogm8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-297593405',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:25:07Z,user_data=None,user_id='275e3d340c9d4d9e90b579e4bc0bfe0b',uuid=ffe50042-29bf-4ef3-a148-8698bc75233b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6169b221-7840-4cfb-ba25-e34a95b35e77", "address": "fa:16:3e:b0:6a:c2", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6169b221-78", "ovs_interfaceid": "6169b221-7840-4cfb-ba25-e34a95b35e77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:37:58 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-c801062e-0555-48cc-8d19-d035530a34a2 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Converting VIF {"id": "6169b221-7840-4cfb-ba25-e34a95b35e77", "address": "fa:16:3e:b0:6a:c2", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6169b221-78", "ovs_interfaceid": "6169b221-7840-4cfb-ba25-e34a95b35e77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:37:58 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-c801062e-0555-48cc-8d19-d035530a34a2 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:6a:c2,bridge_name='br-int',has_traffic_filtering=True,id=6169b221-7840-4cfb-ba25-e34a95b35e77,network=Network(8388eafb-b115-49c7-82cd-0d85d0ee12e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6169b221-78') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:37:58 user nova-compute[74840]: DEBUG os_vif [None req-c801062e-0555-48cc-8d19-d035530a34a2 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:6a:c2,bridge_name='br-int',has_traffic_filtering=True,id=6169b221-7840-4cfb-ba25-e34a95b35e77,network=Network(8388eafb-b115-49c7-82cd-0d85d0ee12e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6169b221-78') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:37:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6169b221-78, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:37:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:37:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=683c15f9-d730-47a4-84ba-aeffb274f6a9) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:37:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:37:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:37:58 user nova-compute[74840]: INFO os_vif [None req-c801062e-0555-48cc-8d19-d035530a34a2 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:6a:c2,bridge_name='br-int',has_traffic_filtering=True,id=6169b221-7840-4cfb-ba25-e34a95b35e77,network=Network(8388eafb-b115-49c7-82cd-0d85d0ee12e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6169b221-78')
Nov 08 12:37:58 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c801062e-0555-48cc-8d19-d035530a34a2 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 12:37:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c801062e-0555-48cc-8d19-d035530a34a2 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'veKSyoaB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:37:58 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-c801062e-0555-48cc-8d19-d035530a34a2 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:37:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-c801062e-0555-48cc-8d19-d035530a34a2 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:37:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-c801062e-0555-48cc-8d19-d035530a34a2 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:37:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:58 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f75379e-4ec2-41ea-a9bb-db39f7008d9d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:37:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c801062e-0555-48cc-8d19-d035530a34a2 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 12:37:58 user nova-compute[74840]: No targets found.
Nov 08 12:37:58 user nova-compute[74840]: iSNS:
Nov 08 12:37:58 user nova-compute[74840]: No targets found.
Nov 08 12:37:58 user nova-compute[74840]: STATIC:
Nov 08 12:37:58 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665
Nov 08 12:37:58 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:37:58 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:37:58 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4
Nov 08 12:37:58 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:37:58 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:37:58 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881
Nov 08 12:37:58 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:37:58 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:37:58 user nova-compute[74840]: FIRMWARE:
Nov 08 12:37:58 user nova-compute[74840]: No targets found.
Nov 08 12:37:58 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:37:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c801062e-0555-48cc-8d19-d035530a34a2 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 12:37:58 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 12:37:58 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 12:37:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c801062e-0555-48cc-8d19-d035530a34a2 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 12:37:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:59 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97d2881-7c6e-4bf6-b3d1-8d27096e75c6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:37:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:59 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9448f900-fac7-4db3-9ba2-290f1f2b1aa1]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:37:59 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c801062e-0555-48cc-8d19-d035530a34a2 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:37:59 user nova-compute[74840]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 (non-flash)
Nov 08 12:37:59 user nova-compute[74840]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881 (non-flash)
Nov 08 12:37:59 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:37:59 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c801062e-0555-48cc-8d19-d035530a34a2 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 (non-flash)
Nov 08 12:37:59 user nova-compute[74840]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 (non-flash)
Nov 08 12:37:59 user nova-compute[74840]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881 (non-flash)
Nov 08 12:37:59 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:37:59 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c801062e-0555-48cc-8d19-d035530a34a2 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7f437beb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4'): ({'sdf'}, set())}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 12:37:59 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-c801062e-0555-48cc-8d19-d035530a34a2 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Removing single pathed devices sdf {{(pid=74840) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 12:37:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:59 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3d5f75-13e2-439f-b547-f2f0664c6eb1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:37:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:59 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c1c96a-e33a-424f-aa3c-fa9d3a8e667d]: (4, ('ok\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:37:59 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-c801062e-0555-48cc-8d19-d035530a34a2 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Flushing IO for device /dev/sdf {{(pid=74840) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 12:37:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:59 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9976b798-0081-4ab9-bb06-aa110a98bdd3]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:37:59 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-c801062e-0555-48cc-8d19-d035530a34a2 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74840) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 12:37:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:59 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[13391c88-e3ac-4518-be29-658b5082e97e]: (4, ('1', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:37:59 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-c801062e-0555-48cc-8d19-d035530a34a2 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 12:37:59 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-c801062e-0555-48cc-8d19-d035530a34a2 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] SCSI volumes sdf have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 12:37:59 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c801062e-0555-48cc-8d19-d035530a34a2 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4')] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 12:37:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:59 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0335e2-9052-4767-b396-3ad208b29f65]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:37:59 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c801062e-0555-48cc-8d19-d035530a34a2 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:37:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 -p 172.16.0.220:3260 --logout {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:59 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[540261a9-c769-49e0-9702-419c270430a6]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:37:59 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c801062e-0555-48cc-8d19-d035530a34a2 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4, portal: 172.16.0.220,3260]
Nov 08 12:37:59 user nova-compute[74840]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4, portal: 172.16.0.220,3260] successful.
Nov 08 12:37:59 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:37:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 -p 172.16.0.220:3260 --op delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:37:59 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10d90d99-351a-48a3-8ad3-37a2bbbc76a4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:37:59 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b216d1-c0b7-4efa-8312-212f55d2091a]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:37:59 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c801062e-0555-48cc-8d19-d035530a34a2 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:37:59 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-c801062e-0555-48cc-8d19-d035530a34a2 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:37:59 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c801062e-0555-48cc-8d19-d035530a34a2 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] <== disconnect_volume: return (322ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:37:59 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c801062e-0555-48cc-8d19-d035530a34a2 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 12:37:59 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-c801062e-0555-48cc-8d19-d035530a34a2 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Deleting instance files /opt/stack/data/nova/instances/ffe50042-29bf-4ef3-a148-8698bc75233b_del
Nov 08 12:37:59 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-c801062e-0555-48cc-8d19-d035530a34a2 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Deletion of /opt/stack/data/nova/instances/ffe50042-29bf-4ef3-a148-8698bc75233b_del complete
Nov 08 12:37:59 user nova-compute[74840]: INFO nova.compute.manager [None req-c801062e-0555-48cc-8d19-d035530a34a2 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 08 12:37:59 user nova-compute[74840]: DEBUG oslo.service.loopingcall [None req-c801062e-0555-48cc-8d19-d035530a34a2 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74840) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 12:37:59 user nova-compute[74840]: DEBUG nova.compute.manager [-] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Deallocating network for instance {{(pid=74840) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 12:37:59 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] deallocate_for_instance() {{(pid=74840) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 12:38:00 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:38:00 user nova-compute[74840]: INFO nova.compute.manager [-] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Took 0.85 seconds to deallocate network for instance.
Nov 08 12:38:00 user nova-compute[74840]: DEBUG nova.compute.manager [req-9b6352db-2b30-4232-8d51-90174cdbb76d req-29835a23-ea07-4f81-bcb3-fcad5c419800 service nova] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Received event network-vif-deleted-6169b221-7840-4cfb-ba25-e34a95b35e77 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:38:00 user nova-compute[74840]: DEBUG nova.compute.manager [req-16fb494f-ad2b-41c1-8283-4a6199cc581a req-6aacfad9-530d-400c-b588-486120557b7c service nova] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Received event network-vif-plugged-6169b221-7840-4cfb-ba25-e34a95b35e77 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:38:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-16fb494f-ad2b-41c1-8283-4a6199cc581a req-6aacfad9-530d-400c-b588-486120557b7c service nova] Acquiring lock "ffe50042-29bf-4ef3-a148-8698bc75233b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:38:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-16fb494f-ad2b-41c1-8283-4a6199cc581a req-6aacfad9-530d-400c-b588-486120557b7c service nova] Lock "ffe50042-29bf-4ef3-a148-8698bc75233b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:38:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-16fb494f-ad2b-41c1-8283-4a6199cc581a req-6aacfad9-530d-400c-b588-486120557b7c service nova] Lock "ffe50042-29bf-4ef3-a148-8698bc75233b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:38:00 user nova-compute[74840]: DEBUG nova.compute.manager [req-16fb494f-ad2b-41c1-8283-4a6199cc581a req-6aacfad9-530d-400c-b588-486120557b7c service nova] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] No waiting events found dispatching network-vif-plugged-6169b221-7840-4cfb-ba25-e34a95b35e77 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:38:00 user nova-compute[74840]: WARNING nova.compute.manager [req-16fb494f-ad2b-41c1-8283-4a6199cc581a req-6aacfad9-530d-400c-b588-486120557b7c service nova] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Received unexpected event network-vif-plugged-6169b221-7840-4cfb-ba25-e34a95b35e77 for instance with vm_state active and task_state deleting.
Nov 08 12:38:01 user nova-compute[74840]: INFO nova.compute.manager [None req-c801062e-0555-48cc-8d19-d035530a34a2 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: ffe50042-29bf-4ef3-a148-8698bc75233b] Took 0.92 seconds to detach 1 volumes for instance.
Nov 08 12:38:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c801062e-0555-48cc-8d19-d035530a34a2 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:38:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c801062e-0555-48cc-8d19-d035530a34a2 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:38:01 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-c801062e-0555-48cc-8d19-d035530a34a2 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:38:01 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-c801062e-0555-48cc-8d19-d035530a34a2 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:38:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c801062e-0555-48cc-8d19-d035530a34a2 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.336s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:38:01 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-c801062e-0555-48cc-8d19-d035530a34a2 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Deleted allocations for instance ffe50042-29bf-4ef3-a148-8698bc75233b
Nov 08 12:38:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c801062e-0555-48cc-8d19-d035530a34a2 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "ffe50042-29bf-4ef3-a148-8698bc75233b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.478s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:38:02 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:05 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:38:05 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:38:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "refresh_cache-10c42516-62ba-4aa9-bc5a-d94499bd6b65" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:38:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquired lock "refresh_cache-10c42516-62ba-4aa9-bc5a-d94499bd6b65" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:38:05 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Forcefully refreshing network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 12:38:06 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Updating instance_info_cache with network_info: [{"id": "7cf349fa-e382-4526-af9d-f60a53d870cb", "address": "fa:16:3e:97:67:76", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cf349fa-e3", "ovs_interfaceid": "7cf349fa-e382-4526-af9d-f60a53d870cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:38:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Releasing lock "refresh_cache-10c42516-62ba-4aa9-bc5a-d94499bd6b65" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:38:06 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Updated the network info_cache for instance {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 12:38:07 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:38:08 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:38:08 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:38:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:09 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:38:10 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:38:11 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-e6766600-5702-4f7f-a033-6056c25ff570 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0cecc731-6f86-475c-8603-591de8e30412 is timed out.
Nov 08 12:38:11 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-e6766600-5702-4f7f-a033-6056c25ff570 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Successfully detached device vdb from instance 0cecc731-6f86-475c-8603-591de8e30412 from the live domain config.
Nov 08 12:38:11 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6766600-5702-4f7f-a033-6056c25ff570 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 0cecc731-6f86-475c-8603-591de8e30412] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 12:38:11 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6766600-5702-4f7f-a033-6056c25ff570 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'boJeuUdc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:38:11 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-e6766600-5702-4f7f-a033-6056c25ff570 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:38:11 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-e6766600-5702-4f7f-a033-6056c25ff570 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:38:11 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-e6766600-5702-4f7f-a033-6056c25ff570 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:38:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:38:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:38:11 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3152a3e9-c8e4-4b67-925b-a078209f6ae9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:38:11 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6766600-5702-4f7f-a033-6056c25ff570 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 12:38:11 user nova-compute[74840]: No targets found.
Nov 08 12:38:11 user nova-compute[74840]: iSNS:
Nov 08 12:38:11 user nova-compute[74840]: No targets found.
Nov 08 12:38:11 user nova-compute[74840]: STATIC:
Nov 08 12:38:11 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665
Nov 08 12:38:11 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:38:11 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:38:11 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881
Nov 08 12:38:11 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:38:11 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:38:11 user nova-compute[74840]: FIRMWARE:
Nov 08 12:38:11 user nova-compute[74840]: No targets found.
Nov 08 12:38:11 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:38:11 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6766600-5702-4f7f-a033-6056c25ff570 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 12:38:11 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 12:38:11 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 12:38:11 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6766600-5702-4f7f-a033-6056c25ff570 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 12:38:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:38:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:38:11 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[83de6606-427a-44df-8e71-e8b0a893a57d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:38:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:38:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:38:11 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec00a5b-c3d8-4abc-b02f-004d17066442]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:38:11 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6766600-5702-4f7f-a033-6056c25ff570 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 (non-flash)
Nov 08 12:38:11 user nova-compute[74840]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881 (non-flash)
Nov 08 12:38:11 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:38:11 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6766600-5702-4f7f-a033-6056c25ff570 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 (non-flash)
Nov 08 12:38:11 user nova-compute[74840]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881 (non-flash)
Nov 08 12:38:11 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:38:11 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6766600-5702-4f7f-a033-6056c25ff570 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7f4379b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881'): ({'sdc'}, set())}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 12:38:11 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-e6766600-5702-4f7f-a033-6056c25ff570 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Removing single pathed devices sdc {{(pid=74840) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 12:38:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:38:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:38:11 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7967ac-0a89-4cb6-8c3e-2f1e74d4160b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:38:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:38:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:38:11 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[52476c21-2b8f-47d5-ab77-edbd176ff241]: (4, ('ok\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:38:11 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-e6766600-5702-4f7f-a033-6056c25ff570 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Flushing IO for device /dev/sdc {{(pid=74840) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 12:38:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:38:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:38:11 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[452609db-d5f2-4767-9718-661b19bba0fc]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:38:11 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-e6766600-5702-4f7f-a033-6056c25ff570 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74840) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 12:38:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:38:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:38:11 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a2f81d-ff7b-49d8-a3b8-13bf823b15ae]: (4, ('1', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:38:11 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-e6766600-5702-4f7f-a033-6056c25ff570 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 12:38:11 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-e6766600-5702-4f7f-a033-6056c25ff570 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] SCSI volumes sdc have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 12:38:11 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6766600-5702-4f7f-a033-6056c25ff570 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881')] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 12:38:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:38:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:38:11 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[4724d653-bba6-40f1-903e-7b4b809da07b]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:38:11 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6766600-5702-4f7f-a033-6056c25ff570 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:38:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881 -p 172.16.0.220:3260 --logout {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:38:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:38:11 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6b77d9-9d16-444f-a933-050d3f506134]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:38:11 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6766600-5702-4f7f-a033-6056c25ff570 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881, portal: 172.16.0.220,3260]
Nov 08 12:38:11 user nova-compute[74840]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881, portal: 172.16.0.220,3260] successful.
Nov 08 12:38:11 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:38:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881 -p 172.16.0.220:3260 --op delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:38:11 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09a74a9e-3fd0-4d3f-ac36-7689df100881 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:38:11 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ad8ef3-66c8-4018-890d-f199af2bf95f]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:38:11 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6766600-5702-4f7f-a033-6056c25ff570 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:38:11 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-e6766600-5702-4f7f-a033-6056c25ff570 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:38:11 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6766600-5702-4f7f-a033-6056c25ff570 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] <== disconnect_volume: return (284ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:38:11 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6766600-5702-4f7f-a033-6056c25ff570 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 12:38:11 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:38:11 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:38:12 user nova-compute[74840]: DEBUG nova.objects.instance [None req-e6766600-5702-4f7f-a033-6056c25ff570 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lazy-loading 'flavor' on Instance uuid 0cecc731-6f86-475c-8603-591de8e30412 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:38:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e6766600-5702-4f7f-a033-6056c25ff570 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "0cecc731-6f86-475c-8603-591de8e30412" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.790s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:38:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-67e67eca-5a09-45cd-9068-b9e05335b9c7 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Acquiring lock "8b7c490e-4c78-4e07-bc8a-3be2328963d7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:38:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-67e67eca-5a09-45cd-9068-b9e05335b9c7 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "8b7c490e-4c78-4e07-bc8a-3be2328963d7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:38:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-67e67eca-5a09-45cd-9068-b9e05335b9c7 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Acquiring lock "8b7c490e-4c78-4e07-bc8a-3be2328963d7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:38:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-67e67eca-5a09-45cd-9068-b9e05335b9c7 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "8b7c490e-4c78-4e07-bc8a-3be2328963d7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:38:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-67e67eca-5a09-45cd-9068-b9e05335b9c7 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "8b7c490e-4c78-4e07-bc8a-3be2328963d7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:38:13 user nova-compute[74840]: INFO nova.compute.manager [None req-67e67eca-5a09-45cd-9068-b9e05335b9c7 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Terminating instance
Nov 08 12:38:13 user nova-compute[74840]: DEBUG nova.compute.manager [None req-67e67eca-5a09-45cd-9068-b9e05335b9c7 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Start destroying the instance on the hypervisor. {{(pid=74840) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 12:38:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:13 user nova-compute[74840]: DEBUG nova.compute.manager [req-984ae555-60a0-483c-87c4-39928c7f950e req-961cf645-f49e-4f98-a76a-c6bc916d08cd service nova] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Received event network-vif-unplugged-d9df071e-c4f0-4c80-9d63-3a41c849dca5 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:38:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-984ae555-60a0-483c-87c4-39928c7f950e req-961cf645-f49e-4f98-a76a-c6bc916d08cd service nova] Acquiring lock "8b7c490e-4c78-4e07-bc8a-3be2328963d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:38:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-984ae555-60a0-483c-87c4-39928c7f950e req-961cf645-f49e-4f98-a76a-c6bc916d08cd service nova] Lock "8b7c490e-4c78-4e07-bc8a-3be2328963d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:38:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-984ae555-60a0-483c-87c4-39928c7f950e req-961cf645-f49e-4f98-a76a-c6bc916d08cd service nova] Lock "8b7c490e-4c78-4e07-bc8a-3be2328963d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:38:13 user nova-compute[74840]: DEBUG nova.compute.manager [req-984ae555-60a0-483c-87c4-39928c7f950e req-961cf645-f49e-4f98-a76a-c6bc916d08cd service nova] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] No waiting events found dispatching network-vif-unplugged-d9df071e-c4f0-4c80-9d63-3a41c849dca5 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:38:13 user nova-compute[74840]: DEBUG nova.compute.manager [req-984ae555-60a0-483c-87c4-39928c7f950e req-961cf645-f49e-4f98-a76a-c6bc916d08cd service nova] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Received event network-vif-unplugged-d9df071e-c4f0-4c80-9d63-3a41c849dca5 for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:38:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:13 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Instance destroyed successfully.
Nov 08 12:38:13 user nova-compute[74840]: DEBUG nova.objects.instance [None req-67e67eca-5a09-45cd-9068-b9e05335b9c7 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lazy-loading 'resources' on Instance uuid 8b7c490e-4c78-4e07-bc8a-3be2328963d7 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:38:13 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-67e67eca-5a09-45cd-9068-b9e05335b9c7 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:20:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1812155088',display_name='tempest-ServerRescueNegativeTestJSON-server-1812155088',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1812155088',id=25,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:25:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='457d61e0588847528ef3dd42a6146599',ramdisk_id='',reservation_id='r-gqzxr43e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1814868989',owner_user_name='tempest-ServerRescueNegativeTestJSON-1814868989-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:27:20Z,user_data=None,user_id='6d4a3286c7d64d59b8ce2e4456db9cc2',uuid=8b7c490e-4c78-4e07-bc8a-3be2328963d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9df071e-c4f0-4c80-9d63-3a41c849dca5", "address": "fa:16:3e:32:c4:9b", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9df071e-c4", "ovs_interfaceid": "d9df071e-c4f0-4c80-9d63-3a41c849dca5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:38:13 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-67e67eca-5a09-45cd-9068-b9e05335b9c7 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Converting VIF {"id": "d9df071e-c4f0-4c80-9d63-3a41c849dca5", "address": "fa:16:3e:32:c4:9b", "network": {"id": "5ee2626f-3d55-44da-a731-761059adfa85", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-731463858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457d61e0588847528ef3dd42a6146599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9df071e-c4", "ovs_interfaceid": "d9df071e-c4f0-4c80-9d63-3a41c849dca5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:38:13 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-67e67eca-5a09-45cd-9068-b9e05335b9c7 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:c4:9b,bridge_name='br-int',has_traffic_filtering=True,id=d9df071e-c4f0-4c80-9d63-3a41c849dca5,network=Network(5ee2626f-3d55-44da-a731-761059adfa85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9df071e-c4') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:38:13 user nova-compute[74840]: DEBUG os_vif [None req-67e67eca-5a09-45cd-9068-b9e05335b9c7 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:c4:9b,bridge_name='br-int',has_traffic_filtering=True,id=d9df071e-c4f0-4c80-9d63-3a41c849dca5,network=Network(5ee2626f-3d55-44da-a731-761059adfa85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9df071e-c4') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:38:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9df071e-c4, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:38:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:38:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=75e275f0-0014-4098-8792-3e657cb4b7a8) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:38:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:13 user nova-compute[74840]: INFO os_vif [None req-67e67eca-5a09-45cd-9068-b9e05335b9c7 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:c4:9b,bridge_name='br-int',has_traffic_filtering=True,id=d9df071e-c4f0-4c80-9d63-3a41c849dca5,network=Network(5ee2626f-3d55-44da-a731-761059adfa85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9df071e-c4')
Nov 08 12:38:13 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-67e67eca-5a09-45cd-9068-b9e05335b9c7 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Deleting instance files /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7_del
Nov 08 12:38:13 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-67e67eca-5a09-45cd-9068-b9e05335b9c7 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Deletion of /opt/stack/data/nova/instances/8b7c490e-4c78-4e07-bc8a-3be2328963d7_del complete
Nov 08 12:38:13 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:38:13 user nova-compute[74840]: INFO nova.compute.manager [None req-67e67eca-5a09-45cd-9068-b9e05335b9c7 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 08 12:38:13 user nova-compute[74840]: DEBUG oslo.service.loopingcall [None req-67e67eca-5a09-45cd-9068-b9e05335b9c7 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74840) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 12:38:13 user nova-compute[74840]: DEBUG nova.compute.manager [-] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Deallocating network for instance {{(pid=74840) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 12:38:13 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] deallocate_for_instance() {{(pid=74840) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 12:38:14 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:38:14 user nova-compute[74840]: DEBUG nova.compute.manager [req-ff8b91be-e142-4604-8f5c-598f506478cf req-2dae6e3e-1eda-40b3-822b-8a0024a75b24 service nova] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Received event network-vif-deleted-d9df071e-c4f0-4c80-9d63-3a41c849dca5 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:38:14 user nova-compute[74840]: INFO nova.compute.manager [req-ff8b91be-e142-4604-8f5c-598f506478cf req-2dae6e3e-1eda-40b3-822b-8a0024a75b24 service nova] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Neutron deleted interface d9df071e-c4f0-4c80-9d63-3a41c849dca5; detaching it from the instance and deleting it from the info cache
Nov 08 12:38:14 user nova-compute[74840]: DEBUG nova.network.neutron [req-ff8b91be-e142-4604-8f5c-598f506478cf req-2dae6e3e-1eda-40b3-822b-8a0024a75b24 service nova] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:38:14 user nova-compute[74840]: INFO nova.compute.manager [-] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Took 0.44 seconds to deallocate network for instance.
Nov 08 12:38:14 user nova-compute[74840]: DEBUG nova.compute.manager [req-ff8b91be-e142-4604-8f5c-598f506478cf req-2dae6e3e-1eda-40b3-822b-8a0024a75b24 service nova] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Detach interface failed, port_id=d9df071e-c4f0-4c80-9d63-3a41c849dca5, reason: Instance 8b7c490e-4c78-4e07-bc8a-3be2328963d7 could not be found. {{(pid=74840) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 12:38:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-67e67eca-5a09-45cd-9068-b9e05335b9c7 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:38:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-67e67eca-5a09-45cd-9068-b9e05335b9c7 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:38:14 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-67e67eca-5a09-45cd-9068-b9e05335b9c7 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:38:14 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-67e67eca-5a09-45cd-9068-b9e05335b9c7 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:38:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-67e67eca-5a09-45cd-9068-b9e05335b9c7 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.282s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:38:14 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-67e67eca-5a09-45cd-9068-b9e05335b9c7 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Deleted allocations for instance 8b7c490e-4c78-4e07-bc8a-3be2328963d7
Nov 08 12:38:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-67e67eca-5a09-45cd-9068-b9e05335b9c7 tempest-ServerRescueNegativeTestJSON-1814868989 tempest-ServerRescueNegativeTestJSON-1814868989-project-member] Lock "8b7c490e-4c78-4e07-bc8a-3be2328963d7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.595s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:38:15 user nova-compute[74840]: DEBUG nova.compute.manager [req-302db733-918b-4542-83ca-775999f7083f req-9c2739f3-0687-4189-ac38-4a25d0f2e6da service nova] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Received event network-vif-plugged-d9df071e-c4f0-4c80-9d63-3a41c849dca5 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:38:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-302db733-918b-4542-83ca-775999f7083f req-9c2739f3-0687-4189-ac38-4a25d0f2e6da service nova] Acquiring lock "8b7c490e-4c78-4e07-bc8a-3be2328963d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:38:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-302db733-918b-4542-83ca-775999f7083f req-9c2739f3-0687-4189-ac38-4a25d0f2e6da service nova] Lock "8b7c490e-4c78-4e07-bc8a-3be2328963d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:38:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-302db733-918b-4542-83ca-775999f7083f req-9c2739f3-0687-4189-ac38-4a25d0f2e6da service nova] Lock "8b7c490e-4c78-4e07-bc8a-3be2328963d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:38:15 user nova-compute[74840]: DEBUG nova.compute.manager [req-302db733-918b-4542-83ca-775999f7083f req-9c2739f3-0687-4189-ac38-4a25d0f2e6da service nova] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] No waiting events found dispatching network-vif-plugged-d9df071e-c4f0-4c80-9d63-3a41c849dca5 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:38:15 user nova-compute[74840]: WARNING nova.compute.manager [req-302db733-918b-4542-83ca-775999f7083f req-9c2739f3-0687-4189-ac38-4a25d0f2e6da service nova] [instance: 8b7c490e-4c78-4e07-bc8a-3be2328963d7] Received unexpected event network-vif-plugged-d9df071e-c4f0-4c80-9d63-3a41c849dca5 for instance with vm_state deleted and task_state None.
Nov 08 12:38:17 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:38:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:38:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:38:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:38:17 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:38:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a482219-16ac-49e2-84ad-7e2030c97184/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:38:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a482219-16ac-49e2-84ad-7e2030c97184/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:38:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a482219-16ac-49e2-84ad-7e2030c97184/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:38:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a482219-16ac-49e2-84ad-7e2030c97184/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:38:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:38:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:38:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:38:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:38:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:38:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6156dbbc-6539-4de3-8ba0-16db61cd7dce/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:38:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6156dbbc-6539-4de3-8ba0-16db61cd7dce/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:38:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6156dbbc-6539-4de3-8ba0-16db61cd7dce/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:38:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6156dbbc-6539-4de3-8ba0-16db61cd7dce/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:38:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cecc731-6f86-475c-8603-591de8e30412/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:38:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cecc731-6f86-475c-8603-591de8e30412/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:38:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cecc731-6f86-475c-8603-591de8e30412/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:38:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cecc731-6f86-475c-8603-591de8e30412/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:38:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:38:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:38:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:38:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:38:20 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:38:20 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:38:20 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=8106MB free_disk=24.72998809814453GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:38:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:38:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:38:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:38:20 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance d3e8efc6-7146-46ef-8433-380d7e69120c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:38:20 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 10c42516-62ba-4aa9-bc5a-d94499bd6b65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:38:20 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 7a482219-16ac-49e2-84ad-7e2030c97184 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:38:20 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 0cecc731-6f86-475c-8603-591de8e30412 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:38:20 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:38:20 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 6156dbbc-6539-4de3-8ba0-16db61cd7dce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:38:20 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 550f8fed-4652-46fe-a440-974ee8f88196 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 08 12:38:20 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:38:20 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:38:20 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:38:20 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:38:20 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:38:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.398s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:38:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.337s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:38:20 user nova-compute[74840]: DEBUG nova.objects.instance [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Lazy-loading 'pci_requests' on Instance uuid 550f8fed-4652-46fe-a440-974ee8f88196 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:38:20 user nova-compute[74840]: DEBUG nova.objects.instance [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Lazy-loading 'numa_topology' on Instance uuid 550f8fed-4652-46fe-a440-974ee8f88196 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:38:20 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:38:20 user nova-compute[74840]: INFO nova.compute.claims [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Claim successful on node user
Nov 08 12:38:20 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:38:20 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:38:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.366s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:38:21 user nova-compute[74840]: INFO nova.network.neutron [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Updating port daa004c9-f48f-4997-8260-7e1f394c3a7c with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 08 12:38:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Acquiring lock "refresh_cache-550f8fed-4652-46fe-a440-974ee8f88196" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:38:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Acquired lock "refresh_cache-550f8fed-4652-46fe-a440-974ee8f88196" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:38:21 user nova-compute[74840]: DEBUG nova.network.neutron [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:38:21 user nova-compute[74840]: DEBUG nova.compute.manager [req-93f38f99-f0de-459b-a70b-74aefba61d9a req-6223ec18-df37-4627-aa63-be78a098fc7d service nova] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Received event network-changed-daa004c9-f48f-4997-8260-7e1f394c3a7c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:38:21 user nova-compute[74840]: DEBUG nova.compute.manager [req-93f38f99-f0de-459b-a70b-74aefba61d9a req-6223ec18-df37-4627-aa63-be78a098fc7d service nova] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Refreshing instance network info cache due to event network-changed-daa004c9-f48f-4997-8260-7e1f394c3a7c. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:38:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-93f38f99-f0de-459b-a70b-74aefba61d9a req-6223ec18-df37-4627-aa63-be78a098fc7d service nova] Acquiring lock "refresh_cache-550f8fed-4652-46fe-a440-974ee8f88196" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:38:21 user nova-compute[74840]: DEBUG nova.network.neutron [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Updating instance_info_cache with network_info: [{"id": "daa004c9-f48f-4997-8260-7e1f394c3a7c", "address": "fa:16:3e:e1:a6:9b", "network": {"id": "5d8710f7-82f1-4670-b564-9ef14312dc8e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1266284233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa486cd37a9c498ba6f800d2dbd415ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaa004c9-f4", "ovs_interfaceid": "daa004c9-f48f-4997-8260-7e1f394c3a7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:38:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Releasing lock "refresh_cache-550f8fed-4652-46fe-a440-974ee8f88196" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:38:21 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:38:21 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Creating image(s)
Nov 08 12:38:21 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Did not create local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 12:38:21 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Ensure instance console log exists: /opt/stack/data/nova/instances/550f8fed-4652-46fe-a440-974ee8f88196/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:38:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:38:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:38:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:38:21 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Start _get_guest_xml network_info=[{"id": "daa004c9-f48f-4997-8260-7e1f394c3a7c", "address": "fa:16:3e:e1:a6:9b", "network": {"id": "5d8710f7-82f1-4670-b564-9ef14312dc8e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1266284233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa486cd37a9c498ba6f800d2dbd415ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaa004c9-f4", "ovs_interfaceid": "daa004c9-f48f-4997-8260-7e1f394c3a7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '2a302fd0-da4d-4fc4-9978-51fa68e747a8', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'txbpOwNW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '550f8fed-4652-46fe-a440-974ee8f88196', 'attached_at': '', 'detached_at': '', 'volume_id': '177df23a-e5d3-41e7-ac17-e0959f15e616', 'serial': '177df23a-e5d3-41e7-ac17-e0959f15e616'}, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:38:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-93f38f99-f0de-459b-a70b-74aefba61d9a req-6223ec18-df37-4627-aa63-be78a098fc7d service nova] Acquired lock "refresh_cache-550f8fed-4652-46fe-a440-974ee8f88196" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:38:21 user nova-compute[74840]: DEBUG nova.network.neutron [req-93f38f99-f0de-459b-a70b-74aefba61d9a req-6223ec18-df37-4627-aa63-be78a098fc7d service nova] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Refreshing network info cache for port daa004c9-f48f-4997-8260-7e1f394c3a7c {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:38:22 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:38:22 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:38:22 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG nova.objects.instance [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Lazy-loading 'vcpu_model' on Instance uuid 550f8fed-4652-46fe-a440-974ee8f88196 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG nova.objects.base [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Object Instance<550f8fed-4652-46fe-a440-974ee8f88196> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Calling os-brick to attach iSCSI Volume {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'txbpOwNW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:38:22 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:38:22 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:38:22 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:38:22 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:38:22 user nova-compute[74840]: INFO os_brick.initiator.connectors.iscsi [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 12:38:22 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 -p 172.16.0.220:3260 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3762e665-3b2e-4f14-b908-43685019004a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 12:38:22 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 -p 172.16.0.220:3260 --interface default --op new {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[32961eb2-31e3-4da7-8e09-bec5b2da5d79]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616] added\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616] added
Nov 08 12:38:22 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e11962e-58e4-4f20-a159-2163a7b1f806]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c44b62-c5fa-4586-a3e0-95d5d5489947]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v txbpOwNW {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v txbpOwNW" returned: 0 in 0.041s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77e47ea-38e9-42b8-b6bf-dc6088ba87be]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'txbpOwNW'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ba1ff7-058b-4dd2-a906-fcc623e6378c]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3032ca-ea1c-48ce-91e5-53a6fe85c6ae]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 (non-flash)
Nov 08 12:38:22 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 (non-flash)
Nov 08 12:38:22 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 -p 172.16.0.220:3260 --login {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5080231a-21fa-4e82-aee0-521ba68fab68]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616, portal: 172.16.0.220,3260]
Nov 08 12:38:22 user nova-compute[74840]: Login to [iface: default, target: iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616, portal: 172.16.0.220,3260] successful.
Nov 08 12:38:22 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ccb856-7b31-42b8-9ac4-b5a1b01ae466]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac2091b-bc7d-4924-bed8-45636df2df5f]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 (non-flash)
Nov 08 12:38:22 user nova-compute[74840]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 (non-flash)
Nov 08 12:38:22 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 (non-flash)
Nov 08 12:38:22 user nova-compute[74840]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 (non-flash)
Nov 08 12:38:22 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Connected to 172.16.0.220:3260 {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=74840) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74840) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dcb9ba0-3fd8-4204-8ee6-7aa6af83035c]: (4, ('- - 0', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'txbpOwNW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG nova.network.neutron [req-93f38f99-f0de-459b-a70b-74aefba61d9a req-6223ec18-df37-4627-aa63-be78a098fc7d service nova] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Updated VIF entry in instance network info cache for port daa004c9-f48f-4997-8260-7e1f394c3a7c. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG nova.network.neutron [req-93f38f99-f0de-459b-a70b-74aefba61d9a req-6223ec18-df37-4627-aa63-be78a098fc7d service nova] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Updating instance_info_cache with network_info: [{"id": "daa004c9-f48f-4997-8260-7e1f394c3a7c", "address": "fa:16:3e:e1:a6:9b", "network": {"id": "5d8710f7-82f1-4670-b564-9ef14312dc8e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1266284233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa486cd37a9c498ba6f800d2dbd415ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaa004c9-f4", "ovs_interfaceid": "daa004c9-f48f-4997-8260-7e1f394c3a7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:38:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-93f38f99-f0de-459b-a70b-74aefba61d9a req-6223ec18-df37-4627-aa63-be78a098fc7d service nova] Releasing lock "refresh_cache-550f8fed-4652-46fe-a440-974ee8f88196" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:38:23 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:38:23 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '26432663365323362', 'path': '/dev/sdc'} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:38:23 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432663365323362', 'path': '/dev/sdc'} {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 12:38:23 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T12:33:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1581355820',display_name='tempest-TestShelveInstance-server-1581355820',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1581355820',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-850605026',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:34:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='fa486cd37a9c498ba6f800d2dbd415ab',ramdisk_id='',reservation_id='r-o5fknux2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1716375711',owner_user_name='tempest-TestShelveInstance-1716375711-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:37:57Z,user_data=None,user_id='ff68af4357024f75888b6f8bd6ada9e5',uuid=550f8fed-4652-46fe-a440-974ee8f88196,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "daa004c9-f48f-4997-8260-7e1f394c3a7c", "address": "fa:16:3e:e1:a6:9b", "network": {"id": "5d8710f7-82f1-4670-b564-9ef14312dc8e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1266284233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa486cd37a9c498ba6f800d2dbd415ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaa004c9-f4", "ovs_interfaceid": "daa004c9-f48f-4997-8260-7e1f394c3a7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:38:23 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Converting VIF {"id": "daa004c9-f48f-4997-8260-7e1f394c3a7c", "address": "fa:16:3e:e1:a6:9b", "network": {"id": "5d8710f7-82f1-4670-b564-9ef14312dc8e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1266284233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa486cd37a9c498ba6f800d2dbd415ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaa004c9-f4", "ovs_interfaceid": "daa004c9-f48f-4997-8260-7e1f394c3a7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:38:23 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:a6:9b,bridge_name='br-int',has_traffic_filtering=True,id=daa004c9-f48f-4997-8260-7e1f394c3a7c,network=Network(5d8710f7-82f1-4670-b564-9ef14312dc8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaa004c9-f4') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:38:23 user nova-compute[74840]: DEBUG nova.objects.instance [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Lazy-loading 'pci_devices' on Instance uuid 550f8fed-4652-46fe-a440-974ee8f88196 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:38:23 user nova-compute[74840]: DEBUG nova.objects.base [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Object Instance<550f8fed-4652-46fe-a440-974ee8f88196> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:38:23 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:38:23 user nova-compute[74840]:   <uuid>550f8fed-4652-46fe-a440-974ee8f88196</uuid>
Nov 08 12:38:23 user nova-compute[74840]:   <name>instance-00000029</name>
Nov 08 12:38:23 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:38:23 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:38:23 user nova-compute[74840]:   <metadata>
Nov 08 12:38:23 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:38:23 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:38:23 user nova-compute[74840]:       <nova:name>tempest-TestShelveInstance-server-1581355820</nova:name>
Nov 08 12:38:23 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:38:22</nova:creationTime>
Nov 08 12:38:23 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:38:23 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:38:23 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:38:23 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:38:23 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:38:23 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:38:23 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:38:23 user nova-compute[74840]:       <nova:owner>
Nov 08 12:38:23 user nova-compute[74840]:         <nova:user uuid="ff68af4357024f75888b6f8bd6ada9e5">tempest-TestShelveInstance-1716375711-project-member</nova:user>
Nov 08 12:38:23 user nova-compute[74840]:         <nova:project uuid="fa486cd37a9c498ba6f800d2dbd415ab">tempest-TestShelveInstance-1716375711</nova:project>
Nov 08 12:38:23 user nova-compute[74840]:       </nova:owner>
Nov 08 12:38:23 user nova-compute[74840]:       <nova:ports>
Nov 08 12:38:23 user nova-compute[74840]:         <nova:port uuid="daa004c9-f48f-4997-8260-7e1f394c3a7c">
Nov 08 12:38:23 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 08 12:38:23 user nova-compute[74840]:         </nova:port>
Nov 08 12:38:23 user nova-compute[74840]:       </nova:ports>
Nov 08 12:38:23 user nova-compute[74840]:     </nova:instance>
Nov 08 12:38:23 user nova-compute[74840]:   </metadata>
Nov 08 12:38:23 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:38:23 user nova-compute[74840]:     <system>
Nov 08 12:38:23 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:38:23 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:38:23 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:38:23 user nova-compute[74840]:       <entry name="serial">550f8fed-4652-46fe-a440-974ee8f88196</entry>
Nov 08 12:38:23 user nova-compute[74840]:       <entry name="uuid">550f8fed-4652-46fe-a440-974ee8f88196</entry>
Nov 08 12:38:23 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:38:23 user nova-compute[74840]:     </system>
Nov 08 12:38:23 user nova-compute[74840]:   </sysinfo>
Nov 08 12:38:23 user nova-compute[74840]:   <os>
Nov 08 12:38:23 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:38:23 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:38:23 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:38:23 user nova-compute[74840]:   </os>
Nov 08 12:38:23 user nova-compute[74840]:   <features>
Nov 08 12:38:23 user nova-compute[74840]:     <acpi/>
Nov 08 12:38:23 user nova-compute[74840]:     <apic/>
Nov 08 12:38:23 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:38:23 user nova-compute[74840]:   </features>
Nov 08 12:38:23 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:38:23 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:38:23 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:38:23 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:38:23 user nova-compute[74840]:   </clock>
Nov 08 12:38:23 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:38:23 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:38:23 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:38:23 user nova-compute[74840]:   </cpu>
Nov 08 12:38:23 user nova-compute[74840]:   <devices>
Nov 08 12:38:23 user nova-compute[74840]:     <disk type="block" device="disk">
Nov 08 12:38:23 user nova-compute[74840]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:38:23 user nova-compute[74840]:       <source dev="/dev/sdc"/>
Nov 08 12:38:23 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:38:23 user nova-compute[74840]:       <serial>177df23a-e5d3-41e7-ac17-e0959f15e616</serial>
Nov 08 12:38:23 user nova-compute[74840]:     </disk>
Nov 08 12:38:23 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:38:23 user nova-compute[74840]:       <mac address="fa:16:3e:e1:a6:9b"/>
Nov 08 12:38:23 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:38:23 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:38:23 user nova-compute[74840]:       <target dev="tapdaa004c9-f4"/>
Nov 08 12:38:23 user nova-compute[74840]:     </interface>
Nov 08 12:38:23 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:38:23 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/550f8fed-4652-46fe-a440-974ee8f88196/console.log" append="off"/>
Nov 08 12:38:23 user nova-compute[74840]:     </serial>
Nov 08 12:38:23 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:38:23 user nova-compute[74840]:     <video>
Nov 08 12:38:23 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:38:23 user nova-compute[74840]:     </video>
Nov 08 12:38:23 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:38:23 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:38:23 user nova-compute[74840]:     </rng>
Nov 08 12:38:23 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:38:23 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:38:23 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:38:23 user nova-compute[74840]:     </memballoon>
Nov 08 12:38:23 user nova-compute[74840]:   </devices>
Nov 08 12:38:23 user nova-compute[74840]: </domain>
Nov 08 12:38:23 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:38:23 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T12:33:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1581355820',display_name='tempest-TestShelveInstance-server-1581355820',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1581355820',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-850605026',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:34:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='fa486cd37a9c498ba6f800d2dbd415ab',ramdisk_id='',reservation_id='r-o5fknux2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1716375711',owner_user_name='tempest-TestShelveInstance-1716375711-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:37:57Z,user_data=None,user_id='ff68af4357024f75888b6f8bd6ada9e5',uuid=550f8fed-4652-46fe-a440-974ee8f88196,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "daa004c9-f48f-4997-8260-7e1f394c3a7c", "address": "fa:16:3e:e1:a6:9b", "network": {"id": "5d8710f7-82f1-4670-b564-9ef14312dc8e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1266284233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa486cd37a9c498ba6f800d2dbd415ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaa004c9-f4", "ovs_interfaceid": "daa004c9-f48f-4997-8260-7e1f394c3a7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:38:23 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Converting VIF {"id": "daa004c9-f48f-4997-8260-7e1f394c3a7c", "address": "fa:16:3e:e1:a6:9b", "network": {"id": "5d8710f7-82f1-4670-b564-9ef14312dc8e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1266284233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa486cd37a9c498ba6f800d2dbd415ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaa004c9-f4", "ovs_interfaceid": "daa004c9-f48f-4997-8260-7e1f394c3a7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:38:23 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:a6:9b,bridge_name='br-int',has_traffic_filtering=True,id=daa004c9-f48f-4997-8260-7e1f394c3a7c,network=Network(5d8710f7-82f1-4670-b564-9ef14312dc8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaa004c9-f4') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:38:23 user nova-compute[74840]: DEBUG os_vif [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:a6:9b,bridge_name='br-int',has_traffic_filtering=True,id=daa004c9-f48f-4997-8260-7e1f394c3a7c,network=Network(5d8710f7-82f1-4670-b564-9ef14312dc8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaa004c9-f4') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:38:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:38:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:38:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '91552544-6998-54d2-9f37-b8e18d2d8efb', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:38:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:38:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdaa004c9-f4, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:38:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdaa004c9-f4, col_values=(('qos', UUID('706b54d9-bfc0-44fa-b500-54093282770d')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:38:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdaa004c9-f4, col_values=(('external_ids', {'iface-id': 'daa004c9-f48f-4997-8260-7e1f394c3a7c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:a6:9b', 'vm-uuid': '550f8fed-4652-46fe-a440-974ee8f88196'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:38:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:38:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:23 user nova-compute[74840]: INFO os_vif [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:a6:9b,bridge_name='br-int',has_traffic_filtering=True,id=daa004c9-f48f-4997-8260-7e1f394c3a7c,network=Network(5d8710f7-82f1-4670-b564-9ef14312dc8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaa004c9-f4')
Nov 08 12:38:23 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:38:23 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] No VIF found with MAC fa:16:3e:e1:a6:9b, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:38:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:25 user nova-compute[74840]: DEBUG nova.compute.manager [req-e32def90-9ebc-45fe-ae5e-6c343c4d2a8a req-654661a6-1fc0-4489-aab8-874e2287b395 service nova] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Received event network-vif-plugged-daa004c9-f48f-4997-8260-7e1f394c3a7c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:38:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e32def90-9ebc-45fe-ae5e-6c343c4d2a8a req-654661a6-1fc0-4489-aab8-874e2287b395 service nova] Acquiring lock "550f8fed-4652-46fe-a440-974ee8f88196-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:38:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e32def90-9ebc-45fe-ae5e-6c343c4d2a8a req-654661a6-1fc0-4489-aab8-874e2287b395 service nova] Lock "550f8fed-4652-46fe-a440-974ee8f88196-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:38:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e32def90-9ebc-45fe-ae5e-6c343c4d2a8a req-654661a6-1fc0-4489-aab8-874e2287b395 service nova] Lock "550f8fed-4652-46fe-a440-974ee8f88196-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:38:25 user nova-compute[74840]: DEBUG nova.compute.manager [req-e32def90-9ebc-45fe-ae5e-6c343c4d2a8a req-654661a6-1fc0-4489-aab8-874e2287b395 service nova] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] No waiting events found dispatching network-vif-plugged-daa004c9-f48f-4997-8260-7e1f394c3a7c {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:38:25 user nova-compute[74840]: WARNING nova.compute.manager [req-e32def90-9ebc-45fe-ae5e-6c343c4d2a8a req-654661a6-1fc0-4489-aab8-874e2287b395 service nova] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Received unexpected event network-vif-plugged-daa004c9-f48f-4997-8260-7e1f394c3a7c for instance with vm_state shelved_offloaded and task_state spawning.
Nov 08 12:38:25 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:25 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:27 user nova-compute[74840]: DEBUG nova.compute.manager [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:38:27 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:38:27 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Instance spawned successfully.
Nov 08 12:38:27 user nova-compute[74840]: DEBUG nova.compute.manager [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:38:27 user nova-compute[74840]: DEBUG nova.compute.manager [req-8b16950f-2ec5-4e5b-a508-170e3ded4556 req-20a0fcbb-5c45-4c2f-975a-7c6a02148d6c service nova] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Received event network-vif-plugged-daa004c9-f48f-4997-8260-7e1f394c3a7c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:38:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8b16950f-2ec5-4e5b-a508-170e3ded4556 req-20a0fcbb-5c45-4c2f-975a-7c6a02148d6c service nova] Acquiring lock "550f8fed-4652-46fe-a440-974ee8f88196-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:38:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8b16950f-2ec5-4e5b-a508-170e3ded4556 req-20a0fcbb-5c45-4c2f-975a-7c6a02148d6c service nova] Lock "550f8fed-4652-46fe-a440-974ee8f88196-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:38:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8b16950f-2ec5-4e5b-a508-170e3ded4556 req-20a0fcbb-5c45-4c2f-975a-7c6a02148d6c service nova] Lock "550f8fed-4652-46fe-a440-974ee8f88196-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:38:27 user nova-compute[74840]: DEBUG nova.compute.manager [req-8b16950f-2ec5-4e5b-a508-170e3ded4556 req-20a0fcbb-5c45-4c2f-975a-7c6a02148d6c service nova] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] No waiting events found dispatching network-vif-plugged-daa004c9-f48f-4997-8260-7e1f394c3a7c {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:38:27 user nova-compute[74840]: WARNING nova.compute.manager [req-8b16950f-2ec5-4e5b-a508-170e3ded4556 req-20a0fcbb-5c45-4c2f-975a-7c6a02148d6c service nova] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Received unexpected event network-vif-plugged-daa004c9-f48f-4997-8260-7e1f394c3a7c for instance with vm_state shelved_offloaded and task_state spawning.
Nov 08 12:38:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-2476ec9e-4479-4a38-9d0d-3d91f9e15400 tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Lock "550f8fed-4652-46fe-a440-974ee8f88196" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 30.135s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:38:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:28 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:38 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:41 user nova-compute[74840]: DEBUG nova.compute.manager [req-581df17d-8f25-44ac-8153-021b73bc4a14 req-ead4631a-5701-483c-a37e-7e47dab2a886 service nova] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Received event network-changed-5f1cf848-e83c-454b-b5ab-d2e047ae5e84 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:38:41 user nova-compute[74840]: DEBUG nova.compute.manager [req-581df17d-8f25-44ac-8153-021b73bc4a14 req-ead4631a-5701-483c-a37e-7e47dab2a886 service nova] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Refreshing instance network info cache due to event network-changed-5f1cf848-e83c-454b-b5ab-d2e047ae5e84. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:38:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-581df17d-8f25-44ac-8153-021b73bc4a14 req-ead4631a-5701-483c-a37e-7e47dab2a886 service nova] Acquiring lock "refresh_cache-0cecc731-6f86-475c-8603-591de8e30412" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:38:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-581df17d-8f25-44ac-8153-021b73bc4a14 req-ead4631a-5701-483c-a37e-7e47dab2a886 service nova] Acquired lock "refresh_cache-0cecc731-6f86-475c-8603-591de8e30412" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:38:41 user nova-compute[74840]: DEBUG nova.network.neutron [req-581df17d-8f25-44ac-8153-021b73bc4a14 req-ead4631a-5701-483c-a37e-7e47dab2a886 service nova] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Refreshing network info cache for port 5f1cf848-e83c-454b-b5ab-d2e047ae5e84 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:38:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-dca6c34a-fd62-4246-8401-a24a854fa614 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Acquiring lock "0cecc731-6f86-475c-8603-591de8e30412" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:38:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-dca6c34a-fd62-4246-8401-a24a854fa614 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "0cecc731-6f86-475c-8603-591de8e30412" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:38:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-dca6c34a-fd62-4246-8401-a24a854fa614 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Acquiring lock "0cecc731-6f86-475c-8603-591de8e30412-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:38:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-dca6c34a-fd62-4246-8401-a24a854fa614 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "0cecc731-6f86-475c-8603-591de8e30412-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:38:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-dca6c34a-fd62-4246-8401-a24a854fa614 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "0cecc731-6f86-475c-8603-591de8e30412-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:38:41 user nova-compute[74840]: INFO nova.compute.manager [None req-dca6c34a-fd62-4246-8401-a24a854fa614 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Terminating instance
Nov 08 12:38:41 user nova-compute[74840]: DEBUG nova.compute.manager [None req-dca6c34a-fd62-4246-8401-a24a854fa614 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Start destroying the instance on the hypervisor. {{(pid=74840) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 12:38:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:41 user nova-compute[74840]: DEBUG nova.network.neutron [req-581df17d-8f25-44ac-8153-021b73bc4a14 req-ead4631a-5701-483c-a37e-7e47dab2a886 service nova] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Updated VIF entry in instance network info cache for port 5f1cf848-e83c-454b-b5ab-d2e047ae5e84. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:38:41 user nova-compute[74840]: DEBUG nova.network.neutron [req-581df17d-8f25-44ac-8153-021b73bc4a14 req-ead4631a-5701-483c-a37e-7e47dab2a886 service nova] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Updating instance_info_cache with network_info: [{"id": "5f1cf848-e83c-454b-b5ab-d2e047ae5e84", "address": "fa:16:3e:6f:d6:9b", "network": {"id": "7faeaea5-04e0-46e0-bb55-9426d599fb1b", "bridge": "br-int", "label": "tempest-TestStampPattern-1080763140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c24d52e18e8e41dfa50aa5aff1f40c6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f1cf848-e8", "ovs_interfaceid": "5f1cf848-e83c-454b-b5ab-d2e047ae5e84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:38:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-581df17d-8f25-44ac-8153-021b73bc4a14 req-ead4631a-5701-483c-a37e-7e47dab2a886 service nova] Releasing lock "refresh_cache-0cecc731-6f86-475c-8603-591de8e30412" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:38:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:42 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Instance destroyed successfully.
Nov 08 12:38:42 user nova-compute[74840]: DEBUG nova.objects.instance [None req-dca6c34a-fd62-4246-8401-a24a854fa614 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lazy-loading 'resources' on Instance uuid 0cecc731-6f86-475c-8603-591de8e30412 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:38:42 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-dca6c34a-fd62-4246-8401-a24a854fa614 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:35:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1688468890',display_name='tempest-TestStampPattern-server-1688468890',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1688468890',id=43,image_ref='9c3801ed-69ca-4405-b972-608d5f4bc4c7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAifdjOvE03LGvvENDtVW5s6JmsBpHl/N8DE5nBoGW2g5OLHF4XEiYFI0Pa1nSZrBetG5b+iQnlywZCqyB795WR0LxYnf+fBshC/Pye35f17zjZfcJWjmT0YUIL12Rw9Xg==',key_name='tempest-TestStampPattern-101204523',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:35:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c24d52e18e8e41dfa50aa5aff1f40c6d',ramdisk_id='',reservation_id='r-xe9fuk73',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='7a482219-16ac-49e2-84ad-7e2030c97184',image_min_disk='1',image_min_ram='0',image_owner_id='c24d52e18e8e41dfa50aa5aff1f40c6d',image_owner_project_name='tempest-TestStampPattern-55983118',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-55983118-project-member',image_user_id='719ac4d31ae447a6a04c1c62c0a73191',owner_project_name='tempest-TestStampPattern-55983118',owner_user_name='tempest-TestStampPattern-55983118-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:35:36Z,user_data=None,user_id='719ac4d31ae447a6a04c1c62c0a73191',uuid=0cecc731-6f86-475c-8603-591de8e30412,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f1cf848-e83c-454b-b5ab-d2e047ae5e84", "address": "fa:16:3e:6f:d6:9b", "network": {"id": "7faeaea5-04e0-46e0-bb55-9426d599fb1b", "bridge": "br-int", "label": "tempest-TestStampPattern-1080763140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c24d52e18e8e41dfa50aa5aff1f40c6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f1cf848-e8", "ovs_interfaceid": "5f1cf848-e83c-454b-b5ab-d2e047ae5e84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:38:42 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-dca6c34a-fd62-4246-8401-a24a854fa614 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Converting VIF {"id": "5f1cf848-e83c-454b-b5ab-d2e047ae5e84", "address": "fa:16:3e:6f:d6:9b", "network": {"id": "7faeaea5-04e0-46e0-bb55-9426d599fb1b", "bridge": "br-int", "label": "tempest-TestStampPattern-1080763140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c24d52e18e8e41dfa50aa5aff1f40c6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f1cf848-e8", "ovs_interfaceid": "5f1cf848-e83c-454b-b5ab-d2e047ae5e84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:38:42 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-dca6c34a-fd62-4246-8401-a24a854fa614 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6f:d6:9b,bridge_name='br-int',has_traffic_filtering=True,id=5f1cf848-e83c-454b-b5ab-d2e047ae5e84,network=Network(7faeaea5-04e0-46e0-bb55-9426d599fb1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f1cf848-e8') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:38:42 user nova-compute[74840]: DEBUG os_vif [None req-dca6c34a-fd62-4246-8401-a24a854fa614 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:d6:9b,bridge_name='br-int',has_traffic_filtering=True,id=5f1cf848-e83c-454b-b5ab-d2e047ae5e84,network=Network(7faeaea5-04e0-46e0-bb55-9426d599fb1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f1cf848-e8') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:38:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f1cf848-e8, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:38:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:38:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f399f494-91e9-4ba3-80f7-f585311d8e66) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:38:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:38:42 user nova-compute[74840]: INFO os_vif [None req-dca6c34a-fd62-4246-8401-a24a854fa614 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:d6:9b,bridge_name='br-int',has_traffic_filtering=True,id=5f1cf848-e83c-454b-b5ab-d2e047ae5e84,network=Network(7faeaea5-04e0-46e0-bb55-9426d599fb1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f1cf848-e8')
Nov 08 12:38:42 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-dca6c34a-fd62-4246-8401-a24a854fa614 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Deleting instance files /opt/stack/data/nova/instances/0cecc731-6f86-475c-8603-591de8e30412_del
Nov 08 12:38:42 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-dca6c34a-fd62-4246-8401-a24a854fa614 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Deletion of /opt/stack/data/nova/instances/0cecc731-6f86-475c-8603-591de8e30412_del complete
Nov 08 12:38:42 user nova-compute[74840]: INFO nova.compute.manager [None req-dca6c34a-fd62-4246-8401-a24a854fa614 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 08 12:38:42 user nova-compute[74840]: DEBUG oslo.service.loopingcall [None req-dca6c34a-fd62-4246-8401-a24a854fa614 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74840) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 12:38:42 user nova-compute[74840]: DEBUG nova.compute.manager [-] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Deallocating network for instance {{(pid=74840) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 12:38:42 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 0cecc731-6f86-475c-8603-591de8e30412] deallocate_for_instance() {{(pid=74840) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 12:38:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:42 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:38:42 user nova-compute[74840]: INFO nova.compute.manager [-] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Took 0.42 seconds to deallocate network for instance.
Nov 08 12:38:42 user nova-compute[74840]: DEBUG nova.compute.manager [req-4e956c69-a241-4ed2-8602-48d76a78d2e3 req-80bf47f7-70a5-496b-abb4-6a6851833624 service nova] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Received event network-vif-deleted-5f1cf848-e83c-454b-b5ab-d2e047ae5e84 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:38:42 user nova-compute[74840]: INFO nova.compute.manager [req-4e956c69-a241-4ed2-8602-48d76a78d2e3 req-80bf47f7-70a5-496b-abb4-6a6851833624 service nova] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Neutron deleted interface 5f1cf848-e83c-454b-b5ab-d2e047ae5e84; detaching it from the instance and deleting it from the info cache
Nov 08 12:38:42 user nova-compute[74840]: DEBUG nova.network.neutron [req-4e956c69-a241-4ed2-8602-48d76a78d2e3 req-80bf47f7-70a5-496b-abb4-6a6851833624 service nova] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:38:42 user nova-compute[74840]: DEBUG nova.compute.manager [req-4e956c69-a241-4ed2-8602-48d76a78d2e3 req-80bf47f7-70a5-496b-abb4-6a6851833624 service nova] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Detach interface failed, port_id=5f1cf848-e83c-454b-b5ab-d2e047ae5e84, reason: Instance 0cecc731-6f86-475c-8603-591de8e30412 could not be found. {{(pid=74840) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 12:38:42 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-dca6c34a-fd62-4246-8401-a24a854fa614 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:38:42 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-dca6c34a-fd62-4246-8401-a24a854fa614 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:38:42 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-dca6c34a-fd62-4246-8401-a24a854fa614 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:38:42 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-dca6c34a-fd62-4246-8401-a24a854fa614 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:38:42 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-dca6c34a-fd62-4246-8401-a24a854fa614 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.245s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:38:42 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-dca6c34a-fd62-4246-8401-a24a854fa614 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Deleted allocations for instance 0cecc731-6f86-475c-8603-591de8e30412
Nov 08 12:38:42 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-dca6c34a-fd62-4246-8401-a24a854fa614 tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "0cecc731-6f86-475c-8603-591de8e30412" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.695s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:38:43 user nova-compute[74840]: DEBUG nova.compute.manager [req-e94c2828-894d-4d0a-8b74-a3a358da41a8 req-751f28f8-a345-4b8b-8276-039c43fb793c service nova] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Received event network-vif-unplugged-5f1cf848-e83c-454b-b5ab-d2e047ae5e84 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:38:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e94c2828-894d-4d0a-8b74-a3a358da41a8 req-751f28f8-a345-4b8b-8276-039c43fb793c service nova] Acquiring lock "0cecc731-6f86-475c-8603-591de8e30412-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:38:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e94c2828-894d-4d0a-8b74-a3a358da41a8 req-751f28f8-a345-4b8b-8276-039c43fb793c service nova] Lock "0cecc731-6f86-475c-8603-591de8e30412-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:38:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e94c2828-894d-4d0a-8b74-a3a358da41a8 req-751f28f8-a345-4b8b-8276-039c43fb793c service nova] Lock "0cecc731-6f86-475c-8603-591de8e30412-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:38:43 user nova-compute[74840]: DEBUG nova.compute.manager [req-e94c2828-894d-4d0a-8b74-a3a358da41a8 req-751f28f8-a345-4b8b-8276-039c43fb793c service nova] [instance: 0cecc731-6f86-475c-8603-591de8e30412] No waiting events found dispatching network-vif-unplugged-5f1cf848-e83c-454b-b5ab-d2e047ae5e84 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:38:43 user nova-compute[74840]: WARNING nova.compute.manager [req-e94c2828-894d-4d0a-8b74-a3a358da41a8 req-751f28f8-a345-4b8b-8276-039c43fb793c service nova] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Received unexpected event network-vif-unplugged-5f1cf848-e83c-454b-b5ab-d2e047ae5e84 for instance with vm_state deleted and task_state None.
Nov 08 12:38:43 user nova-compute[74840]: DEBUG nova.compute.manager [req-e94c2828-894d-4d0a-8b74-a3a358da41a8 req-751f28f8-a345-4b8b-8276-039c43fb793c service nova] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Received event network-vif-plugged-5f1cf848-e83c-454b-b5ab-d2e047ae5e84 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:38:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e94c2828-894d-4d0a-8b74-a3a358da41a8 req-751f28f8-a345-4b8b-8276-039c43fb793c service nova] Acquiring lock "0cecc731-6f86-475c-8603-591de8e30412-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:38:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e94c2828-894d-4d0a-8b74-a3a358da41a8 req-751f28f8-a345-4b8b-8276-039c43fb793c service nova] Lock "0cecc731-6f86-475c-8603-591de8e30412-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:38:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e94c2828-894d-4d0a-8b74-a3a358da41a8 req-751f28f8-a345-4b8b-8276-039c43fb793c service nova] Lock "0cecc731-6f86-475c-8603-591de8e30412-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:38:43 user nova-compute[74840]: DEBUG nova.compute.manager [req-e94c2828-894d-4d0a-8b74-a3a358da41a8 req-751f28f8-a345-4b8b-8276-039c43fb793c service nova] [instance: 0cecc731-6f86-475c-8603-591de8e30412] No waiting events found dispatching network-vif-plugged-5f1cf848-e83c-454b-b5ab-d2e047ae5e84 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:38:43 user nova-compute[74840]: WARNING nova.compute.manager [req-e94c2828-894d-4d0a-8b74-a3a358da41a8 req-751f28f8-a345-4b8b-8276-039c43fb793c service nova] [instance: 0cecc731-6f86-475c-8603-591de8e30412] Received unexpected event network-vif-plugged-5f1cf848-e83c-454b-b5ab-d2e047ae5e84 for instance with vm_state deleted and task_state None.
Nov 08 12:38:46 user nova-compute[74840]: DEBUG nova.compute.manager [req-ec58045d-da72-4012-9d14-ab9aee0d7320 req-2aea89a0-bdfa-4af5-886f-b22c5adf9446 service nova] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Received event network-changed-7cf349fa-e382-4526-af9d-f60a53d870cb {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:38:46 user nova-compute[74840]: DEBUG nova.compute.manager [req-ec58045d-da72-4012-9d14-ab9aee0d7320 req-2aea89a0-bdfa-4af5-886f-b22c5adf9446 service nova] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Refreshing instance network info cache due to event network-changed-7cf349fa-e382-4526-af9d-f60a53d870cb. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:38:46 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-ec58045d-da72-4012-9d14-ab9aee0d7320 req-2aea89a0-bdfa-4af5-886f-b22c5adf9446 service nova] Acquiring lock "refresh_cache-10c42516-62ba-4aa9-bc5a-d94499bd6b65" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:38:46 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-ec58045d-da72-4012-9d14-ab9aee0d7320 req-2aea89a0-bdfa-4af5-886f-b22c5adf9446 service nova] Acquired lock "refresh_cache-10c42516-62ba-4aa9-bc5a-d94499bd6b65" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:38:46 user nova-compute[74840]: DEBUG nova.network.neutron [req-ec58045d-da72-4012-9d14-ab9aee0d7320 req-2aea89a0-bdfa-4af5-886f-b22c5adf9446 service nova] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Refreshing network info cache for port 7cf349fa-e382-4526-af9d-f60a53d870cb {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:38:46 user nova-compute[74840]: DEBUG nova.network.neutron [req-ec58045d-da72-4012-9d14-ab9aee0d7320 req-2aea89a0-bdfa-4af5-886f-b22c5adf9446 service nova] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Updated VIF entry in instance network info cache for port 7cf349fa-e382-4526-af9d-f60a53d870cb. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:38:46 user nova-compute[74840]: DEBUG nova.network.neutron [req-ec58045d-da72-4012-9d14-ab9aee0d7320 req-2aea89a0-bdfa-4af5-886f-b22c5adf9446 service nova] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Updating instance_info_cache with network_info: [{"id": "7cf349fa-e382-4526-af9d-f60a53d870cb", "address": "fa:16:3e:97:67:76", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cf349fa-e3", "ovs_interfaceid": "7cf349fa-e382-4526-af9d-f60a53d870cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:38:46 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-ec58045d-da72-4012-9d14-ab9aee0d7320 req-2aea89a0-bdfa-4af5-886f-b22c5adf9446 service nova] Releasing lock "refresh_cache-10c42516-62ba-4aa9-bc5a-d94499bd6b65" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:38:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:48 user nova-compute[74840]: DEBUG nova.compute.manager [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Stashing vm_state: active {{(pid=74840) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 08 12:38:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:38:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:38:48 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:38:48 user nova-compute[74840]: INFO nova.compute.claims [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Claim successful on node user
Nov 08 12:38:48 user nova-compute[74840]: DEBUG nova.compute.manager [req-4630e8e5-c31f-49a0-9414-6008f977221e req-6d47a744-b822-452d-b50b-a9b8fd1b015f service nova] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Received event network-changed-18c0341b-6a4a-4235-993f-da29deeadcb5 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:38:48 user nova-compute[74840]: DEBUG nova.compute.manager [req-4630e8e5-c31f-49a0-9414-6008f977221e req-6d47a744-b822-452d-b50b-a9b8fd1b015f service nova] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Refreshing instance network info cache due to event network-changed-18c0341b-6a4a-4235-993f-da29deeadcb5. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:38:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4630e8e5-c31f-49a0-9414-6008f977221e req-6d47a744-b822-452d-b50b-a9b8fd1b015f service nova] Acquiring lock "refresh_cache-c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:38:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4630e8e5-c31f-49a0-9414-6008f977221e req-6d47a744-b822-452d-b50b-a9b8fd1b015f service nova] Acquired lock "refresh_cache-c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:38:48 user nova-compute[74840]: DEBUG nova.network.neutron [req-4630e8e5-c31f-49a0-9414-6008f977221e req-6d47a744-b822-452d-b50b-a9b8fd1b015f service nova] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Refreshing network info cache for port 18c0341b-6a4a-4235-993f-da29deeadcb5 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:38:48 user nova-compute[74840]: INFO nova.compute.resource_tracker [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Updating resource usage from migration f74796e5-2ba9-491a-9b2b-3c93e110e5e1
Nov 08 12:38:48 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:38:48 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:38:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.373s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:38:48 user nova-compute[74840]: INFO nova.compute.manager [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Migrating
Nov 08 12:38:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "refresh_cache-c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:38:48 user nova-compute[74840]: DEBUG nova.network.neutron [req-4630e8e5-c31f-49a0-9414-6008f977221e req-6d47a744-b822-452d-b50b-a9b8fd1b015f service nova] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Updated VIF entry in instance network info cache for port 18c0341b-6a4a-4235-993f-da29deeadcb5. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:38:48 user nova-compute[74840]: DEBUG nova.network.neutron [req-4630e8e5-c31f-49a0-9414-6008f977221e req-6d47a744-b822-452d-b50b-a9b8fd1b015f service nova] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Updating instance_info_cache with network_info: [{"id": "18c0341b-6a4a-4235-993f-da29deeadcb5", "address": "fa:16:3e:e7:6e:a4", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18c0341b-6a", "ovs_interfaceid": "18c0341b-6a4a-4235-993f-da29deeadcb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:38:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4630e8e5-c31f-49a0-9414-6008f977221e req-6d47a744-b822-452d-b50b-a9b8fd1b015f service nova] Releasing lock "refresh_cache-c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:38:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquired lock "refresh_cache-c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:38:48 user nova-compute[74840]: DEBUG nova.network.neutron [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:38:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5fc0d6aa-7041-4b91-a36c-a7193bcfe631 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquiring lock "d3e8efc6-7146-46ef-8433-380d7e69120c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:38:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5fc0d6aa-7041-4b91-a36c-a7193bcfe631 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "d3e8efc6-7146-46ef-8433-380d7e69120c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:38:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5fc0d6aa-7041-4b91-a36c-a7193bcfe631 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquiring lock "d3e8efc6-7146-46ef-8433-380d7e69120c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:38:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5fc0d6aa-7041-4b91-a36c-a7193bcfe631 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "d3e8efc6-7146-46ef-8433-380d7e69120c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:38:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5fc0d6aa-7041-4b91-a36c-a7193bcfe631 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "d3e8efc6-7146-46ef-8433-380d7e69120c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:38:48 user nova-compute[74840]: INFO nova.compute.manager [None req-5fc0d6aa-7041-4b91-a36c-a7193bcfe631 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Terminating instance
Nov 08 12:38:48 user nova-compute[74840]: DEBUG nova.compute.manager [None req-5fc0d6aa-7041-4b91-a36c-a7193bcfe631 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Start destroying the instance on the hypervisor. {{(pid=74840) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 12:38:48 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:48 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:48 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:48 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:49 user nova-compute[74840]: DEBUG nova.network.neutron [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Updating instance_info_cache with network_info: [{"id": "18c0341b-6a4a-4235-993f-da29deeadcb5", "address": "fa:16:3e:e7:6e:a4", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18c0341b-6a", "ovs_interfaceid": "18c0341b-6a4a-4235-993f-da29deeadcb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:38:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Releasing lock "refresh_cache-c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:38:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Starting migrate_disk_and_power_off {{(pid=74840) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 08 12:38:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:49 user nova-compute[74840]: DEBUG nova.compute.manager [req-d5636c4e-16b0-409e-905d-cd26ee13b913 req-4dbcace5-8c6a-4070-9157-116e966a7fab service nova] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Received event network-vif-unplugged-18c0341b-6a4a-4235-993f-da29deeadcb5 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:38:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-d5636c4e-16b0-409e-905d-cd26ee13b913 req-4dbcace5-8c6a-4070-9157-116e966a7fab service nova] Acquiring lock "c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:38:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-d5636c4e-16b0-409e-905d-cd26ee13b913 req-4dbcace5-8c6a-4070-9157-116e966a7fab service nova] Lock "c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:38:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-d5636c4e-16b0-409e-905d-cd26ee13b913 req-4dbcace5-8c6a-4070-9157-116e966a7fab service nova] Lock "c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:38:49 user nova-compute[74840]: DEBUG nova.compute.manager [req-d5636c4e-16b0-409e-905d-cd26ee13b913 req-4dbcace5-8c6a-4070-9157-116e966a7fab service nova] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] No waiting events found dispatching network-vif-unplugged-18c0341b-6a4a-4235-993f-da29deeadcb5 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:38:49 user nova-compute[74840]: WARNING nova.compute.manager [req-d5636c4e-16b0-409e-905d-cd26ee13b913 req-4dbcace5-8c6a-4070-9157-116e966a7fab service nova] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Received unexpected event network-vif-unplugged-18c0341b-6a4a-4235-993f-da29deeadcb5 for instance with vm_state active and task_state resize_migrating.
Nov 08 12:38:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:49 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Instance destroyed successfully.
Nov 08 12:38:49 user nova-compute[74840]: DEBUG nova.objects.instance [None req-5fc0d6aa-7041-4b91-a36c-a7193bcfe631 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lazy-loading 'resources' on Instance uuid d3e8efc6-7146-46ef-8433-380d7e69120c {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:38:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-5fc0d6aa-7041-4b91-a36c-a7193bcfe631 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:16:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1144019394',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1144019394',id=17,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:16:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72c97c47ab144ef3a8d5e9ee1ecc059e',ramdisk_id='',reservation_id='r-kgiexb9c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-297593405',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:18:36Z,user_data=None,user_id='275e3d340c9d4d9e90b579e4bc0bfe0b',uuid=d3e8efc6-7146-46ef-8433-380d7e69120c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c942bb3-846b-4319-961f-42aed0e55bdf", "address": "fa:16:3e:29:6a:cd", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c942bb3-84", "ovs_interfaceid": "5c942bb3-846b-4319-961f-42aed0e55bdf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:38:49 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-5fc0d6aa-7041-4b91-a36c-a7193bcfe631 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Converting VIF {"id": "5c942bb3-846b-4319-961f-42aed0e55bdf", "address": "fa:16:3e:29:6a:cd", "network": {"id": "8388eafb-b115-49c7-82cd-0d85d0ee12e4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2023509650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c97c47ab144ef3a8d5e9ee1ecc059e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c942bb3-84", "ovs_interfaceid": "5c942bb3-846b-4319-961f-42aed0e55bdf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:38:49 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-5fc0d6aa-7041-4b91-a36c-a7193bcfe631 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:6a:cd,bridge_name='br-int',has_traffic_filtering=True,id=5c942bb3-846b-4319-961f-42aed0e55bdf,network=Network(8388eafb-b115-49c7-82cd-0d85d0ee12e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c942bb3-84') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:38:49 user nova-compute[74840]: DEBUG os_vif [None req-5fc0d6aa-7041-4b91-a36c-a7193bcfe631 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:6a:cd,bridge_name='br-int',has_traffic_filtering=True,id=5c942bb3-846b-4319-961f-42aed0e55bdf,network=Network(8388eafb-b115-49c7-82cd-0d85d0ee12e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c942bb3-84') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:38:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5c942bb3-84, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:38:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:38:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8dc48b2d-3504-431c-ad25-3c85cc1fe947) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:38:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:38:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:49 user nova-compute[74840]: INFO os_vif [None req-5fc0d6aa-7041-4b91-a36c-a7193bcfe631 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:6a:cd,bridge_name='br-int',has_traffic_filtering=True,id=5c942bb3-846b-4319-961f-42aed0e55bdf,network=Network(8388eafb-b115-49c7-82cd-0d85d0ee12e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c942bb3-84')
Nov 08 12:38:49 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-5fc0d6aa-7041-4b91-a36c-a7193bcfe631 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Deleting instance files /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c_del
Nov 08 12:38:49 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-5fc0d6aa-7041-4b91-a36c-a7193bcfe631 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Deletion of /opt/stack/data/nova/instances/d3e8efc6-7146-46ef-8433-380d7e69120c_del complete
Nov 08 12:38:49 user nova-compute[74840]: INFO nova.compute.manager [None req-5fc0d6aa-7041-4b91-a36c-a7193bcfe631 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 08 12:38:49 user nova-compute[74840]: DEBUG oslo.service.loopingcall [None req-5fc0d6aa-7041-4b91-a36c-a7193bcfe631 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74840) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 12:38:49 user nova-compute[74840]: DEBUG nova.compute.manager [-] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Deallocating network for instance {{(pid=74840) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 12:38:49 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] deallocate_for_instance() {{(pid=74840) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 12:38:50 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Instance destroyed successfully.
Nov 08 12:38:50 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:36:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1685775036',display_name='tempest-ServerActionsTestOtherA-server-1685775036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1685775036',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAmkFC6dPojPaRdPJh94q0/wuvRVxh1HPsrsmItydl0iUnCu6UdbkD5pi9CgzgYpLamuUC6eRZK4fPtOQ5ReX7Sfuo5mKd9gSajCUuWaRBqISYVRzAbikSahnbP3hsO0g==',key_name='tempest-keypair-428361338',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:37:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5e47ef156b3649839ff728eaf23121da',ramdisk_id='',reservation_id='r-od43glui',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-401855506',owner_user_name='tempest-ServerActionsTestOtherA-401855506-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:38:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a49f88cb74c47bdb9a35883adbae454',uuid=c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18c0341b-6a4a-4235-993f-da29deeadcb5", "address": "fa:16:3e:e7:6e:a4", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1377629335-network", "vif_mac": "fa:16:3e:e7:6e:a4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18c0341b-6a", "ovs_interfaceid": "18c0341b-6a4a-4235-993f-da29deeadcb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Converting VIF {"id": "18c0341b-6a4a-4235-993f-da29deeadcb5", "address": "fa:16:3e:e7:6e:a4", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1377629335-network", "vif_mac": "fa:16:3e:e7:6e:a4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18c0341b-6a", "ovs_interfaceid": "18c0341b-6a4a-4235-993f-da29deeadcb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:6e:a4,bridge_name='br-int',has_traffic_filtering=True,id=18c0341b-6a4a-4235-993f-da29deeadcb5,network=Network(e92448c4-9bc0-424b-a07f-a398ac46fada),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18c0341b-6a') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG os_vif [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:6e:a4,bridge_name='br-int',has_traffic_filtering=True,id=18c0341b-6a4a-4235-993f-da29deeadcb5,network=Network(e92448c4-9bc0-424b-a07f-a398ac46fada),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18c0341b-6a') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18c0341b-6a, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=208c3b02-5066-4942-b83d-12a477f69b05) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:50 user nova-compute[74840]: INFO os_vif [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:6e:a4,bridge_name='br-int',has_traffic_filtering=True,id=18c0341b-6a4a-4235-993f-da29deeadcb5,network=Network(e92448c4-9bc0-424b-a07f-a398ac46fada),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18c0341b-6a')
Nov 08 12:38:50 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gAtTOrZz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:38:50 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:38:50 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52f34f2-73b2-459a-aba9-2f8cbfb3b6e9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 12:38:50 user nova-compute[74840]: No targets found.
Nov 08 12:38:50 user nova-compute[74840]: iSNS:
Nov 08 12:38:50 user nova-compute[74840]: No targets found.
Nov 08 12:38:50 user nova-compute[74840]: STATIC:
Nov 08 12:38:50 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616
Nov 08 12:38:50 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:38:50 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:38:50 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665
Nov 08 12:38:50 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:38:50 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:38:50 user nova-compute[74840]: FIRMWARE:
Nov 08 12:38:50 user nova-compute[74840]: No targets found.
Nov 08 12:38:50 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 12:38:50 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 12:38:50 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f49f6c4-f82e-4006-a253-b448aac73838]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d28d64f-bcf2-4fad-8170-06f3d9dc318e]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 (non-flash)
Nov 08 12:38:50 user nova-compute[74840]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 (non-flash)
Nov 08 12:38:50 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 (non-flash)
Nov 08 12:38:50 user nova-compute[74840]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 (non-flash)
Nov 08 12:38:50 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7f7e1a680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665'): ({'sdb'}, set())}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Removing single pathed devices sdb {{(pid=74840) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56bb35b-2080-458a-97ae-fd42af8ae052]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8c5d8a-e5b3-48ea-839f-4e5bc1c9b1b1]: (4, ('ok\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Flushing IO for device /dev/sdb {{(pid=74840) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fee15c8-8501-4743-82e0-18cc433498f9]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74840) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG nova.compute.manager [req-3e0bdd14-384a-46d3-9615-aaba37514656 req-a45cb939-ce7d-41b6-a852-780312f1c861 service nova] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Received event network-vif-unplugged-5c942bb3-846b-4319-961f-42aed0e55bdf {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3e0bdd14-384a-46d3-9615-aaba37514656 req-a45cb939-ce7d-41b6-a852-780312f1c861 service nova] Acquiring lock "d3e8efc6-7146-46ef-8433-380d7e69120c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3e0bdd14-384a-46d3-9615-aaba37514656 req-a45cb939-ce7d-41b6-a852-780312f1c861 service nova] Lock "d3e8efc6-7146-46ef-8433-380d7e69120c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3e0bdd14-384a-46d3-9615-aaba37514656 req-a45cb939-ce7d-41b6-a852-780312f1c861 service nova] Lock "d3e8efc6-7146-46ef-8433-380d7e69120c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG nova.compute.manager [req-3e0bdd14-384a-46d3-9615-aaba37514656 req-a45cb939-ce7d-41b6-a852-780312f1c861 service nova] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] No waiting events found dispatching network-vif-unplugged-5c942bb3-846b-4319-961f-42aed0e55bdf {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG nova.compute.manager [req-3e0bdd14-384a-46d3-9615-aaba37514656 req-a45cb939-ce7d-41b6-a852-780312f1c861 service nova] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Received event network-vif-unplugged-5c942bb3-846b-4319-961f-42aed0e55bdf for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG nova.compute.manager [req-3e0bdd14-384a-46d3-9615-aaba37514656 req-a45cb939-ce7d-41b6-a852-780312f1c861 service nova] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Received event network-vif-plugged-5c942bb3-846b-4319-961f-42aed0e55bdf {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3e0bdd14-384a-46d3-9615-aaba37514656 req-a45cb939-ce7d-41b6-a852-780312f1c861 service nova] Acquiring lock "d3e8efc6-7146-46ef-8433-380d7e69120c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3e0bdd14-384a-46d3-9615-aaba37514656 req-a45cb939-ce7d-41b6-a852-780312f1c861 service nova] Lock "d3e8efc6-7146-46ef-8433-380d7e69120c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3e0bdd14-384a-46d3-9615-aaba37514656 req-a45cb939-ce7d-41b6-a852-780312f1c861 service nova] Lock "d3e8efc6-7146-46ef-8433-380d7e69120c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG nova.compute.manager [req-3e0bdd14-384a-46d3-9615-aaba37514656 req-a45cb939-ce7d-41b6-a852-780312f1c861 service nova] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] No waiting events found dispatching network-vif-plugged-5c942bb3-846b-4319-961f-42aed0e55bdf {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:38:50 user nova-compute[74840]: WARNING nova.compute.manager [req-3e0bdd14-384a-46d3-9615-aaba37514656 req-a45cb939-ce7d-41b6-a852-780312f1c861 service nova] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Received unexpected event network-vif-plugged-5c942bb3-846b-4319-961f-42aed0e55bdf for instance with vm_state active and task_state deleting.
Nov 08 12:38:50 user nova-compute[74840]: INFO nova.compute.manager [-] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Took 0.47 seconds to deallocate network for instance.
Nov 08 12:38:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dcd1fce-bd35-4a6c-8485-ce63b77fd7af]: (4, ('1', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] SCSI volumes sdb have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665')] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98089b9-d657-47e8-9f96-b10a62393d18]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 -p 172.16.0.220:3260 --logout {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5fc0d6aa-7041-4b91-a36c-a7193bcfe631 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5fc0d6aa-7041-4b91-a36c-a7193bcfe631 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e2482a-86f7-4092-8282-5e45e049067b]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665, portal: 172.16.0.220,3260]
Nov 08 12:38:50 user nova-compute[74840]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665, portal: 172.16.0.220,3260] successful.
Nov 08 12:38:50 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 -p 172.16.0.220:3260 --op delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce488b07-94ea-4637-a0d7-14a69185a414]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.571s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] <== disconnect_volume: return (573ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-5fc0d6aa-7041-4b91-a36c-a7193bcfe631 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-5fc0d6aa-7041-4b91-a36c-a7193bcfe631 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:38:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5fc0d6aa-7041-4b91-a36c-a7193bcfe631 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.545s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:38:50 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-5fc0d6aa-7041-4b91-a36c-a7193bcfe631 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Deleted allocations for instance d3e8efc6-7146-46ef-8433-380d7e69120c
Nov 08 12:38:51 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-5fc0d6aa-7041-4b91-a36c-a7193bcfe631 tempest-ServerBootFromVolumeStableRescueTest-297593405 tempest-ServerBootFromVolumeStableRescueTest-297593405-project-member] Lock "d3e8efc6-7146-46ef-8433-380d7e69120c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.196s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:38:51 user nova-compute[74840]: DEBUG nova.compute.manager [req-c366cc95-091f-4ee9-b5c2-be1c23433952 req-9b10a39f-f86e-43b6-b229-8811c2176e96 service nova] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Received event network-vif-plugged-18c0341b-6a4a-4235-993f-da29deeadcb5 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:38:51 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-c366cc95-091f-4ee9-b5c2-be1c23433952 req-9b10a39f-f86e-43b6-b229-8811c2176e96 service nova] Acquiring lock "c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:38:51 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-c366cc95-091f-4ee9-b5c2-be1c23433952 req-9b10a39f-f86e-43b6-b229-8811c2176e96 service nova] Lock "c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:38:51 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-c366cc95-091f-4ee9-b5c2-be1c23433952 req-9b10a39f-f86e-43b6-b229-8811c2176e96 service nova] Lock "c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:38:51 user nova-compute[74840]: DEBUG nova.compute.manager [req-c366cc95-091f-4ee9-b5c2-be1c23433952 req-9b10a39f-f86e-43b6-b229-8811c2176e96 service nova] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] No waiting events found dispatching network-vif-plugged-18c0341b-6a4a-4235-993f-da29deeadcb5 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:38:51 user nova-compute[74840]: WARNING nova.compute.manager [req-c366cc95-091f-4ee9-b5c2-be1c23433952 req-9b10a39f-f86e-43b6-b229-8811c2176e96 service nova] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Received unexpected event network-vif-plugged-18c0341b-6a4a-4235-993f-da29deeadcb5 for instance with vm_state active and task_state resize_migrating.
Nov 08 12:38:51 user nova-compute[74840]: DEBUG nova.network.neutron [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Port 18c0341b-6a4a-4235-993f-da29deeadcb5 binding to destination host user is already ACTIVE {{(pid=74840) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 08 12:38:52 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:38:52 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:38:52 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:38:52 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "refresh_cache-c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:38:52 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquired lock "refresh_cache-c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:38:52 user nova-compute[74840]: DEBUG nova.network.neutron [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:38:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:52 user nova-compute[74840]: DEBUG nova.compute.manager [req-030a0b41-2b81-4166-a917-52fa68940609 req-24c288e1-60ee-4ea3-8b42-99ce11f54d53 service nova] [instance: d3e8efc6-7146-46ef-8433-380d7e69120c] Received event network-vif-deleted-5c942bb3-846b-4319-961f-42aed0e55bdf {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:38:52 user nova-compute[74840]: DEBUG nova.network.neutron [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Updating instance_info_cache with network_info: [{"id": "18c0341b-6a4a-4235-993f-da29deeadcb5", "address": "fa:16:3e:e7:6e:a4", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18c0341b-6a", "ovs_interfaceid": "18c0341b-6a4a-4235-993f-da29deeadcb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:38:52 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Releasing lock "refresh_cache-c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:38:52 user nova-compute[74840]: DEBUG os_brick.utils [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:38:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:38:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:38:52 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d3f71b-fd66-4e62-a0e1-7ee7265915b2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c8228a11e03c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:38:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:38:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:38:52 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccbb6a32-5f8a-4a29-bc10-bb9151cf8c10]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:38:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:38:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:38:52 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e8b324-92d4-4673-84c8-cfe51d547ed7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:38:52 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[294c7349-6efa-448f-b456-27daf1483ebb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:38:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Running cmd (subprocess): nvme version {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:38:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] 'nvme version' failed. Not Retrying. {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:38:52 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.nvmeof [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] nvme not present on system {{(pid=74840) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 12:38:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:38:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:38:52 user nova-compute[74840]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 12:38:52 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd86ba35-8d26-49ad-8f0b-fff366081642]: (4, '') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:38:52 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74840) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 12:38:52 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 12:38:52 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] LIGHTOS: no hostnqn found. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 12:38:52 user nova-compute[74840]: DEBUG os_brick.utils [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c8228a11e03c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:38:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:38:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:39:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:09 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:39:09 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:39:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "refresh_cache-7a482219-16ac-49e2-84ad-7e2030c97184" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:39:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquired lock "refresh_cache-7a482219-16ac-49e2-84ad-7e2030c97184" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:39:10 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Forcefully refreshing network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 12:39:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:10 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Updating instance_info_cache with network_info: [{"id": "00efdc72-8528-41eb-be2b-c9b190863053", "address": "fa:16:3e:72:4b:1f", "network": {"id": "7faeaea5-04e0-46e0-bb55-9426d599fb1b", "bridge": "br-int", "label": "tempest-TestStampPattern-1080763140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c24d52e18e8e41dfa50aa5aff1f40c6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00efdc72-85", "ovs_interfaceid": "00efdc72-8528-41eb-be2b-c9b190863053", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:39:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Releasing lock "refresh_cache-7a482219-16ac-49e2-84ad-7e2030c97184" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:39:10 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Updated the network info_cache for instance {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 12:39:10 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:39:10 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:39:10 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:39:10 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:39:10 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:39:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-6561e3dc-5d84-40c7-bb87-1fa7f59cbc99 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Acquiring lock "6156dbbc-6539-4de3-8ba0-16db61cd7dce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:39:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-6561e3dc-5d84-40c7-bb87-1fa7f59cbc99 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "6156dbbc-6539-4de3-8ba0-16db61cd7dce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:39:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-6561e3dc-5d84-40c7-bb87-1fa7f59cbc99 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Acquiring lock "6156dbbc-6539-4de3-8ba0-16db61cd7dce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:39:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-6561e3dc-5d84-40c7-bb87-1fa7f59cbc99 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "6156dbbc-6539-4de3-8ba0-16db61cd7dce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:39:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-6561e3dc-5d84-40c7-bb87-1fa7f59cbc99 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "6156dbbc-6539-4de3-8ba0-16db61cd7dce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:39:10 user nova-compute[74840]: INFO nova.compute.manager [None req-6561e3dc-5d84-40c7-bb87-1fa7f59cbc99 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Terminating instance
Nov 08 12:39:10 user nova-compute[74840]: DEBUG nova.compute.manager [None req-6561e3dc-5d84-40c7-bb87-1fa7f59cbc99 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Start destroying the instance on the hypervisor. {{(pid=74840) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 12:39:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:11 user nova-compute[74840]: DEBUG nova.compute.manager [req-2c45049c-25c7-439a-a222-3d70473fe67c req-aa6f477d-3038-4b0b-afc7-c7e4d7fa794a service nova] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Received event network-vif-unplugged-0c5dbe98-66f5-492a-8da2-8eca6cf38de5 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:39:11 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2c45049c-25c7-439a-a222-3d70473fe67c req-aa6f477d-3038-4b0b-afc7-c7e4d7fa794a service nova] Acquiring lock "6156dbbc-6539-4de3-8ba0-16db61cd7dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:39:11 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2c45049c-25c7-439a-a222-3d70473fe67c req-aa6f477d-3038-4b0b-afc7-c7e4d7fa794a service nova] Lock "6156dbbc-6539-4de3-8ba0-16db61cd7dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:39:11 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2c45049c-25c7-439a-a222-3d70473fe67c req-aa6f477d-3038-4b0b-afc7-c7e4d7fa794a service nova] Lock "6156dbbc-6539-4de3-8ba0-16db61cd7dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:39:11 user nova-compute[74840]: DEBUG nova.compute.manager [req-2c45049c-25c7-439a-a222-3d70473fe67c req-aa6f477d-3038-4b0b-afc7-c7e4d7fa794a service nova] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] No waiting events found dispatching network-vif-unplugged-0c5dbe98-66f5-492a-8da2-8eca6cf38de5 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:39:11 user nova-compute[74840]: DEBUG nova.compute.manager [req-2c45049c-25c7-439a-a222-3d70473fe67c req-aa6f477d-3038-4b0b-afc7-c7e4d7fa794a service nova] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Received event network-vif-unplugged-0c5dbe98-66f5-492a-8da2-8eca6cf38de5 for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:39:11 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Instance destroyed successfully.
Nov 08 12:39:11 user nova-compute[74840]: DEBUG nova.objects.instance [None req-6561e3dc-5d84-40c7-bb87-1fa7f59cbc99 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lazy-loading 'resources' on Instance uuid 6156dbbc-6539-4de3-8ba0-16db61cd7dce {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:39:11 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-6561e3dc-5d84-40c7-bb87-1fa7f59cbc99 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T12:33:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1903705906',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1903705906',id=42,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFyOqyXoJE6A6khVhOqKm6eVWT5lVBOlj4aL8lXGOedklADnjHYeCbyRzst0jVwSHeyseYsI5B6BggkYstW9mP1b77U3gf+VYtK1KZlTE1fMpYwW88X38s9nwM8iJQzsg==',key_name='tempest-keypair-1939521876',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:37:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='93a05cda834445fb94e71f6cac02f198',ramdisk_id='',reservation_id='r-wqqsoqk3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1958698266',owner_user_name='tempest-AttachVolumeShelveTestJSON-1958698266-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:37:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='afc4e8483a1f4e08b3f81a9b9323be84',uuid=6156dbbc-6539-4de3-8ba0-16db61cd7dce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c5dbe98-66f5-492a-8da2-8eca6cf38de5", "address": "fa:16:3e:ab:15:81", "network": {"id": "918d8aed-1f09-4cfb-9c7f-48f002ad6ba3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-927886396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a05cda834445fb94e71f6cac02f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5dbe98-66", "ovs_interfaceid": "0c5dbe98-66f5-492a-8da2-8eca6cf38de5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:39:11 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-6561e3dc-5d84-40c7-bb87-1fa7f59cbc99 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Converting VIF {"id": "0c5dbe98-66f5-492a-8da2-8eca6cf38de5", "address": "fa:16:3e:ab:15:81", "network": {"id": "918d8aed-1f09-4cfb-9c7f-48f002ad6ba3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-927886396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a05cda834445fb94e71f6cac02f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5dbe98-66", "ovs_interfaceid": "0c5dbe98-66f5-492a-8da2-8eca6cf38de5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:39:11 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-6561e3dc-5d84-40c7-bb87-1fa7f59cbc99 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:15:81,bridge_name='br-int',has_traffic_filtering=True,id=0c5dbe98-66f5-492a-8da2-8eca6cf38de5,network=Network(918d8aed-1f09-4cfb-9c7f-48f002ad6ba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5dbe98-66') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:39:11 user nova-compute[74840]: DEBUG os_vif [None req-6561e3dc-5d84-40c7-bb87-1fa7f59cbc99 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:15:81,bridge_name='br-int',has_traffic_filtering=True,id=0c5dbe98-66f5-492a-8da2-8eca6cf38de5,network=Network(918d8aed-1f09-4cfb-9c7f-48f002ad6ba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5dbe98-66') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:39:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c5dbe98-66, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:39:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=61a976ba-ab62-46c6-8c88-c2281790bdfb) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:39:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:39:11 user nova-compute[74840]: INFO os_vif [None req-6561e3dc-5d84-40c7-bb87-1fa7f59cbc99 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:15:81,bridge_name='br-int',has_traffic_filtering=True,id=0c5dbe98-66f5-492a-8da2-8eca6cf38de5,network=Network(918d8aed-1f09-4cfb-9c7f-48f002ad6ba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5dbe98-66')
Nov 08 12:39:11 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-6561e3dc-5d84-40c7-bb87-1fa7f59cbc99 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Deleting instance files /opt/stack/data/nova/instances/6156dbbc-6539-4de3-8ba0-16db61cd7dce_del
Nov 08 12:39:11 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-6561e3dc-5d84-40c7-bb87-1fa7f59cbc99 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Deletion of /opt/stack/data/nova/instances/6156dbbc-6539-4de3-8ba0-16db61cd7dce_del complete
Nov 08 12:39:11 user nova-compute[74840]: INFO nova.compute.manager [None req-6561e3dc-5d84-40c7-bb87-1fa7f59cbc99 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 08 12:39:11 user nova-compute[74840]: DEBUG oslo.service.loopingcall [None req-6561e3dc-5d84-40c7-bb87-1fa7f59cbc99 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74840) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 12:39:11 user nova-compute[74840]: DEBUG nova.compute.manager [-] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Deallocating network for instance {{(pid=74840) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 12:39:11 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] deallocate_for_instance() {{(pid=74840) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 12:39:11 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:39:11 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:39:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:12 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:39:12 user nova-compute[74840]: INFO nova.compute.manager [-] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Took 0.85 seconds to deallocate network for instance.
Nov 08 12:39:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-6561e3dc-5d84-40c7-bb87-1fa7f59cbc99 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:39:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-6561e3dc-5d84-40c7-bb87-1fa7f59cbc99 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:39:12 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-6561e3dc-5d84-40c7-bb87-1fa7f59cbc99 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:39:12 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-6561e3dc-5d84-40c7-bb87-1fa7f59cbc99 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:39:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-6561e3dc-5d84-40c7-bb87-1fa7f59cbc99 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.239s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:39:12 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-6561e3dc-5d84-40c7-bb87-1fa7f59cbc99 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Deleted allocations for instance 6156dbbc-6539-4de3-8ba0-16db61cd7dce
Nov 08 12:39:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-6561e3dc-5d84-40c7-bb87-1fa7f59cbc99 tempest-AttachVolumeShelveTestJSON-1958698266 tempest-AttachVolumeShelveTestJSON-1958698266-project-member] Lock "6156dbbc-6539-4de3-8ba0-16db61cd7dce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.945s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:39:13 user nova-compute[74840]: DEBUG nova.compute.manager [req-d322eeec-34d0-4ed8-90f7-0cae4d799f43 req-3cdecb44-9005-4dc8-9417-962b64a135bc service nova] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Received event network-vif-plugged-0c5dbe98-66f5-492a-8da2-8eca6cf38de5 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:39:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-d322eeec-34d0-4ed8-90f7-0cae4d799f43 req-3cdecb44-9005-4dc8-9417-962b64a135bc service nova] Acquiring lock "6156dbbc-6539-4de3-8ba0-16db61cd7dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:39:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-d322eeec-34d0-4ed8-90f7-0cae4d799f43 req-3cdecb44-9005-4dc8-9417-962b64a135bc service nova] Lock "6156dbbc-6539-4de3-8ba0-16db61cd7dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:39:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-d322eeec-34d0-4ed8-90f7-0cae4d799f43 req-3cdecb44-9005-4dc8-9417-962b64a135bc service nova] Lock "6156dbbc-6539-4de3-8ba0-16db61cd7dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:39:13 user nova-compute[74840]: DEBUG nova.compute.manager [req-d322eeec-34d0-4ed8-90f7-0cae4d799f43 req-3cdecb44-9005-4dc8-9417-962b64a135bc service nova] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] No waiting events found dispatching network-vif-plugged-0c5dbe98-66f5-492a-8da2-8eca6cf38de5 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:39:13 user nova-compute[74840]: WARNING nova.compute.manager [req-d322eeec-34d0-4ed8-90f7-0cae4d799f43 req-3cdecb44-9005-4dc8-9417-962b64a135bc service nova] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Received unexpected event network-vif-plugged-0c5dbe98-66f5-492a-8da2-8eca6cf38de5 for instance with vm_state deleted and task_state None.
Nov 08 12:39:13 user nova-compute[74840]: DEBUG nova.compute.manager [req-d322eeec-34d0-4ed8-90f7-0cae4d799f43 req-3cdecb44-9005-4dc8-9417-962b64a135bc service nova] [instance: 6156dbbc-6539-4de3-8ba0-16db61cd7dce] Received event network-vif-deleted-0c5dbe98-66f5-492a-8da2-8eca6cf38de5 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:39:13 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Starting finish_migration {{(pid=74840) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Instance directory exists: not creating {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 12:39:15 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Creating image(s)
Nov 08 12:39:15 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Did not create local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Ensure instance console log exists: /opt/stack/data/nova/instances/c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Start _get_guest_xml network_info=[{"id": "18c0341b-6a4a-4235-993f-da29deeadcb5", "address": "fa:16:3e:e7:6e:a4", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1377629335-network", "vif_mac": "fa:16:3e:e7:6e:a4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18c0341b-6a", "ovs_interfaceid": "18c0341b-6a4a-4235-993f-da29deeadcb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9d14b794-0756-4805-8cd2-aa827f07ff30', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gAtTOrZz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a', 'attached_at': '2023-11-08T12:39:16.000000', 'detached_at': '', 'volume_id': '9116b48b-6faa-44d9-a397-54a614016665', 'serial': '9116b48b-6faa-44d9-a397-54a614016665'}, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:39:15 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:39:15 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:39:15 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:05:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Calling os-brick to attach iSCSI Volume {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gAtTOrZz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:39:15 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:39:15 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:39:15 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:39:15 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:39:15 user nova-compute[74840]: INFO os_brick.initiator.connectors.iscsi [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 12:39:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 -p 172.16.0.220:3260 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1cf57c-df75-42f2-95df-f2d5e495fdc2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 12:39:15 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 -p 172.16.0.220:3260 --interface default --op new {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70c1ec3-8034-4ce6-9e10-212152773233]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665] added\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665] added
Nov 08 12:39:15 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[27642b12-64ec-43c9-b2e9-b2ebd34aa0ee]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c748ac-45e4-44fc-9aee-4c14198fad9a]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gAtTOrZz {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gAtTOrZz" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae381a8-19b0-490b-af78-13ef451ad636]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gAtTOrZz'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9259a1-bdab-4f72-8e1f-25df2d8c8eac]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e8de19-76cc-46f6-aa6f-c0032e61c6d4]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 (non-flash)
Nov 08 12:39:15 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 (non-flash)
Nov 08 12:39:15 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:39:15 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 -p 172.16.0.220:3260 --login {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:39:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:39:16 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f645da-e169-4a32-aec2-efc6cca6043b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:39:16 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665, portal: 172.16.0.220,3260]
Nov 08 12:39:16 user nova-compute[74840]: Login to [iface: default, target: iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665, portal: 172.16.0.220,3260] successful.
Nov 08 12:39:16 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:39:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:39:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:39:16 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf29ee3-663a-45aa-b519-9c2409dfc04a]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:39:16 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:39:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:39:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:39:16 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d797a0-3bbe-4fee-8ed5-0135f9c5b5d2]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:39:16 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 (non-flash)
Nov 08 12:39:16 user nova-compute[74840]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 (non-flash)
Nov 08 12:39:16 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:39:16 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 (non-flash)
Nov 08 12:39:16 user nova-compute[74840]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 (non-flash)
Nov 08 12:39:16 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:39:16 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:39:16 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Connected to 172.16.0.220:3260 {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 12:39:16 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=74840) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 12:39:16 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74840) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 12:39:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:39:16 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:39:16 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e604247-933e-48dd-9108-69c23ca50408]: (4, ('- - 0', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:39:16 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: None {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:39:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:17 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:39:17 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gAtTOrZz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 12:39:17 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:39:17 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23835383362326464', 'path': '/dev/sdb'} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:39:17 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835383362326464', 'path': '/dev/sdb'} {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 12:39:17 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:36:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1685775036',display_name='tempest-ServerActionsTestOtherA-server-1685775036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1685775036',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAmkFC6dPojPaRdPJh94q0/wuvRVxh1HPsrsmItydl0iUnCu6UdbkD5pi9CgzgYpLamuUC6eRZK4fPtOQ5ReX7Sfuo5mKd9gSajCUuWaRBqISYVRzAbikSahnbP3hsO0g==',key_name='tempest-keypair-428361338',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:37:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5e47ef156b3649839ff728eaf23121da',ramdisk_id='',reservation_id='r-od43glui',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-401855506',owner_user_name='tempest-ServerActionsTestOtherA-401855506-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:38:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a49f88cb74c47bdb9a35883adbae454',uuid=c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18c0341b-6a4a-4235-993f-da29deeadcb5", "address": "fa:16:3e:e7:6e:a4", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1377629335-network", "vif_mac": "fa:16:3e:e7:6e:a4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18c0341b-6a", "ovs_interfaceid": "18c0341b-6a4a-4235-993f-da29deeadcb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:39:17 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Converting VIF {"id": "18c0341b-6a4a-4235-993f-da29deeadcb5", "address": "fa:16:3e:e7:6e:a4", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1377629335-network", "vif_mac": "fa:16:3e:e7:6e:a4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18c0341b-6a", "ovs_interfaceid": "18c0341b-6a4a-4235-993f-da29deeadcb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:39:17 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:6e:a4,bridge_name='br-int',has_traffic_filtering=True,id=18c0341b-6a4a-4235-993f-da29deeadcb5,network=Network(e92448c4-9bc0-424b-a07f-a398ac46fada),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18c0341b-6a') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:39:17 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:39:17 user nova-compute[74840]:   <uuid>c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a</uuid>
Nov 08 12:39:17 user nova-compute[74840]:   <name>instance-0000002c</name>
Nov 08 12:39:17 user nova-compute[74840]:   <memory>2097152</memory>
Nov 08 12:39:17 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:39:17 user nova-compute[74840]:   <metadata>
Nov 08 12:39:17 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:39:17 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:39:17 user nova-compute[74840]:       <nova:name>tempest-ServerActionsTestOtherA-server-1685775036</nova:name>
Nov 08 12:39:17 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:39:15</nova:creationTime>
Nov 08 12:39:17 user nova-compute[74840]:       <nova:flavor name="m1.small">
Nov 08 12:39:17 user nova-compute[74840]:         <nova:memory>2048</nova:memory>
Nov 08 12:39:17 user nova-compute[74840]:         <nova:disk>20</nova:disk>
Nov 08 12:39:17 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:39:17 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:39:17 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:39:17 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:39:17 user nova-compute[74840]:       <nova:owner>
Nov 08 12:39:17 user nova-compute[74840]:         <nova:user uuid="9a49f88cb74c47bdb9a35883adbae454">tempest-ServerActionsTestOtherA-401855506-project-member</nova:user>
Nov 08 12:39:17 user nova-compute[74840]:         <nova:project uuid="5e47ef156b3649839ff728eaf23121da">tempest-ServerActionsTestOtherA-401855506</nova:project>
Nov 08 12:39:17 user nova-compute[74840]:       </nova:owner>
Nov 08 12:39:17 user nova-compute[74840]:       <nova:ports>
Nov 08 12:39:17 user nova-compute[74840]:         <nova:port uuid="18c0341b-6a4a-4235-993f-da29deeadcb5">
Nov 08 12:39:17 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 12:39:17 user nova-compute[74840]:         </nova:port>
Nov 08 12:39:17 user nova-compute[74840]:       </nova:ports>
Nov 08 12:39:17 user nova-compute[74840]:     </nova:instance>
Nov 08 12:39:17 user nova-compute[74840]:   </metadata>
Nov 08 12:39:17 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:39:17 user nova-compute[74840]:     <system>
Nov 08 12:39:17 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:39:17 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:39:17 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:39:17 user nova-compute[74840]:       <entry name="serial">c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a</entry>
Nov 08 12:39:17 user nova-compute[74840]:       <entry name="uuid">c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a</entry>
Nov 08 12:39:17 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:39:17 user nova-compute[74840]:     </system>
Nov 08 12:39:17 user nova-compute[74840]:   </sysinfo>
Nov 08 12:39:17 user nova-compute[74840]:   <os>
Nov 08 12:39:17 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:39:17 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:39:17 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:39:17 user nova-compute[74840]:   </os>
Nov 08 12:39:17 user nova-compute[74840]:   <features>
Nov 08 12:39:17 user nova-compute[74840]:     <acpi/>
Nov 08 12:39:17 user nova-compute[74840]:     <apic/>
Nov 08 12:39:17 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:39:17 user nova-compute[74840]:   </features>
Nov 08 12:39:17 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:39:17 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:39:17 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:39:17 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:39:17 user nova-compute[74840]:   </clock>
Nov 08 12:39:17 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:39:17 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:39:17 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:39:17 user nova-compute[74840]:   </cpu>
Nov 08 12:39:17 user nova-compute[74840]:   <devices>
Nov 08 12:39:17 user nova-compute[74840]:     <disk type="block" device="disk">
Nov 08 12:39:17 user nova-compute[74840]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:39:17 user nova-compute[74840]:       <source dev="/dev/sdb"/>
Nov 08 12:39:17 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:39:17 user nova-compute[74840]:       <serial>9116b48b-6faa-44d9-a397-54a614016665</serial>
Nov 08 12:39:17 user nova-compute[74840]:     </disk>
Nov 08 12:39:17 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:39:17 user nova-compute[74840]:       <mac address="fa:16:3e:e7:6e:a4"/>
Nov 08 12:39:17 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:39:17 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:39:17 user nova-compute[74840]:       <target dev="tap18c0341b-6a"/>
Nov 08 12:39:17 user nova-compute[74840]:     </interface>
Nov 08 12:39:17 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:39:17 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a/console.log" append="off"/>
Nov 08 12:39:17 user nova-compute[74840]:     </serial>
Nov 08 12:39:17 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:39:17 user nova-compute[74840]:     <video>
Nov 08 12:39:17 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:39:17 user nova-compute[74840]:     </video>
Nov 08 12:39:17 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:39:17 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:39:17 user nova-compute[74840]:     </rng>
Nov 08 12:39:17 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:39:17 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:39:17 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:39:17 user nova-compute[74840]:     </memballoon>
Nov 08 12:39:17 user nova-compute[74840]:   </devices>
Nov 08 12:39:17 user nova-compute[74840]: </domain>
Nov 08 12:39:17 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:39:17 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:36:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1685775036',display_name='tempest-ServerActionsTestOtherA-server-1685775036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1685775036',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAmkFC6dPojPaRdPJh94q0/wuvRVxh1HPsrsmItydl0iUnCu6UdbkD5pi9CgzgYpLamuUC6eRZK4fPtOQ5ReX7Sfuo5mKd9gSajCUuWaRBqISYVRzAbikSahnbP3hsO0g==',key_name='tempest-keypair-428361338',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:37:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5e47ef156b3649839ff728eaf23121da',ramdisk_id='',reservation_id='r-od43glui',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-401855506',owner_user_name='tempest-ServerActionsTestOtherA-401855506-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:38:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a49f88cb74c47bdb9a35883adbae454',uuid=c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18c0341b-6a4a-4235-993f-da29deeadcb5", "address": "fa:16:3e:e7:6e:a4", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1377629335-network", "vif_mac": "fa:16:3e:e7:6e:a4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18c0341b-6a", "ovs_interfaceid": "18c0341b-6a4a-4235-993f-da29deeadcb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:39:17 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Converting VIF {"id": "18c0341b-6a4a-4235-993f-da29deeadcb5", "address": "fa:16:3e:e7:6e:a4", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1377629335-network", "vif_mac": "fa:16:3e:e7:6e:a4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18c0341b-6a", "ovs_interfaceid": "18c0341b-6a4a-4235-993f-da29deeadcb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:39:17 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:6e:a4,bridge_name='br-int',has_traffic_filtering=True,id=18c0341b-6a4a-4235-993f-da29deeadcb5,network=Network(e92448c4-9bc0-424b-a07f-a398ac46fada),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18c0341b-6a') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:39:17 user nova-compute[74840]: DEBUG os_vif [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:6e:a4,bridge_name='br-int',has_traffic_filtering=True,id=18c0341b-6a4a-4235-993f-da29deeadcb5,network=Network(e92448c4-9bc0-424b-a07f-a398ac46fada),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18c0341b-6a') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:39:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:39:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:39:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ccacf72c-a4b8-5d42-9bcf-d5de7c5584e5', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:39:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:39:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18c0341b-6a, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:39:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap18c0341b-6a, col_values=(('qos', UUID('a0b5cc09-d66a-458f-8a0b-8ce83a32ef53')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:39:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap18c0341b-6a, col_values=(('external_ids', {'iface-id': '18c0341b-6a4a-4235-993f-da29deeadcb5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:6e:a4', 'vm-uuid': 'c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:39:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:39:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:17 user nova-compute[74840]: INFO os_vif [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:6e:a4,bridge_name='br-int',has_traffic_filtering=True,id=18c0341b-6a4a-4235-993f-da29deeadcb5,network=Network(e92448c4-9bc0-424b-a07f-a398ac46fada),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18c0341b-6a')
Nov 08 12:39:17 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:39:17 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] No VIF found with MAC fa:16:3e:e7:6e:a4, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:39:17 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:39:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:39:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:39:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:39:17 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:39:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:18 user nova-compute[74840]: DEBUG nova.compute.manager [req-3376a69b-4df0-406c-bbf3-9ba4fc1cfd26 req-cb8aaf39-3b0d-4c6d-baa6-d588aaf53f2f service nova] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Received event network-vif-plugged-18c0341b-6a4a-4235-993f-da29deeadcb5 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:39:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3376a69b-4df0-406c-bbf3-9ba4fc1cfd26 req-cb8aaf39-3b0d-4c6d-baa6-d588aaf53f2f service nova] Acquiring lock "c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:39:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3376a69b-4df0-406c-bbf3-9ba4fc1cfd26 req-cb8aaf39-3b0d-4c6d-baa6-d588aaf53f2f service nova] Lock "c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:39:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3376a69b-4df0-406c-bbf3-9ba4fc1cfd26 req-cb8aaf39-3b0d-4c6d-baa6-d588aaf53f2f service nova] Lock "c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:39:18 user nova-compute[74840]: DEBUG nova.compute.manager [req-3376a69b-4df0-406c-bbf3-9ba4fc1cfd26 req-cb8aaf39-3b0d-4c6d-baa6-d588aaf53f2f service nova] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] No waiting events found dispatching network-vif-plugged-18c0341b-6a4a-4235-993f-da29deeadcb5 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:39:18 user nova-compute[74840]: WARNING nova.compute.manager [req-3376a69b-4df0-406c-bbf3-9ba4fc1cfd26 req-cb8aaf39-3b0d-4c6d-baa6-d588aaf53f2f service nova] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Received unexpected event network-vif-plugged-18c0341b-6a4a-4235-993f-da29deeadcb5 for instance with vm_state active and task_state resize_finish.
Nov 08 12:39:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:39:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a482219-16ac-49e2-84ad-7e2030c97184/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:39:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a482219-16ac-49e2-84ad-7e2030c97184/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:39:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a482219-16ac-49e2-84ad-7e2030c97184/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:39:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a482219-16ac-49e2-84ad-7e2030c97184/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:39:19 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:39:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:39:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:39:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:39:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:39:20 user nova-compute[74840]: DEBUG nova.compute.manager [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:39:20 user nova-compute[74840]: DEBUG nova.compute.manager [req-7625bfa1-f37e-4de7-ad75-80e9af17d61e req-72985417-c3ef-45f7-8f3b-d5fd9a3a82b5 service nova] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Received event network-vif-plugged-18c0341b-6a4a-4235-993f-da29deeadcb5 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:39:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-7625bfa1-f37e-4de7-ad75-80e9af17d61e req-72985417-c3ef-45f7-8f3b-d5fd9a3a82b5 service nova] Acquiring lock "c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:39:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-7625bfa1-f37e-4de7-ad75-80e9af17d61e req-72985417-c3ef-45f7-8f3b-d5fd9a3a82b5 service nova] Lock "c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:39:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-7625bfa1-f37e-4de7-ad75-80e9af17d61e req-72985417-c3ef-45f7-8f3b-d5fd9a3a82b5 service nova] Lock "c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:39:20 user nova-compute[74840]: DEBUG nova.compute.manager [req-7625bfa1-f37e-4de7-ad75-80e9af17d61e req-72985417-c3ef-45f7-8f3b-d5fd9a3a82b5 service nova] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] No waiting events found dispatching network-vif-plugged-18c0341b-6a4a-4235-993f-da29deeadcb5 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:39:20 user nova-compute[74840]: WARNING nova.compute.manager [req-7625bfa1-f37e-4de7-ad75-80e9af17d61e req-72985417-c3ef-45f7-8f3b-d5fd9a3a82b5 service nova] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Received unexpected event network-vif-plugged-18c0341b-6a4a-4235-993f-da29deeadcb5 for instance with vm_state active and task_state resize_finish.
Nov 08 12:39:20 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:39:20 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:39:20 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=8472MB free_disk=24.881641387939453GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:39:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:39:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:39:20 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Instance running successfully.
Nov 08 12:39:20 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Failed to set time: agent not configured {{(pid=74840) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 08 12:39:20 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-255f5024-a6e7-4f3a-9306-6fe8cabc38a1 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] finish_migration finished successfully. {{(pid=74840) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 08 12:39:20 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Applying migration context for instance c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a as it has an incoming, in-progress migration f74796e5-2ba9-491a-9b2b-3c93e110e5e1. Migration status is post-migrating {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 08 12:39:20 user nova-compute[74840]: INFO nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Updating resource usage from migration f74796e5-2ba9-491a-9b2b-3c93e110e5e1
Nov 08 12:39:20 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 10c42516-62ba-4aa9-bc5a-d94499bd6b65 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:39:20 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 7a482219-16ac-49e2-84ad-7e2030c97184 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:39:20 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 550f8fed-4652-46fe-a440-974ee8f88196 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:39:20 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Migration f74796e5-2ba9-491a-9b2b-3c93e110e5e1 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 08 12:39:20 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:39:20 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:39:20 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:39:21 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:39:21 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:39:21 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:39:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.369s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:39:22 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:22 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:31 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:39:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:39:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:39:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:48 user nova-compute[74840]: DEBUG nova.compute.manager [req-9434c3b2-2302-4915-a939-0fdccce8a413 req-981d2075-6c38-4784-a24b-88148ab378a0 service nova] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Received event network-changed-daa004c9-f48f-4997-8260-7e1f394c3a7c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:39:48 user nova-compute[74840]: DEBUG nova.compute.manager [req-9434c3b2-2302-4915-a939-0fdccce8a413 req-981d2075-6c38-4784-a24b-88148ab378a0 service nova] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Refreshing instance network info cache due to event network-changed-daa004c9-f48f-4997-8260-7e1f394c3a7c. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:39:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9434c3b2-2302-4915-a939-0fdccce8a413 req-981d2075-6c38-4784-a24b-88148ab378a0 service nova] Acquiring lock "refresh_cache-550f8fed-4652-46fe-a440-974ee8f88196" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:39:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9434c3b2-2302-4915-a939-0fdccce8a413 req-981d2075-6c38-4784-a24b-88148ab378a0 service nova] Acquired lock "refresh_cache-550f8fed-4652-46fe-a440-974ee8f88196" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:39:48 user nova-compute[74840]: DEBUG nova.network.neutron [req-9434c3b2-2302-4915-a939-0fdccce8a413 req-981d2075-6c38-4784-a24b-88148ab378a0 service nova] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Refreshing network info cache for port daa004c9-f48f-4997-8260-7e1f394c3a7c {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:39:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c74c4ddd-b94f-4ccd-81e5-c455def3963e tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Acquiring lock "550f8fed-4652-46fe-a440-974ee8f88196" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:39:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c74c4ddd-b94f-4ccd-81e5-c455def3963e tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Lock "550f8fed-4652-46fe-a440-974ee8f88196" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:39:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c74c4ddd-b94f-4ccd-81e5-c455def3963e tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Acquiring lock "550f8fed-4652-46fe-a440-974ee8f88196-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:39:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c74c4ddd-b94f-4ccd-81e5-c455def3963e tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Lock "550f8fed-4652-46fe-a440-974ee8f88196-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:39:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c74c4ddd-b94f-4ccd-81e5-c455def3963e tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Lock "550f8fed-4652-46fe-a440-974ee8f88196-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:39:48 user nova-compute[74840]: INFO nova.compute.manager [None req-c74c4ddd-b94f-4ccd-81e5-c455def3963e tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Terminating instance
Nov 08 12:39:48 user nova-compute[74840]: DEBUG nova.compute.manager [None req-c74c4ddd-b94f-4ccd-81e5-c455def3963e tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Start destroying the instance on the hypervisor. {{(pid=74840) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 12:39:48 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:48 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:48 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:48 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:48 user nova-compute[74840]: DEBUG nova.network.neutron [req-9434c3b2-2302-4915-a939-0fdccce8a413 req-981d2075-6c38-4784-a24b-88148ab378a0 service nova] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Updated VIF entry in instance network info cache for port daa004c9-f48f-4997-8260-7e1f394c3a7c. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:39:48 user nova-compute[74840]: DEBUG nova.network.neutron [req-9434c3b2-2302-4915-a939-0fdccce8a413 req-981d2075-6c38-4784-a24b-88148ab378a0 service nova] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Updating instance_info_cache with network_info: [{"id": "daa004c9-f48f-4997-8260-7e1f394c3a7c", "address": "fa:16:3e:e1:a6:9b", "network": {"id": "5d8710f7-82f1-4670-b564-9ef14312dc8e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1266284233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa486cd37a9c498ba6f800d2dbd415ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaa004c9-f4", "ovs_interfaceid": "daa004c9-f48f-4997-8260-7e1f394c3a7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:39:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9434c3b2-2302-4915-a939-0fdccce8a413 req-981d2075-6c38-4784-a24b-88148ab378a0 service nova] Releasing lock "refresh_cache-550f8fed-4652-46fe-a440-974ee8f88196" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:39:48 user nova-compute[74840]: DEBUG nova.compute.manager [req-b75ed8db-1d97-4fc1-9e6d-700997eb1edd req-11fdaae0-4593-40dc-b105-16c054793d79 service nova] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Received event network-vif-unplugged-daa004c9-f48f-4997-8260-7e1f394c3a7c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:39:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-b75ed8db-1d97-4fc1-9e6d-700997eb1edd req-11fdaae0-4593-40dc-b105-16c054793d79 service nova] Acquiring lock "550f8fed-4652-46fe-a440-974ee8f88196-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:39:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-b75ed8db-1d97-4fc1-9e6d-700997eb1edd req-11fdaae0-4593-40dc-b105-16c054793d79 service nova] Lock "550f8fed-4652-46fe-a440-974ee8f88196-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:39:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-b75ed8db-1d97-4fc1-9e6d-700997eb1edd req-11fdaae0-4593-40dc-b105-16c054793d79 service nova] Lock "550f8fed-4652-46fe-a440-974ee8f88196-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:39:48 user nova-compute[74840]: DEBUG nova.compute.manager [req-b75ed8db-1d97-4fc1-9e6d-700997eb1edd req-11fdaae0-4593-40dc-b105-16c054793d79 service nova] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] No waiting events found dispatching network-vif-unplugged-daa004c9-f48f-4997-8260-7e1f394c3a7c {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:39:48 user nova-compute[74840]: DEBUG nova.compute.manager [req-b75ed8db-1d97-4fc1-9e6d-700997eb1edd req-11fdaae0-4593-40dc-b105-16c054793d79 service nova] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Received event network-vif-unplugged-daa004c9-f48f-4997-8260-7e1f394c3a7c for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:39:48 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Instance destroyed successfully.
Nov 08 12:39:48 user nova-compute[74840]: DEBUG nova.objects.instance [None req-c74c4ddd-b94f-4ccd-81e5-c455def3963e tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Lazy-loading 'resources' on Instance uuid 550f8fed-4652-46fe-a440-974ee8f88196 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:39:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-c74c4ddd-b94f-4ccd-81e5-c455def3963e tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T12:33:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1581355820',display_name='tempest-TestShelveInstance-server-1581355820',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1581355820',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMa4hvb8cWjBz4jMMa+/lZwnWtFqszzwskJtEIpqap//CbH421Hhd++cesn8avpj6IUxUQoy6rfFajaUge6h3UgyQ7k3b8nofngq0aAHrZpvXyuczTPqMuSft/WEq95F1g==',key_name='tempest-TestShelveInstance-850605026',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:38:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fa486cd37a9c498ba6f800d2dbd415ab',ramdisk_id='',reservation_id='r-o5fknux2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1716375711',owner_user_name='tempest-TestShelveInstance-1716375711-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:38:27Z,user_data=None,user_id='ff68af4357024f75888b6f8bd6ada9e5',uuid=550f8fed-4652-46fe-a440-974ee8f88196,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "daa004c9-f48f-4997-8260-7e1f394c3a7c", "address": "fa:16:3e:e1:a6:9b", "network": {"id": "5d8710f7-82f1-4670-b564-9ef14312dc8e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1266284233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa486cd37a9c498ba6f800d2dbd415ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaa004c9-f4", "ovs_interfaceid": "daa004c9-f48f-4997-8260-7e1f394c3a7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:39:48 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-c74c4ddd-b94f-4ccd-81e5-c455def3963e tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Converting VIF {"id": "daa004c9-f48f-4997-8260-7e1f394c3a7c", "address": "fa:16:3e:e1:a6:9b", "network": {"id": "5d8710f7-82f1-4670-b564-9ef14312dc8e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1266284233-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa486cd37a9c498ba6f800d2dbd415ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaa004c9-f4", "ovs_interfaceid": "daa004c9-f48f-4997-8260-7e1f394c3a7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:39:48 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-c74c4ddd-b94f-4ccd-81e5-c455def3963e tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:a6:9b,bridge_name='br-int',has_traffic_filtering=True,id=daa004c9-f48f-4997-8260-7e1f394c3a7c,network=Network(5d8710f7-82f1-4670-b564-9ef14312dc8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaa004c9-f4') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:39:48 user nova-compute[74840]: DEBUG os_vif [None req-c74c4ddd-b94f-4ccd-81e5-c455def3963e tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:a6:9b,bridge_name='br-int',has_traffic_filtering=True,id=daa004c9-f48f-4997-8260-7e1f394c3a7c,network=Network(5d8710f7-82f1-4670-b564-9ef14312dc8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaa004c9-f4') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:39:48 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:48 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdaa004c9-f4, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:39:48 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:48 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:39:48 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:48 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=706b54d9-bfc0-44fa-b500-54093282770d) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:39:48 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:48 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:49 user nova-compute[74840]: INFO os_vif [None req-c74c4ddd-b94f-4ccd-81e5-c455def3963e tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:a6:9b,bridge_name='br-int',has_traffic_filtering=True,id=daa004c9-f48f-4997-8260-7e1f394c3a7c,network=Network(5d8710f7-82f1-4670-b564-9ef14312dc8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaa004c9-f4')
Nov 08 12:39:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c74c4ddd-b94f-4ccd-81e5-c455def3963e tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c74c4ddd-b94f-4ccd-81e5-c455def3963e tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'txbpOwNW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:39:49 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-c74c4ddd-b94f-4ccd-81e5-c455def3963e tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:39:49 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-c74c4ddd-b94f-4ccd-81e5-c455def3963e tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-c74c4ddd-b94f-4ccd-81e5-c455def3963e tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[725a6ef5-64db-43c7-88cd-5abc054bb28d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c74c4ddd-b94f-4ccd-81e5-c455def3963e tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 12:39:49 user nova-compute[74840]: No targets found.
Nov 08 12:39:49 user nova-compute[74840]: iSNS:
Nov 08 12:39:49 user nova-compute[74840]: No targets found.
Nov 08 12:39:49 user nova-compute[74840]: STATIC:
Nov 08 12:39:49 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616
Nov 08 12:39:49 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:39:49 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:39:49 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665
Nov 08 12:39:49 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:39:49 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:39:49 user nova-compute[74840]: FIRMWARE:
Nov 08 12:39:49 user nova-compute[74840]: No targets found.
Nov 08 12:39:49 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c74c4ddd-b94f-4ccd-81e5-c455def3963e tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 12:39:49 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 12:39:49 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c74c4ddd-b94f-4ccd-81e5-c455def3963e tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[205c5f6b-2ffb-4dbd-b954-cd2a933429b3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f321c2-024e-4733-a1f4-18f52088998d]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c74c4ddd-b94f-4ccd-81e5-c455def3963e tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 (non-flash)
Nov 08 12:39:49 user nova-compute[74840]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 (non-flash)
Nov 08 12:39:49 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c74c4ddd-b94f-4ccd-81e5-c455def3963e tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 (non-flash)
Nov 08 12:39:49 user nova-compute[74840]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 (non-flash)
Nov 08 12:39:49 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c74c4ddd-b94f-4ccd-81e5-c455def3963e tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7d4438430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616'): ({'sdc'}, set())}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-c74c4ddd-b94f-4ccd-81e5-c455def3963e tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Removing single pathed devices sdc {{(pid=74840) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0deb01-9c53-4f0b-98cc-f7cd0d97caa8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.034s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[727dedfc-a387-4837-ad2c-76c4763d1e7e]: (4, ('ok\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-c74c4ddd-b94f-4ccd-81e5-c455def3963e tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Flushing IO for device /dev/sdc {{(pid=74840) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e106ac-78d1-4a6c-a43f-8b269c174671]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-c74c4ddd-b94f-4ccd-81e5-c455def3963e tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74840) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[54406192-2c2c-42bb-8ca4-df14d2f10bc8]: (4, ('1', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-c74c4ddd-b94f-4ccd-81e5-c455def3963e tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-c74c4ddd-b94f-4ccd-81e5-c455def3963e tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] SCSI volumes sdc have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_13afdcb8', '/dev/disk/by-id/scsi-1SCST_BIO13afdcb8-d2f3e23ba1605432', '/dev/disk/by-id/scsi-26432663365323362') {{(pid=85688) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[0020ed61-2b28-4d3f-9e3a-b5501e9245f8]: (4, None) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c74c4ddd-b94f-4ccd-81e5-c455def3963e tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616')] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95ec7fc-6a9f-4be3-aca1-d6aea39fca68]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c74c4ddd-b94f-4ccd-81e5-c455def3963e tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 -p 172.16.0.220:3260 --logout {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98a4028-31e9-4e9b-9552-edb0922d6f9a]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c74c4ddd-b94f-4ccd-81e5-c455def3963e tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616, portal: 172.16.0.220,3260]
Nov 08 12:39:49 user nova-compute[74840]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616, portal: 172.16.0.220,3260] successful.
Nov 08 12:39:49 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 -p 172.16.0.220:3260 --op delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:177df23a-e5d3-41e7-ac17-e0959f15e616 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4fe1b4-edd2-4452-9e20-21fe2f9b469d]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c74c4ddd-b94f-4ccd-81e5-c455def3963e tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-c74c4ddd-b94f-4ccd-81e5-c455def3963e tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c74c4ddd-b94f-4ccd-81e5-c455def3963e tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] <== disconnect_volume: return (360ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c74c4ddd-b94f-4ccd-81e5-c455def3963e tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 12:39:49 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-c74c4ddd-b94f-4ccd-81e5-c455def3963e tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Deleting instance files /opt/stack/data/nova/instances/550f8fed-4652-46fe-a440-974ee8f88196_del
Nov 08 12:39:49 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-c74c4ddd-b94f-4ccd-81e5-c455def3963e tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Deletion of /opt/stack/data/nova/instances/550f8fed-4652-46fe-a440-974ee8f88196_del complete
Nov 08 12:39:49 user nova-compute[74840]: INFO nova.compute.manager [None req-c74c4ddd-b94f-4ccd-81e5-c455def3963e tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 08 12:39:49 user nova-compute[74840]: DEBUG oslo.service.loopingcall [None req-c74c4ddd-b94f-4ccd-81e5-c455def3963e tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74840) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG nova.compute.manager [-] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Deallocating network for instance {{(pid=74840) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] deallocate_for_instance() {{(pid=74840) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 12:39:49 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:39:49 user nova-compute[74840]: INFO nova.compute.manager [-] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Took 0.52 seconds to deallocate network for instance.
Nov 08 12:39:50 user nova-compute[74840]: DEBUG nova.compute.manager [req-62d1cd83-afb9-4217-8e9a-30a5507d4e65 req-dee0b0fa-fb0c-45dd-8c1f-9f3b18f495bd service nova] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Received event network-vif-deleted-daa004c9-f48f-4997-8260-7e1f394c3a7c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:39:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:50 user nova-compute[74840]: DEBUG nova.compute.manager [req-a6189cf0-cad4-4b6e-8a20-e48b6c156f6d req-4c52bd73-5913-454e-8926-d722a1df1f52 service nova] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Received event network-vif-plugged-daa004c9-f48f-4997-8260-7e1f394c3a7c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:39:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a6189cf0-cad4-4b6e-8a20-e48b6c156f6d req-4c52bd73-5913-454e-8926-d722a1df1f52 service nova] Acquiring lock "550f8fed-4652-46fe-a440-974ee8f88196-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:39:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a6189cf0-cad4-4b6e-8a20-e48b6c156f6d req-4c52bd73-5913-454e-8926-d722a1df1f52 service nova] Lock "550f8fed-4652-46fe-a440-974ee8f88196-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:39:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a6189cf0-cad4-4b6e-8a20-e48b6c156f6d req-4c52bd73-5913-454e-8926-d722a1df1f52 service nova] Lock "550f8fed-4652-46fe-a440-974ee8f88196-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:39:50 user nova-compute[74840]: DEBUG nova.compute.manager [req-a6189cf0-cad4-4b6e-8a20-e48b6c156f6d req-4c52bd73-5913-454e-8926-d722a1df1f52 service nova] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] No waiting events found dispatching network-vif-plugged-daa004c9-f48f-4997-8260-7e1f394c3a7c {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:39:50 user nova-compute[74840]: WARNING nova.compute.manager [req-a6189cf0-cad4-4b6e-8a20-e48b6c156f6d req-4c52bd73-5913-454e-8926-d722a1df1f52 service nova] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Received unexpected event network-vif-plugged-daa004c9-f48f-4997-8260-7e1f394c3a7c for instance with vm_state active and task_state deleting.
Nov 08 12:39:50 user nova-compute[74840]: INFO nova.compute.manager [None req-c74c4ddd-b94f-4ccd-81e5-c455def3963e tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Took 0.98 seconds to detach 1 volumes for instance.
Nov 08 12:39:50 user nova-compute[74840]: DEBUG nova.compute.manager [None req-c74c4ddd-b94f-4ccd-81e5-c455def3963e tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] [instance: 550f8fed-4652-46fe-a440-974ee8f88196] Deleting volume: 177df23a-e5d3-41e7-ac17-e0959f15e616 {{(pid=74840) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 12:39:51 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c74c4ddd-b94f-4ccd-81e5-c455def3963e tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:39:51 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c74c4ddd-b94f-4ccd-81e5-c455def3963e tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:39:51 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-c74c4ddd-b94f-4ccd-81e5-c455def3963e tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:39:51 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-c74c4ddd-b94f-4ccd-81e5-c455def3963e tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:39:51 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c74c4ddd-b94f-4ccd-81e5-c455def3963e tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.254s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:39:51 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-c74c4ddd-b94f-4ccd-81e5-c455def3963e tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Deleted allocations for instance 550f8fed-4652-46fe-a440-974ee8f88196
Nov 08 12:39:51 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c74c4ddd-b94f-4ccd-81e5-c455def3963e tempest-TestShelveInstance-1716375711 tempest-TestShelveInstance-1716375711-project-member] Lock "550f8fed-4652-46fe-a440-974ee8f88196" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.317s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:39:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:53 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:54 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Acquiring lock "f6bccde5-832b-476f-95c0-10b16af6b126" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:39:54 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Lock "f6bccde5-832b-476f-95c0-10b16af6b126" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:39:54 user nova-compute[74840]: DEBUG nova.compute.manager [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Starting instance... {{(pid=74840) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 12:39:54 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:39:54 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:39:54 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:39:54 user nova-compute[74840]: INFO nova.compute.claims [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Claim successful on node user
Nov 08 12:39:55 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:39:55 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:39:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.366s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:39:55 user nova-compute[74840]: DEBUG nova.compute.manager [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Start building networks asynchronously for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 12:39:55 user nova-compute[74840]: DEBUG nova.compute.manager [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Allocating IP information in the background. {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 12:39:55 user nova-compute[74840]: DEBUG nova.network.neutron [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 12:39:55 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 12:39:55 user nova-compute[74840]: DEBUG nova.compute.manager [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Start building block device mappings for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 12:39:55 user nova-compute[74840]: DEBUG nova.policy [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '95152d14cd714fa494e353afb9ffccec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3fd3c6c8e1c46c99adee8fdcc73bddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 12:39:55 user nova-compute[74840]: DEBUG nova.compute.manager [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Start spawning the instance on the hypervisor. {{(pid=74840) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 12:39:55 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:39:55 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Creating image(s)
Nov 08 12:39:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Acquiring lock "/opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:39:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Lock "/opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:39:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Lock "/opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:39:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:39:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.266s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:39:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Acquiring lock "5d26578eba85497f494c575690c4248f381a0fe6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:39:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:39:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:39:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.201s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:39:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk 1073741824 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:39:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk 1073741824" returned: 0 in 0.053s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:39:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:39:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:39:56 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.201s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:39:56 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk. size=1073741824 {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 12:39:56 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:39:56 user nova-compute[74840]: DEBUG nova.network.neutron [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Successfully created port: 850d3852-db4b-4634-b37d-ad1e18f04a6b {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:39:56 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:39:56 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Cannot resize image /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk to a smaller size. {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 12:39:56 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Created local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 12:39:56 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Ensure instance console log exists: /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:39:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:39:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:39:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:39:56 user nova-compute[74840]: DEBUG nova.network.neutron [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Successfully updated port: 850d3852-db4b-4634-b37d-ad1e18f04a6b {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:39:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Acquiring lock "refresh_cache-f6bccde5-832b-476f-95c0-10b16af6b126" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:39:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Acquired lock "refresh_cache-f6bccde5-832b-476f-95c0-10b16af6b126" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:39:56 user nova-compute[74840]: DEBUG nova.network.neutron [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:39:56 user nova-compute[74840]: DEBUG nova.compute.manager [req-80476127-0792-43e7-8e1a-ca65bcb15c67 req-e11e6ba7-1e1f-4f57-9a14-52dac86da3cf service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Received event network-changed-850d3852-db4b-4634-b37d-ad1e18f04a6b {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:39:56 user nova-compute[74840]: DEBUG nova.compute.manager [req-80476127-0792-43e7-8e1a-ca65bcb15c67 req-e11e6ba7-1e1f-4f57-9a14-52dac86da3cf service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Refreshing instance network info cache due to event network-changed-850d3852-db4b-4634-b37d-ad1e18f04a6b. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:39:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-80476127-0792-43e7-8e1a-ca65bcb15c67 req-e11e6ba7-1e1f-4f57-9a14-52dac86da3cf service nova] Acquiring lock "refresh_cache-f6bccde5-832b-476f-95c0-10b16af6b126" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:39:56 user nova-compute[74840]: DEBUG nova.network.neutron [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:39:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:57 user nova-compute[74840]: DEBUG nova.network.neutron [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Updating instance_info_cache with network_info: [{"id": "850d3852-db4b-4634-b37d-ad1e18f04a6b", "address": "fa:16:3e:41:0b:a1", "network": {"id": "a52573e9-cee6-4a6d-944d-56fe99e1c3a9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1100599758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3fd3c6c8e1c46c99adee8fdcc73bddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap850d3852-db", "ovs_interfaceid": "850d3852-db4b-4634-b37d-ad1e18f04a6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:39:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Releasing lock "refresh_cache-f6bccde5-832b-476f-95c0-10b16af6b126" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:39:57 user nova-compute[74840]: DEBUG nova.compute.manager [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Instance network_info: |[{"id": "850d3852-db4b-4634-b37d-ad1e18f04a6b", "address": "fa:16:3e:41:0b:a1", "network": {"id": "a52573e9-cee6-4a6d-944d-56fe99e1c3a9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1100599758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3fd3c6c8e1c46c99adee8fdcc73bddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap850d3852-db", "ovs_interfaceid": "850d3852-db4b-4634-b37d-ad1e18f04a6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 12:39:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-80476127-0792-43e7-8e1a-ca65bcb15c67 req-e11e6ba7-1e1f-4f57-9a14-52dac86da3cf service nova] Acquired lock "refresh_cache-f6bccde5-832b-476f-95c0-10b16af6b126" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:39:57 user nova-compute[74840]: DEBUG nova.network.neutron [req-80476127-0792-43e7-8e1a-ca65bcb15c67 req-e11e6ba7-1e1f-4f57-9a14-52dac86da3cf service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Refreshing network info cache for port 850d3852-db4b-4634-b37d-ad1e18f04a6b {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:39:57 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Start _get_guest_xml network_info=[{"id": "850d3852-db4b-4634-b37d-ad1e18f04a6b", "address": "fa:16:3e:41:0b:a1", "network": {"id": "a52573e9-cee6-4a6d-944d-56fe99e1c3a9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1100599758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3fd3c6c8e1c46c99adee8fdcc73bddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap850d3852-db", "ovs_interfaceid": "850d3852-db4b-4634-b37d-ad1e18f04a6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'image_id': '4fa17706-d304-4117-a420-dab994c703dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:39:57 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:39:57 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:39:57 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:39:57 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:39:57 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:39:57 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:39:57 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:39:57 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:39:57 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:39:57 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:39:57 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:39:57 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:39:57 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:39:57 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:39:57 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:39:57 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:39:57 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:39:57 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:39:57 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:39:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1299138905',display_name='tempest-ServerStableDeviceRescueTest-server-1299138905',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1299138905',id=45,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqa/+iNxPeIQYD3fLVa0jz66LjeWDnwNuOQk1VW3EmJ7Go0FB1KgI7HiVq2xPRo/3cUnAUmUNTqS4etPW+TkhZHwcnmFn5gt2tpGmOQDIvxOymmXIi5GxQ6a3v7+Mu/mg==',key_name='tempest-keypair-1162134661',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d3fd3c6c8e1c46c99adee8fdcc73bddd',ramdisk_id='',reservation_id='r-it2qamc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-950232424',owner_user_name='tempest-ServerStableDeviceRescueTest-950232424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:39:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='95152d14cd714fa494e353afb9ffccec',uuid=f6bccde5-832b-476f-95c0-10b16af6b126,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "850d3852-db4b-4634-b37d-ad1e18f04a6b", "address": "fa:16:3e:41:0b:a1", "network": {"id": "a52573e9-cee6-4a6d-944d-56fe99e1c3a9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1100599758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3fd3c6c8e1c46c99adee8fdcc73bddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap850d3852-db", "ovs_interfaceid": "850d3852-db4b-4634-b37d-ad1e18f04a6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:39:57 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Converting VIF {"id": "850d3852-db4b-4634-b37d-ad1e18f04a6b", "address": "fa:16:3e:41:0b:a1", "network": {"id": "a52573e9-cee6-4a6d-944d-56fe99e1c3a9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1100599758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3fd3c6c8e1c46c99adee8fdcc73bddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap850d3852-db", "ovs_interfaceid": "850d3852-db4b-4634-b37d-ad1e18f04a6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:39:57 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:0b:a1,bridge_name='br-int',has_traffic_filtering=True,id=850d3852-db4b-4634-b37d-ad1e18f04a6b,network=Network(a52573e9-cee6-4a6d-944d-56fe99e1c3a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap850d3852-db') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:39:57 user nova-compute[74840]: DEBUG nova.objects.instance [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Lazy-loading 'pci_devices' on Instance uuid f6bccde5-832b-476f-95c0-10b16af6b126 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:39:57 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:39:57 user nova-compute[74840]:   <uuid>f6bccde5-832b-476f-95c0-10b16af6b126</uuid>
Nov 08 12:39:57 user nova-compute[74840]:   <name>instance-0000002d</name>
Nov 08 12:39:57 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:39:57 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:39:57 user nova-compute[74840]:   <metadata>
Nov 08 12:39:57 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:39:57 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:39:57 user nova-compute[74840]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1299138905</nova:name>
Nov 08 12:39:57 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:39:57</nova:creationTime>
Nov 08 12:39:57 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:39:57 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:39:57 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:39:57 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:39:57 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:39:57 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:39:57 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:39:57 user nova-compute[74840]:       <nova:owner>
Nov 08 12:39:57 user nova-compute[74840]:         <nova:user uuid="95152d14cd714fa494e353afb9ffccec">tempest-ServerStableDeviceRescueTest-950232424-project-member</nova:user>
Nov 08 12:39:57 user nova-compute[74840]:         <nova:project uuid="d3fd3c6c8e1c46c99adee8fdcc73bddd">tempest-ServerStableDeviceRescueTest-950232424</nova:project>
Nov 08 12:39:57 user nova-compute[74840]:       </nova:owner>
Nov 08 12:39:57 user nova-compute[74840]:       <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:39:57 user nova-compute[74840]:       <nova:ports>
Nov 08 12:39:57 user nova-compute[74840]:         <nova:port uuid="850d3852-db4b-4634-b37d-ad1e18f04a6b">
Nov 08 12:39:57 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 12:39:57 user nova-compute[74840]:         </nova:port>
Nov 08 12:39:57 user nova-compute[74840]:       </nova:ports>
Nov 08 12:39:57 user nova-compute[74840]:     </nova:instance>
Nov 08 12:39:57 user nova-compute[74840]:   </metadata>
Nov 08 12:39:57 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:39:57 user nova-compute[74840]:     <system>
Nov 08 12:39:57 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:39:57 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:39:57 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:39:57 user nova-compute[74840]:       <entry name="serial">f6bccde5-832b-476f-95c0-10b16af6b126</entry>
Nov 08 12:39:57 user nova-compute[74840]:       <entry name="uuid">f6bccde5-832b-476f-95c0-10b16af6b126</entry>
Nov 08 12:39:57 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:39:57 user nova-compute[74840]:     </system>
Nov 08 12:39:57 user nova-compute[74840]:   </sysinfo>
Nov 08 12:39:57 user nova-compute[74840]:   <os>
Nov 08 12:39:57 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:39:57 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:39:57 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:39:57 user nova-compute[74840]:   </os>
Nov 08 12:39:57 user nova-compute[74840]:   <features>
Nov 08 12:39:57 user nova-compute[74840]:     <acpi/>
Nov 08 12:39:57 user nova-compute[74840]:     <apic/>
Nov 08 12:39:57 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:39:57 user nova-compute[74840]:   </features>
Nov 08 12:39:57 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:39:57 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:39:57 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:39:57 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:39:57 user nova-compute[74840]:   </clock>
Nov 08 12:39:57 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:39:57 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:39:57 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:39:57 user nova-compute[74840]:   </cpu>
Nov 08 12:39:57 user nova-compute[74840]:   <devices>
Nov 08 12:39:57 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:39:57 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:39:57 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk"/>
Nov 08 12:39:57 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:39:57 user nova-compute[74840]:     </disk>
Nov 08 12:39:57 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:39:57 user nova-compute[74840]:       <mac address="fa:16:3e:41:0b:a1"/>
Nov 08 12:39:57 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:39:57 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:39:57 user nova-compute[74840]:       <target dev="tap850d3852-db"/>
Nov 08 12:39:57 user nova-compute[74840]:     </interface>
Nov 08 12:39:57 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:39:57 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/console.log" append="off"/>
Nov 08 12:39:57 user nova-compute[74840]:     </serial>
Nov 08 12:39:57 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:39:57 user nova-compute[74840]:     <video>
Nov 08 12:39:57 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:39:57 user nova-compute[74840]:     </video>
Nov 08 12:39:57 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:39:57 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:39:57 user nova-compute[74840]:     </rng>
Nov 08 12:39:57 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:39:57 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:39:57 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:39:57 user nova-compute[74840]:     </memballoon>
Nov 08 12:39:57 user nova-compute[74840]:   </devices>
Nov 08 12:39:57 user nova-compute[74840]: </domain>
Nov 08 12:39:57 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:39:57 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:39:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1299138905',display_name='tempest-ServerStableDeviceRescueTest-server-1299138905',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1299138905',id=45,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqa/+iNxPeIQYD3fLVa0jz66LjeWDnwNuOQk1VW3EmJ7Go0FB1KgI7HiVq2xPRo/3cUnAUmUNTqS4etPW+TkhZHwcnmFn5gt2tpGmOQDIvxOymmXIi5GxQ6a3v7+Mu/mg==',key_name='tempest-keypair-1162134661',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d3fd3c6c8e1c46c99adee8fdcc73bddd',ramdisk_id='',reservation_id='r-it2qamc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-950232424',owner_user_name='tempest-ServerStableDeviceRescueTest-950232424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:39:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='95152d14cd714fa494e353afb9ffccec',uuid=f6bccde5-832b-476f-95c0-10b16af6b126,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "850d3852-db4b-4634-b37d-ad1e18f04a6b", "address": "fa:16:3e:41:0b:a1", "network": {"id": "a52573e9-cee6-4a6d-944d-56fe99e1c3a9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1100599758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3fd3c6c8e1c46c99adee8fdcc73bddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap850d3852-db", "ovs_interfaceid": "850d3852-db4b-4634-b37d-ad1e18f04a6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:39:57 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Converting VIF {"id": "850d3852-db4b-4634-b37d-ad1e18f04a6b", "address": "fa:16:3e:41:0b:a1", "network": {"id": "a52573e9-cee6-4a6d-944d-56fe99e1c3a9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1100599758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3fd3c6c8e1c46c99adee8fdcc73bddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap850d3852-db", "ovs_interfaceid": "850d3852-db4b-4634-b37d-ad1e18f04a6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:39:57 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:0b:a1,bridge_name='br-int',has_traffic_filtering=True,id=850d3852-db4b-4634-b37d-ad1e18f04a6b,network=Network(a52573e9-cee6-4a6d-944d-56fe99e1c3a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap850d3852-db') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:39:57 user nova-compute[74840]: DEBUG os_vif [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:0b:a1,bridge_name='br-int',has_traffic_filtering=True,id=850d3852-db4b-4634-b37d-ad1e18f04a6b,network=Network(a52573e9-cee6-4a6d-944d-56fe99e1c3a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap850d3852-db') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:39:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:39:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:39:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4c370c5c-df09-560b-b175-41b0b89509eb', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:39:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap850d3852-db, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:39:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap850d3852-db, col_values=(('qos', UUID('9a17c82c-7cd0-4f5d-89fe-20d52f944fff')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:39:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap850d3852-db, col_values=(('external_ids', {'iface-id': '850d3852-db4b-4634-b37d-ad1e18f04a6b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:0b:a1', 'vm-uuid': 'f6bccde5-832b-476f-95c0-10b16af6b126'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:39:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:39:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:57 user nova-compute[74840]: INFO os_vif [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:0b:a1,bridge_name='br-int',has_traffic_filtering=True,id=850d3852-db4b-4634-b37d-ad1e18f04a6b,network=Network(a52573e9-cee6-4a6d-944d-56fe99e1c3a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap850d3852-db')
Nov 08 12:39:57 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:39:57 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] No VIF found with MAC fa:16:3e:41:0b:a1, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:39:57 user nova-compute[74840]: DEBUG nova.network.neutron [req-80476127-0792-43e7-8e1a-ca65bcb15c67 req-e11e6ba7-1e1f-4f57-9a14-52dac86da3cf service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Updated VIF entry in instance network info cache for port 850d3852-db4b-4634-b37d-ad1e18f04a6b. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:39:57 user nova-compute[74840]: DEBUG nova.network.neutron [req-80476127-0792-43e7-8e1a-ca65bcb15c67 req-e11e6ba7-1e1f-4f57-9a14-52dac86da3cf service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Updating instance_info_cache with network_info: [{"id": "850d3852-db4b-4634-b37d-ad1e18f04a6b", "address": "fa:16:3e:41:0b:a1", "network": {"id": "a52573e9-cee6-4a6d-944d-56fe99e1c3a9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1100599758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3fd3c6c8e1c46c99adee8fdcc73bddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap850d3852-db", "ovs_interfaceid": "850d3852-db4b-4634-b37d-ad1e18f04a6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:39:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-80476127-0792-43e7-8e1a-ca65bcb15c67 req-e11e6ba7-1e1f-4f57-9a14-52dac86da3cf service nova] Releasing lock "refresh_cache-f6bccde5-832b-476f-95c0-10b16af6b126" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:39:59 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:59 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:59 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:59 user nova-compute[74840]: DEBUG nova.compute.manager [req-77b8355b-a515-4825-b7d7-80cbe508d19b req-b22427f4-973b-41bb-9641-4a85d9f8555b service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Received event network-vif-plugged-850d3852-db4b-4634-b37d-ad1e18f04a6b {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:39:59 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-77b8355b-a515-4825-b7d7-80cbe508d19b req-b22427f4-973b-41bb-9641-4a85d9f8555b service nova] Acquiring lock "f6bccde5-832b-476f-95c0-10b16af6b126-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:39:59 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-77b8355b-a515-4825-b7d7-80cbe508d19b req-b22427f4-973b-41bb-9641-4a85d9f8555b service nova] Lock "f6bccde5-832b-476f-95c0-10b16af6b126-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:39:59 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-77b8355b-a515-4825-b7d7-80cbe508d19b req-b22427f4-973b-41bb-9641-4a85d9f8555b service nova] Lock "f6bccde5-832b-476f-95c0-10b16af6b126-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:39:59 user nova-compute[74840]: DEBUG nova.compute.manager [req-77b8355b-a515-4825-b7d7-80cbe508d19b req-b22427f4-973b-41bb-9641-4a85d9f8555b service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] No waiting events found dispatching network-vif-plugged-850d3852-db4b-4634-b37d-ad1e18f04a6b {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:39:59 user nova-compute[74840]: WARNING nova.compute.manager [req-77b8355b-a515-4825-b7d7-80cbe508d19b req-b22427f4-973b-41bb-9641-4a85d9f8555b service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Received unexpected event network-vif-plugged-850d3852-db4b-4634-b37d-ad1e18f04a6b for instance with vm_state building and task_state spawning.
Nov 08 12:39:59 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:59 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:39:59 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:40:01 user nova-compute[74840]: DEBUG nova.compute.manager [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:40:01 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:40:01 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Instance spawned successfully.
Nov 08 12:40:01 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:40:01 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Found default for hw_cdrom_bus of ide {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:40:01 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Found default for hw_disk_bus of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:40:01 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:40:01 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:40:01 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Found default for hw_video_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:40:01 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Found default for hw_vif_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:40:01 user nova-compute[74840]: INFO nova.compute.manager [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Took 6.03 seconds to spawn the instance on the hypervisor.
Nov 08 12:40:01 user nova-compute[74840]: DEBUG nova.compute.manager [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:40:01 user nova-compute[74840]: INFO nova.compute.manager [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Took 6.80 seconds to build instance.
Nov 08 12:40:01 user nova-compute[74840]: DEBUG nova.compute.manager [req-898e431a-bfa5-4843-8332-44e5de99c45a req-31255bc1-bd61-4dd9-8dda-215c63fc6fe1 service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Received event network-vif-plugged-850d3852-db4b-4634-b37d-ad1e18f04a6b {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:40:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-898e431a-bfa5-4843-8332-44e5de99c45a req-31255bc1-bd61-4dd9-8dda-215c63fc6fe1 service nova] Acquiring lock "f6bccde5-832b-476f-95c0-10b16af6b126-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:40:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-898e431a-bfa5-4843-8332-44e5de99c45a req-31255bc1-bd61-4dd9-8dda-215c63fc6fe1 service nova] Lock "f6bccde5-832b-476f-95c0-10b16af6b126-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:40:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-898e431a-bfa5-4843-8332-44e5de99c45a req-31255bc1-bd61-4dd9-8dda-215c63fc6fe1 service nova] Lock "f6bccde5-832b-476f-95c0-10b16af6b126-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:40:01 user nova-compute[74840]: DEBUG nova.compute.manager [req-898e431a-bfa5-4843-8332-44e5de99c45a req-31255bc1-bd61-4dd9-8dda-215c63fc6fe1 service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] No waiting events found dispatching network-vif-plugged-850d3852-db4b-4634-b37d-ad1e18f04a6b {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:40:01 user nova-compute[74840]: WARNING nova.compute.manager [req-898e431a-bfa5-4843-8332-44e5de99c45a req-31255bc1-bd61-4dd9-8dda-215c63fc6fe1 service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Received unexpected event network-vif-plugged-850d3852-db4b-4634-b37d-ad1e18f04a6b for instance with vm_state building and task_state spawning.
Nov 08 12:40:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c059104e-4e94-4ea3-b3b5-00fc34ff65cf tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Lock "f6bccde5-832b-476f-95c0-10b16af6b126" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.930s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:40:02 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:40:02 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:40:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:40:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:40:08 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:40:08 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:40:08 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Didn't find any instances for network info cache update. {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 12:40:08 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:40:10 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:40:10 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:40:11 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:40:11 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:40:11 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:40:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:40:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:40:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 12:40:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:40:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:40:12 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:40:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:40:14 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:40:17 user nova-compute[74840]: DEBUG nova.compute.manager [req-c2a33bcc-6901-4db0-aa09-8ffa37c2314b req-dba82f29-643e-4e9a-9b60-0fab8d473e53 service nova] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Received event network-changed-00efdc72-8528-41eb-be2b-c9b190863053 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:40:17 user nova-compute[74840]: DEBUG nova.compute.manager [req-c2a33bcc-6901-4db0-aa09-8ffa37c2314b req-dba82f29-643e-4e9a-9b60-0fab8d473e53 service nova] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Refreshing instance network info cache due to event network-changed-00efdc72-8528-41eb-be2b-c9b190863053. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:40:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-c2a33bcc-6901-4db0-aa09-8ffa37c2314b req-dba82f29-643e-4e9a-9b60-0fab8d473e53 service nova] Acquiring lock "refresh_cache-7a482219-16ac-49e2-84ad-7e2030c97184" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:40:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-c2a33bcc-6901-4db0-aa09-8ffa37c2314b req-dba82f29-643e-4e9a-9b60-0fab8d473e53 service nova] Acquired lock "refresh_cache-7a482219-16ac-49e2-84ad-7e2030c97184" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:40:17 user nova-compute[74840]: DEBUG nova.network.neutron [req-c2a33bcc-6901-4db0-aa09-8ffa37c2314b req-dba82f29-643e-4e9a-9b60-0fab8d473e53 service nova] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Refreshing network info cache for port 00efdc72-8528-41eb-be2b-c9b190863053 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:40:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:40:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-64fcefb3-c0c6-416d-a235-eb9c42b2a7ed tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Acquiring lock "7a482219-16ac-49e2-84ad-7e2030c97184" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:40:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-64fcefb3-c0c6-416d-a235-eb9c42b2a7ed tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "7a482219-16ac-49e2-84ad-7e2030c97184" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:40:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-64fcefb3-c0c6-416d-a235-eb9c42b2a7ed tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Acquiring lock "7a482219-16ac-49e2-84ad-7e2030c97184-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:40:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-64fcefb3-c0c6-416d-a235-eb9c42b2a7ed tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "7a482219-16ac-49e2-84ad-7e2030c97184-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:40:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-64fcefb3-c0c6-416d-a235-eb9c42b2a7ed tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "7a482219-16ac-49e2-84ad-7e2030c97184-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:40:17 user nova-compute[74840]: INFO nova.compute.manager [None req-64fcefb3-c0c6-416d-a235-eb9c42b2a7ed tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Terminating instance
Nov 08 12:40:17 user nova-compute[74840]: DEBUG nova.compute.manager [None req-64fcefb3-c0c6-416d-a235-eb9c42b2a7ed tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Start destroying the instance on the hypervisor. {{(pid=74840) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 12:40:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:40:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:40:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:40:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:40:17 user nova-compute[74840]: DEBUG nova.compute.manager [req-8c916c0d-355c-4f94-ab6a-6161976c0667 req-54f35adf-d665-47fa-9302-8a54b033af2a service nova] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Received event network-vif-unplugged-00efdc72-8528-41eb-be2b-c9b190863053 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:40:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8c916c0d-355c-4f94-ab6a-6161976c0667 req-54f35adf-d665-47fa-9302-8a54b033af2a service nova] Acquiring lock "7a482219-16ac-49e2-84ad-7e2030c97184-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:40:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8c916c0d-355c-4f94-ab6a-6161976c0667 req-54f35adf-d665-47fa-9302-8a54b033af2a service nova] Lock "7a482219-16ac-49e2-84ad-7e2030c97184-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:40:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8c916c0d-355c-4f94-ab6a-6161976c0667 req-54f35adf-d665-47fa-9302-8a54b033af2a service nova] Lock "7a482219-16ac-49e2-84ad-7e2030c97184-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:40:17 user nova-compute[74840]: DEBUG nova.compute.manager [req-8c916c0d-355c-4f94-ab6a-6161976c0667 req-54f35adf-d665-47fa-9302-8a54b033af2a service nova] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] No waiting events found dispatching network-vif-unplugged-00efdc72-8528-41eb-be2b-c9b190863053 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:40:17 user nova-compute[74840]: DEBUG nova.compute.manager [req-8c916c0d-355c-4f94-ab6a-6161976c0667 req-54f35adf-d665-47fa-9302-8a54b033af2a service nova] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Received event network-vif-unplugged-00efdc72-8528-41eb-be2b-c9b190863053 for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:40:17 user nova-compute[74840]: DEBUG nova.network.neutron [req-c2a33bcc-6901-4db0-aa09-8ffa37c2314b req-dba82f29-643e-4e9a-9b60-0fab8d473e53 service nova] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Updated VIF entry in instance network info cache for port 00efdc72-8528-41eb-be2b-c9b190863053. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:40:17 user nova-compute[74840]: DEBUG nova.network.neutron [req-c2a33bcc-6901-4db0-aa09-8ffa37c2314b req-dba82f29-643e-4e9a-9b60-0fab8d473e53 service nova] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Updating instance_info_cache with network_info: [{"id": "00efdc72-8528-41eb-be2b-c9b190863053", "address": "fa:16:3e:72:4b:1f", "network": {"id": "7faeaea5-04e0-46e0-bb55-9426d599fb1b", "bridge": "br-int", "label": "tempest-TestStampPattern-1080763140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c24d52e18e8e41dfa50aa5aff1f40c6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00efdc72-85", "ovs_interfaceid": "00efdc72-8528-41eb-be2b-c9b190863053", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:40:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:40:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-c2a33bcc-6901-4db0-aa09-8ffa37c2314b req-dba82f29-643e-4e9a-9b60-0fab8d473e53 service nova] Releasing lock "refresh_cache-7a482219-16ac-49e2-84ad-7e2030c97184" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:40:18 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Instance destroyed successfully.
Nov 08 12:40:18 user nova-compute[74840]: DEBUG nova.objects.instance [None req-64fcefb3-c0c6-416d-a235-eb9c42b2a7ed tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lazy-loading 'resources' on Instance uuid 7a482219-16ac-49e2-84ad-7e2030c97184 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:40:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-64fcefb3-c0c6-416d-a235-eb9c42b2a7ed tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:31:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1167917458',display_name='tempest-TestStampPattern-server-1167917458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1167917458',id=39,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAifdjOvE03LGvvENDtVW5s6JmsBpHl/N8DE5nBoGW2g5OLHF4XEiYFI0Pa1nSZrBetG5b+iQnlywZCqyB795WR0LxYnf+fBshC/Pye35f17zjZfcJWjmT0YUIL12Rw9Xg==',key_name='tempest-TestStampPattern-101204523',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:31:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c24d52e18e8e41dfa50aa5aff1f40c6d',ramdisk_id='',reservation_id='r-33csrtv1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-55983118',owner_user_name='tempest-TestStampPattern-55983118-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:35:27Z,user_data=None,user_id='719ac4d31ae447a6a04c1c62c0a73191',uuid=7a482219-16ac-49e2-84ad-7e2030c97184,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "00efdc72-8528-41eb-be2b-c9b190863053", "address": "fa:16:3e:72:4b:1f", "network": {"id": "7faeaea5-04e0-46e0-bb55-9426d599fb1b", "bridge": "br-int", "label": "tempest-TestStampPattern-1080763140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c24d52e18e8e41dfa50aa5aff1f40c6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00efdc72-85", "ovs_interfaceid": "00efdc72-8528-41eb-be2b-c9b190863053", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:40:18 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-64fcefb3-c0c6-416d-a235-eb9c42b2a7ed tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Converting VIF {"id": "00efdc72-8528-41eb-be2b-c9b190863053", "address": "fa:16:3e:72:4b:1f", "network": {"id": "7faeaea5-04e0-46e0-bb55-9426d599fb1b", "bridge": "br-int", "label": "tempest-TestStampPattern-1080763140-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c24d52e18e8e41dfa50aa5aff1f40c6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00efdc72-85", "ovs_interfaceid": "00efdc72-8528-41eb-be2b-c9b190863053", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:40:18 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-64fcefb3-c0c6-416d-a235-eb9c42b2a7ed tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:4b:1f,bridge_name='br-int',has_traffic_filtering=True,id=00efdc72-8528-41eb-be2b-c9b190863053,network=Network(7faeaea5-04e0-46e0-bb55-9426d599fb1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00efdc72-85') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:40:18 user nova-compute[74840]: DEBUG os_vif [None req-64fcefb3-c0c6-416d-a235-eb9c42b2a7ed tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:4b:1f,bridge_name='br-int',has_traffic_filtering=True,id=00efdc72-8528-41eb-be2b-c9b190863053,network=Network(7faeaea5-04e0-46e0-bb55-9426d599fb1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00efdc72-85') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:40:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:40:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap00efdc72-85, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:40:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:40:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:40:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:40:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:40:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b44a1220-6b94-47f6-afc8-ee3c133407a3) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:40:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:40:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:40:18 user nova-compute[74840]: INFO os_vif [None req-64fcefb3-c0c6-416d-a235-eb9c42b2a7ed tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:4b:1f,bridge_name='br-int',has_traffic_filtering=True,id=00efdc72-8528-41eb-be2b-c9b190863053,network=Network(7faeaea5-04e0-46e0-bb55-9426d599fb1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00efdc72-85')
Nov 08 12:40:18 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-64fcefb3-c0c6-416d-a235-eb9c42b2a7ed tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Deleting instance files /opt/stack/data/nova/instances/7a482219-16ac-49e2-84ad-7e2030c97184_del
Nov 08 12:40:18 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-64fcefb3-c0c6-416d-a235-eb9c42b2a7ed tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Deletion of /opt/stack/data/nova/instances/7a482219-16ac-49e2-84ad-7e2030c97184_del complete
Nov 08 12:40:18 user nova-compute[74840]: INFO nova.compute.manager [None req-64fcefb3-c0c6-416d-a235-eb9c42b2a7ed tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 08 12:40:18 user nova-compute[74840]: DEBUG oslo.service.loopingcall [None req-64fcefb3-c0c6-416d-a235-eb9c42b2a7ed tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74840) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 12:40:18 user nova-compute[74840]: DEBUG nova.compute.manager [-] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Deallocating network for instance {{(pid=74840) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 12:40:18 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] deallocate_for_instance() {{(pid=74840) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 12:40:18 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:40:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:40:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:40:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:40:18 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:40:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:40:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:40:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:40:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:40:19 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:40:19 user nova-compute[74840]: INFO nova.compute.manager [-] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Took 0.56 seconds to deallocate network for instance.
Nov 08 12:40:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-64fcefb3-c0c6-416d-a235-eb9c42b2a7ed tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:40:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-64fcefb3-c0c6-416d-a235-eb9c42b2a7ed tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:40:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:40:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:40:19 user nova-compute[74840]: DEBUG nova.compute.manager [req-739daffb-0f83-4d72-a919-df717c2e670b req-45518e21-82b8-4964-816e-c762e767532f service nova] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Received event network-vif-deleted-00efdc72-8528-41eb-be2b-c9b190863053 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:40:19 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-64fcefb3-c0c6-416d-a235-eb9c42b2a7ed tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:40:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:40:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:40:19 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-64fcefb3-c0c6-416d-a235-eb9c42b2a7ed tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:40:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-64fcefb3-c0c6-416d-a235-eb9c42b2a7ed tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:40:19 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-64fcefb3-c0c6-416d-a235-eb9c42b2a7ed tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Deleted allocations for instance 7a482219-16ac-49e2-84ad-7e2030c97184
Nov 08 12:40:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:40:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-64fcefb3-c0c6-416d-a235-eb9c42b2a7ed tempest-TestStampPattern-55983118 tempest-TestStampPattern-55983118-project-member] Lock "7a482219-16ac-49e2-84ad-7e2030c97184" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.582s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:40:19 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:40:19 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:40:19 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=8307MB free_disk=24.96839141845703GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:40:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:40:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:40:20 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Applying migration context for instance c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a as it has an incoming, in-progress migration f74796e5-2ba9-491a-9b2b-3c93e110e5e1. Migration status is finished {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 08 12:40:20 user nova-compute[74840]: INFO nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Updating resource usage from migration f74796e5-2ba9-491a-9b2b-3c93e110e5e1
Nov 08 12:40:20 user nova-compute[74840]: DEBUG nova.compute.manager [req-9238339d-d5ad-4c92-86b5-9d19c937ee5b req-d8beb8e9-892c-4527-baec-66144fc3a0aa service nova] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Received event network-vif-plugged-00efdc72-8528-41eb-be2b-c9b190863053 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:40:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9238339d-d5ad-4c92-86b5-9d19c937ee5b req-d8beb8e9-892c-4527-baec-66144fc3a0aa service nova] Acquiring lock "7a482219-16ac-49e2-84ad-7e2030c97184-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:40:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9238339d-d5ad-4c92-86b5-9d19c937ee5b req-d8beb8e9-892c-4527-baec-66144fc3a0aa service nova] Lock "7a482219-16ac-49e2-84ad-7e2030c97184-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:40:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9238339d-d5ad-4c92-86b5-9d19c937ee5b req-d8beb8e9-892c-4527-baec-66144fc3a0aa service nova] Lock "7a482219-16ac-49e2-84ad-7e2030c97184-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:40:20 user nova-compute[74840]: DEBUG nova.compute.manager [req-9238339d-d5ad-4c92-86b5-9d19c937ee5b req-d8beb8e9-892c-4527-baec-66144fc3a0aa service nova] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] No waiting events found dispatching network-vif-plugged-00efdc72-8528-41eb-be2b-c9b190863053 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:40:20 user nova-compute[74840]: WARNING nova.compute.manager [req-9238339d-d5ad-4c92-86b5-9d19c937ee5b req-d8beb8e9-892c-4527-baec-66144fc3a0aa service nova] [instance: 7a482219-16ac-49e2-84ad-7e2030c97184] Received unexpected event network-vif-plugged-00efdc72-8528-41eb-be2b-c9b190863053 for instance with vm_state deleted and task_state None.
Nov 08 12:40:20 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 10c42516-62ba-4aa9-bc5a-d94499bd6b65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:40:20 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Migration f74796e5-2ba9-491a-9b2b-3c93e110e5e1 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 08 12:40:20 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:40:20 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance f6bccde5-832b-476f-95c0-10b16af6b126 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:40:20 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:40:20 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:40:20 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:40:20 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:40:20 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:40:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.417s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:40:22 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:40:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:40:23 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:40:23 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74840) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 12:40:23 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:40:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:40:28 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:40:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:40:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:40:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:40:33 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:40:33 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Cleaning up deleted instances {{(pid=74840) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 12:40:33 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] There are 0 instances to clean {{(pid=74840) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 12:40:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d2226f26-6e57-4918-85e9-6303b74f5942 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:40:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d2226f26-6e57-4918-85e9-6303b74f5942 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:40:37 user nova-compute[74840]: DEBUG nova.compute.manager [None req-d2226f26-6e57-4918-85e9-6303b74f5942 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Going to confirm migration 2 {{(pid=74840) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 08 12:40:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d2226f26-6e57-4918-85e9-6303b74f5942 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "refresh_cache-c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:40:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d2226f26-6e57-4918-85e9-6303b74f5942 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquired lock "refresh_cache-c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:40:37 user nova-compute[74840]: DEBUG nova.network.neutron [None req-d2226f26-6e57-4918-85e9-6303b74f5942 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:40:37 user nova-compute[74840]: DEBUG nova.objects.instance [None req-d2226f26-6e57-4918-85e9-6303b74f5942 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lazy-loading 'info_cache' on Instance uuid c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:40:38 user nova-compute[74840]: DEBUG nova.network.neutron [None req-d2226f26-6e57-4918-85e9-6303b74f5942 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Updating instance_info_cache with network_info: [{"id": "18c0341b-6a4a-4235-993f-da29deeadcb5", "address": "fa:16:3e:e7:6e:a4", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18c0341b-6a", "ovs_interfaceid": "18c0341b-6a4a-4235-993f-da29deeadcb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:40:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d2226f26-6e57-4918-85e9-6303b74f5942 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Releasing lock "refresh_cache-c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:40:38 user nova-compute[74840]: DEBUG nova.objects.instance [None req-d2226f26-6e57-4918-85e9-6303b74f5942 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lazy-loading 'migration_context' on Instance uuid c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:40:38 user nova-compute[74840]: DEBUG nova.objects.base [None req-d2226f26-6e57-4918-85e9-6303b74f5942 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Object Instance<c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a> lazy-loaded attributes: info_cache,migration_context {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:40:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d2226f26-6e57-4918-85e9-6303b74f5942 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:40:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d2226f26-6e57-4918-85e9-6303b74f5942 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:40:38 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:40:38 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-d2226f26-6e57-4918-85e9-6303b74f5942 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:40:38 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-d2226f26-6e57-4918-85e9-6303b74f5942 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:40:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d2226f26-6e57-4918-85e9-6303b74f5942 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.300s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:40:38 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-d2226f26-6e57-4918-85e9-6303b74f5942 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Deleted allocation for migration f74796e5-2ba9-491a-9b2b-3c93e110e5e1
Nov 08 12:40:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-d2226f26-6e57-4918-85e9-6303b74f5942 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.277s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:40:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:40:43 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:40:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:40:48 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:40:53 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:40:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:41:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:41:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:41:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 12:41:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:41:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:41:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:41:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:41:08 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:41:08 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:41:08 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Rebuilding the list of instances to heal {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 12:41:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "refresh_cache-10c42516-62ba-4aa9-bc5a-d94499bd6b65" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:41:08 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquired lock "refresh_cache-10c42516-62ba-4aa9-bc5a-d94499bd6b65" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:41:08 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Forcefully refreshing network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 12:41:08 user nova-compute[74840]: DEBUG nova.objects.instance [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lazy-loading 'info_cache' on Instance uuid 10c42516-62ba-4aa9-bc5a-d94499bd6b65 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:41:09 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Updating instance_info_cache with network_info: [{"id": "7cf349fa-e382-4526-af9d-f60a53d870cb", "address": "fa:16:3e:97:67:76", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cf349fa-e3", "ovs_interfaceid": "7cf349fa-e382-4526-af9d-f60a53d870cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:41:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Releasing lock "refresh_cache-10c42516-62ba-4aa9-bc5a-d94499bd6b65" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:41:09 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Updated the network info_cache for instance {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 12:41:10 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:41:10 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:41:10 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:41:12 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:41:12 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:41:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:41:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:41:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 12:41:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:41:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:41:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:41:13 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:41:14 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:41:14 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:41:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:41:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:41:18 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:41:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:41:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:41:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:41:18 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:41:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:41:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:41:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:41:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:41:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:41:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:41:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:41:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:41:19 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:41:19 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:41:19 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:41:19 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=8548MB free_disk=24.95539093017578GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:41:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:41:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:41:20 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 10c42516-62ba-4aa9-bc5a-d94499bd6b65 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:41:20 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:41:20 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance f6bccde5-832b-476f-95c0-10b16af6b126 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:41:20 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:41:20 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:41:20 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Refreshing inventories for resource provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 12:41:20 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Updating ProviderTree inventory for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 12:41:20 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Updating inventory in ProviderTree for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 12:41:20 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Refreshing aggregate associations for resource provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e, aggregates: None {{(pid=74840) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 12:41:20 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Refreshing trait associations for resource provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=74840) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 12:41:20 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:41:20 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:41:20 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:41:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.653s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:41:22 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:41:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:41:25 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:41:28 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:41:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:41:33 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:41:38 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:41:43 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:41:45 user nova-compute[74840]: DEBUG nova.compute.manager [req-45ff42e6-08f4-4e25-b340-511a07f3d0f8 req-1e1248d4-7e94-4f98-806d-88ac05883174 service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Received event network-changed-850d3852-db4b-4634-b37d-ad1e18f04a6b {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:41:45 user nova-compute[74840]: DEBUG nova.compute.manager [req-45ff42e6-08f4-4e25-b340-511a07f3d0f8 req-1e1248d4-7e94-4f98-806d-88ac05883174 service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Refreshing instance network info cache due to event network-changed-850d3852-db4b-4634-b37d-ad1e18f04a6b. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:41:45 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-45ff42e6-08f4-4e25-b340-511a07f3d0f8 req-1e1248d4-7e94-4f98-806d-88ac05883174 service nova] Acquiring lock "refresh_cache-f6bccde5-832b-476f-95c0-10b16af6b126" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:41:45 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-45ff42e6-08f4-4e25-b340-511a07f3d0f8 req-1e1248d4-7e94-4f98-806d-88ac05883174 service nova] Acquired lock "refresh_cache-f6bccde5-832b-476f-95c0-10b16af6b126" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:41:45 user nova-compute[74840]: DEBUG nova.network.neutron [req-45ff42e6-08f4-4e25-b340-511a07f3d0f8 req-1e1248d4-7e94-4f98-806d-88ac05883174 service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Refreshing network info cache for port 850d3852-db4b-4634-b37d-ad1e18f04a6b {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:41:46 user nova-compute[74840]: DEBUG nova.network.neutron [req-45ff42e6-08f4-4e25-b340-511a07f3d0f8 req-1e1248d4-7e94-4f98-806d-88ac05883174 service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Updated VIF entry in instance network info cache for port 850d3852-db4b-4634-b37d-ad1e18f04a6b. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:41:46 user nova-compute[74840]: DEBUG nova.network.neutron [req-45ff42e6-08f4-4e25-b340-511a07f3d0f8 req-1e1248d4-7e94-4f98-806d-88ac05883174 service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Updating instance_info_cache with network_info: [{"id": "850d3852-db4b-4634-b37d-ad1e18f04a6b", "address": "fa:16:3e:41:0b:a1", "network": {"id": "a52573e9-cee6-4a6d-944d-56fe99e1c3a9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1100599758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3fd3c6c8e1c46c99adee8fdcc73bddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap850d3852-db", "ovs_interfaceid": "850d3852-db4b-4634-b37d-ad1e18f04a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:41:46 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-45ff42e6-08f4-4e25-b340-511a07f3d0f8 req-1e1248d4-7e94-4f98-806d-88ac05883174 service nova] Releasing lock "refresh_cache-f6bccde5-832b-476f-95c0-10b16af6b126" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:41:46 user nova-compute[74840]: DEBUG nova.compute.manager [None req-efb52311-f15b-44e7-99fb-40c27ee4238b tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:41:46 user nova-compute[74840]: INFO nova.compute.manager [None req-efb52311-f15b-44e7-99fb-40c27ee4238b tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] instance snapshotting
Nov 08 12:41:47 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-efb52311-f15b-44e7-99fb-40c27ee4238b tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Beginning live snapshot process
Nov 08 12:41:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-efb52311-f15b-44e7-99fb-40c27ee4238b tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk --force-share --output=json -f qcow2 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:41:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:41:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-efb52311-f15b-44e7-99fb-40c27ee4238b tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk --force-share --output=json -f qcow2" returned: 0 in 0.172s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:41:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-efb52311-f15b-44e7-99fb-40c27ee4238b tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk --force-share --output=json -f qcow2 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:41:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-efb52311-f15b-44e7-99fb-40c27ee4238b tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk --force-share --output=json -f qcow2" returned: 0 in 0.185s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:41:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-efb52311-f15b-44e7-99fb-40c27ee4238b tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:41:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-efb52311-f15b-44e7-99fb-40c27ee4238b tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.174s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:41:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-efb52311-f15b-44e7-99fb-40c27ee4238b tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp22o63zc0/a8dc27f5a0f949b882ed8ddefbb5093f.delta 1073741824 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:41:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-efb52311-f15b-44e7-99fb-40c27ee4238b tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp22o63zc0/a8dc27f5a0f949b882ed8ddefbb5093f.delta 1073741824" returned: 0 in 0.048s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:41:47 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-efb52311-f15b-44e7-99fb-40c27ee4238b tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 08 12:41:48 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:41:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-efb52311-f15b-44e7-99fb-40c27ee4238b tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74840) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 12:41:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-efb52311-f15b-44e7-99fb-40c27ee4238b tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74840) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 12:41:49 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-efb52311-f15b-44e7-99fb-40c27ee4238b tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 08 12:41:49 user nova-compute[74840]: DEBUG nova.privsep.utils [None req-efb52311-f15b-44e7-99fb-40c27ee4238b tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74840) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 12:41:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-efb52311-f15b-44e7-99fb-40c27ee4238b tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp22o63zc0/a8dc27f5a0f949b882ed8ddefbb5093f.delta /opt/stack/data/nova/instances/snapshots/tmp22o63zc0/a8dc27f5a0f949b882ed8ddefbb5093f {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:41:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-efb52311-f15b-44e7-99fb-40c27ee4238b tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp22o63zc0/a8dc27f5a0f949b882ed8ddefbb5093f.delta /opt/stack/data/nova/instances/snapshots/tmp22o63zc0/a8dc27f5a0f949b882ed8ddefbb5093f" returned: 0 in 0.505s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:41:49 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-efb52311-f15b-44e7-99fb-40c27ee4238b tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Snapshot extracted, beginning image upload
Nov 08 12:41:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:41:52 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-efb52311-f15b-44e7-99fb-40c27ee4238b tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Snapshot image upload complete
Nov 08 12:41:52 user nova-compute[74840]: INFO nova.compute.manager [None req-efb52311-f15b-44e7-99fb-40c27ee4238b tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Took 5.45 seconds to snapshot the instance on the hypervisor.
Nov 08 12:41:53 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:41:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:41:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:42:02 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:42:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:42:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:42:10 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:42:10 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:42:10 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:42:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "refresh_cache-c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:42:10 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquired lock "refresh_cache-c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:42:10 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Forcefully refreshing network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 12:42:11 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Updating instance_info_cache with network_info: [{"id": "18c0341b-6a4a-4235-993f-da29deeadcb5", "address": "fa:16:3e:e7:6e:a4", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18c0341b-6a", "ovs_interfaceid": "18c0341b-6a4a-4235-993f-da29deeadcb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:42:11 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Releasing lock "refresh_cache-c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:42:11 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Updated the network info_cache for instance {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 12:42:11 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:42:12 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:42:12 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:42:12 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:42:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:42:14 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:42:16 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:42:16 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:42:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:42:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:42:20 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:42:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:42:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:42:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:42:20 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:42:20 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:42:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:42:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:42:20 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:42:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:42:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:42:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:42:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:42:21 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:42:22 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:42:22 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:42:22 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=8534MB free_disk=24.902584075927734GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:42:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:42:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:42:22 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 10c42516-62ba-4aa9-bc5a-d94499bd6b65 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:42:22 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:42:22 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance f6bccde5-832b-476f-95c0-10b16af6b126 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:42:22 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:42:22 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:42:22 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:42:22 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:42:22 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:42:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.265s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:42:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:42:28 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:42:28 user nova-compute[74840]: INFO nova.compute.manager [None req-af71c4ff-3a00-4386-bd27-666414e1608b tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Get console output
Nov 08 12:42:28 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:42:28 user nova-compute[74840]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 08 12:42:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:42:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:42:38 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:42:43 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:42:48 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:42:53 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:42:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:43:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:43:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:43:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:43:12 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:43:12 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:43:12 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:43:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "refresh_cache-f6bccde5-832b-476f-95c0-10b16af6b126" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:43:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquired lock "refresh_cache-f6bccde5-832b-476f-95c0-10b16af6b126" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:43:12 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Forcefully refreshing network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 12:43:13 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Updating instance_info_cache with network_info: [{"id": "850d3852-db4b-4634-b37d-ad1e18f04a6b", "address": "fa:16:3e:41:0b:a1", "network": {"id": "a52573e9-cee6-4a6d-944d-56fe99e1c3a9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1100599758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3fd3c6c8e1c46c99adee8fdcc73bddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap850d3852-db", "ovs_interfaceid": "850d3852-db4b-4634-b37d-ad1e18f04a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:43:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Releasing lock "refresh_cache-f6bccde5-832b-476f-95c0-10b16af6b126" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:43:13 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Updated the network info_cache for instance {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 12:43:13 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:43:13 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:43:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:43:13 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:43:13 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:43:16 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:43:16 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:43:17 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:43:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:43:22 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:43:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:43:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:43:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:43:22 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:43:22 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:43:22 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:43:23 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:43:23 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:43:23 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:43:23 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:43:23 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:43:23 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:43:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:43:23 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:43:23 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:43:23 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:43:24 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=8683MB free_disk=24.900588989257812GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:43:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:43:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:43:24 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 10c42516-62ba-4aa9-bc5a-d94499bd6b65 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:43:24 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:43:24 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance f6bccde5-832b-476f-95c0-10b16af6b126 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:43:24 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:43:24 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:43:24 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:43:24 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:43:24 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:43:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.265s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:43:25 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:43:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:43:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:43:28 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:43:29 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-01b65913-d02c-4ad1-8736-2b95be1f4099 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:43:29 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-01b65913-d02c-4ad1-8736-2b95be1f4099 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:43:29 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-01b65913-d02c-4ad1-8736-2b95be1f4099 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:43:29 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-01b65913-d02c-4ad1-8736-2b95be1f4099 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:43:29 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-01b65913-d02c-4ad1-8736-2b95be1f4099 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:43:29 user nova-compute[74840]: INFO nova.compute.manager [None req-01b65913-d02c-4ad1-8736-2b95be1f4099 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Terminating instance
Nov 08 12:43:29 user nova-compute[74840]: DEBUG nova.compute.manager [None req-01b65913-d02c-4ad1-8736-2b95be1f4099 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Start destroying the instance on the hypervisor. {{(pid=74840) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 12:43:29 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:43:29 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG nova.compute.manager [req-caa0eddb-1e16-4877-a9bf-27c2d7e0e72a req-a023c0c4-4162-4d06-850e-c81d8987cb09 service nova] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Received event network-vif-unplugged-18c0341b-6a4a-4235-993f-da29deeadcb5 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-caa0eddb-1e16-4877-a9bf-27c2d7e0e72a req-a023c0c4-4162-4d06-850e-c81d8987cb09 service nova] Acquiring lock "c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-caa0eddb-1e16-4877-a9bf-27c2d7e0e72a req-a023c0c4-4162-4d06-850e-c81d8987cb09 service nova] Lock "c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-caa0eddb-1e16-4877-a9bf-27c2d7e0e72a req-a023c0c4-4162-4d06-850e-c81d8987cb09 service nova] Lock "c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG nova.compute.manager [req-caa0eddb-1e16-4877-a9bf-27c2d7e0e72a req-a023c0c4-4162-4d06-850e-c81d8987cb09 service nova] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] No waiting events found dispatching network-vif-unplugged-18c0341b-6a4a-4235-993f-da29deeadcb5 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG nova.compute.manager [req-caa0eddb-1e16-4877-a9bf-27c2d7e0e72a req-a023c0c4-4162-4d06-850e-c81d8987cb09 service nova] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Received event network-vif-unplugged-18c0341b-6a4a-4235-993f-da29deeadcb5 for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:43:30 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Instance destroyed successfully.
Nov 08 12:43:30 user nova-compute[74840]: DEBUG nova.objects.instance [None req-01b65913-d02c-4ad1-8736-2b95be1f4099 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lazy-loading 'resources' on Instance uuid c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-01b65913-d02c-4ad1-8736-2b95be1f4099 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:36:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1685775036',display_name='tempest-ServerActionsTestOtherA-server-1685775036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1685775036',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAmkFC6dPojPaRdPJh94q0/wuvRVxh1HPsrsmItydl0iUnCu6UdbkD5pi9CgzgYpLamuUC6eRZK4fPtOQ5ReX7Sfuo5mKd9gSajCUuWaRBqISYVRzAbikSahnbP3hsO0g==',key_name='tempest-keypair-428361338',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:39:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5e47ef156b3649839ff728eaf23121da',ramdisk_id='',reservation_id='r-od43glui',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-401855506',owner_user_name='tempest-ServerActionsTestOtherA-401855506-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:40:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a49f88cb74c47bdb9a35883adbae454',uuid=c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18c0341b-6a4a-4235-993f-da29deeadcb5", "address": "fa:16:3e:e7:6e:a4", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18c0341b-6a", "ovs_interfaceid": "18c0341b-6a4a-4235-993f-da29deeadcb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-01b65913-d02c-4ad1-8736-2b95be1f4099 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Converting VIF {"id": "18c0341b-6a4a-4235-993f-da29deeadcb5", "address": "fa:16:3e:e7:6e:a4", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18c0341b-6a", "ovs_interfaceid": "18c0341b-6a4a-4235-993f-da29deeadcb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-01b65913-d02c-4ad1-8736-2b95be1f4099 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:6e:a4,bridge_name='br-int',has_traffic_filtering=True,id=18c0341b-6a4a-4235-993f-da29deeadcb5,network=Network(e92448c4-9bc0-424b-a07f-a398ac46fada),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18c0341b-6a') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG os_vif [None req-01b65913-d02c-4ad1-8736-2b95be1f4099 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:6e:a4,bridge_name='br-int',has_traffic_filtering=True,id=18c0341b-6a4a-4235-993f-da29deeadcb5,network=Network(e92448c4-9bc0-424b-a07f-a398ac46fada),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18c0341b-6a') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18c0341b-6a, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a0b5cc09-d66a-458f-8a0b-8ce83a32ef53) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:43:30 user nova-compute[74840]: INFO os_vif [None req-01b65913-d02c-4ad1-8736-2b95be1f4099 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:6e:a4,bridge_name='br-int',has_traffic_filtering=True,id=18c0341b-6a4a-4235-993f-da29deeadcb5,network=Network(e92448c4-9bc0-424b-a07f-a398ac46fada),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18c0341b-6a')
Nov 08 12:43:30 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01b65913-d02c-4ad1-8736-2b95be1f4099 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b65913-d02c-4ad1-8736-2b95be1f4099 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gAtTOrZz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:43:30 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-01b65913-d02c-4ad1-8736-2b95be1f4099 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:43:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-01b65913-d02c-4ad1-8736-2b95be1f4099 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-01b65913-d02c-4ad1-8736-2b95be1f4099 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d27b092-c3e0-4768-a532-89d217010ff0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b65913-d02c-4ad1-8736-2b95be1f4099 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 12:43:30 user nova-compute[74840]: No targets found.
Nov 08 12:43:30 user nova-compute[74840]: iSNS:
Nov 08 12:43:30 user nova-compute[74840]: No targets found.
Nov 08 12:43:30 user nova-compute[74840]: STATIC:
Nov 08 12:43:30 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665
Nov 08 12:43:30 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:43:30 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:43:30 user nova-compute[74840]: FIRMWARE:
Nov 08 12:43:30 user nova-compute[74840]: No targets found.
Nov 08 12:43:30 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b65913-d02c-4ad1-8736-2b95be1f4099 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 12:43:30 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 12:43:30 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b65913-d02c-4ad1-8736-2b95be1f4099 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c5789e-d6fe-43c9-92ea-0d0e79bcdca3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa8c14b-c85b-4056-a446-af536bf0cbca]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b65913-d02c-4ad1-8736-2b95be1f4099 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 (non-flash)
Nov 08 12:43:30 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b65913-d02c-4ad1-8736-2b95be1f4099 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 (non-flash)
Nov 08 12:43:30 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b65913-d02c-4ad1-8736-2b95be1f4099 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7d443b760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665'): ({'sdb'}, set())}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-01b65913-d02c-4ad1-8736-2b95be1f4099 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Removing single pathed devices sdb {{(pid=74840) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff44abc3-1d70-49b1-b773-84df4d8d87f2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[11237171-0ecd-418b-bdb1-711efe889bb5]: (4, ('ok\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-01b65913-d02c-4ad1-8736-2b95be1f4099 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Flushing IO for device /dev/sdb {{(pid=74840) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01fe272-470f-4bdd-a967-73cff3159724]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-01b65913-d02c-4ad1-8736-2b95be1f4099 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74840) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.066s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73cdf15-2840-48de-a0fb-4bc176e2f653]: (4, ('1', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-01b65913-d02c-4ad1-8736-2b95be1f4099 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-01b65913-d02c-4ad1-8736-2b95be1f4099 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] SCSI volumes sdb have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO3b8fcaf3-8583b2dd67e5949c', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_3b8fcaf3', '/dev/disk/by-id/scsi-23835383362326464') {{(pid=85688) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96d4e9f-9b67-4376-b4a8-6bd53fd0995c]: (4, None) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b65913-d02c-4ad1-8736-2b95be1f4099 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665')] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b904b0e-b435-4f92-9328-366581003cba]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b65913-d02c-4ad1-8736-2b95be1f4099 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 -p 172.16.0.220:3260 --logout {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f16147-03e1-46d9-a226-99d2bef3741b]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b65913-d02c-4ad1-8736-2b95be1f4099 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665, portal: 172.16.0.220,3260]
Nov 08 12:43:30 user nova-compute[74840]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665, portal: 172.16.0.220,3260] successful.
Nov 08 12:43:30 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 -p 172.16.0.220:3260 --op delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9116b48b-6faa-44d9-a397-54a614016665 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ab8fa7-1f79-4092-87ec-4855b87d16ac]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b65913-d02c-4ad1-8736-2b95be1f4099 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-01b65913-d02c-4ad1-8736-2b95be1f4099 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-01b65913-d02c-4ad1-8736-2b95be1f4099 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] <== disconnect_volume: return (343ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01b65913-d02c-4ad1-8736-2b95be1f4099 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 12:43:30 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-01b65913-d02c-4ad1-8736-2b95be1f4099 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Deleting instance files /opt/stack/data/nova/instances/c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a_del
Nov 08 12:43:30 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-01b65913-d02c-4ad1-8736-2b95be1f4099 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Deletion of /opt/stack/data/nova/instances/c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a_del complete
Nov 08 12:43:30 user nova-compute[74840]: INFO nova.compute.manager [None req-01b65913-d02c-4ad1-8736-2b95be1f4099 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Took 1.28 seconds to destroy the instance on the hypervisor.
Nov 08 12:43:30 user nova-compute[74840]: DEBUG oslo.service.loopingcall [None req-01b65913-d02c-4ad1-8736-2b95be1f4099 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74840) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG nova.compute.manager [-] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Deallocating network for instance {{(pid=74840) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] deallocate_for_instance() {{(pid=74840) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:43:30 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:43:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:43:31 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:43:31 user nova-compute[74840]: INFO nova.compute.manager [-] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Took 0.77 seconds to deallocate network for instance.
Nov 08 12:43:31 user nova-compute[74840]: DEBUG nova.compute.manager [req-21bb8945-0d9e-4fa6-8842-911632b9ed3d req-550b2af7-ee49-4f14-b800-fa446f2af31f service nova] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Received event network-vif-deleted-18c0341b-6a4a-4235-993f-da29deeadcb5 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:43:32 user nova-compute[74840]: DEBUG nova.compute.manager [req-3da5b6b9-1c35-4fb0-8310-ca2172d2627a req-73e5bee1-4015-4ca3-adab-a68e3d720f73 service nova] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Received event network-vif-plugged-18c0341b-6a4a-4235-993f-da29deeadcb5 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:43:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3da5b6b9-1c35-4fb0-8310-ca2172d2627a req-73e5bee1-4015-4ca3-adab-a68e3d720f73 service nova] Acquiring lock "c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:43:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3da5b6b9-1c35-4fb0-8310-ca2172d2627a req-73e5bee1-4015-4ca3-adab-a68e3d720f73 service nova] Lock "c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:43:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3da5b6b9-1c35-4fb0-8310-ca2172d2627a req-73e5bee1-4015-4ca3-adab-a68e3d720f73 service nova] Lock "c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:43:32 user nova-compute[74840]: DEBUG nova.compute.manager [req-3da5b6b9-1c35-4fb0-8310-ca2172d2627a req-73e5bee1-4015-4ca3-adab-a68e3d720f73 service nova] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] No waiting events found dispatching network-vif-plugged-18c0341b-6a4a-4235-993f-da29deeadcb5 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:43:32 user nova-compute[74840]: WARNING nova.compute.manager [req-3da5b6b9-1c35-4fb0-8310-ca2172d2627a req-73e5bee1-4015-4ca3-adab-a68e3d720f73 service nova] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Received unexpected event network-vif-plugged-18c0341b-6a4a-4235-993f-da29deeadcb5 for instance with vm_state active and task_state deleting.
Nov 08 12:43:32 user nova-compute[74840]: DEBUG nova.compute.manager [req-3da5b6b9-1c35-4fb0-8310-ca2172d2627a req-73e5bee1-4015-4ca3-adab-a68e3d720f73 service nova] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Received event network-vif-plugged-18c0341b-6a4a-4235-993f-da29deeadcb5 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:43:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3da5b6b9-1c35-4fb0-8310-ca2172d2627a req-73e5bee1-4015-4ca3-adab-a68e3d720f73 service nova] Acquiring lock "c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:43:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3da5b6b9-1c35-4fb0-8310-ca2172d2627a req-73e5bee1-4015-4ca3-adab-a68e3d720f73 service nova] Lock "c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:43:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3da5b6b9-1c35-4fb0-8310-ca2172d2627a req-73e5bee1-4015-4ca3-adab-a68e3d720f73 service nova] Lock "c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:43:32 user nova-compute[74840]: DEBUG nova.compute.manager [req-3da5b6b9-1c35-4fb0-8310-ca2172d2627a req-73e5bee1-4015-4ca3-adab-a68e3d720f73 service nova] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] No waiting events found dispatching network-vif-plugged-18c0341b-6a4a-4235-993f-da29deeadcb5 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:43:32 user nova-compute[74840]: WARNING nova.compute.manager [req-3da5b6b9-1c35-4fb0-8310-ca2172d2627a req-73e5bee1-4015-4ca3-adab-a68e3d720f73 service nova] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Received unexpected event network-vif-plugged-18c0341b-6a4a-4235-993f-da29deeadcb5 for instance with vm_state active and task_state deleting.
Nov 08 12:43:32 user nova-compute[74840]: DEBUG nova.compute.manager [req-3da5b6b9-1c35-4fb0-8310-ca2172d2627a req-73e5bee1-4015-4ca3-adab-a68e3d720f73 service nova] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Received event network-vif-plugged-18c0341b-6a4a-4235-993f-da29deeadcb5 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:43:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3da5b6b9-1c35-4fb0-8310-ca2172d2627a req-73e5bee1-4015-4ca3-adab-a68e3d720f73 service nova] Acquiring lock "c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:43:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3da5b6b9-1c35-4fb0-8310-ca2172d2627a req-73e5bee1-4015-4ca3-adab-a68e3d720f73 service nova] Lock "c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:43:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3da5b6b9-1c35-4fb0-8310-ca2172d2627a req-73e5bee1-4015-4ca3-adab-a68e3d720f73 service nova] Lock "c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:43:32 user nova-compute[74840]: DEBUG nova.compute.manager [req-3da5b6b9-1c35-4fb0-8310-ca2172d2627a req-73e5bee1-4015-4ca3-adab-a68e3d720f73 service nova] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] No waiting events found dispatching network-vif-plugged-18c0341b-6a4a-4235-993f-da29deeadcb5 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:43:32 user nova-compute[74840]: WARNING nova.compute.manager [req-3da5b6b9-1c35-4fb0-8310-ca2172d2627a req-73e5bee1-4015-4ca3-adab-a68e3d720f73 service nova] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Received unexpected event network-vif-plugged-18c0341b-6a4a-4235-993f-da29deeadcb5 for instance with vm_state active and task_state deleting.
Nov 08 12:43:32 user nova-compute[74840]: DEBUG nova.compute.manager [req-3da5b6b9-1c35-4fb0-8310-ca2172d2627a req-73e5bee1-4015-4ca3-adab-a68e3d720f73 service nova] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Received event network-vif-unplugged-18c0341b-6a4a-4235-993f-da29deeadcb5 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:43:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3da5b6b9-1c35-4fb0-8310-ca2172d2627a req-73e5bee1-4015-4ca3-adab-a68e3d720f73 service nova] Acquiring lock "c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:43:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3da5b6b9-1c35-4fb0-8310-ca2172d2627a req-73e5bee1-4015-4ca3-adab-a68e3d720f73 service nova] Lock "c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:43:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3da5b6b9-1c35-4fb0-8310-ca2172d2627a req-73e5bee1-4015-4ca3-adab-a68e3d720f73 service nova] Lock "c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:43:32 user nova-compute[74840]: DEBUG nova.compute.manager [req-3da5b6b9-1c35-4fb0-8310-ca2172d2627a req-73e5bee1-4015-4ca3-adab-a68e3d720f73 service nova] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] No waiting events found dispatching network-vif-unplugged-18c0341b-6a4a-4235-993f-da29deeadcb5 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:43:32 user nova-compute[74840]: DEBUG nova.compute.manager [req-3da5b6b9-1c35-4fb0-8310-ca2172d2627a req-73e5bee1-4015-4ca3-adab-a68e3d720f73 service nova] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Received event network-vif-unplugged-18c0341b-6a4a-4235-993f-da29deeadcb5 for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:43:32 user nova-compute[74840]: DEBUG nova.compute.manager [req-3da5b6b9-1c35-4fb0-8310-ca2172d2627a req-73e5bee1-4015-4ca3-adab-a68e3d720f73 service nova] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Received event network-vif-plugged-18c0341b-6a4a-4235-993f-da29deeadcb5 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:43:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3da5b6b9-1c35-4fb0-8310-ca2172d2627a req-73e5bee1-4015-4ca3-adab-a68e3d720f73 service nova] Acquiring lock "c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:43:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3da5b6b9-1c35-4fb0-8310-ca2172d2627a req-73e5bee1-4015-4ca3-adab-a68e3d720f73 service nova] Lock "c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:43:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3da5b6b9-1c35-4fb0-8310-ca2172d2627a req-73e5bee1-4015-4ca3-adab-a68e3d720f73 service nova] Lock "c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:43:32 user nova-compute[74840]: DEBUG nova.compute.manager [req-3da5b6b9-1c35-4fb0-8310-ca2172d2627a req-73e5bee1-4015-4ca3-adab-a68e3d720f73 service nova] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] No waiting events found dispatching network-vif-plugged-18c0341b-6a4a-4235-993f-da29deeadcb5 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:43:32 user nova-compute[74840]: WARNING nova.compute.manager [req-3da5b6b9-1c35-4fb0-8310-ca2172d2627a req-73e5bee1-4015-4ca3-adab-a68e3d720f73 service nova] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Received unexpected event network-vif-plugged-18c0341b-6a4a-4235-993f-da29deeadcb5 for instance with vm_state active and task_state deleting.
Nov 08 12:43:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:43:32 user nova-compute[74840]: INFO nova.compute.manager [None req-01b65913-d02c-4ad1-8736-2b95be1f4099 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Took 1.02 seconds to detach 1 volumes for instance.
Nov 08 12:43:32 user nova-compute[74840]: DEBUG nova.compute.manager [None req-01b65913-d02c-4ad1-8736-2b95be1f4099 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a] Deleting volume: 9116b48b-6faa-44d9-a397-54a614016665 {{(pid=74840) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 12:43:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-01b65913-d02c-4ad1-8736-2b95be1f4099 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:43:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-01b65913-d02c-4ad1-8736-2b95be1f4099 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:43:33 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-01b65913-d02c-4ad1-8736-2b95be1f4099 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:43:33 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-01b65913-d02c-4ad1-8736-2b95be1f4099 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:43:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-01b65913-d02c-4ad1-8736-2b95be1f4099 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.356s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:43:33 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-01b65913-d02c-4ad1-8736-2b95be1f4099 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Deleted allocations for instance c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a
Nov 08 12:43:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-01b65913-d02c-4ad1-8736-2b95be1f4099 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "c10a5783-c9ac-4b79-b8b5-2b9dc8eee21a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.735s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:43:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:43:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:43:37 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:43:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:43:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Acquiring lock "c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:43:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:43:37 user nova-compute[74840]: DEBUG nova.compute.manager [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Starting instance... {{(pid=74840) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 12:43:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:43:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:43:37 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:43:37 user nova-compute[74840]: INFO nova.compute.claims [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Claim successful on node user
Nov 08 12:43:37 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:43:37 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:43:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.269s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:43:37 user nova-compute[74840]: DEBUG nova.compute.manager [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Start building networks asynchronously for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 12:43:37 user nova-compute[74840]: DEBUG nova.compute.manager [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Allocating IP information in the background. {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 12:43:38 user nova-compute[74840]: DEBUG nova.network.neutron [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 12:43:38 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 12:43:38 user nova-compute[74840]: DEBUG nova.compute.manager [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Start building block device mappings for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 12:43:38 user nova-compute[74840]: DEBUG nova.policy [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '40cef2061d7a4ad9a98409cbaa0f6351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270eb2fc5485447f9e09d83d48fdc14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 12:43:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Acquiring lock "f6bccde5-832b-476f-95c0-10b16af6b126" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:43:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Lock "f6bccde5-832b-476f-95c0-10b16af6b126" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:43:38 user nova-compute[74840]: DEBUG nova.objects.instance [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Lazy-loading 'flavor' on Instance uuid f6bccde5-832b-476f-95c0-10b16af6b126 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:43:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Lock "f6bccde5-832b-476f-95c0-10b16af6b126" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:43:38 user nova-compute[74840]: DEBUG nova.compute.manager [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Start spawning the instance on the hypervisor. {{(pid=74840) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 12:43:38 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:43:38 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Creating image(s)
Nov 08 12:43:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Acquiring lock "/opt/stack/data/nova/instances/c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:43:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "/opt/stack/data/nova/instances/c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:43:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "/opt/stack/data/nova/instances/c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:43:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Acquiring lock "9ec708014af3b8e424e066da6b0282ca7a16a4bb" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:43:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "9ec708014af3b8e424e066da6b0282ca7a16a4bb" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:43:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ec708014af3b8e424e066da6b0282ca7a16a4bb.part --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:43:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Acquiring lock "f6bccde5-832b-476f-95c0-10b16af6b126" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:43:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Lock "f6bccde5-832b-476f-95c0-10b16af6b126" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:43:38 user nova-compute[74840]: INFO nova.compute.manager [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Attaching volume 3894819a-ade4-48be-aa72-8fe08f2ed68c to /dev/vdb
Nov 08 12:43:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ec708014af3b8e424e066da6b0282ca7a16a4bb.part --force-share --output=json" returned: 0 in 0.179s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:43:38 user nova-compute[74840]: DEBUG nova.virt.images [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] fb6bd902-0ff7-4bbf-99b5-308600485455 was qcow2, converting to raw {{(pid=74840) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 12:43:38 user nova-compute[74840]: DEBUG nova.privsep.utils [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74840) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 12:43:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9ec708014af3b8e424e066da6b0282ca7a16a4bb.part /opt/stack/data/nova/instances/_base/9ec708014af3b8e424e066da6b0282ca7a16a4bb.converted {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:43:38 user nova-compute[74840]: DEBUG nova.network.neutron [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Successfully created port: 0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3 {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:43:38 user nova-compute[74840]: DEBUG os_brick.utils [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:43:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:43:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:43:38 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5043857f-5e4d-454b-91de-80a670abcb2f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c8228a11e03c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:43:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:43:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:43:38 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbeff989-8702-4fa2-b69d-1404c3051687]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:43:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:43:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:43:38 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d71ffc1-8454-4774-bd77-eb125283d4a9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:43:38 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e4d334-1feb-4ec5-9acd-47cc985855f1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:43:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Running cmd (subprocess): nvme version {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:43:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] 'nvme version' failed. Not Retrying. {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:43:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] nvme not present on system {{(pid=74840) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 12:43:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:43:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:43:39 user nova-compute[74840]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 12:43:39 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2cddb93-5316-4172-9428-2ca0877919d4]: (4, '') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:43:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74840) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 12:43:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 12:43:39 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] LIGHTOS: no hostnqn found. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 12:43:39 user nova-compute[74840]: DEBUG os_brick.utils [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c8228a11e03c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:43:39 user nova-compute[74840]: DEBUG nova.virt.block_device [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Updating existing volume attachment record: 47597091-bd9b-4fe1-9768-762951a57a49 {{(pid=74840) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 12:43:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9ec708014af3b8e424e066da6b0282ca7a16a4bb.part /opt/stack/data/nova/instances/_base/9ec708014af3b8e424e066da6b0282ca7a16a4bb.converted" returned: 0 in 0.256s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:43:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ec708014af3b8e424e066da6b0282ca7a16a4bb.converted --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:43:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ec708014af3b8e424e066da6b0282ca7a16a4bb.converted --force-share --output=json" returned: 0 in 0.198s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:43:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "9ec708014af3b8e424e066da6b0282ca7a16a4bb" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.067s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:43:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ec708014af3b8e424e066da6b0282ca7a16a4bb --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:43:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ec708014af3b8e424e066da6b0282ca7a16a4bb --force-share --output=json" returned: 0 in 0.173s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:43:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Acquiring lock "9ec708014af3b8e424e066da6b0282ca7a16a4bb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:43:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "9ec708014af3b8e424e066da6b0282ca7a16a4bb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:43:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ec708014af3b8e424e066da6b0282ca7a16a4bb --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:43:39 user nova-compute[74840]: DEBUG nova.network.neutron [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Successfully updated port: 0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3 {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:43:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Acquiring lock "refresh_cache-c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:43:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Acquired lock "refresh_cache-c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:43:39 user nova-compute[74840]: DEBUG nova.network.neutron [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:43:39 user nova-compute[74840]: DEBUG nova.compute.manager [req-5d57593f-8eeb-49e6-b24d-dd1ef6862cf4 req-79f8eade-d6c9-4065-a14c-1b17fa1860a1 service nova] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Received event network-changed-0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:43:39 user nova-compute[74840]: DEBUG nova.compute.manager [req-5d57593f-8eeb-49e6-b24d-dd1ef6862cf4 req-79f8eade-d6c9-4065-a14c-1b17fa1860a1 service nova] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Refreshing instance network info cache due to event network-changed-0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:43:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-5d57593f-8eeb-49e6-b24d-dd1ef6862cf4 req-79f8eade-d6c9-4065-a14c-1b17fa1860a1 service nova] Acquiring lock "refresh_cache-c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:43:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ec708014af3b8e424e066da6b0282ca7a16a4bb --force-share --output=json" returned: 0 in 0.187s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:43:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ec708014af3b8e424e066da6b0282ca7a16a4bb,backing_fmt=raw /opt/stack/data/nova/instances/c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf/disk 1073741824 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:43:39 user nova-compute[74840]: DEBUG nova.network.neutron [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:43:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ec708014af3b8e424e066da6b0282ca7a16a4bb,backing_fmt=raw /opt/stack/data/nova/instances/c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf/disk 1073741824" returned: 0 in 0.049s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:43:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "9ec708014af3b8e424e066da6b0282ca7a16a4bb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:43:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ec708014af3b8e424e066da6b0282ca7a16a4bb --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:43:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ec708014af3b8e424e066da6b0282ca7a16a4bb --force-share --output=json" returned: 0 in 0.172s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:43:39 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf/disk. size=1073741824 {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 12:43:39 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG nova.network.neutron [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Updating instance_info_cache with network_info: [{"id": "0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3", "address": "fa:16:3e:f4:cf:dd", "network": {"id": "8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1654230640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "270eb2fc5485447f9e09d83d48fdc14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe1ab7b-d3", "ovs_interfaceid": "0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Releasing lock "refresh_cache-c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG nova.compute.manager [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Instance network_info: |[{"id": "0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3", "address": "fa:16:3e:f4:cf:dd", "network": {"id": "8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1654230640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "270eb2fc5485447f9e09d83d48fdc14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe1ab7b-d3", "ovs_interfaceid": "0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-5d57593f-8eeb-49e6-b24d-dd1ef6862cf4 req-79f8eade-d6c9-4065-a14c-1b17fa1860a1 service nova] Acquired lock "refresh_cache-c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG nova.network.neutron [req-5d57593f-8eeb-49e6-b24d-dd1ef6862cf4 req-79f8eade-d6c9-4065-a14c-1b17fa1860a1 service nova] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Refreshing network info cache for port 0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Cannot resize image /opt/stack/data/nova/instances/c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf/disk to a smaller size. {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Created local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Ensure instance console log exists: /opt/stack/data/nova/instances/c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Start _get_guest_xml network_info=[{"id": "0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3", "address": "fa:16:3e:f4:cf:dd", "network": {"id": "8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1654230640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "270eb2fc5485447f9e09d83d48fdc14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe1ab7b-d3", "ovs_interfaceid": "0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:43:35Z,direct_url=<?>,disk_format='qcow2',id=fb6bd902-0ff7-4bbf-99b5-308600485455,min_disk=0,min_ram=0,name='tempest-scenario-img--691089221',owner='270eb2fc5485447f9e09d83d48fdc14f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:43:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'image_id': 'fb6bd902-0ff7-4bbf-99b5-308600485455'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:43:40 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:43:40 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:43:40 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:43:35Z,direct_url=<?>,disk_format='qcow2',id=fb6bd902-0ff7-4bbf-99b5-308600485455,min_disk=0,min_ram=0,name='tempest-scenario-img--691089221',owner='270eb2fc5485447f9e09d83d48fdc14f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:43:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:43:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1016291031',display_name='tempest-TestMinimumBasicScenario-server-1016291031',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1016291031',id=46,image_ref='fb6bd902-0ff7-4bbf-99b5-308600485455',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP28XUPPJPJMSa6nvlhEkvvxfAeIxKGkf0ffCl4HMfj1up76qF0QvFROqPKMV9Q9YL9WFQR+ruARvXIB+pK3zkDnL2G/bM1eQWd/Fad9kzzpD9yPXSoXQpzWqLai1C9/lg==',key_name='tempest-TestMinimumBasicScenario-1808576556',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='270eb2fc5485447f9e09d83d48fdc14f',ramdisk_id='',reservation_id='r-tw2o6si9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fb6bd902-0ff7-4bbf-99b5-308600485455',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1675831883',owner_user_name='tempest-TestMinimumBasicScenario-1675831883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:43:38Z,user_data=None,user_id='40cef2061d7a4ad9a98409cbaa0f6351',uuid=c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3", "address": "fa:16:3e:f4:cf:dd", "network": {"id": "8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1654230640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "270eb2fc5485447f9e09d83d48fdc14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe1ab7b-d3", "ovs_interfaceid": "0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Converting VIF {"id": "0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3", "address": "fa:16:3e:f4:cf:dd", "network": {"id": "8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1654230640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "270eb2fc5485447f9e09d83d48fdc14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe1ab7b-d3", "ovs_interfaceid": "0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:cf:dd,bridge_name='br-int',has_traffic_filtering=True,id=0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3,network=Network(8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fe1ab7b-d3') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG nova.objects.instance [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lazy-loading 'pci_devices' on Instance uuid c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:43:40 user nova-compute[74840]:   <uuid>c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf</uuid>
Nov 08 12:43:40 user nova-compute[74840]:   <name>instance-0000002e</name>
Nov 08 12:43:40 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:43:40 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:43:40 user nova-compute[74840]:   <metadata>
Nov 08 12:43:40 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:43:40 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:43:40 user nova-compute[74840]:       <nova:name>tempest-TestMinimumBasicScenario-server-1016291031</nova:name>
Nov 08 12:43:40 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:43:40</nova:creationTime>
Nov 08 12:43:40 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:43:40 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:43:40 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:43:40 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:43:40 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:43:40 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:43:40 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:43:40 user nova-compute[74840]:       <nova:owner>
Nov 08 12:43:40 user nova-compute[74840]:         <nova:user uuid="40cef2061d7a4ad9a98409cbaa0f6351">tempest-TestMinimumBasicScenario-1675831883-project-member</nova:user>
Nov 08 12:43:40 user nova-compute[74840]:         <nova:project uuid="270eb2fc5485447f9e09d83d48fdc14f">tempest-TestMinimumBasicScenario-1675831883</nova:project>
Nov 08 12:43:40 user nova-compute[74840]:       </nova:owner>
Nov 08 12:43:40 user nova-compute[74840]:       <nova:root type="image" uuid="fb6bd902-0ff7-4bbf-99b5-308600485455"/>
Nov 08 12:43:40 user nova-compute[74840]:       <nova:ports>
Nov 08 12:43:40 user nova-compute[74840]:         <nova:port uuid="0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3">
Nov 08 12:43:40 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 12:43:40 user nova-compute[74840]:         </nova:port>
Nov 08 12:43:40 user nova-compute[74840]:       </nova:ports>
Nov 08 12:43:40 user nova-compute[74840]:     </nova:instance>
Nov 08 12:43:40 user nova-compute[74840]:   </metadata>
Nov 08 12:43:40 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:43:40 user nova-compute[74840]:     <system>
Nov 08 12:43:40 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:43:40 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:43:40 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:43:40 user nova-compute[74840]:       <entry name="serial">c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf</entry>
Nov 08 12:43:40 user nova-compute[74840]:       <entry name="uuid">c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf</entry>
Nov 08 12:43:40 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:43:40 user nova-compute[74840]:     </system>
Nov 08 12:43:40 user nova-compute[74840]:   </sysinfo>
Nov 08 12:43:40 user nova-compute[74840]:   <os>
Nov 08 12:43:40 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:43:40 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:43:40 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:43:40 user nova-compute[74840]:   </os>
Nov 08 12:43:40 user nova-compute[74840]:   <features>
Nov 08 12:43:40 user nova-compute[74840]:     <acpi/>
Nov 08 12:43:40 user nova-compute[74840]:     <apic/>
Nov 08 12:43:40 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:43:40 user nova-compute[74840]:   </features>
Nov 08 12:43:40 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:43:40 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:43:40 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:43:40 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:43:40 user nova-compute[74840]:   </clock>
Nov 08 12:43:40 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:43:40 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:43:40 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:43:40 user nova-compute[74840]:   </cpu>
Nov 08 12:43:40 user nova-compute[74840]:   <devices>
Nov 08 12:43:40 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:43:40 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:43:40 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf/disk"/>
Nov 08 12:43:40 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:43:40 user nova-compute[74840]:     </disk>
Nov 08 12:43:40 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:43:40 user nova-compute[74840]:       <mac address="fa:16:3e:f4:cf:dd"/>
Nov 08 12:43:40 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:43:40 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:43:40 user nova-compute[74840]:       <target dev="tap0fe1ab7b-d3"/>
Nov 08 12:43:40 user nova-compute[74840]:     </interface>
Nov 08 12:43:40 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:43:40 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf/console.log" append="off"/>
Nov 08 12:43:40 user nova-compute[74840]:     </serial>
Nov 08 12:43:40 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:43:40 user nova-compute[74840]:     <video>
Nov 08 12:43:40 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:43:40 user nova-compute[74840]:     </video>
Nov 08 12:43:40 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:43:40 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:43:40 user nova-compute[74840]:     </rng>
Nov 08 12:43:40 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:43:40 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:43:40 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:43:40 user nova-compute[74840]:     </memballoon>
Nov 08 12:43:40 user nova-compute[74840]:   </devices>
Nov 08 12:43:40 user nova-compute[74840]: </domain>
Nov 08 12:43:40 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:43:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1016291031',display_name='tempest-TestMinimumBasicScenario-server-1016291031',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1016291031',id=46,image_ref='fb6bd902-0ff7-4bbf-99b5-308600485455',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP28XUPPJPJMSa6nvlhEkvvxfAeIxKGkf0ffCl4HMfj1up76qF0QvFROqPKMV9Q9YL9WFQR+ruARvXIB+pK3zkDnL2G/bM1eQWd/Fad9kzzpD9yPXSoXQpzWqLai1C9/lg==',key_name='tempest-TestMinimumBasicScenario-1808576556',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='270eb2fc5485447f9e09d83d48fdc14f',ramdisk_id='',reservation_id='r-tw2o6si9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fb6bd902-0ff7-4bbf-99b5-308600485455',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1675831883',owner_user_name='tempest-TestMinimumBasicScenario-1675831883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:43:38Z,user_data=None,user_id='40cef2061d7a4ad9a98409cbaa0f6351',uuid=c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3", "address": "fa:16:3e:f4:cf:dd", "network": {"id": "8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1654230640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "270eb2fc5485447f9e09d83d48fdc14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe1ab7b-d3", "ovs_interfaceid": "0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Converting VIF {"id": "0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3", "address": "fa:16:3e:f4:cf:dd", "network": {"id": "8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1654230640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "270eb2fc5485447f9e09d83d48fdc14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe1ab7b-d3", "ovs_interfaceid": "0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:cf:dd,bridge_name='br-int',has_traffic_filtering=True,id=0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3,network=Network(8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fe1ab7b-d3') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG os_vif [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:cf:dd,bridge_name='br-int',has_traffic_filtering=True,id=0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3,network=Network(8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fe1ab7b-d3') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7a2c15ac-53cb-5a0c-af12-d030b5fe4c35', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0fe1ab7b-d3, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0fe1ab7b-d3, col_values=(('qos', UUID('a23d6874-8219-4458-9917-da4c70f6e5b6')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0fe1ab7b-d3, col_values=(('external_ids', {'iface-id': '0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:cf:dd', 'vm-uuid': 'c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:43:40 user nova-compute[74840]: INFO os_vif [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:cf:dd,bridge_name='br-int',has_traffic_filtering=True,id=0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3,network=Network(8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fe1ab7b-d3')
Nov 08 12:43:40 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] No VIF found with MAC fa:16:3e:f4:cf:dd, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG nova.network.neutron [req-5d57593f-8eeb-49e6-b24d-dd1ef6862cf4 req-79f8eade-d6c9-4065-a14c-1b17fa1860a1 service nova] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Updated VIF entry in instance network info cache for port 0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG nova.network.neutron [req-5d57593f-8eeb-49e6-b24d-dd1ef6862cf4 req-79f8eade-d6c9-4065-a14c-1b17fa1860a1 service nova] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Updating instance_info_cache with network_info: [{"id": "0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3", "address": "fa:16:3e:f4:cf:dd", "network": {"id": "8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1654230640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "270eb2fc5485447f9e09d83d48fdc14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe1ab7b-d3", "ovs_interfaceid": "0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:43:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-5d57593f-8eeb-49e6-b24d-dd1ef6862cf4 req-79f8eade-d6c9-4065-a14c-1b17fa1860a1 service nova] Releasing lock "refresh_cache-c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:43:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:43:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:43:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:43:41 user nova-compute[74840]: DEBUG nova.compute.manager [req-61754271-4d42-4ea2-845d-7ce2e441c722 req-48128dfd-8e23-466a-8e0b-8fd43975f78a service nova] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Received event network-vif-plugged-0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:43:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-61754271-4d42-4ea2-845d-7ce2e441c722 req-48128dfd-8e23-466a-8e0b-8fd43975f78a service nova] Acquiring lock "c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:43:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-61754271-4d42-4ea2-845d-7ce2e441c722 req-48128dfd-8e23-466a-8e0b-8fd43975f78a service nova] Lock "c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:43:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-61754271-4d42-4ea2-845d-7ce2e441c722 req-48128dfd-8e23-466a-8e0b-8fd43975f78a service nova] Lock "c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:43:41 user nova-compute[74840]: DEBUG nova.compute.manager [req-61754271-4d42-4ea2-845d-7ce2e441c722 req-48128dfd-8e23-466a-8e0b-8fd43975f78a service nova] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] No waiting events found dispatching network-vif-plugged-0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:43:41 user nova-compute[74840]: WARNING nova.compute.manager [req-61754271-4d42-4ea2-845d-7ce2e441c722 req-48128dfd-8e23-466a-8e0b-8fd43975f78a service nova] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Received unexpected event network-vif-plugged-0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3 for instance with vm_state building and task_state spawning.
Nov 08 12:43:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:43:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:43:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:43:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:43:44 user nova-compute[74840]: DEBUG nova.compute.manager [req-796aa3d8-ef38-40bc-b8dd-e36653c5d243 req-11f48aa7-5d9d-4d11-8f94-3edbc9130e7a service nova] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Received event network-vif-plugged-0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:43:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-796aa3d8-ef38-40bc-b8dd-e36653c5d243 req-11f48aa7-5d9d-4d11-8f94-3edbc9130e7a service nova] Acquiring lock "c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:43:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-796aa3d8-ef38-40bc-b8dd-e36653c5d243 req-11f48aa7-5d9d-4d11-8f94-3edbc9130e7a service nova] Lock "c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:43:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-796aa3d8-ef38-40bc-b8dd-e36653c5d243 req-11f48aa7-5d9d-4d11-8f94-3edbc9130e7a service nova] Lock "c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:43:44 user nova-compute[74840]: DEBUG nova.compute.manager [req-796aa3d8-ef38-40bc-b8dd-e36653c5d243 req-11f48aa7-5d9d-4d11-8f94-3edbc9130e7a service nova] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] No waiting events found dispatching network-vif-plugged-0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:43:44 user nova-compute[74840]: WARNING nova.compute.manager [req-796aa3d8-ef38-40bc-b8dd-e36653c5d243 req-11f48aa7-5d9d-4d11-8f94-3edbc9130e7a service nova] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Received unexpected event network-vif-plugged-0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3 for instance with vm_state building and task_state spawning.
Nov 08 12:43:44 user nova-compute[74840]: DEBUG nova.compute.manager [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:43:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:43:44 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Instance spawned successfully.
Nov 08 12:43:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:43:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Found default for hw_cdrom_bus of ide {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:43:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Found default for hw_disk_bus of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:43:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:43:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:43:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Found default for hw_video_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:43:44 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Found default for hw_vif_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:43:44 user nova-compute[74840]: INFO nova.compute.manager [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Took 6.00 seconds to spawn the instance on the hypervisor.
Nov 08 12:43:44 user nova-compute[74840]: DEBUG nova.compute.manager [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:43:44 user nova-compute[74840]: INFO nova.compute.manager [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Took 6.70 seconds to build instance.
Nov 08 12:43:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-712c0669-b196-450d-93ad-e45ee3a5b105 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.844s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:43:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:43:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:43:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:43:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:43:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:43:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 12:43:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:43:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:43:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:43:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:44:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:44:01 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Calling os-brick to attach iSCSI Volume {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 12:44:01 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qfCsNcVm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:44:01 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:44:01 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:44:01 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:44:01 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:44:01 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:44:01 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:44:01 user nova-compute[74840]: INFO os_brick.initiator.connectors.iscsi [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 12:44:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c -p 172.16.0.220:3260 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:44:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:44:01 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa058d65-fcc0-4230-8fd9-fe8744344d2c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:44:01 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 12:44:01 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:44:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c -p 172.16.0.220:3260 --interface default --op new {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:44:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:44:01 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1054b242-9234-446c-8d9f-d5e4f0542263]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c] added\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:44:01 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c] added
Nov 08 12:44:01 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:44:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:44:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:44:01 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b59cf8-027d-4389-8560-b4a1f82607df]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:44:01 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:44:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:44:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:44:01 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b141a00-16ee-47ac-8e04-338f4db1b905]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:44:01 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:44:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qfCsNcVm {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:44:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qfCsNcVm" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:44:02 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa84f7d-4c37-4f25-97e5-4c0637c065c0]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:44:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qfCsNcVm'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:44:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:44:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:44:02 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b09341-3e10-43cd-b91e-3b660715ffe4]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:44:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:44:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:44:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:44:02 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbeb81b-066e-4438-af8a-bcd2525a6501]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:44:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 12:44:02 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:44:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 12:44:02 user nova-compute[74840]:  {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:44:02 user nova-compute[74840]: WARNING os_brick.initiator.connectors.iscsi [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 12:44:02 user nova-compute[74840]: 
Nov 08 12:44:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c -p 172.16.0.220:3260 --login {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:44:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:44:02 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[612442a7-0535-4c77-9ce3-a22c6e5fbcf9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:44:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c, portal: 172.16.0.220,3260]
Nov 08 12:44:02 user nova-compute[74840]: Login to [iface: default, target: iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c, portal: 172.16.0.220,3260] successful.
Nov 08 12:44:02 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:44:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:44:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:44:02 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73899b3-e406-469a-8417-438676dd681d]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:44:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:44:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:44:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:44:02 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17dc219-4536-4e5a-ac07-9c9c4d11ea40]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:44:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c (non-flash)
Nov 08 12:44:02 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:44:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c (non-flash)
Nov 08 12:44:02 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:44:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:44:02 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Connected to 172.16.0.220:3260 {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 12:44:02 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=74840) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 12:44:02 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74840) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 12:44:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:44:02 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:44:02 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0834d4-efb3-4cbf-9314-ab68d358e713]: (4, ('- - 0', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:44:02 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: None {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:44:02 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:44:03 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:44:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qfCsNcVm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 12:44:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:44:03 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '26364633538343438', 'path': '/dev/sdb'} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:44:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364633538343438', 'path': '/dev/sdb'} {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 12:44:03 user nova-compute[74840]: DEBUG nova.objects.instance [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Lazy-loading 'flavor' on Instance uuid f6bccde5-832b-476f-95c0-10b16af6b126 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:44:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 12:44:03 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:44:03 user nova-compute[74840]:   <source dev="/dev/sdb"/>
Nov 08 12:44:03 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:44:03 user nova-compute[74840]:   <serial>3894819a-ade4-48be-aa72-8fe08f2ed68c</serial>
Nov 08 12:44:03 user nova-compute[74840]: </disk>
Nov 08 12:44:03 user nova-compute[74840]:  {{(pid=74840) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 12:44:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:44:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:44:03 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] No VIF found with MAC fa:16:3e:41:0b:a1, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:44:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-a15dcaa5-c558-4dd9-84c6-8dd7e0606ac7 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Lock "f6bccde5-832b-476f-95c0-10b16af6b126" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.962s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:44:04 user nova-compute[74840]: INFO nova.compute.manager [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Rescuing
Nov 08 12:44:04 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Acquiring lock "refresh_cache-f6bccde5-832b-476f-95c0-10b16af6b126" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:44:04 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Acquired lock "refresh_cache-f6bccde5-832b-476f-95c0-10b16af6b126" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:44:04 user nova-compute[74840]: DEBUG nova.network.neutron [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:44:05 user nova-compute[74840]: DEBUG nova.network.neutron [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Updating instance_info_cache with network_info: [{"id": "850d3852-db4b-4634-b37d-ad1e18f04a6b", "address": "fa:16:3e:41:0b:a1", "network": {"id": "a52573e9-cee6-4a6d-944d-56fe99e1c3a9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1100599758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3fd3c6c8e1c46c99adee8fdcc73bddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap850d3852-db", "ovs_interfaceid": "850d3852-db4b-4634-b37d-ad1e18f04a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:44:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Releasing lock "refresh_cache-f6bccde5-832b-476f-95c0-10b16af6b126" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:44:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:44:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:44:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:44:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:44:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:44:05 user nova-compute[74840]: DEBUG nova.compute.manager [req-10dd9068-f34d-4a23-a66b-e4c485ebead0 req-1fac72e2-e59b-43f9-8cca-23aceabc005c service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Received event network-vif-unplugged-850d3852-db4b-4634-b37d-ad1e18f04a6b {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:44:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-10dd9068-f34d-4a23-a66b-e4c485ebead0 req-1fac72e2-e59b-43f9-8cca-23aceabc005c service nova] Acquiring lock "f6bccde5-832b-476f-95c0-10b16af6b126-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:44:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-10dd9068-f34d-4a23-a66b-e4c485ebead0 req-1fac72e2-e59b-43f9-8cca-23aceabc005c service nova] Lock "f6bccde5-832b-476f-95c0-10b16af6b126-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:44:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-10dd9068-f34d-4a23-a66b-e4c485ebead0 req-1fac72e2-e59b-43f9-8cca-23aceabc005c service nova] Lock "f6bccde5-832b-476f-95c0-10b16af6b126-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:44:05 user nova-compute[74840]: DEBUG nova.compute.manager [req-10dd9068-f34d-4a23-a66b-e4c485ebead0 req-1fac72e2-e59b-43f9-8cca-23aceabc005c service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] No waiting events found dispatching network-vif-unplugged-850d3852-db4b-4634-b37d-ad1e18f04a6b {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:44:05 user nova-compute[74840]: WARNING nova.compute.manager [req-10dd9068-f34d-4a23-a66b-e4c485ebead0 req-1fac72e2-e59b-43f9-8cca-23aceabc005c service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Received unexpected event network-vif-unplugged-850d3852-db4b-4634-b37d-ad1e18f04a6b for instance with vm_state active and task_state rescuing.
Nov 08 12:44:05 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Instance destroyed successfully.
Nov 08 12:44:05 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Attempting a stable device rescue
Nov 08 12:44:06 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74840) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 12:44:06 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Instance directory exists: not creating {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 12:44:06 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Creating image(s)
Nov 08 12:44:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Acquiring lock "/opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:44:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Lock "/opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:44:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Lock "/opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:44:06 user nova-compute[74840]: DEBUG nova.objects.instance [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Lazy-loading 'trusted_certs' on Instance uuid f6bccde5-832b-476f-95c0-10b16af6b126 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:44:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Acquiring lock "dff9c7599e020f0693d65ebf0773334bf4185e75" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:44:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Lock "dff9c7599e020f0693d65ebf0773334bf4185e75" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:44:06 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dff9c7599e020f0693d65ebf0773334bf4185e75.part --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:44:07 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dff9c7599e020f0693d65ebf0773334bf4185e75.part --force-share --output=json" returned: 0 in 0.167s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:44:07 user nova-compute[74840]: DEBUG nova.virt.images [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] 27a1e0ec-576d-4c3a-82f4-30368a4e5b89 was qcow2, converting to raw {{(pid=74840) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 12:44:07 user nova-compute[74840]: DEBUG nova.privsep.utils [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74840) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 12:44:07 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dff9c7599e020f0693d65ebf0773334bf4185e75.part /opt/stack/data/nova/instances/_base/dff9c7599e020f0693d65ebf0773334bf4185e75.converted {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:44:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:44:07 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dff9c7599e020f0693d65ebf0773334bf4185e75.part /opt/stack/data/nova/instances/_base/dff9c7599e020f0693d65ebf0773334bf4185e75.converted" returned: 0 in 0.267s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:44:07 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dff9c7599e020f0693d65ebf0773334bf4185e75.converted --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:44:07 user nova-compute[74840]: DEBUG nova.compute.manager [req-85b3696d-6f17-48dd-b1f9-33100d3a9ab1 req-7e0d0333-0413-47d2-afac-9760762c12d7 service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Received event network-vif-plugged-850d3852-db4b-4634-b37d-ad1e18f04a6b {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:44:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-85b3696d-6f17-48dd-b1f9-33100d3a9ab1 req-7e0d0333-0413-47d2-afac-9760762c12d7 service nova] Acquiring lock "f6bccde5-832b-476f-95c0-10b16af6b126-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:44:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-85b3696d-6f17-48dd-b1f9-33100d3a9ab1 req-7e0d0333-0413-47d2-afac-9760762c12d7 service nova] Lock "f6bccde5-832b-476f-95c0-10b16af6b126-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:44:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-85b3696d-6f17-48dd-b1f9-33100d3a9ab1 req-7e0d0333-0413-47d2-afac-9760762c12d7 service nova] Lock "f6bccde5-832b-476f-95c0-10b16af6b126-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:44:07 user nova-compute[74840]: DEBUG nova.compute.manager [req-85b3696d-6f17-48dd-b1f9-33100d3a9ab1 req-7e0d0333-0413-47d2-afac-9760762c12d7 service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] No waiting events found dispatching network-vif-plugged-850d3852-db4b-4634-b37d-ad1e18f04a6b {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:44:07 user nova-compute[74840]: WARNING nova.compute.manager [req-85b3696d-6f17-48dd-b1f9-33100d3a9ab1 req-7e0d0333-0413-47d2-afac-9760762c12d7 service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Received unexpected event network-vif-plugged-850d3852-db4b-4634-b37d-ad1e18f04a6b for instance with vm_state active and task_state rescuing.
Nov 08 12:44:07 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dff9c7599e020f0693d65ebf0773334bf4185e75.converted --force-share --output=json" returned: 0 in 0.174s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:44:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Lock "dff9c7599e020f0693d65ebf0773334bf4185e75" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.552s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:44:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Acquiring lock "dff9c7599e020f0693d65ebf0773334bf4185e75" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:44:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Lock "dff9c7599e020f0693d65ebf0773334bf4185e75" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:44:07 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dff9c7599e020f0693d65ebf0773334bf4185e75 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:44:07 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dff9c7599e020f0693d65ebf0773334bf4185e75 --force-share --output=json" returned: 0 in 0.196s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:44:07 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dff9c7599e020f0693d65ebf0773334bf4185e75,backing_fmt=raw /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk.rescue {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:44:07 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dff9c7599e020f0693d65ebf0773334bf4185e75,backing_fmt=raw /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk.rescue" returned: 0 in 0.047s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:44:07 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Lock "dff9c7599e020f0693d65ebf0773334bf4185e75" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:44:07 user nova-compute[74840]: DEBUG nova.objects.instance [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Lazy-loading 'migration_context' on Instance uuid f6bccde5-832b-476f-95c0-10b16af6b126 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:44:07 user nova-compute[74840]: DEBUG nova.objects.base [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Object Instance<f6bccde5-832b-476f-95c0-10b16af6b126> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:44:07 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Created local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 12:44:07 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Start _get_guest_xml network_info=[{"id": "850d3852-db4b-4634-b37d-ad1e18f04a6b", "address": "fa:16:3e:41:0b:a1", "network": {"id": "a52573e9-cee6-4a6d-944d-56fe99e1c3a9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1100599758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1100599758-network", "vif_mac": "fa:16:3e:41:0b:a1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3fd3c6c8e1c46c99adee8fdcc73bddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap850d3852-db", "ovs_interfaceid": "850d3852-db4b-4634-b37d-ad1e18f04a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '27a1e0ec-576d-4c3a-82f4-30368a4e5b89', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'image_id': '4fa17706-d304-4117-a420-dab994c703dc'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '47597091-bd9b-4fe1-9768-762951a57a49', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qfCsNcVm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'f6bccde5-832b-476f-95c0-10b16af6b126', 'attached_at': '', 'detached_at': '', 'volume_id': '3894819a-ade4-48be-aa72-8fe08f2ed68c', 'serial': '3894819a-ade4-48be-aa72-8fe08f2ed68c'}, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:44:07 user nova-compute[74840]: DEBUG nova.objects.instance [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Lazy-loading 'resources' on Instance uuid f6bccde5-832b-476f-95c0-10b16af6b126 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:44:07 user nova-compute[74840]: DEBUG nova.objects.base [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Object Instance<f6bccde5-832b-476f-95c0-10b16af6b126> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:44:07 user nova-compute[74840]: DEBUG nova.objects.instance [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Lazy-loading 'numa_topology' on Instance uuid f6bccde5-832b-476f-95c0-10b16af6b126 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:44:07 user nova-compute[74840]: DEBUG nova.objects.base [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Object Instance<f6bccde5-832b-476f-95c0-10b16af6b126> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:44:07 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:44:07 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:44:07 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:44:07 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:44:07 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:44:07 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:44:07 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:44:07 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:44:07 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:44:07 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:44:07 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:44:07 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:44:07 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:44:07 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:44:07 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:44:07 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:44:07 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:44:07 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:44:07 user nova-compute[74840]: DEBUG nova.objects.instance [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Lazy-loading 'vcpu_model' on Instance uuid f6bccde5-832b-476f-95c0-10b16af6b126 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:44:07 user nova-compute[74840]: DEBUG nova.objects.base [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Object Instance<f6bccde5-832b-476f-95c0-10b16af6b126> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:44:07 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Calling os-brick to attach iSCSI Volume {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 12:44:07 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qfCsNcVm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:44:07 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:44:07 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:44:07 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:44:07 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:44:07 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:44:07 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:44:07 user nova-compute[74840]: INFO os_brick.initiator.connectors.iscsi [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 12:44:07 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c -p 172.16.0.220:3260 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:44:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:44:08 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c01ba8-33f1-4c1a-924d-872d56ea6557]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = qfCsNcVm\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:44:08 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 08 12:44:08 user nova-compute[74840]: node.name = iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c
Nov 08 12:44:08 user nova-compute[74840]: node.tpgt = -1
Nov 08 12:44:08 user nova-compute[74840]: node.startup = automatic
Nov 08 12:44:08 user nova-compute[74840]: node.leading_login = No
Nov 08 12:44:08 user nova-compute[74840]: iface.iscsi_ifacename = default
Nov 08 12:44:08 user nova-compute[74840]: iface.net_ifacename = <empty>
Nov 08 12:44:08 user nova-compute[74840]: iface.ipaddress = <empty>
Nov 08 12:44:08 user nova-compute[74840]: iface.prefix_len = 0
Nov 08 12:44:08 user nova-compute[74840]: iface.hwaddress = <empty>
Nov 08 12:44:08 user nova-compute[74840]: iface.transport_name = tcp
Nov 08 12:44:08 user nova-compute[74840]: iface.initiatorname = <empty>
Nov 08 12:44:08 user nova-compute[74840]: iface.state = <empty>
Nov 08 12:44:08 user nova-compute[74840]: iface.vlan_id = 0
Nov 08 12:44:08 user nova-compute[74840]: iface.vlan_priority = 0
Nov 08 12:44:08 user nova-compute[74840]: iface.vlan_state = <empty>
Nov 08 12:44:08 user nova-compute[74840]: iface.iface_num = 0
Nov 08 12:44:08 user nova-compute[74840]: iface.mtu = 0
Nov 08 12:44:08 user nova-compute[74840]: iface.port = 0
Nov 08 12:44:08 user nova-compute[74840]: iface.bootproto = <empty>
Nov 08 12:44:08 user nova-compute[74840]: iface.subnet_mask = <empty>
Nov 08 12:44:08 user nova-compute[74840]: iface.gateway = <empty>
Nov 08 12:44:08 user nova-compute[74840]: iface.dhcp_alt_client_id_state = <empty>
Nov 08 12:44:08 user nova-compute[74840]: iface.dhcp_alt_client_id = <empty>
Nov 08 12:44:08 user nova-compute[74840]: iface.dhcp_dns = <empty>
Nov 08 12:44:08 user nova-compute[74840]: iface.dhcp_learn_iqn = <empty>
Nov 08 12:44:08 user nova-compute[74840]: iface.dhcp_req_vendor_id_state = <empty>
Nov 08 12:44:08 user nova-compute[74840]: iface.dhcp_vendor_id_state = <empty>
Nov 08 12:44:08 user nova-compute[74840]: iface.dhcp_vendor_id = <empty>
Nov 08 12:44:08 user nova-compute[74840]: iface.dhcp_slp_da = <empty>
Nov 08 12:44:08 user nova-compute[74840]: iface.fragmentation = <empty>
Nov 08 12:44:08 user nova-compute[74840]: iface.gratuitous_arp = <empty>
Nov 08 12:44:08 user nova-compute[74840]: iface.incoming_forwarding = <empty>
Nov 08 12:44:08 user nova-compute[74840]: iface.tos_state = <empty>
Nov 08 12:44:08 user nova-compute[74840]: iface.tos = 0
Nov 08 12:44:08 user nova-compute[74840]: iface.ttl = 0
Nov 08 12:44:08 user nova-compute[74840]: iface.delayed_ack = <empty>
Nov 08 12:44:08 user nova-compute[74840]: iface.tcp_nagle = <empty>
Nov 08 12:44:08 user nova-compute[74840]: iface.tcp_wsf_state = <empty>
Nov 08 12:44:08 user nova-compute[74840]: iface.tcp_wsf = 0
Nov 08 12:44:08 user nova-compute[74840]: iface.tcp_timer_scale = 0
Nov 08 12:44:08 user nova-compute[74840]: iface.tcp_timestamp = <empty>
Nov 08 12:44:08 user nova-compute[74840]: iface.redirect = <empty>
Nov 08 12:44:08 user nova-compute[74840]: iface.def_task_mgmt_timeout = 0
Nov 08 12:44:08 user nova-compute[74840]: iface.header_digest = <empty>
Nov 08 12:44:08 user nova-compute[74840]: iface.data_digest = <empty>
Nov 08 12:44:08 user nova-compute[74840]: iface.immediate_data = <empty>
Nov 08 12:44:08 user nova-compute[74840]: iface.initial_r2t = <empty>
Nov 08 12:44:08 user nova-compute[74840]: iface.data_seq_inorder = <empty>
Nov 08 12:44:08 user nova-compute[74840]: iface.data_pdu_inorder = <empty>
Nov 08 12:44:08 user nova-compute[74840]: iface.erl = 0
Nov 08 12:44:08 user nova-compute[74840]: iface.max_receive_data_len = 0
Nov 08 12:44:08 user nova-compute[74840]: iface.first_burst_len = 0
Nov 08 12:44:08 user nova-compute[74840]: iface.max_outstanding_r2t = 0
Nov 08 12:44:08 user nova-compute[74840]: iface.max_burst_len = 0
Nov 08 12:44:08 user nova-compute[74840]: iface.chap_auth = <empty>
Nov 08 12:44:08 user nova-compute[74840]: iface.bidi_chap = <empty>
Nov 08 12:44:08 user nova-compute[74840]: iface.strict_login_compliance = <empty>
Nov 08 12:44:08 user nova-compute[74840]: iface.discovery_auth = <empty>
Nov 08 12:44:08 user nova-compute[74840]: iface.discovery_logout = <empty>
Nov 08 12:44:08 user nova-compute[74840]: node.discovery_address = <empty>
Nov 08 12:44:08 user nova-compute[74840]: node.discovery_port = 0
Nov 08 12:44:08 user nova-compute[74840]: node.discovery_type = static
Nov 08 12:44:08 user nova-compute[74840]: node.session.initial_cmdsn = 0
Nov 08 12:44:08 user nova-compute[74840]: node.session.initial_login_retry_max = 8
Nov 08 12:44:08 user nova-compute[74840]: node.session.xmit_thread_priority = -20
Nov 08 12:44:08 user nova-compute[74840]: node.session.cmds_max = 128
Nov 08 12:44:08 user nova-compute[74840]: node.session.queue_depth = 32
Nov 08 12:44:08 user nova-compute[74840]: node.session.nr_sessions = 1
Nov 08 12:44:08 user nova-compute[74840]: node.session.auth.authmethod = CHAP
Nov 08 12:44:08 user nova-compute[74840]: node.session.auth.username = qfCsNcVm
Nov 08 12:44:08 user nova-compute[74840]: node.session.auth.password = ***
Nov 08 12:44:08 user nova-compute[74840]: node.session.auth.username_in = <empty>
Nov 08 12:44:08 user nova-compute[74840]: node.session.auth.password_in = <empty>
Nov 08 12:44:08 user nova-compute[74840]: node.session.auth.chap_algs = MD5
Nov 08 12:44:08 user nova-compute[74840]: node.session.timeo.replacement_timeout = 120
Nov 08 12:44:08 user nova-compute[74840]: node.session.err_timeo.abort_timeout = 15
Nov 08 12:44:08 user nova-compute[74840]: node.session.err_timeo.lu_reset_timeout = 30
Nov 08 12:44:08 user nova-compute[74840]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 08 12:44:08 user nova-compute[74840]: node.session.err_timeo.host_reset_timeout = 60
Nov 08 12:44:08 user nova-compute[74840]: node.session.iscsi.FastAbort = Yes
Nov 08 12:44:08 user nova-compute[74840]: node.session.iscsi.InitialR2T = No
Nov 08 12:44:08 user nova-compute[74840]: node.session.iscsi.ImmediateData = Yes
Nov 08 12:44:08 user nova-compute[74840]: node.session.iscsi.FirstBurstLength = 262144
Nov 08 12:44:08 user nova-compute[74840]: node.session.iscsi.MaxBurstLength = 16776192
Nov 08 12:44:08 user nova-compute[74840]: node.session.iscsi.DefaultTime2Retain = 0
Nov 08 12:44:08 user nova-compute[74840]: node.session.iscsi.DefaultTime2Wait = 2
Nov 08 12:44:08 user nova-compute[74840]: node.session.iscsi.MaxConnections = 1
Nov 08 12:44:08 user nova-compute[74840]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 08 12:44:08 user nova-compute[74840]: node.session.iscsi.ERL = 0
Nov 08 12:44:08 user nova-compute[74840]: node.session.scan = manual
Nov 08 12:44:08 user nova-compute[74840]: node.session.reopen_max = 0
Nov 08 12:44:08 user nova-compute[74840]: node.conn[0].address = 172.16.0.220
Nov 08 12:44:08 user nova-compute[74840]: node.conn[0].port = 3260
Nov 08 12:44:08 user nova-compute[74840]: node.conn[0].startup = manual
Nov 08 12:44:08 user nova-compute[74840]: node.conn[0].tcp.window_size = 524288
Nov 08 12:44:08 user nova-compute[74840]: node.conn[0].tcp.type_of_service = 0
Nov 08 12:44:08 user nova-compute[74840]: node.conn[0].timeo.logout_timeout = 15
Nov 08 12:44:08 user nova-compute[74840]: node.conn[0].timeo.login_timeout = 15
Nov 08 12:44:08 user nova-compute[74840]: node.conn[0].timeo.auth_timeout = 45
Nov 08 12:44:08 user nova-compute[74840]: node.conn[0].timeo.noop_out_interval = 5
Nov 08 12:44:08 user nova-compute[74840]: node.conn[0].timeo.noop_out_timeout = 5
Nov 08 12:44:08 user nova-compute[74840]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 08 12:44:08 user nova-compute[74840]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 08 12:44:08 user nova-compute[74840]: node.conn[0].iscsi.HeaderDigest = None
Nov 08 12:44:08 user nova-compute[74840]: node.conn[0].iscsi.DataDigest = None
Nov 08 12:44:08 user nova-compute[74840]: node.conn[0].iscsi.IFMarker = No
Nov 08 12:44:08 user nova-compute[74840]: node.conn[0].iscsi.OFMarker = No
Nov 08 12:44:08 user nova-compute[74840]: # END RECORD
Nov 08 12:44:08 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:44:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:44:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:44:08 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[489ddb62-ade0-408f-9474-02c152f8a68f]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:44:08 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:44:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:44:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:44:08 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bdb47c6-16e1-48e8-866e-40897d75f2c3]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:44:08 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:44:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qfCsNcVm {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:44:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qfCsNcVm" returned: 0 in 0.016s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:44:08 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8ec66d-5c59-4820-991f-f8d5bcd89aad]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:44:08 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qfCsNcVm'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:44:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:44:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:44:08 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaac3258-7f65-4c01-adeb-c3dd9627fb2b]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:44:08 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:44:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:44:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:44:08 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7389cacb-1cf6-495e-8a04-055f01a4902c]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:44:08 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c (non-flash)
Nov 08 12:44:08 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:44:08 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c (non-flash)
Nov 08 12:44:08 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:44:08 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.125s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:44:08 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Connected to 172.16.0.220:3260 {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 12:44:08 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] HCTL ('33', '0', '0', 0) found on session 48 with lun 0 {{(pid=74840) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 12:44:08 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74840) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 12:44:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:44:08 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:44:08 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91355e3-00e7-47e9-845f-a19a7e73546e]: (4, ('0 0 0', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:44:08 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Searching for a device in session 48 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:44:08 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qfCsNcVm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 12:44:08 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.148s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:44:08 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] <== connect_volume: return (150ms) {'type': 'block', 'scsi_wwn': '26364633538343438', 'path': '/dev/sdb'} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:44:08 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364633538343438', 'path': '/dev/sdb'} {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 12:44:08 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:39:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1299138905',display_name='tempest-ServerStableDeviceRescueTest-server-1299138905',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1299138905',id=45,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqa/+iNxPeIQYD3fLVa0jz66LjeWDnwNuOQk1VW3EmJ7Go0FB1KgI7HiVq2xPRo/3cUnAUmUNTqS4etPW+TkhZHwcnmFn5gt2tpGmOQDIvxOymmXIi5GxQ6a3v7+Mu/mg==',key_name='tempest-keypair-1162134661',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:40:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d3fd3c6c8e1c46c99adee8fdcc73bddd',ramdisk_id='',reservation_id='r-it2qamc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-950232424',owner_user_name='tempest-ServerStableDeviceRescueTest-950232424-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:41:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='95152d14cd714fa494e353afb9ffccec',uuid=f6bccde5-832b-476f-95c0-10b16af6b126,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "850d3852-db4b-4634-b37d-ad1e18f04a6b", "address": "fa:16:3e:41:0b:a1", "network": {"id": "a52573e9-cee6-4a6d-944d-56fe99e1c3a9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1100599758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1100599758-network", "vif_mac": "fa:16:3e:41:0b:a1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3fd3c6c8e1c46c99adee8fdcc73bddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap850d3852-db", "ovs_interfaceid": "850d3852-db4b-4634-b37d-ad1e18f04a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:44:08 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Converting VIF {"id": "850d3852-db4b-4634-b37d-ad1e18f04a6b", "address": "fa:16:3e:41:0b:a1", "network": {"id": "a52573e9-cee6-4a6d-944d-56fe99e1c3a9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1100599758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1100599758-network", "vif_mac": "fa:16:3e:41:0b:a1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3fd3c6c8e1c46c99adee8fdcc73bddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap850d3852-db", "ovs_interfaceid": "850d3852-db4b-4634-b37d-ad1e18f04a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:44:08 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:0b:a1,bridge_name='br-int',has_traffic_filtering=True,id=850d3852-db4b-4634-b37d-ad1e18f04a6b,network=Network(a52573e9-cee6-4a6d-944d-56fe99e1c3a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap850d3852-db') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:44:08 user nova-compute[74840]: DEBUG nova.objects.instance [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Lazy-loading 'pci_devices' on Instance uuid f6bccde5-832b-476f-95c0-10b16af6b126 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:44:08 user nova-compute[74840]: DEBUG nova.objects.base [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Object Instance<f6bccde5-832b-476f-95c0-10b16af6b126> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:44:08 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:44:08 user nova-compute[74840]:   <uuid>f6bccde5-832b-476f-95c0-10b16af6b126</uuid>
Nov 08 12:44:08 user nova-compute[74840]:   <name>instance-0000002d</name>
Nov 08 12:44:08 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:44:08 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:44:08 user nova-compute[74840]:   <metadata>
Nov 08 12:44:08 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:44:08 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:44:08 user nova-compute[74840]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1299138905</nova:name>
Nov 08 12:44:08 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:44:07</nova:creationTime>
Nov 08 12:44:08 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:44:08 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:44:08 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:44:08 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:44:08 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:44:08 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:44:08 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:44:08 user nova-compute[74840]:       <nova:owner>
Nov 08 12:44:08 user nova-compute[74840]:         <nova:user uuid="95152d14cd714fa494e353afb9ffccec">tempest-ServerStableDeviceRescueTest-950232424-project-member</nova:user>
Nov 08 12:44:08 user nova-compute[74840]:         <nova:project uuid="d3fd3c6c8e1c46c99adee8fdcc73bddd">tempest-ServerStableDeviceRescueTest-950232424</nova:project>
Nov 08 12:44:08 user nova-compute[74840]:       </nova:owner>
Nov 08 12:44:08 user nova-compute[74840]:       <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:44:08 user nova-compute[74840]:       <nova:ports>
Nov 08 12:44:08 user nova-compute[74840]:         <nova:port uuid="850d3852-db4b-4634-b37d-ad1e18f04a6b">
Nov 08 12:44:08 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 12:44:08 user nova-compute[74840]:         </nova:port>
Nov 08 12:44:08 user nova-compute[74840]:       </nova:ports>
Nov 08 12:44:08 user nova-compute[74840]:     </nova:instance>
Nov 08 12:44:08 user nova-compute[74840]:   </metadata>
Nov 08 12:44:08 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:44:08 user nova-compute[74840]:     <system>
Nov 08 12:44:08 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:44:08 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:44:08 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:44:08 user nova-compute[74840]:       <entry name="serial">f6bccde5-832b-476f-95c0-10b16af6b126</entry>
Nov 08 12:44:08 user nova-compute[74840]:       <entry name="uuid">f6bccde5-832b-476f-95c0-10b16af6b126</entry>
Nov 08 12:44:08 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:44:08 user nova-compute[74840]:     </system>
Nov 08 12:44:08 user nova-compute[74840]:   </sysinfo>
Nov 08 12:44:08 user nova-compute[74840]:   <os>
Nov 08 12:44:08 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:44:08 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:44:08 user nova-compute[74840]:   </os>
Nov 08 12:44:08 user nova-compute[74840]:   <features>
Nov 08 12:44:08 user nova-compute[74840]:     <acpi/>
Nov 08 12:44:08 user nova-compute[74840]:     <apic/>
Nov 08 12:44:08 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:44:08 user nova-compute[74840]:   </features>
Nov 08 12:44:08 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:44:08 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:44:08 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:44:08 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:44:08 user nova-compute[74840]:   </clock>
Nov 08 12:44:08 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:44:08 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:44:08 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:44:08 user nova-compute[74840]:   </cpu>
Nov 08 12:44:08 user nova-compute[74840]:   <devices>
Nov 08 12:44:08 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:44:08 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:44:08 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk"/>
Nov 08 12:44:08 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:44:08 user nova-compute[74840]:     </disk>
Nov 08 12:44:08 user nova-compute[74840]:     <disk type="block" device="disk">
Nov 08 12:44:08 user nova-compute[74840]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:44:08 user nova-compute[74840]:       <source dev="/dev/sdb"/>
Nov 08 12:44:08 user nova-compute[74840]:       <target dev="vdb" bus="virtio"/>
Nov 08 12:44:08 user nova-compute[74840]:       <serial>3894819a-ade4-48be-aa72-8fe08f2ed68c</serial>
Nov 08 12:44:08 user nova-compute[74840]:     </disk>
Nov 08 12:44:08 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:44:08 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:44:08 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk.rescue"/>
Nov 08 12:44:08 user nova-compute[74840]:       <target dev="vdc" bus="virtio"/>
Nov 08 12:44:08 user nova-compute[74840]:       <boot order="1"/>
Nov 08 12:44:08 user nova-compute[74840]:     </disk>
Nov 08 12:44:08 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:44:08 user nova-compute[74840]:       <mac address="fa:16:3e:41:0b:a1"/>
Nov 08 12:44:08 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:44:08 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:44:08 user nova-compute[74840]:       <target dev="tap850d3852-db"/>
Nov 08 12:44:08 user nova-compute[74840]:     </interface>
Nov 08 12:44:08 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:44:08 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/console.log" append="off"/>
Nov 08 12:44:08 user nova-compute[74840]:     </serial>
Nov 08 12:44:08 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:44:08 user nova-compute[74840]:     <video>
Nov 08 12:44:08 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:44:08 user nova-compute[74840]:     </video>
Nov 08 12:44:08 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:44:08 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:44:08 user nova-compute[74840]:     </rng>
Nov 08 12:44:08 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:44:08 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:44:08 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:44:08 user nova-compute[74840]:     </memballoon>
Nov 08 12:44:08 user nova-compute[74840]:   </devices>
Nov 08 12:44:08 user nova-compute[74840]: </domain>
Nov 08 12:44:08 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:44:08 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Instance destroyed successfully.
Nov 08 12:44:08 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:44:08 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:44:08 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:44:08 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] No VIF found with MAC fa:16:3e:41:0b:a1, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:44:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:44:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:44:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:44:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:44:09 user nova-compute[74840]: DEBUG nova.compute.manager [req-94f91bde-ecc5-4f69-ab99-ae26a373a41c req-3068b0ef-b277-40fb-a28a-f19d27bb0068 service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Received event network-vif-plugged-850d3852-db4b-4634-b37d-ad1e18f04a6b {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:44:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-94f91bde-ecc5-4f69-ab99-ae26a373a41c req-3068b0ef-b277-40fb-a28a-f19d27bb0068 service nova] Acquiring lock "f6bccde5-832b-476f-95c0-10b16af6b126-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:44:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-94f91bde-ecc5-4f69-ab99-ae26a373a41c req-3068b0ef-b277-40fb-a28a-f19d27bb0068 service nova] Lock "f6bccde5-832b-476f-95c0-10b16af6b126-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:44:09 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-94f91bde-ecc5-4f69-ab99-ae26a373a41c req-3068b0ef-b277-40fb-a28a-f19d27bb0068 service nova] Lock "f6bccde5-832b-476f-95c0-10b16af6b126-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:44:09 user nova-compute[74840]: DEBUG nova.compute.manager [req-94f91bde-ecc5-4f69-ab99-ae26a373a41c req-3068b0ef-b277-40fb-a28a-f19d27bb0068 service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] No waiting events found dispatching network-vif-plugged-850d3852-db4b-4634-b37d-ad1e18f04a6b {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:44:09 user nova-compute[74840]: WARNING nova.compute.manager [req-94f91bde-ecc5-4f69-ab99-ae26a373a41c req-3068b0ef-b277-40fb-a28a-f19d27bb0068 service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Received unexpected event network-vif-plugged-850d3852-db4b-4634-b37d-ad1e18f04a6b for instance with vm_state active and task_state rescuing.
Nov 08 12:44:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:44:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:44:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:44:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:44:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:44:11 user nova-compute[74840]: DEBUG nova.compute.manager [None req-28527845-fa39-45b4-a261-f931bf8fde5f tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:44:11 user nova-compute[74840]: DEBUG nova.compute.manager [req-96db77a4-fbe9-4713-8110-bc799da5f368 req-77a3dc6c-d65f-4aed-8c68-6358472e4360 service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Received event network-vif-plugged-850d3852-db4b-4634-b37d-ad1e18f04a6b {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:44:11 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-96db77a4-fbe9-4713-8110-bc799da5f368 req-77a3dc6c-d65f-4aed-8c68-6358472e4360 service nova] Acquiring lock "f6bccde5-832b-476f-95c0-10b16af6b126-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:44:11 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-96db77a4-fbe9-4713-8110-bc799da5f368 req-77a3dc6c-d65f-4aed-8c68-6358472e4360 service nova] Lock "f6bccde5-832b-476f-95c0-10b16af6b126-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:44:11 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-96db77a4-fbe9-4713-8110-bc799da5f368 req-77a3dc6c-d65f-4aed-8c68-6358472e4360 service nova] Lock "f6bccde5-832b-476f-95c0-10b16af6b126-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:44:11 user nova-compute[74840]: DEBUG nova.compute.manager [req-96db77a4-fbe9-4713-8110-bc799da5f368 req-77a3dc6c-d65f-4aed-8c68-6358472e4360 service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] No waiting events found dispatching network-vif-plugged-850d3852-db4b-4634-b37d-ad1e18f04a6b {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:44:11 user nova-compute[74840]: WARNING nova.compute.manager [req-96db77a4-fbe9-4713-8110-bc799da5f368 req-77a3dc6c-d65f-4aed-8c68-6358472e4360 service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Received unexpected event network-vif-plugged-850d3852-db4b-4634-b37d-ad1e18f04a6b for instance with vm_state rescued and task_state None.
Nov 08 12:44:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:44:12 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:44:12 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:44:13 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:44:13 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:44:13 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Rebuilding the list of instances to heal {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 12:44:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "refresh_cache-10c42516-62ba-4aa9-bc5a-d94499bd6b65" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:44:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquired lock "refresh_cache-10c42516-62ba-4aa9-bc5a-d94499bd6b65" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:44:13 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Forcefully refreshing network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 12:44:13 user nova-compute[74840]: DEBUG nova.objects.instance [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lazy-loading 'info_cache' on Instance uuid 10c42516-62ba-4aa9-bc5a-d94499bd6b65 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:44:14 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Updating instance_info_cache with network_info: [{"id": "7cf349fa-e382-4526-af9d-f60a53d870cb", "address": "fa:16:3e:97:67:76", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cf349fa-e3", "ovs_interfaceid": "7cf349fa-e382-4526-af9d-f60a53d870cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:44:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Releasing lock "refresh_cache-10c42516-62ba-4aa9-bc5a-d94499bd6b65" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:44:14 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Updated the network info_cache for instance {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 12:44:14 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:44:14 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:44:14 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:44:15 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:44:16 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:44:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:44:17 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:44:18 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:44:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:44:23 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:44:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:44:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:44:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:44:23 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:44:23 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:44:23 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:44:23 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:44:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:44:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:44:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:44:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:44:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:44:24 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:44:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk.rescue --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:44:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:44:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk.rescue --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:44:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:44:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:44:25 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:44:25 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:44:25 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:44:25 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:44:25 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:44:25 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:44:25 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=8651MB free_disk=24.705944061279297GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:44:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:44:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:44:25 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 10c42516-62ba-4aa9-bc5a-d94499bd6b65 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:44:25 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance f6bccde5-832b-476f-95c0-10b16af6b126 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:44:25 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:44:25 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:44:25 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:44:25 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:44:25 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:44:25 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:44:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.252s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:44:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:44:30 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:44:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-568a76bf-f5ef-4864-bb29-9592a5271155 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "10c42516-62ba-4aa9-bc5a-d94499bd6b65" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:44:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-568a76bf-f5ef-4864-bb29-9592a5271155 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "10c42516-62ba-4aa9-bc5a-d94499bd6b65" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:44:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-568a76bf-f5ef-4864-bb29-9592a5271155 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "10c42516-62ba-4aa9-bc5a-d94499bd6b65-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:44:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-568a76bf-f5ef-4864-bb29-9592a5271155 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "10c42516-62ba-4aa9-bc5a-d94499bd6b65-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:44:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-568a76bf-f5ef-4864-bb29-9592a5271155 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "10c42516-62ba-4aa9-bc5a-d94499bd6b65-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:44:31 user nova-compute[74840]: INFO nova.compute.manager [None req-568a76bf-f5ef-4864-bb29-9592a5271155 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Terminating instance
Nov 08 12:44:31 user nova-compute[74840]: DEBUG nova.compute.manager [None req-568a76bf-f5ef-4864-bb29-9592a5271155 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Start destroying the instance on the hypervisor. {{(pid=74840) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 12:44:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:44:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:44:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:44:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:44:31 user nova-compute[74840]: DEBUG nova.compute.manager [req-59e74f8a-d4e5-4b03-84a9-7c4e89101877 req-fd89f894-a6f7-4979-9e9c-7cb2d349e5c3 service nova] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Received event network-vif-unplugged-7cf349fa-e382-4526-af9d-f60a53d870cb {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:44:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-59e74f8a-d4e5-4b03-84a9-7c4e89101877 req-fd89f894-a6f7-4979-9e9c-7cb2d349e5c3 service nova] Acquiring lock "10c42516-62ba-4aa9-bc5a-d94499bd6b65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:44:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-59e74f8a-d4e5-4b03-84a9-7c4e89101877 req-fd89f894-a6f7-4979-9e9c-7cb2d349e5c3 service nova] Lock "10c42516-62ba-4aa9-bc5a-d94499bd6b65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:44:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-59e74f8a-d4e5-4b03-84a9-7c4e89101877 req-fd89f894-a6f7-4979-9e9c-7cb2d349e5c3 service nova] Lock "10c42516-62ba-4aa9-bc5a-d94499bd6b65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:44:31 user nova-compute[74840]: DEBUG nova.compute.manager [req-59e74f8a-d4e5-4b03-84a9-7c4e89101877 req-fd89f894-a6f7-4979-9e9c-7cb2d349e5c3 service nova] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] No waiting events found dispatching network-vif-unplugged-7cf349fa-e382-4526-af9d-f60a53d870cb {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:44:31 user nova-compute[74840]: DEBUG nova.compute.manager [req-59e74f8a-d4e5-4b03-84a9-7c4e89101877 req-fd89f894-a6f7-4979-9e9c-7cb2d349e5c3 service nova] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Received event network-vif-unplugged-7cf349fa-e382-4526-af9d-f60a53d870cb for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:44:31 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Instance destroyed successfully.
Nov 08 12:44:31 user nova-compute[74840]: DEBUG nova.objects.instance [None req-568a76bf-f5ef-4864-bb29-9592a5271155 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lazy-loading 'resources' on Instance uuid 10c42516-62ba-4aa9-bc5a-d94499bd6b65 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:44:31 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-568a76bf-f5ef-4864-bb29-9592a5271155 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:24:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1092983192',display_name='tempest-ServerActionsTestOtherA-server-1092983192',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1092983192',id=31,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAmkFC6dPojPaRdPJh94q0/wuvRVxh1HPsrsmItydl0iUnCu6UdbkD5pi9CgzgYpLamuUC6eRZK4fPtOQ5ReX7Sfuo5mKd9gSajCUuWaRBqISYVRzAbikSahnbP3hsO0g==',key_name='tempest-keypair-428361338',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:25:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5e47ef156b3649839ff728eaf23121da',ramdisk_id='',reservation_id='r-jd81dz6r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-401855506',owner_user_name='tempest-ServerActionsTestOtherA-401855506-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:25:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a49f88cb74c47bdb9a35883adbae454',uuid=10c42516-62ba-4aa9-bc5a-d94499bd6b65,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7cf349fa-e382-4526-af9d-f60a53d870cb", "address": "fa:16:3e:97:67:76", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cf349fa-e3", "ovs_interfaceid": "7cf349fa-e382-4526-af9d-f60a53d870cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:44:31 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-568a76bf-f5ef-4864-bb29-9592a5271155 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Converting VIF {"id": "7cf349fa-e382-4526-af9d-f60a53d870cb", "address": "fa:16:3e:97:67:76", "network": {"id": "e92448c4-9bc0-424b-a07f-a398ac46fada", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1377629335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e47ef156b3649839ff728eaf23121da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cf349fa-e3", "ovs_interfaceid": "7cf349fa-e382-4526-af9d-f60a53d870cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:44:31 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-568a76bf-f5ef-4864-bb29-9592a5271155 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:67:76,bridge_name='br-int',has_traffic_filtering=True,id=7cf349fa-e382-4526-af9d-f60a53d870cb,network=Network(e92448c4-9bc0-424b-a07f-a398ac46fada),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cf349fa-e3') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:44:31 user nova-compute[74840]: DEBUG os_vif [None req-568a76bf-f5ef-4864-bb29-9592a5271155 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:67:76,bridge_name='br-int',has_traffic_filtering=True,id=7cf349fa-e382-4526-af9d-f60a53d870cb,network=Network(e92448c4-9bc0-424b-a07f-a398ac46fada),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cf349fa-e3') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:44:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:44:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7cf349fa-e3, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:44:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:44:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:44:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:44:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a2a2f901-b53a-4561-a3b8-dd8af374e17e) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:44:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:44:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:44:31 user nova-compute[74840]: INFO os_vif [None req-568a76bf-f5ef-4864-bb29-9592a5271155 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:67:76,bridge_name='br-int',has_traffic_filtering=True,id=7cf349fa-e382-4526-af9d-f60a53d870cb,network=Network(e92448c4-9bc0-424b-a07f-a398ac46fada),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cf349fa-e3')
Nov 08 12:44:31 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-568a76bf-f5ef-4864-bb29-9592a5271155 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Deleting instance files /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65_del
Nov 08 12:44:31 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-568a76bf-f5ef-4864-bb29-9592a5271155 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Deletion of /opt/stack/data/nova/instances/10c42516-62ba-4aa9-bc5a-d94499bd6b65_del complete
Nov 08 12:44:31 user nova-compute[74840]: INFO nova.compute.manager [None req-568a76bf-f5ef-4864-bb29-9592a5271155 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 08 12:44:31 user nova-compute[74840]: DEBUG oslo.service.loopingcall [None req-568a76bf-f5ef-4864-bb29-9592a5271155 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74840) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 12:44:31 user nova-compute[74840]: DEBUG nova.compute.manager [-] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Deallocating network for instance {{(pid=74840) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 12:44:31 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] deallocate_for_instance() {{(pid=74840) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 12:44:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:44:32 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:44:32 user nova-compute[74840]: INFO nova.compute.manager [-] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Took 0.94 seconds to deallocate network for instance.
Nov 08 12:44:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-568a76bf-f5ef-4864-bb29-9592a5271155 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:44:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-568a76bf-f5ef-4864-bb29-9592a5271155 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:44:32 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-568a76bf-f5ef-4864-bb29-9592a5271155 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:44:33 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-568a76bf-f5ef-4864-bb29-9592a5271155 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:44:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-568a76bf-f5ef-4864-bb29-9592a5271155 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.157s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:44:33 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-568a76bf-f5ef-4864-bb29-9592a5271155 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Deleted allocations for instance 10c42516-62ba-4aa9-bc5a-d94499bd6b65
Nov 08 12:44:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-568a76bf-f5ef-4864-bb29-9592a5271155 tempest-ServerActionsTestOtherA-401855506 tempest-ServerActionsTestOtherA-401855506-project-member] Lock "10c42516-62ba-4aa9-bc5a-d94499bd6b65" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.161s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:44:33 user nova-compute[74840]: DEBUG nova.compute.manager [req-a8967688-4865-4983-9a9e-8afbdf62569f req-fc6df9bb-01bc-4e97-aac4-9c1f5b009846 service nova] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Received event network-vif-plugged-7cf349fa-e382-4526-af9d-f60a53d870cb {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:44:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a8967688-4865-4983-9a9e-8afbdf62569f req-fc6df9bb-01bc-4e97-aac4-9c1f5b009846 service nova] Acquiring lock "10c42516-62ba-4aa9-bc5a-d94499bd6b65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:44:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a8967688-4865-4983-9a9e-8afbdf62569f req-fc6df9bb-01bc-4e97-aac4-9c1f5b009846 service nova] Lock "10c42516-62ba-4aa9-bc5a-d94499bd6b65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:44:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a8967688-4865-4983-9a9e-8afbdf62569f req-fc6df9bb-01bc-4e97-aac4-9c1f5b009846 service nova] Lock "10c42516-62ba-4aa9-bc5a-d94499bd6b65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:44:33 user nova-compute[74840]: DEBUG nova.compute.manager [req-a8967688-4865-4983-9a9e-8afbdf62569f req-fc6df9bb-01bc-4e97-aac4-9c1f5b009846 service nova] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] No waiting events found dispatching network-vif-plugged-7cf349fa-e382-4526-af9d-f60a53d870cb {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:44:33 user nova-compute[74840]: WARNING nova.compute.manager [req-a8967688-4865-4983-9a9e-8afbdf62569f req-fc6df9bb-01bc-4e97-aac4-9c1f5b009846 service nova] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Received unexpected event network-vif-plugged-7cf349fa-e382-4526-af9d-f60a53d870cb for instance with vm_state deleted and task_state None.
Nov 08 12:44:33 user nova-compute[74840]: DEBUG nova.compute.manager [req-a8967688-4865-4983-9a9e-8afbdf62569f req-fc6df9bb-01bc-4e97-aac4-9c1f5b009846 service nova] [instance: 10c42516-62ba-4aa9-bc5a-d94499bd6b65] Received event network-vif-deleted-7cf349fa-e382-4526-af9d-f60a53d870cb {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:44:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:44:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:44:40 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:44:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:44:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:44:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:44:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:44:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:44:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:44:40 user nova-compute[74840]: DEBUG nova.virt.libvirt.imagecache [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Verify base images {{(pid=74840) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 08 12:44:40 user nova-compute[74840]: DEBUG nova.virt.libvirt.imagecache [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Image id fb6bd902-0ff7-4bbf-99b5-308600485455 yields fingerprint 9ec708014af3b8e424e066da6b0282ca7a16a4bb {{(pid=74840) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 08 12:44:40 user nova-compute[74840]: INFO nova.virt.libvirt.imagecache [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] image fb6bd902-0ff7-4bbf-99b5-308600485455 at (/opt/stack/data/nova/instances/_base/9ec708014af3b8e424e066da6b0282ca7a16a4bb): checking
Nov 08 12:44:40 user nova-compute[74840]: DEBUG nova.virt.libvirt.imagecache [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] image fb6bd902-0ff7-4bbf-99b5-308600485455 at (/opt/stack/data/nova/instances/_base/9ec708014af3b8e424e066da6b0282ca7a16a4bb): image is in use {{(pid=74840) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 08 12:44:40 user nova-compute[74840]: DEBUG nova.virt.libvirt.imagecache [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74840) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 08 12:44:40 user nova-compute[74840]: DEBUG nova.virt.libvirt.imagecache [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Image id 4fa17706-d304-4117-a420-dab994c703dc yields fingerprint 5d26578eba85497f494c575690c4248f381a0fe6 {{(pid=74840) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 08 12:44:40 user nova-compute[74840]: INFO nova.virt.libvirt.imagecache [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] image 4fa17706-d304-4117-a420-dab994c703dc at (/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6): checking
Nov 08 12:44:40 user nova-compute[74840]: DEBUG nova.virt.libvirt.imagecache [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] image 4fa17706-d304-4117-a420-dab994c703dc at (/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6): image is in use {{(pid=74840) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 08 12:44:40 user nova-compute[74840]: DEBUG nova.virt.libvirt.imagecache [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] f6bccde5-832b-476f-95c0-10b16af6b126 is a valid instance name {{(pid=74840) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 08 12:44:40 user nova-compute[74840]: DEBUG nova.virt.libvirt.imagecache [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] f6bccde5-832b-476f-95c0-10b16af6b126 has a disk file {{(pid=74840) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 08 12:44:40 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:44:40 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:44:40 user nova-compute[74840]: DEBUG nova.virt.libvirt.imagecache [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance f6bccde5-832b-476f-95c0-10b16af6b126 is backed by 5d26578eba85497f494c575690c4248f381a0fe6 {{(pid=74840) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 08 12:44:40 user nova-compute[74840]: DEBUG nova.virt.libvirt.imagecache [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf is a valid instance name {{(pid=74840) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 08 12:44:40 user nova-compute[74840]: DEBUG nova.virt.libvirt.imagecache [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf has a disk file {{(pid=74840) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 08 12:44:40 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:44:41 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:44:41 user nova-compute[74840]: DEBUG nova.virt.libvirt.imagecache [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf is backed by 9ec708014af3b8e424e066da6b0282ca7a16a4bb {{(pid=74840) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 08 12:44:41 user nova-compute[74840]: WARNING nova.virt.libvirt.imagecache [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/495389a74bf56faf938cfeb6e8c534d27a149955
Nov 08 12:44:41 user nova-compute[74840]: WARNING nova.virt.libvirt.imagecache [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/60e08fe0addd41deea40c877b9fd77e748d85727
Nov 08 12:44:41 user nova-compute[74840]: WARNING nova.virt.libvirt.imagecache [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/f8d5ecd30fc6a8e40b2f178f4547e549d7189869
Nov 08 12:44:41 user nova-compute[74840]: WARNING nova.virt.libvirt.imagecache [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/47404ecbbc241394773fc3ad597637e2b47fec91
Nov 08 12:44:41 user nova-compute[74840]: WARNING nova.virt.libvirt.imagecache [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/cba754e59ce029fae9f23f50fbabcb5cedcb9abb
Nov 08 12:44:41 user nova-compute[74840]: WARNING nova.virt.libvirt.imagecache [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/5b6470ee09f569b53ed589342eb14f3238f1b92b
Nov 08 12:44:41 user nova-compute[74840]: WARNING nova.virt.libvirt.imagecache [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/dff9c7599e020f0693d65ebf0773334bf4185e75
Nov 08 12:44:41 user nova-compute[74840]: INFO nova.virt.libvirt.imagecache [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Active base files: /opt/stack/data/nova/instances/_base/9ec708014af3b8e424e066da6b0282ca7a16a4bb /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6
Nov 08 12:44:41 user nova-compute[74840]: INFO nova.virt.libvirt.imagecache [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Removable base files: /opt/stack/data/nova/instances/_base/495389a74bf56faf938cfeb6e8c534d27a149955 /opt/stack/data/nova/instances/_base/60e08fe0addd41deea40c877b9fd77e748d85727 /opt/stack/data/nova/instances/_base/f8d5ecd30fc6a8e40b2f178f4547e549d7189869 /opt/stack/data/nova/instances/_base/47404ecbbc241394773fc3ad597637e2b47fec91 /opt/stack/data/nova/instances/_base/cba754e59ce029fae9f23f50fbabcb5cedcb9abb /opt/stack/data/nova/instances/_base/5b6470ee09f569b53ed589342eb14f3238f1b92b /opt/stack/data/nova/instances/_base/dff9c7599e020f0693d65ebf0773334bf4185e75
Nov 08 12:44:41 user nova-compute[74840]: INFO nova.virt.libvirt.imagecache [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/495389a74bf56faf938cfeb6e8c534d27a149955
Nov 08 12:44:41 user nova-compute[74840]: INFO nova.virt.libvirt.imagecache [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/60e08fe0addd41deea40c877b9fd77e748d85727
Nov 08 12:44:41 user nova-compute[74840]: INFO nova.virt.libvirt.imagecache [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f8d5ecd30fc6a8e40b2f178f4547e549d7189869
Nov 08 12:44:41 user nova-compute[74840]: INFO nova.virt.libvirt.imagecache [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/47404ecbbc241394773fc3ad597637e2b47fec91
Nov 08 12:44:41 user nova-compute[74840]: INFO nova.virt.libvirt.imagecache [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/cba754e59ce029fae9f23f50fbabcb5cedcb9abb
Nov 08 12:44:41 user nova-compute[74840]: INFO nova.virt.libvirt.imagecache [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5b6470ee09f569b53ed589342eb14f3238f1b92b
Nov 08 12:44:41 user nova-compute[74840]: INFO nova.virt.libvirt.imagecache [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/dff9c7599e020f0693d65ebf0773334bf4185e75
Nov 08 12:44:41 user nova-compute[74840]: DEBUG nova.virt.libvirt.imagecache [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Verification complete {{(pid=74840) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 08 12:44:41 user nova-compute[74840]: DEBUG nova.virt.libvirt.imagecache [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Verify swap images {{(pid=74840) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 08 12:44:41 user nova-compute[74840]: DEBUG nova.virt.libvirt.imagecache [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Verify ephemeral images {{(pid=74840) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 08 12:44:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:44:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:44:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:44:51 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:44:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:45:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:45:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:45:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:45:13 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:45:14 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:45:14 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:45:14 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:45:15 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:45:15 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:45:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "refresh_cache-f6bccde5-832b-476f-95c0-10b16af6b126" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:45:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquired lock "refresh_cache-f6bccde5-832b-476f-95c0-10b16af6b126" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:45:15 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Forcefully refreshing network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 12:45:16 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Updating instance_info_cache with network_info: [{"id": "850d3852-db4b-4634-b37d-ad1e18f04a6b", "address": "fa:16:3e:41:0b:a1", "network": {"id": "a52573e9-cee6-4a6d-944d-56fe99e1c3a9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1100599758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3fd3c6c8e1c46c99adee8fdcc73bddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap850d3852-db", "ovs_interfaceid": "850d3852-db4b-4634-b37d-ad1e18f04a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:45:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Releasing lock "refresh_cache-f6bccde5-832b-476f-95c0-10b16af6b126" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:45:16 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Updated the network info_cache for instance {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 12:45:16 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:45:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:45:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:45:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 12:45:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:45:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:45:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:45:17 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:45:18 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:45:19 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:45:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:45:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:45:23 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:45:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:45:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:45:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:45:23 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:45:23 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:45:23 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:45:23 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:45:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:45:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:45:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:45:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:45:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:45:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:45:24 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:45:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk.rescue --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:45:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:45:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk.rescue --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:45:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:45:25 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:45:25 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:45:25 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=8796MB free_disk=24.73189926147461GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:45:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:45:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:45:25 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance f6bccde5-832b-476f-95c0-10b16af6b126 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:45:25 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:45:25 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:45:25 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:45:25 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:45:25 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:45:25 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:45:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.224s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:45:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:45:29 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:45:29 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:45:30 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:45:30 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74840) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 12:45:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:45:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:45:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:45:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Acquiring lock "9294d85f-20ec-4a6c-9a52-379187cb2aa1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:45:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Lock "9294d85f-20ec-4a6c-9a52-379187cb2aa1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:45:32 user nova-compute[74840]: DEBUG nova.compute.manager [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Starting instance... {{(pid=74840) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 12:45:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:45:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:45:33 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:45:33 user nova-compute[74840]: INFO nova.compute.claims [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Claim successful on node user
Nov 08 12:45:33 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:45:33 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:45:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.268s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:45:33 user nova-compute[74840]: DEBUG nova.compute.manager [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Start building networks asynchronously for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 12:45:33 user nova-compute[74840]: DEBUG nova.compute.manager [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Allocating IP information in the background. {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 12:45:33 user nova-compute[74840]: DEBUG nova.network.neutron [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 12:45:33 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 12:45:33 user nova-compute[74840]: DEBUG nova.compute.manager [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Start building block device mappings for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 12:45:33 user nova-compute[74840]: DEBUG nova.policy [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '52ea0bf6286c45f987154493a281b260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e48fbc441e79426f859e00e5c19a1167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 12:45:33 user nova-compute[74840]: DEBUG nova.compute.manager [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Start spawning the instance on the hypervisor. {{(pid=74840) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 12:45:33 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:45:33 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Creating image(s)
Nov 08 12:45:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Acquiring lock "/opt/stack/data/nova/instances/9294d85f-20ec-4a6c-9a52-379187cb2aa1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:45:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Lock "/opt/stack/data/nova/instances/9294d85f-20ec-4a6c-9a52-379187cb2aa1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:45:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Lock "/opt/stack/data/nova/instances/9294d85f-20ec-4a6c-9a52-379187cb2aa1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:45:33 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:45:33 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.183s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:45:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Acquiring lock "5d26578eba85497f494c575690c4248f381a0fe6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:45:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:45:33 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:45:33 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.191s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:45:33 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/9294d85f-20ec-4a6c-9a52-379187cb2aa1/disk 1073741824 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:45:33 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/9294d85f-20ec-4a6c-9a52-379187cb2aa1/disk 1073741824" returned: 0 in 0.059s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:45:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:45:33 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:45:33 user nova-compute[74840]: DEBUG nova.network.neutron [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Successfully created port: 4fed7aed-812e-40c4-a02b-25874b4dca07 {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:45:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.180s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:45:34 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9294d85f-20ec-4a6c-9a52-379187cb2aa1/disk. size=1073741824 {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 12:45:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9294d85f-20ec-4a6c-9a52-379187cb2aa1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:45:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c1814bd9-0b5a-4ddc-8a25-9d14e5efe53b tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Acquiring lock "c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:45:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c1814bd9-0b5a-4ddc-8a25-9d14e5efe53b tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:45:34 user nova-compute[74840]: DEBUG nova.objects.instance [None req-c1814bd9-0b5a-4ddc-8a25-9d14e5efe53b tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lazy-loading 'flavor' on Instance uuid c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:45:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c1814bd9-0b5a-4ddc-8a25-9d14e5efe53b tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:45:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9294d85f-20ec-4a6c-9a52-379187cb2aa1/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:45:34 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Cannot resize image /opt/stack/data/nova/instances/9294d85f-20ec-4a6c-9a52-379187cb2aa1/disk to a smaller size. {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 12:45:34 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Created local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 12:45:34 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Ensure instance console log exists: /opt/stack/data/nova/instances/9294d85f-20ec-4a6c-9a52-379187cb2aa1/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:45:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:45:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:45:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:45:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c1814bd9-0b5a-4ddc-8a25-9d14e5efe53b tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Acquiring lock "c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:45:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c1814bd9-0b5a-4ddc-8a25-9d14e5efe53b tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:45:34 user nova-compute[74840]: INFO nova.compute.manager [None req-c1814bd9-0b5a-4ddc-8a25-9d14e5efe53b tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Attaching volume bc3597a9-a73b-484b-9c74-80c716a4d729 to /dev/vdb
Nov 08 12:45:34 user nova-compute[74840]: DEBUG os_brick.utils [None req-c1814bd9-0b5a-4ddc-8a25-9d14e5efe53b tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:45:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:45:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:45:34 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe26c6c6-54e4-491a-b2d4-de54503efb16]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c8228a11e03c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:45:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:45:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:45:34 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51fea3b-d6df-443a-ad54-c25c8416a5e4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:45:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:45:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:45:34 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf7cba6-3983-4364-9ac9-9dcdef678016]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:45:34 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf455607-f503-4bc6-b638-9ca1f9620deb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:45:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-c1814bd9-0b5a-4ddc-8a25-9d14e5efe53b tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Running cmd (subprocess): nvme version {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:45:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-c1814bd9-0b5a-4ddc-8a25-9d14e5efe53b tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] 'nvme version' failed. Not Retrying. {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:45:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c1814bd9-0b5a-4ddc-8a25-9d14e5efe53b tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] nvme not present on system {{(pid=74840) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 12:45:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:45:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:45:34 user nova-compute[74840]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 12:45:34 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[45164ad4-da57-486b-a5f8-65390ff2721b]: (4, '') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:45:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-c1814bd9-0b5a-4ddc-8a25-9d14e5efe53b tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74840) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 12:45:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-c1814bd9-0b5a-4ddc-8a25-9d14e5efe53b tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 12:45:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-c1814bd9-0b5a-4ddc-8a25-9d14e5efe53b tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] LIGHTOS: no hostnqn found. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 12:45:34 user nova-compute[74840]: DEBUG os_brick.utils [None req-c1814bd9-0b5a-4ddc-8a25-9d14e5efe53b tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c8228a11e03c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:45:34 user nova-compute[74840]: DEBUG nova.virt.block_device [None req-c1814bd9-0b5a-4ddc-8a25-9d14e5efe53b tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Updating existing volume attachment record: 27c47911-4c4a-4bc9-9f7c-44864c563a59 {{(pid=74840) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 12:45:34 user nova-compute[74840]: DEBUG nova.network.neutron [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Successfully updated port: 4fed7aed-812e-40c4-a02b-25874b4dca07 {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:45:34 user nova-compute[74840]: DEBUG nova.compute.manager [req-5e225447-702d-44da-8481-e16f1b6e7dab req-7c1913dc-2198-4ca0-9931-99586583384e service nova] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Received event network-changed-4fed7aed-812e-40c4-a02b-25874b4dca07 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:45:34 user nova-compute[74840]: DEBUG nova.compute.manager [req-5e225447-702d-44da-8481-e16f1b6e7dab req-7c1913dc-2198-4ca0-9931-99586583384e service nova] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Refreshing instance network info cache due to event network-changed-4fed7aed-812e-40c4-a02b-25874b4dca07. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:45:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-5e225447-702d-44da-8481-e16f1b6e7dab req-7c1913dc-2198-4ca0-9931-99586583384e service nova] Acquiring lock "refresh_cache-9294d85f-20ec-4a6c-9a52-379187cb2aa1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:45:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-5e225447-702d-44da-8481-e16f1b6e7dab req-7c1913dc-2198-4ca0-9931-99586583384e service nova] Acquired lock "refresh_cache-9294d85f-20ec-4a6c-9a52-379187cb2aa1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:45:34 user nova-compute[74840]: DEBUG nova.network.neutron [req-5e225447-702d-44da-8481-e16f1b6e7dab req-7c1913dc-2198-4ca0-9931-99586583384e service nova] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Refreshing network info cache for port 4fed7aed-812e-40c4-a02b-25874b4dca07 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:45:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Acquiring lock "refresh_cache-9294d85f-20ec-4a6c-9a52-379187cb2aa1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:45:34 user nova-compute[74840]: DEBUG nova.network.neutron [req-5e225447-702d-44da-8481-e16f1b6e7dab req-7c1913dc-2198-4ca0-9931-99586583384e service nova] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:45:34 user nova-compute[74840]: DEBUG nova.network.neutron [req-5e225447-702d-44da-8481-e16f1b6e7dab req-7c1913dc-2198-4ca0-9931-99586583384e service nova] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:45:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-5e225447-702d-44da-8481-e16f1b6e7dab req-7c1913dc-2198-4ca0-9931-99586583384e service nova] Releasing lock "refresh_cache-9294d85f-20ec-4a6c-9a52-379187cb2aa1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:45:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Acquired lock "refresh_cache-9294d85f-20ec-4a6c-9a52-379187cb2aa1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:45:34 user nova-compute[74840]: DEBUG nova.network.neutron [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:45:34 user nova-compute[74840]: DEBUG nova.network.neutron [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:45:35 user nova-compute[74840]: DEBUG nova.network.neutron [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Updating instance_info_cache with network_info: [{"id": "4fed7aed-812e-40c4-a02b-25874b4dca07", "address": "fa:16:3e:88:d5:f1", "network": {"id": "88ccbadb-f25d-463d-a2c3-01dcd402b165", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1492603656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e48fbc441e79426f859e00e5c19a1167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fed7aed-81", "ovs_interfaceid": "4fed7aed-812e-40c4-a02b-25874b4dca07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:45:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Releasing lock "refresh_cache-9294d85f-20ec-4a6c-9a52-379187cb2aa1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:45:35 user nova-compute[74840]: DEBUG nova.compute.manager [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Instance network_info: |[{"id": "4fed7aed-812e-40c4-a02b-25874b4dca07", "address": "fa:16:3e:88:d5:f1", "network": {"id": "88ccbadb-f25d-463d-a2c3-01dcd402b165", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1492603656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e48fbc441e79426f859e00e5c19a1167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fed7aed-81", "ovs_interfaceid": "4fed7aed-812e-40c4-a02b-25874b4dca07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 12:45:35 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Start _get_guest_xml network_info=[{"id": "4fed7aed-812e-40c4-a02b-25874b4dca07", "address": "fa:16:3e:88:d5:f1", "network": {"id": "88ccbadb-f25d-463d-a2c3-01dcd402b165", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1492603656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e48fbc441e79426f859e00e5c19a1167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fed7aed-81", "ovs_interfaceid": "4fed7aed-812e-40c4-a02b-25874b4dca07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'image_id': '4fa17706-d304-4117-a420-dab994c703dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:45:35 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:45:35 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:45:35 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:45:35 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:45:35 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:45:35 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:45:35 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:45:35 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:45:35 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:45:35 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:45:35 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:45:35 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:45:35 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:45:35 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:45:35 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:45:35 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:45:35 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:45:35 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:45:35 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:45:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1986475937',display_name='tempest-ServersNegativeTestJSON-server-1986475937',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1986475937',id=47,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e48fbc441e79426f859e00e5c19a1167',ramdisk_id='',reservation_id='r-sa8x2z47',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-199749076',owner_user_name='tempest-ServersNegativeTestJSON-199749076-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:45:33Z,user_data=None,user_id='52ea0bf6286c45f987154493a281b260',uuid=9294d85f-20ec-4a6c-9a52-379187cb2aa1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fed7aed-812e-40c4-a02b-25874b4dca07", "address": "fa:16:3e:88:d5:f1", "network": {"id": "88ccbadb-f25d-463d-a2c3-01dcd402b165", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1492603656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e48fbc441e79426f859e00e5c19a1167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fed7aed-81", "ovs_interfaceid": "4fed7aed-812e-40c4-a02b-25874b4dca07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:45:35 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Converting VIF {"id": "4fed7aed-812e-40c4-a02b-25874b4dca07", "address": "fa:16:3e:88:d5:f1", "network": {"id": "88ccbadb-f25d-463d-a2c3-01dcd402b165", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1492603656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e48fbc441e79426f859e00e5c19a1167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fed7aed-81", "ovs_interfaceid": "4fed7aed-812e-40c4-a02b-25874b4dca07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:45:35 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:d5:f1,bridge_name='br-int',has_traffic_filtering=True,id=4fed7aed-812e-40c4-a02b-25874b4dca07,network=Network(88ccbadb-f25d-463d-a2c3-01dcd402b165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fed7aed-81') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:45:35 user nova-compute[74840]: DEBUG nova.objects.instance [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Lazy-loading 'pci_devices' on Instance uuid 9294d85f-20ec-4a6c-9a52-379187cb2aa1 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:45:35 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:45:35 user nova-compute[74840]:   <uuid>9294d85f-20ec-4a6c-9a52-379187cb2aa1</uuid>
Nov 08 12:45:35 user nova-compute[74840]:   <name>instance-0000002f</name>
Nov 08 12:45:35 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:45:35 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:45:35 user nova-compute[74840]:   <metadata>
Nov 08 12:45:35 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:45:35 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:45:35 user nova-compute[74840]:       <nova:name>tempest-ServersNegativeTestJSON-server-1986475937</nova:name>
Nov 08 12:45:35 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:45:35</nova:creationTime>
Nov 08 12:45:35 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:45:35 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:45:35 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:45:35 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:45:35 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:45:35 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:45:35 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:45:35 user nova-compute[74840]:       <nova:owner>
Nov 08 12:45:35 user nova-compute[74840]:         <nova:user uuid="52ea0bf6286c45f987154493a281b260">tempest-ServersNegativeTestJSON-199749076-project-member</nova:user>
Nov 08 12:45:35 user nova-compute[74840]:         <nova:project uuid="e48fbc441e79426f859e00e5c19a1167">tempest-ServersNegativeTestJSON-199749076</nova:project>
Nov 08 12:45:35 user nova-compute[74840]:       </nova:owner>
Nov 08 12:45:35 user nova-compute[74840]:       <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:45:35 user nova-compute[74840]:       <nova:ports>
Nov 08 12:45:35 user nova-compute[74840]:         <nova:port uuid="4fed7aed-812e-40c4-a02b-25874b4dca07">
Nov 08 12:45:35 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 12:45:35 user nova-compute[74840]:         </nova:port>
Nov 08 12:45:35 user nova-compute[74840]:       </nova:ports>
Nov 08 12:45:35 user nova-compute[74840]:     </nova:instance>
Nov 08 12:45:35 user nova-compute[74840]:   </metadata>
Nov 08 12:45:35 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:45:35 user nova-compute[74840]:     <system>
Nov 08 12:45:35 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:45:35 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:45:35 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:45:35 user nova-compute[74840]:       <entry name="serial">9294d85f-20ec-4a6c-9a52-379187cb2aa1</entry>
Nov 08 12:45:35 user nova-compute[74840]:       <entry name="uuid">9294d85f-20ec-4a6c-9a52-379187cb2aa1</entry>
Nov 08 12:45:35 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:45:35 user nova-compute[74840]:     </system>
Nov 08 12:45:35 user nova-compute[74840]:   </sysinfo>
Nov 08 12:45:35 user nova-compute[74840]:   <os>
Nov 08 12:45:35 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:45:35 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:45:35 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:45:35 user nova-compute[74840]:   </os>
Nov 08 12:45:35 user nova-compute[74840]:   <features>
Nov 08 12:45:35 user nova-compute[74840]:     <acpi/>
Nov 08 12:45:35 user nova-compute[74840]:     <apic/>
Nov 08 12:45:35 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:45:35 user nova-compute[74840]:   </features>
Nov 08 12:45:35 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:45:35 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:45:35 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:45:35 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:45:35 user nova-compute[74840]:   </clock>
Nov 08 12:45:35 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:45:35 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:45:35 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:45:35 user nova-compute[74840]:   </cpu>
Nov 08 12:45:35 user nova-compute[74840]:   <devices>
Nov 08 12:45:35 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:45:35 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:45:35 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/9294d85f-20ec-4a6c-9a52-379187cb2aa1/disk"/>
Nov 08 12:45:35 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:45:35 user nova-compute[74840]:     </disk>
Nov 08 12:45:35 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:45:35 user nova-compute[74840]:       <mac address="fa:16:3e:88:d5:f1"/>
Nov 08 12:45:35 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:45:35 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:45:35 user nova-compute[74840]:       <target dev="tap4fed7aed-81"/>
Nov 08 12:45:35 user nova-compute[74840]:     </interface>
Nov 08 12:45:35 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:45:35 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/9294d85f-20ec-4a6c-9a52-379187cb2aa1/console.log" append="off"/>
Nov 08 12:45:35 user nova-compute[74840]:     </serial>
Nov 08 12:45:35 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:45:35 user nova-compute[74840]:     <video>
Nov 08 12:45:35 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:45:35 user nova-compute[74840]:     </video>
Nov 08 12:45:35 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:45:35 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:45:35 user nova-compute[74840]:     </rng>
Nov 08 12:45:35 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:45:35 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:45:35 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:45:35 user nova-compute[74840]:     </memballoon>
Nov 08 12:45:35 user nova-compute[74840]:   </devices>
Nov 08 12:45:35 user nova-compute[74840]: </domain>
Nov 08 12:45:35 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:45:35 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:45:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1986475937',display_name='tempest-ServersNegativeTestJSON-server-1986475937',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1986475937',id=47,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e48fbc441e79426f859e00e5c19a1167',ramdisk_id='',reservation_id='r-sa8x2z47',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-199749076',owner_user_name='tempest-ServersNegativeTestJSON-199749076-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:45:33Z,user_data=None,user_id='52ea0bf6286c45f987154493a281b260',uuid=9294d85f-20ec-4a6c-9a52-379187cb2aa1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fed7aed-812e-40c4-a02b-25874b4dca07", "address": "fa:16:3e:88:d5:f1", "network": {"id": "88ccbadb-f25d-463d-a2c3-01dcd402b165", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1492603656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e48fbc441e79426f859e00e5c19a1167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fed7aed-81", "ovs_interfaceid": "4fed7aed-812e-40c4-a02b-25874b4dca07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:45:35 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Converting VIF {"id": "4fed7aed-812e-40c4-a02b-25874b4dca07", "address": "fa:16:3e:88:d5:f1", "network": {"id": "88ccbadb-f25d-463d-a2c3-01dcd402b165", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1492603656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e48fbc441e79426f859e00e5c19a1167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fed7aed-81", "ovs_interfaceid": "4fed7aed-812e-40c4-a02b-25874b4dca07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:45:35 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:d5:f1,bridge_name='br-int',has_traffic_filtering=True,id=4fed7aed-812e-40c4-a02b-25874b4dca07,network=Network(88ccbadb-f25d-463d-a2c3-01dcd402b165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fed7aed-81') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:45:35 user nova-compute[74840]: DEBUG os_vif [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:d5:f1,bridge_name='br-int',has_traffic_filtering=True,id=4fed7aed-812e-40c4-a02b-25874b4dca07,network=Network(88ccbadb-f25d-463d-a2c3-01dcd402b165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fed7aed-81') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:45:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:45:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:45:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:45:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:45:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4b30d187-830b-53cf-b43a-c8a0dd4e8168', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:45:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:45:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:45:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:45:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4fed7aed-81, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:45:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4fed7aed-81, col_values=(('qos', UUID('69d99011-9573-45e8-8539-f68891f113c7')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:45:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4fed7aed-81, col_values=(('external_ids', {'iface-id': '4fed7aed-812e-40c4-a02b-25874b4dca07', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:d5:f1', 'vm-uuid': '9294d85f-20ec-4a6c-9a52-379187cb2aa1'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:45:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:45:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:45:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:45:35 user nova-compute[74840]: INFO os_vif [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:d5:f1,bridge_name='br-int',has_traffic_filtering=True,id=4fed7aed-812e-40c4-a02b-25874b4dca07,network=Network(88ccbadb-f25d-463d-a2c3-01dcd402b165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fed7aed-81')
Nov 08 12:45:35 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:45:35 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] No VIF found with MAC fa:16:3e:88:d5:f1, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:45:35 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:45:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:45:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:45:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:45:36 user nova-compute[74840]: DEBUG nova.compute.manager [req-3f246250-a3b4-4974-8428-b6c6b91c03ca req-fd7cfa9b-41dc-47a2-b23d-cca7b229f79b service nova] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Received event network-vif-plugged-4fed7aed-812e-40c4-a02b-25874b4dca07 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:45:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3f246250-a3b4-4974-8428-b6c6b91c03ca req-fd7cfa9b-41dc-47a2-b23d-cca7b229f79b service nova] Acquiring lock "9294d85f-20ec-4a6c-9a52-379187cb2aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:45:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3f246250-a3b4-4974-8428-b6c6b91c03ca req-fd7cfa9b-41dc-47a2-b23d-cca7b229f79b service nova] Lock "9294d85f-20ec-4a6c-9a52-379187cb2aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:45:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-3f246250-a3b4-4974-8428-b6c6b91c03ca req-fd7cfa9b-41dc-47a2-b23d-cca7b229f79b service nova] Lock "9294d85f-20ec-4a6c-9a52-379187cb2aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:45:36 user nova-compute[74840]: DEBUG nova.compute.manager [req-3f246250-a3b4-4974-8428-b6c6b91c03ca req-fd7cfa9b-41dc-47a2-b23d-cca7b229f79b service nova] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] No waiting events found dispatching network-vif-plugged-4fed7aed-812e-40c4-a02b-25874b4dca07 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:45:36 user nova-compute[74840]: WARNING nova.compute.manager [req-3f246250-a3b4-4974-8428-b6c6b91c03ca req-fd7cfa9b-41dc-47a2-b23d-cca7b229f79b service nova] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Received unexpected event network-vif-plugged-4fed7aed-812e-40c4-a02b-25874b4dca07 for instance with vm_state building and task_state spawning.
Nov 08 12:45:37 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Triggering sync for uuid f6bccde5-832b-476f-95c0-10b16af6b126 {{(pid=74840) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 12:45:37 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Triggering sync for uuid c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf {{(pid=74840) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 12:45:37 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Triggering sync for uuid 9294d85f-20ec-4a6c-9a52-379187cb2aa1 {{(pid=74840) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 12:45:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "f6bccde5-832b-476f-95c0-10b16af6b126" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:45:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "f6bccde5-832b-476f-95c0-10b16af6b126" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:45:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:45:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "9294d85f-20ec-4a6c-9a52-379187cb2aa1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:45:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "f6bccde5-832b-476f-95c0-10b16af6b126" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:45:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:45:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:45:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:45:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:45:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:45:38 user nova-compute[74840]: DEBUG nova.compute.manager [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:45:38 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:45:38 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Instance spawned successfully.
Nov 08 12:45:38 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:45:38 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Found default for hw_cdrom_bus of ide {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:45:38 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Found default for hw_disk_bus of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:45:38 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:45:38 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:45:38 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Found default for hw_video_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:45:38 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Found default for hw_vif_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:45:38 user nova-compute[74840]: INFO nova.compute.manager [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Took 5.42 seconds to spawn the instance on the hypervisor.
Nov 08 12:45:38 user nova-compute[74840]: DEBUG nova.compute.manager [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:45:38 user nova-compute[74840]: DEBUG nova.compute.manager [req-689364f4-51e4-44dc-8414-667f98322cf7 req-34316e85-7968-4906-b092-5828d104d885 service nova] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Received event network-vif-plugged-4fed7aed-812e-40c4-a02b-25874b4dca07 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:45:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-689364f4-51e4-44dc-8414-667f98322cf7 req-34316e85-7968-4906-b092-5828d104d885 service nova] Acquiring lock "9294d85f-20ec-4a6c-9a52-379187cb2aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:45:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-689364f4-51e4-44dc-8414-667f98322cf7 req-34316e85-7968-4906-b092-5828d104d885 service nova] Lock "9294d85f-20ec-4a6c-9a52-379187cb2aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:45:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-689364f4-51e4-44dc-8414-667f98322cf7 req-34316e85-7968-4906-b092-5828d104d885 service nova] Lock "9294d85f-20ec-4a6c-9a52-379187cb2aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:45:38 user nova-compute[74840]: DEBUG nova.compute.manager [req-689364f4-51e4-44dc-8414-667f98322cf7 req-34316e85-7968-4906-b092-5828d104d885 service nova] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] No waiting events found dispatching network-vif-plugged-4fed7aed-812e-40c4-a02b-25874b4dca07 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:45:38 user nova-compute[74840]: WARNING nova.compute.manager [req-689364f4-51e4-44dc-8414-667f98322cf7 req-34316e85-7968-4906-b092-5828d104d885 service nova] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Received unexpected event network-vif-plugged-4fed7aed-812e-40c4-a02b-25874b4dca07 for instance with vm_state building and task_state spawning.
Nov 08 12:45:38 user nova-compute[74840]: INFO nova.compute.manager [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Took 6.00 seconds to build instance.
Nov 08 12:45:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fa5d8163-e227-47b4-b683-a0d3cba4e0cb tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Lock "9294d85f-20ec-4a6c-9a52-379187cb2aa1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.096s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:45:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "9294d85f-20ec-4a6c-9a52-379187cb2aa1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.969s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:45:39 user nova-compute[74840]: INFO nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] During sync_power_state the instance has a pending task (spawning). Skip.
Nov 08 12:45:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "9294d85f-20ec-4a6c-9a52-379187cb2aa1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:45:39 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:45:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:45:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:45:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:45:46 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:45:46 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Cleaning up deleted instances {{(pid=74840) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 12:45:46 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] There are 0 instances to clean {{(pid=74840) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 12:45:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:45:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:45:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:45:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:45:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 12:45:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:45:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:45:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:45:55 user nova-compute[74840]: INFO nova.compute.manager [None req-fbb564ce-0c58-41b2-8a44-52332172e5f5 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Unrescuing
Nov 08 12:45:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fbb564ce-0c58-41b2-8a44-52332172e5f5 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Acquiring lock "refresh_cache-f6bccde5-832b-476f-95c0-10b16af6b126" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:45:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fbb564ce-0c58-41b2-8a44-52332172e5f5 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Acquired lock "refresh_cache-f6bccde5-832b-476f-95c0-10b16af6b126" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:45:55 user nova-compute[74840]: DEBUG nova.network.neutron [None req-fbb564ce-0c58-41b2-8a44-52332172e5f5 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:45:55 user nova-compute[74840]: DEBUG nova.network.neutron [None req-fbb564ce-0c58-41b2-8a44-52332172e5f5 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Updating instance_info_cache with network_info: [{"id": "850d3852-db4b-4634-b37d-ad1e18f04a6b", "address": "fa:16:3e:41:0b:a1", "network": {"id": "a52573e9-cee6-4a6d-944d-56fe99e1c3a9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1100599758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3fd3c6c8e1c46c99adee8fdcc73bddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap850d3852-db", "ovs_interfaceid": "850d3852-db4b-4634-b37d-ad1e18f04a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:45:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-fbb564ce-0c58-41b2-8a44-52332172e5f5 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Releasing lock "refresh_cache-f6bccde5-832b-476f-95c0-10b16af6b126" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:45:55 user nova-compute[74840]: DEBUG nova.objects.instance [None req-fbb564ce-0c58-41b2-8a44-52332172e5f5 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Lazy-loading 'flavor' on Instance uuid f6bccde5-832b-476f-95c0-10b16af6b126 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:45:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:45:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:45:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:45:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:45:56 user nova-compute[74840]: DEBUG nova.compute.manager [req-00f22a2b-2956-46fe-be0d-4f7ba7aeeccb req-96bd1bac-562d-4c2e-9945-b02ff17c2b92 service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Received event network-vif-unplugged-850d3852-db4b-4634-b37d-ad1e18f04a6b {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:45:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-00f22a2b-2956-46fe-be0d-4f7ba7aeeccb req-96bd1bac-562d-4c2e-9945-b02ff17c2b92 service nova] Acquiring lock "f6bccde5-832b-476f-95c0-10b16af6b126-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:45:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-00f22a2b-2956-46fe-be0d-4f7ba7aeeccb req-96bd1bac-562d-4c2e-9945-b02ff17c2b92 service nova] Lock "f6bccde5-832b-476f-95c0-10b16af6b126-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:45:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-00f22a2b-2956-46fe-be0d-4f7ba7aeeccb req-96bd1bac-562d-4c2e-9945-b02ff17c2b92 service nova] Lock "f6bccde5-832b-476f-95c0-10b16af6b126-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:45:56 user nova-compute[74840]: DEBUG nova.compute.manager [req-00f22a2b-2956-46fe-be0d-4f7ba7aeeccb req-96bd1bac-562d-4c2e-9945-b02ff17c2b92 service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] No waiting events found dispatching network-vif-unplugged-850d3852-db4b-4634-b37d-ad1e18f04a6b {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:45:56 user nova-compute[74840]: WARNING nova.compute.manager [req-00f22a2b-2956-46fe-be0d-4f7ba7aeeccb req-96bd1bac-562d-4c2e-9945-b02ff17c2b92 service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Received unexpected event network-vif-unplugged-850d3852-db4b-4634-b37d-ad1e18f04a6b for instance with vm_state rescued and task_state unrescuing.
Nov 08 12:45:56 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Instance destroyed successfully.
Nov 08 12:45:56 user nova-compute[74840]: DEBUG nova.compute.manager [req-9c1a877c-d396-4dee-ac49-8c3707860798 req-df616a37-c698-404b-adba-73efb402304f service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Received event network-changed-850d3852-db4b-4634-b37d-ad1e18f04a6b {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:45:56 user nova-compute[74840]: DEBUG nova.compute.manager [req-9c1a877c-d396-4dee-ac49-8c3707860798 req-df616a37-c698-404b-adba-73efb402304f service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Refreshing instance network info cache due to event network-changed-850d3852-db4b-4634-b37d-ad1e18f04a6b. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:45:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9c1a877c-d396-4dee-ac49-8c3707860798 req-df616a37-c698-404b-adba-73efb402304f service nova] Acquiring lock "refresh_cache-f6bccde5-832b-476f-95c0-10b16af6b126" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:45:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9c1a877c-d396-4dee-ac49-8c3707860798 req-df616a37-c698-404b-adba-73efb402304f service nova] Acquired lock "refresh_cache-f6bccde5-832b-476f-95c0-10b16af6b126" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:45:56 user nova-compute[74840]: DEBUG nova.network.neutron [req-9c1a877c-d396-4dee-ac49-8c3707860798 req-df616a37-c698-404b-adba-73efb402304f service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Refreshing network info cache for port 850d3852-db4b-4634-b37d-ad1e18f04a6b {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:45:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:45:57 user nova-compute[74840]: DEBUG nova.network.neutron [req-9c1a877c-d396-4dee-ac49-8c3707860798 req-df616a37-c698-404b-adba-73efb402304f service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Updated VIF entry in instance network info cache for port 850d3852-db4b-4634-b37d-ad1e18f04a6b. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:45:57 user nova-compute[74840]: DEBUG nova.network.neutron [req-9c1a877c-d396-4dee-ac49-8c3707860798 req-df616a37-c698-404b-adba-73efb402304f service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Updating instance_info_cache with network_info: [{"id": "850d3852-db4b-4634-b37d-ad1e18f04a6b", "address": "fa:16:3e:41:0b:a1", "network": {"id": "a52573e9-cee6-4a6d-944d-56fe99e1c3a9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1100599758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3fd3c6c8e1c46c99adee8fdcc73bddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap850d3852-db", "ovs_interfaceid": "850d3852-db4b-4634-b37d-ad1e18f04a6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:45:57 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-9c1a877c-d396-4dee-ac49-8c3707860798 req-df616a37-c698-404b-adba-73efb402304f service nova] Releasing lock "refresh_cache-f6bccde5-832b-476f-95c0-10b16af6b126" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:45:57 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1814bd9-0b5a-4ddc-8a25-9d14e5efe53b tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Calling os-brick to attach iSCSI Volume {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 12:45:57 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1814bd9-0b5a-4ddc-8a25-9d14e5efe53b tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EImsVpbk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:45:57 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-c1814bd9-0b5a-4ddc-8a25-9d14e5efe53b tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:45:57 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-c1814bd9-0b5a-4ddc-8a25-9d14e5efe53b tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:45:57 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-c1814bd9-0b5a-4ddc-8a25-9d14e5efe53b tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:45:57 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-c1814bd9-0b5a-4ddc-8a25-9d14e5efe53b tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:45:57 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-c1814bd9-0b5a-4ddc-8a25-9d14e5efe53b tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:45:57 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-c1814bd9-0b5a-4ddc-8a25-9d14e5efe53b tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:45:57 user nova-compute[74840]: INFO os_brick.initiator.connectors.iscsi [None req-c1814bd9-0b5a-4ddc-8a25-9d14e5efe53b tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 12:45:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 -p 172.16.0.220:3260 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:45:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:45:57 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[789bd725-79ab-41cc-893d-b3416aaa4822]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:45:57 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1814bd9-0b5a-4ddc-8a25-9d14e5efe53b tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 12:45:57 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:45:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 -p 172.16.0.220:3260 --interface default --op new {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:45:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:45:57 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb328a9d-a605-4fc2-b5b7-8c5ade78a022]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729] added\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:45:57 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1814bd9-0b5a-4ddc-8a25-9d14e5efe53b tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729] added
Nov 08 12:45:57 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:45:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:45:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:45:57 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5020c194-5e0f-4ada-99ea-dc80aae632f2]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:45:57 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1814bd9-0b5a-4ddc-8a25-9d14e5efe53b tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:45:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:45:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:45:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:45:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:45:57 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a9199a-dba2-436b-8bd6-580023e911bd]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:45:57 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1814bd9-0b5a-4ddc-8a25-9d14e5efe53b tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:45:57 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EImsVpbk {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:45:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:45:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EImsVpbk" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:45:58 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a42ed01-d305-436d-9537-95ca6092a35a]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:45:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1814bd9-0b5a-4ddc-8a25-9d14e5efe53b tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EImsVpbk'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:45:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:45:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:45:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:45:58 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[47181ba5-efa2-439b-badc-dbbc553606c9]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:45:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1814bd9-0b5a-4ddc-8a25-9d14e5efe53b tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:45:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:45:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:45:58 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a176145-c18a-4318-80dd-d9c8198bf93d]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:45:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1814bd9-0b5a-4ddc-8a25-9d14e5efe53b tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c (non-flash)
Nov 08 12:45:58 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:45:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1814bd9-0b5a-4ddc-8a25-9d14e5efe53b tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c (non-flash)
Nov 08 12:45:58 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:45:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 -p 172.16.0.220:3260 --login {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:45:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:45:58 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[71580500-a895-4192-8502-c2bb9a5a9e13]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:45:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1814bd9-0b5a-4ddc-8a25-9d14e5efe53b tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729, portal: 172.16.0.220,3260]
Nov 08 12:45:58 user nova-compute[74840]: Login to [iface: default, target: iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729, portal: 172.16.0.220,3260] successful.
Nov 08 12:45:58 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:45:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:45:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:45:58 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ac1824-fc6e-43dd-99dd-d79566917dfa]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:45:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1814bd9-0b5a-4ddc-8a25-9d14e5efe53b tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:45:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:45:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:45:58 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[487c3b9e-dcbb-4802-910e-80e4d40f05e5]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:45:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1814bd9-0b5a-4ddc-8a25-9d14e5efe53b tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c (non-flash)
Nov 08 12:45:58 user nova-compute[74840]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 (non-flash)
Nov 08 12:45:58 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:45:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1814bd9-0b5a-4ddc-8a25-9d14e5efe53b tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c (non-flash)
Nov 08 12:45:58 user nova-compute[74840]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 (non-flash)
Nov 08 12:45:58 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:45:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-c1814bd9-0b5a-4ddc-8a25-9d14e5efe53b tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:45:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1814bd9-0b5a-4ddc-8a25-9d14e5efe53b tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Connected to 172.16.0.220:3260 {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 12:45:58 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-c1814bd9-0b5a-4ddc-8a25-9d14e5efe53b tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=74840) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 12:45:58 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-c1814bd9-0b5a-4ddc-8a25-9d14e5efe53b tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74840) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 12:45:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:45:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:45:58 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67dd58b-2793-43c4-a342-b8763727f11a]: (4, ('- - 0', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:45:58 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-c1814bd9-0b5a-4ddc-8a25-9d14e5efe53b tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:45:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1814bd9-0b5a-4ddc-8a25-9d14e5efe53b tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EImsVpbk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 12:45:58 user nova-compute[74840]: DEBUG nova.compute.manager [req-aa9c62d8-05db-42d7-aa56-d1734506ec36 req-f5cba11b-40a0-4a55-80bd-39994ebc1868 service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Received event network-vif-plugged-850d3852-db4b-4634-b37d-ad1e18f04a6b {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:45:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-aa9c62d8-05db-42d7-aa56-d1734506ec36 req-f5cba11b-40a0-4a55-80bd-39994ebc1868 service nova] Acquiring lock "f6bccde5-832b-476f-95c0-10b16af6b126-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:45:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-aa9c62d8-05db-42d7-aa56-d1734506ec36 req-f5cba11b-40a0-4a55-80bd-39994ebc1868 service nova] Lock "f6bccde5-832b-476f-95c0-10b16af6b126-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:45:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-aa9c62d8-05db-42d7-aa56-d1734506ec36 req-f5cba11b-40a0-4a55-80bd-39994ebc1868 service nova] Lock "f6bccde5-832b-476f-95c0-10b16af6b126-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:45:58 user nova-compute[74840]: DEBUG nova.compute.manager [req-aa9c62d8-05db-42d7-aa56-d1734506ec36 req-f5cba11b-40a0-4a55-80bd-39994ebc1868 service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] No waiting events found dispatching network-vif-plugged-850d3852-db4b-4634-b37d-ad1e18f04a6b {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:45:58 user nova-compute[74840]: WARNING nova.compute.manager [req-aa9c62d8-05db-42d7-aa56-d1734506ec36 req-f5cba11b-40a0-4a55-80bd-39994ebc1868 service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Received unexpected event network-vif-plugged-850d3852-db4b-4634-b37d-ad1e18f04a6b for instance with vm_state rescued and task_state unrescuing.
Nov 08 12:45:58 user nova-compute[74840]: DEBUG nova.compute.manager [req-aa9c62d8-05db-42d7-aa56-d1734506ec36 req-f5cba11b-40a0-4a55-80bd-39994ebc1868 service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Received event network-vif-plugged-850d3852-db4b-4634-b37d-ad1e18f04a6b {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:45:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-aa9c62d8-05db-42d7-aa56-d1734506ec36 req-f5cba11b-40a0-4a55-80bd-39994ebc1868 service nova] Acquiring lock "f6bccde5-832b-476f-95c0-10b16af6b126-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:45:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-aa9c62d8-05db-42d7-aa56-d1734506ec36 req-f5cba11b-40a0-4a55-80bd-39994ebc1868 service nova] Lock "f6bccde5-832b-476f-95c0-10b16af6b126-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:45:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-aa9c62d8-05db-42d7-aa56-d1734506ec36 req-f5cba11b-40a0-4a55-80bd-39994ebc1868 service nova] Lock "f6bccde5-832b-476f-95c0-10b16af6b126-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:45:58 user nova-compute[74840]: DEBUG nova.compute.manager [req-aa9c62d8-05db-42d7-aa56-d1734506ec36 req-f5cba11b-40a0-4a55-80bd-39994ebc1868 service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] No waiting events found dispatching network-vif-plugged-850d3852-db4b-4634-b37d-ad1e18f04a6b {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:45:58 user nova-compute[74840]: WARNING nova.compute.manager [req-aa9c62d8-05db-42d7-aa56-d1734506ec36 req-f5cba11b-40a0-4a55-80bd-39994ebc1868 service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Received unexpected event network-vif-plugged-850d3852-db4b-4634-b37d-ad1e18f04a6b for instance with vm_state rescued and task_state unrescuing.
Nov 08 12:45:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:45:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:45:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:45:58 user nova-compute[74840]: DEBUG nova.compute.manager [req-850085b0-bf7a-406d-bd35-32a174232a1d req-bed90841-aea2-4a09-ba86-2804d07ee6b5 service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Received event network-changed-850d3852-db4b-4634-b37d-ad1e18f04a6b {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:45:58 user nova-compute[74840]: DEBUG nova.compute.manager [req-850085b0-bf7a-406d-bd35-32a174232a1d req-bed90841-aea2-4a09-ba86-2804d07ee6b5 service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Refreshing instance network info cache due to event network-changed-850d3852-db4b-4634-b37d-ad1e18f04a6b. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:45:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-850085b0-bf7a-406d-bd35-32a174232a1d req-bed90841-aea2-4a09-ba86-2804d07ee6b5 service nova] Acquiring lock "refresh_cache-f6bccde5-832b-476f-95c0-10b16af6b126" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:45:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-850085b0-bf7a-406d-bd35-32a174232a1d req-bed90841-aea2-4a09-ba86-2804d07ee6b5 service nova] Acquired lock "refresh_cache-f6bccde5-832b-476f-95c0-10b16af6b126" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:45:58 user nova-compute[74840]: DEBUG nova.network.neutron [req-850085b0-bf7a-406d-bd35-32a174232a1d req-bed90841-aea2-4a09-ba86-2804d07ee6b5 service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Refreshing network info cache for port 850d3852-db4b-4634-b37d-ad1e18f04a6b {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:45:59 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-c1814bd9-0b5a-4ddc-8a25-9d14e5efe53b tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:45:59 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1814bd9-0b5a-4ddc-8a25-9d14e5efe53b tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '26432323662363738', 'path': '/dev/sdc'} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:45:59 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1814bd9-0b5a-4ddc-8a25-9d14e5efe53b tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432323662363738', 'path': '/dev/sdc'} {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 12:45:59 user nova-compute[74840]: DEBUG nova.objects.instance [None req-c1814bd9-0b5a-4ddc-8a25-9d14e5efe53b tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lazy-loading 'flavor' on Instance uuid c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:45:59 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-c1814bd9-0b5a-4ddc-8a25-9d14e5efe53b tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 12:45:59 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:45:59 user nova-compute[74840]:   <source dev="/dev/sdc"/>
Nov 08 12:45:59 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:45:59 user nova-compute[74840]:   <serial>bc3597a9-a73b-484b-9c74-80c716a4d729</serial>
Nov 08 12:45:59 user nova-compute[74840]: </disk>
Nov 08 12:45:59 user nova-compute[74840]:  {{(pid=74840) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 12:45:59 user nova-compute[74840]: DEBUG nova.network.neutron [req-850085b0-bf7a-406d-bd35-32a174232a1d req-bed90841-aea2-4a09-ba86-2804d07ee6b5 service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Updated VIF entry in instance network info cache for port 850d3852-db4b-4634-b37d-ad1e18f04a6b. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:45:59 user nova-compute[74840]: DEBUG nova.network.neutron [req-850085b0-bf7a-406d-bd35-32a174232a1d req-bed90841-aea2-4a09-ba86-2804d07ee6b5 service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Updating instance_info_cache with network_info: [{"id": "850d3852-db4b-4634-b37d-ad1e18f04a6b", "address": "fa:16:3e:41:0b:a1", "network": {"id": "a52573e9-cee6-4a6d-944d-56fe99e1c3a9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1100599758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3fd3c6c8e1c46c99adee8fdcc73bddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap850d3852-db", "ovs_interfaceid": "850d3852-db4b-4634-b37d-ad1e18f04a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:45:59 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-850085b0-bf7a-406d-bd35-32a174232a1d req-bed90841-aea2-4a09-ba86-2804d07ee6b5 service nova] Releasing lock "refresh_cache-f6bccde5-832b-476f-95c0-10b16af6b126" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:45:59 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-c1814bd9-0b5a-4ddc-8a25-9d14e5efe53b tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:45:59 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-c1814bd9-0b5a-4ddc-8a25-9d14e5efe53b tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:45:59 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-c1814bd9-0b5a-4ddc-8a25-9d14e5efe53b tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] No VIF found with MAC fa:16:3e:f4:cf:dd, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:45:59 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-c1814bd9-0b5a-4ddc-8a25-9d14e5efe53b tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.411s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:45:59 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 22.772s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:45:59 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:46:00 user nova-compute[74840]: DEBUG nova.compute.manager [None req-fbb564ce-0c58-41b2-8a44-52332172e5f5 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:46:00 user nova-compute[74840]: DEBUG nova.compute.manager [req-a02597c7-b2ba-4c42-8c82-8223fea7e6e2 req-157848ad-773d-4cbb-8240-c0d19f9a9ca7 service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Received event network-vif-plugged-850d3852-db4b-4634-b37d-ad1e18f04a6b {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:46:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a02597c7-b2ba-4c42-8c82-8223fea7e6e2 req-157848ad-773d-4cbb-8240-c0d19f9a9ca7 service nova] Acquiring lock "f6bccde5-832b-476f-95c0-10b16af6b126-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:46:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a02597c7-b2ba-4c42-8c82-8223fea7e6e2 req-157848ad-773d-4cbb-8240-c0d19f9a9ca7 service nova] Lock "f6bccde5-832b-476f-95c0-10b16af6b126-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:46:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a02597c7-b2ba-4c42-8c82-8223fea7e6e2 req-157848ad-773d-4cbb-8240-c0d19f9a9ca7 service nova] Lock "f6bccde5-832b-476f-95c0-10b16af6b126-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:46:00 user nova-compute[74840]: DEBUG nova.compute.manager [req-a02597c7-b2ba-4c42-8c82-8223fea7e6e2 req-157848ad-773d-4cbb-8240-c0d19f9a9ca7 service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] No waiting events found dispatching network-vif-plugged-850d3852-db4b-4634-b37d-ad1e18f04a6b {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:46:00 user nova-compute[74840]: WARNING nova.compute.manager [req-a02597c7-b2ba-4c42-8c82-8223fea7e6e2 req-157848ad-773d-4cbb-8240-c0d19f9a9ca7 service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Received unexpected event network-vif-plugged-850d3852-db4b-4634-b37d-ad1e18f04a6b for instance with vm_state active and task_state None.
Nov 08 12:46:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:46:02 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:46:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:46:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:46:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:46:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:46:13 user nova-compute[74840]: DEBUG nova.compute.manager [req-4ebda4d3-e09f-43a2-9258-6d5112b5f557 req-ffb5178c-6d0e-4804-bf17-1baf821e4c0b service nova] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Received event network-changed-0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:46:13 user nova-compute[74840]: DEBUG nova.compute.manager [req-4ebda4d3-e09f-43a2-9258-6d5112b5f557 req-ffb5178c-6d0e-4804-bf17-1baf821e4c0b service nova] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Refreshing instance network info cache due to event network-changed-0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:46:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4ebda4d3-e09f-43a2-9258-6d5112b5f557 req-ffb5178c-6d0e-4804-bf17-1baf821e4c0b service nova] Acquiring lock "refresh_cache-c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:46:13 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4ebda4d3-e09f-43a2-9258-6d5112b5f557 req-ffb5178c-6d0e-4804-bf17-1baf821e4c0b service nova] Acquired lock "refresh_cache-c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:46:13 user nova-compute[74840]: DEBUG nova.network.neutron [req-4ebda4d3-e09f-43a2-9258-6d5112b5f557 req-ffb5178c-6d0e-4804-bf17-1baf821e4c0b service nova] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Refreshing network info cache for port 0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:46:14 user nova-compute[74840]: DEBUG nova.network.neutron [req-4ebda4d3-e09f-43a2-9258-6d5112b5f557 req-ffb5178c-6d0e-4804-bf17-1baf821e4c0b service nova] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Updated VIF entry in instance network info cache for port 0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:46:14 user nova-compute[74840]: DEBUG nova.network.neutron [req-4ebda4d3-e09f-43a2-9258-6d5112b5f557 req-ffb5178c-6d0e-4804-bf17-1baf821e4c0b service nova] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Updating instance_info_cache with network_info: [{"id": "0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3", "address": "fa:16:3e:f4:cf:dd", "network": {"id": "8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1654230640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "270eb2fc5485447f9e09d83d48fdc14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe1ab7b-d3", "ovs_interfaceid": "0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:46:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4ebda4d3-e09f-43a2-9258-6d5112b5f557 req-ffb5178c-6d0e-4804-bf17-1baf821e4c0b service nova] Releasing lock "refresh_cache-c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:46:14 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:46:14 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:46:14 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:46:15 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:46:15 user nova-compute[74840]: DEBUG nova.compute.manager [req-b2182ff5-30ec-4954-8cef-242fa5e7e8a1 req-d356ae6e-1bdd-44b4-93fa-bf96112db425 service nova] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Received event network-changed-0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:46:15 user nova-compute[74840]: DEBUG nova.compute.manager [req-b2182ff5-30ec-4954-8cef-242fa5e7e8a1 req-d356ae6e-1bdd-44b4-93fa-bf96112db425 service nova] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Refreshing instance network info cache due to event network-changed-0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:46:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-b2182ff5-30ec-4954-8cef-242fa5e7e8a1 req-d356ae6e-1bdd-44b4-93fa-bf96112db425 service nova] Acquiring lock "refresh_cache-c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:46:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-b2182ff5-30ec-4954-8cef-242fa5e7e8a1 req-d356ae6e-1bdd-44b4-93fa-bf96112db425 service nova] Acquired lock "refresh_cache-c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:46:15 user nova-compute[74840]: DEBUG nova.network.neutron [req-b2182ff5-30ec-4954-8cef-242fa5e7e8a1 req-d356ae6e-1bdd-44b4-93fa-bf96112db425 service nova] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Refreshing network info cache for port 0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:46:15 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:46:15 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:46:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "refresh_cache-c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:46:16 user nova-compute[74840]: DEBUG nova.network.neutron [req-b2182ff5-30ec-4954-8cef-242fa5e7e8a1 req-d356ae6e-1bdd-44b4-93fa-bf96112db425 service nova] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Updated VIF entry in instance network info cache for port 0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:46:16 user nova-compute[74840]: DEBUG nova.network.neutron [req-b2182ff5-30ec-4954-8cef-242fa5e7e8a1 req-d356ae6e-1bdd-44b4-93fa-bf96112db425 service nova] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Updating instance_info_cache with network_info: [{"id": "0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3", "address": "fa:16:3e:f4:cf:dd", "network": {"id": "8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1654230640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "270eb2fc5485447f9e09d83d48fdc14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe1ab7b-d3", "ovs_interfaceid": "0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:46:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-b2182ff5-30ec-4954-8cef-242fa5e7e8a1 req-d356ae6e-1bdd-44b4-93fa-bf96112db425 service nova] Releasing lock "refresh_cache-c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:46:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquired lock "refresh_cache-c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:46:16 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Forcefully refreshing network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 12:46:16 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Updating instance_info_cache with network_info: [{"id": "0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3", "address": "fa:16:3e:f4:cf:dd", "network": {"id": "8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1654230640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "270eb2fc5485447f9e09d83d48fdc14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe1ab7b-d3", "ovs_interfaceid": "0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:46:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Releasing lock "refresh_cache-c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:46:16 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Updated the network info_cache for instance {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 12:46:16 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:46:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:46:17 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:46:17 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:46:18 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:46:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:46:21 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:46:22 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:46:23 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:46:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:46:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:46:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:46:23 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:46:23 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:46:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:46:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:46:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:46:24 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:46:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:46:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:46:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:46:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:46:24 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:46:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9294d85f-20ec-4a6c-9a52-379187cb2aa1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:46:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9294d85f-20ec-4a6c-9a52-379187cb2aa1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:46:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9294d85f-20ec-4a6c-9a52-379187cb2aa1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:46:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9294d85f-20ec-4a6c-9a52-379187cb2aa1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:46:25 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:46:25 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:46:25 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=8577MB free_disk=24.701339721679688GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:46:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:46:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:46:25 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:46:25 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance f6bccde5-832b-476f-95c0-10b16af6b126 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:46:25 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:46:25 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 9294d85f-20ec-4a6c-9a52-379187cb2aa1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:46:25 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:46:25 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:46:25 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Refreshing inventories for resource provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 12:46:25 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Updating ProviderTree inventory for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 12:46:25 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Updating inventory in ProviderTree for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 12:46:25 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Refreshing aggregate associations for resource provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e, aggregates: None {{(pid=74840) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 12:46:25 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Refreshing trait associations for resource provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=74840) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 12:46:25 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:46:25 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:46:25 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:46:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.438s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:46:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:46:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Acquiring lock "c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:46:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:46:28 user nova-compute[74840]: INFO nova.compute.manager [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Rebooting instance
Nov 08 12:46:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Acquiring lock "refresh_cache-c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:46:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Acquired lock "refresh_cache-c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:46:28 user nova-compute[74840]: DEBUG nova.network.neutron [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:46:28 user nova-compute[74840]: DEBUG nova.network.neutron [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Updating instance_info_cache with network_info: [{"id": "0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3", "address": "fa:16:3e:f4:cf:dd", "network": {"id": "8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1654230640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "270eb2fc5485447f9e09d83d48fdc14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe1ab7b-d3", "ovs_interfaceid": "0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:46:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Releasing lock "refresh_cache-c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:46:28 user nova-compute[74840]: DEBUG nova.compute.manager [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:46:28 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:46:28 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:46:28 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:46:28 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:46:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ddfc5294-55c1-4678-bd18-d7fb08a8705a tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Acquiring lock "f6bccde5-832b-476f-95c0-10b16af6b126" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:46:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ddfc5294-55c1-4678-bd18-d7fb08a8705a tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Lock "f6bccde5-832b-476f-95c0-10b16af6b126" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:46:28 user nova-compute[74840]: INFO nova.compute.manager [None req-ddfc5294-55c1-4678-bd18-d7fb08a8705a tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Detaching volume 3894819a-ade4-48be-aa72-8fe08f2ed68c
Nov 08 12:46:28 user nova-compute[74840]: INFO nova.virt.block_device [None req-ddfc5294-55c1-4678-bd18-d7fb08a8705a tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Attempting to driver detach volume 3894819a-ade4-48be-aa72-8fe08f2ed68c from mountpoint /dev/vdb
Nov 08 12:46:28 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-ddfc5294-55c1-4678-bd18-d7fb08a8705a tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Attempting to detach device vdb from instance f6bccde5-832b-476f-95c0-10b16af6b126 from the persistent domain config. {{(pid=74840) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 12:46:28 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-ddfc5294-55c1-4678-bd18-d7fb08a8705a tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 12:46:28 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:46:28 user nova-compute[74840]:   <source dev="/dev/sdb"/>
Nov 08 12:46:28 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:46:28 user nova-compute[74840]:   <serial>3894819a-ade4-48be-aa72-8fe08f2ed68c</serial>
Nov 08 12:46:28 user nova-compute[74840]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 12:46:28 user nova-compute[74840]: </disk>
Nov 08 12:46:28 user nova-compute[74840]:  {{(pid=74840) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 12:46:28 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-ddfc5294-55c1-4678-bd18-d7fb08a8705a tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Successfully detached device vdb from instance f6bccde5-832b-476f-95c0-10b16af6b126 from the persistent domain config.
Nov 08 12:46:28 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-ddfc5294-55c1-4678-bd18-d7fb08a8705a tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f6bccde5-832b-476f-95c0-10b16af6b126 from the live domain config. {{(pid=74840) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 12:46:28 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-ddfc5294-55c1-4678-bd18-d7fb08a8705a tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 12:46:28 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:46:28 user nova-compute[74840]:   <source dev="/dev/sdb"/>
Nov 08 12:46:28 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:46:28 user nova-compute[74840]:   <serial>3894819a-ade4-48be-aa72-8fe08f2ed68c</serial>
Nov 08 12:46:28 user nova-compute[74840]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 12:46:28 user nova-compute[74840]: </disk>
Nov 08 12:46:28 user nova-compute[74840]:  {{(pid=74840) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG nova.compute.manager [req-c2e22014-6189-48dd-b17d-30e97567cf79 req-d53ff7eb-5f8d-4bb9-94f2-231c419eea5f service nova] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Received event network-vif-unplugged-0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-c2e22014-6189-48dd-b17d-30e97567cf79 req-d53ff7eb-5f8d-4bb9-94f2-231c419eea5f service nova] Acquiring lock "c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-c2e22014-6189-48dd-b17d-30e97567cf79 req-d53ff7eb-5f8d-4bb9-94f2-231c419eea5f service nova] Lock "c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-c2e22014-6189-48dd-b17d-30e97567cf79 req-d53ff7eb-5f8d-4bb9-94f2-231c419eea5f service nova] Lock "c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG nova.compute.manager [req-c2e22014-6189-48dd-b17d-30e97567cf79 req-d53ff7eb-5f8d-4bb9-94f2-231c419eea5f service nova] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] No waiting events found dispatching network-vif-unplugged-0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:46:29 user nova-compute[74840]: WARNING nova.compute.manager [req-c2e22014-6189-48dd-b17d-30e97567cf79 req-d53ff7eb-5f8d-4bb9-94f2-231c419eea5f service nova] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Received unexpected event network-vif-unplugged-0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3 for instance with vm_state active and task_state reboot_started_hard.
Nov 08 12:46:29 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-ddfc5294-55c1-4678-bd18-d7fb08a8705a tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f6bccde5-832b-476f-95c0-10b16af6b126 {{(pid=74840) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 12:46:29 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Instance destroyed successfully.
Nov 08 12:46:29 user nova-compute[74840]: DEBUG nova.objects.instance [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lazy-loading 'resources' on Instance uuid c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:43:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1016291031',display_name='tempest-TestMinimumBasicScenario-server-1016291031',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1016291031',id=46,image_ref='fb6bd902-0ff7-4bbf-99b5-308600485455',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP28XUPPJPJMSa6nvlhEkvvxfAeIxKGkf0ffCl4HMfj1up76qF0QvFROqPKMV9Q9YL9WFQR+ruARvXIB+pK3zkDnL2G/bM1eQWd/Fad9kzzpD9yPXSoXQpzWqLai1C9/lg==',key_name='tempest-TestMinimumBasicScenario-1808576556',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:43:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='270eb2fc5485447f9e09d83d48fdc14f',ramdisk_id='',reservation_id='r-tw2o6si9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fb6bd902-0ff7-4bbf-99b5-308600485455',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1675831883',owner_user_name='tempest-TestMinimumBasicScenario-1675831883-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:46:29Z,user_data=None,user_id='40cef2061d7a4ad9a98409cbaa0f6351',uuid=c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3", "address": "fa:16:3e:f4:cf:dd", "network": {"id": "8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1654230640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "270eb2fc5485447f9e09d83d48fdc14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe1ab7b-d3", "ovs_interfaceid": "0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Converting VIF {"id": "0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3", "address": "fa:16:3e:f4:cf:dd", "network": {"id": "8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1654230640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "270eb2fc5485447f9e09d83d48fdc14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe1ab7b-d3", "ovs_interfaceid": "0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:cf:dd,bridge_name='br-int',has_traffic_filtering=True,id=0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3,network=Network(8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fe1ab7b-d3') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG os_vif [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:cf:dd,bridge_name='br-int',has_traffic_filtering=True,id=0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3,network=Network(8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fe1ab7b-d3') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0fe1ab7b-d3, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a23d6874-8219-4458-9917-da4c70f6e5b6) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:46:29 user nova-compute[74840]: INFO os_vif [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:cf:dd,bridge_name='br-int',has_traffic_filtering=True,id=0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3,network=Network(8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fe1ab7b-d3')
Nov 08 12:46:29 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EImsVpbk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:46:29 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:46:29 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8d2ea0-2e93-4285-ab90-bd8854d92b94]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 12:46:29 user nova-compute[74840]: No targets found.
Nov 08 12:46:29 user nova-compute[74840]: iSNS:
Nov 08 12:46:29 user nova-compute[74840]: No targets found.
Nov 08 12:46:29 user nova-compute[74840]: STATIC:
Nov 08 12:46:29 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c
Nov 08 12:46:29 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:46:29 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:46:29 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729
Nov 08 12:46:29 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:46:29 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:46:29 user nova-compute[74840]: FIRMWARE:
Nov 08 12:46:29 user nova-compute[74840]: No targets found.
Nov 08 12:46:29 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 12:46:29 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 12:46:29 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8473f9a7-810c-4b8b-94ce-703dc9b90215]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2432a75-d7e8-4e9e-a561-38ec37dfc592]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c (non-flash)
Nov 08 12:46:29 user nova-compute[74840]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 (non-flash)
Nov 08 12:46:29 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c (non-flash)
Nov 08 12:46:29 user nova-compute[74840]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 (non-flash)
Nov 08 12:46:29 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7d44391b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729'): ({'sdc'}, set())}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Removing single pathed devices sdc {{(pid=74840) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[756e454b-e25e-4bfb-bb4c-85d0e60bf63a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85ce739-92d7-4cf3-90ef-8bc652dca5c3]: (4, ('ok\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Flushing IO for device /dev/sdc {{(pid=74840) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34589b8-f92d-4c8c-817a-c6692c6c2f55]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74840) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96f8561-669b-4a87-8c7c-7b44c1065065]: (4, ('1', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] SCSI volumes sdc have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729')] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f41a364-0a16-4da1-98de-3e6481498418]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:46:29 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 -p 172.16.0.220:3260 --logout {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1b7f49-d3e9-4a54-abdf-739f7fc790fd]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729, portal: 172.16.0.220,3260]
Nov 08 12:46:30 user nova-compute[74840]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729, portal: 172.16.0.220,3260] successful.
Nov 08 12:46:30 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 -p 172.16.0.220:3260 --op delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02b0a44-648a-47ea-9dd5-95af18b19eb7]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] <== disconnect_volume: return (296ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Start _get_guest_xml network_info=[{"id": "0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3", "address": "fa:16:3e:f4:cf:dd", "network": {"id": "8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1654230640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "270eb2fc5485447f9e09d83d48fdc14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe1ab7b-d3", "ovs_interfaceid": "0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=fb6bd902-0ff7-4bbf-99b5-308600485455,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'image_id': 'fb6bd902-0ff7-4bbf-99b5-308600485455'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '27c47911-4c4a-4bc9-9f7c-44864c563a59', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EImsVpbk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf', 'attached_at': '', 'detached_at': '', 'volume_id': 'bc3597a9-a73b-484b-9c74-80c716a4d729', 'serial': 'bc3597a9-a73b-484b-9c74-80c716a4d729'}, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:46:30 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:46:30 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:46:30 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=fb6bd902-0ff7-4bbf-99b5-308600485455,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG nova.objects.instance [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lazy-loading 'vcpu_model' on Instance uuid c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG nova.objects.base [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Object Instance<c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf> lazy-loaded attributes: resources,vcpu_model {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Calling os-brick to attach iSCSI Volume {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EImsVpbk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:46:30 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:46:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:46:30 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:46:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:46:30 user nova-compute[74840]: INFO os_brick.initiator.connectors.iscsi [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 12:46:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 -p 172.16.0.220:3260 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fdbfc10-3501-40fc-83bf-c3f426bf63e9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 12:46:30 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 -p 172.16.0.220:3260 --interface default --op new {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[366a1cf4-91b4-48ea-b269-315c1757b1e4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729] added\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729] added
Nov 08 12:46:30 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f332598e-7fd3-4b64-8226-a2159ba8f34f]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a93474c-4eb9-47c5-a96c-ec039b87cfaa]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EImsVpbk {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EImsVpbk" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb9c21c-972c-4102-8762-a7c44cfdeb8e]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EImsVpbk'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c05a5c-acac-48c3-b8f9-8953f5029ddb]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[399246b6-f3e3-4d80-9281-2edc60e95531]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c (non-flash)
Nov 08 12:46:30 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c (non-flash)
Nov 08 12:46:30 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 -p 172.16.0.220:3260 --login {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1f3436-430f-41a7-9158-dc65d5b31da4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729, portal: 172.16.0.220,3260]
Nov 08 12:46:30 user nova-compute[74840]: Login to [iface: default, target: iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729, portal: 172.16.0.220,3260] successful.
Nov 08 12:46:30 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d52b1e-845e-4ee5-9857-d3c625888ebf]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[94712aae-3276-4087-926a-b63abbfb24fa]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c (non-flash)
Nov 08 12:46:30 user nova-compute[74840]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 (non-flash)
Nov 08 12:46:30 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c (non-flash)
Nov 08 12:46:30 user nova-compute[74840]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 (non-flash)
Nov 08 12:46:30 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Connected to 172.16.0.220:3260 {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=74840) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74840) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d955e4d4-d981-465c-b486-717660d92b56]: (4, ('- - 0', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:46:30 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: None {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:46:31 user nova-compute[74840]: DEBUG nova.compute.manager [req-e02163b3-f0d3-46ec-bdfe-6d719bfbe45e req-f1749b8f-3488-40e2-badf-1733e20f5948 service nova] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Received event network-vif-plugged-0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:46:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e02163b3-f0d3-46ec-bdfe-6d719bfbe45e req-f1749b8f-3488-40e2-badf-1733e20f5948 service nova] Acquiring lock "c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:46:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e02163b3-f0d3-46ec-bdfe-6d719bfbe45e req-f1749b8f-3488-40e2-badf-1733e20f5948 service nova] Lock "c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:46:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e02163b3-f0d3-46ec-bdfe-6d719bfbe45e req-f1749b8f-3488-40e2-badf-1733e20f5948 service nova] Lock "c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:46:31 user nova-compute[74840]: DEBUG nova.compute.manager [req-e02163b3-f0d3-46ec-bdfe-6d719bfbe45e req-f1749b8f-3488-40e2-badf-1733e20f5948 service nova] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] No waiting events found dispatching network-vif-plugged-0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:46:31 user nova-compute[74840]: WARNING nova.compute.manager [req-e02163b3-f0d3-46ec-bdfe-6d719bfbe45e req-f1749b8f-3488-40e2-badf-1733e20f5948 service nova] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Received unexpected event network-vif-plugged-0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3 for instance with vm_state active and task_state reboot_started_hard.
Nov 08 12:46:31 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:46:31 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EImsVpbk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 12:46:31 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.276s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:46:31 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '26432323662363738', 'path': '/dev/sdc'} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:46:31 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432323662363738', 'path': '/dev/sdc'} {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 12:46:31 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:43:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1016291031',display_name='tempest-TestMinimumBasicScenario-server-1016291031',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1016291031',id=46,image_ref='fb6bd902-0ff7-4bbf-99b5-308600485455',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP28XUPPJPJMSa6nvlhEkvvxfAeIxKGkf0ffCl4HMfj1up76qF0QvFROqPKMV9Q9YL9WFQR+ruARvXIB+pK3zkDnL2G/bM1eQWd/Fad9kzzpD9yPXSoXQpzWqLai1C9/lg==',key_name='tempest-TestMinimumBasicScenario-1808576556',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:43:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='270eb2fc5485447f9e09d83d48fdc14f',ramdisk_id='',reservation_id='r-tw2o6si9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fb6bd902-0ff7-4bbf-99b5-308600485455',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1675831883',owner_user_name='tempest-TestMinimumBasicScenario-1675831883-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:46:29Z,user_data=None,user_id='40cef2061d7a4ad9a98409cbaa0f6351',uuid=c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3", "address": "fa:16:3e:f4:cf:dd", "network": {"id": "8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1654230640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "270eb2fc5485447f9e09d83d48fdc14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe1ab7b-d3", "ovs_interfaceid": "0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:46:31 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Converting VIF {"id": "0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3", "address": "fa:16:3e:f4:cf:dd", "network": {"id": "8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1654230640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "270eb2fc5485447f9e09d83d48fdc14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe1ab7b-d3", "ovs_interfaceid": "0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:46:31 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:cf:dd,bridge_name='br-int',has_traffic_filtering=True,id=0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3,network=Network(8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fe1ab7b-d3') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:46:31 user nova-compute[74840]: DEBUG nova.objects.instance [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lazy-loading 'pci_devices' on Instance uuid c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:46:31 user nova-compute[74840]: DEBUG nova.objects.base [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Object Instance<c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:46:31 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:46:31 user nova-compute[74840]:   <uuid>c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf</uuid>
Nov 08 12:46:31 user nova-compute[74840]:   <name>instance-0000002e</name>
Nov 08 12:46:31 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:46:31 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:46:31 user nova-compute[74840]:   <metadata>
Nov 08 12:46:31 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:46:31 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:46:31 user nova-compute[74840]:       <nova:name>tempest-TestMinimumBasicScenario-server-1016291031</nova:name>
Nov 08 12:46:31 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:46:30</nova:creationTime>
Nov 08 12:46:31 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:46:31 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:46:31 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:46:31 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:46:31 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:46:31 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:46:31 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:46:31 user nova-compute[74840]:       <nova:owner>
Nov 08 12:46:31 user nova-compute[74840]:         <nova:user uuid="40cef2061d7a4ad9a98409cbaa0f6351">tempest-TestMinimumBasicScenario-1675831883-project-member</nova:user>
Nov 08 12:46:31 user nova-compute[74840]:         <nova:project uuid="270eb2fc5485447f9e09d83d48fdc14f">tempest-TestMinimumBasicScenario-1675831883</nova:project>
Nov 08 12:46:31 user nova-compute[74840]:       </nova:owner>
Nov 08 12:46:31 user nova-compute[74840]:       <nova:root type="image" uuid="fb6bd902-0ff7-4bbf-99b5-308600485455"/>
Nov 08 12:46:31 user nova-compute[74840]:       <nova:ports>
Nov 08 12:46:31 user nova-compute[74840]:         <nova:port uuid="0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3">
Nov 08 12:46:31 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 12:46:31 user nova-compute[74840]:         </nova:port>
Nov 08 12:46:31 user nova-compute[74840]:       </nova:ports>
Nov 08 12:46:31 user nova-compute[74840]:     </nova:instance>
Nov 08 12:46:31 user nova-compute[74840]:   </metadata>
Nov 08 12:46:31 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:46:31 user nova-compute[74840]:     <system>
Nov 08 12:46:31 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:46:31 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:46:31 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:46:31 user nova-compute[74840]:       <entry name="serial">c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf</entry>
Nov 08 12:46:31 user nova-compute[74840]:       <entry name="uuid">c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf</entry>
Nov 08 12:46:31 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:46:31 user nova-compute[74840]:     </system>
Nov 08 12:46:31 user nova-compute[74840]:   </sysinfo>
Nov 08 12:46:31 user nova-compute[74840]:   <os>
Nov 08 12:46:31 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:46:31 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:46:31 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:46:31 user nova-compute[74840]:   </os>
Nov 08 12:46:31 user nova-compute[74840]:   <features>
Nov 08 12:46:31 user nova-compute[74840]:     <acpi/>
Nov 08 12:46:31 user nova-compute[74840]:     <apic/>
Nov 08 12:46:31 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:46:31 user nova-compute[74840]:   </features>
Nov 08 12:46:31 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:46:31 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:46:31 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:46:31 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:46:31 user nova-compute[74840]:   </clock>
Nov 08 12:46:31 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:46:31 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:46:31 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:46:31 user nova-compute[74840]:   </cpu>
Nov 08 12:46:31 user nova-compute[74840]:   <devices>
Nov 08 12:46:31 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:46:31 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:46:31 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf/disk"/>
Nov 08 12:46:31 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:46:31 user nova-compute[74840]:     </disk>
Nov 08 12:46:31 user nova-compute[74840]:     <disk type="block" device="disk">
Nov 08 12:46:31 user nova-compute[74840]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:46:31 user nova-compute[74840]:       <source dev="/dev/sdc"/>
Nov 08 12:46:31 user nova-compute[74840]:       <target dev="vdb" bus="virtio"/>
Nov 08 12:46:31 user nova-compute[74840]:       <serial>bc3597a9-a73b-484b-9c74-80c716a4d729</serial>
Nov 08 12:46:31 user nova-compute[74840]:     </disk>
Nov 08 12:46:31 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:46:31 user nova-compute[74840]:       <mac address="fa:16:3e:f4:cf:dd"/>
Nov 08 12:46:31 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:46:31 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:46:31 user nova-compute[74840]:       <target dev="tap0fe1ab7b-d3"/>
Nov 08 12:46:31 user nova-compute[74840]:     </interface>
Nov 08 12:46:31 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:46:31 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf/console.log" append="off"/>
Nov 08 12:46:31 user nova-compute[74840]:     </serial>
Nov 08 12:46:31 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:46:31 user nova-compute[74840]:     <video>
Nov 08 12:46:31 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:46:31 user nova-compute[74840]:     </video>
Nov 08 12:46:31 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:46:31 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:46:31 user nova-compute[74840]:     </rng>
Nov 08 12:46:31 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:46:31 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:46:31 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:46:31 user nova-compute[74840]:     </memballoon>
Nov 08 12:46:31 user nova-compute[74840]:   </devices>
Nov 08 12:46:31 user nova-compute[74840]: </domain>
Nov 08 12:46:31 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:46:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:46:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:46:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:46:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:46:31 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:46:31 user nova-compute[74840]: DEBUG nova.objects.instance [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lazy-loading 'trusted_certs' on Instance uuid c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:46:31 user nova-compute[74840]: DEBUG nova.objects.base [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Object Instance<c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:46:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ec708014af3b8e424e066da6b0282ca7a16a4bb --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:46:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ec708014af3b8e424e066da6b0282ca7a16a4bb --force-share --output=json" returned: 0 in 0.179s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:46:31 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf/disk. size=1073741824 {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 12:46:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:46:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:46:32 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Cannot resize image /opt/stack/data/nova/instances/c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf/disk to a smaller size. {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 12:46:32 user nova-compute[74840]: DEBUG nova.objects.instance [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lazy-loading 'migration_context' on Instance uuid c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:46:32 user nova-compute[74840]: DEBUG nova.objects.base [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Object Instance<c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:46:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:43:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1016291031',display_name='tempest-TestMinimumBasicScenario-server-1016291031',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1016291031',id=46,image_ref='fb6bd902-0ff7-4bbf-99b5-308600485455',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP28XUPPJPJMSa6nvlhEkvvxfAeIxKGkf0ffCl4HMfj1up76qF0QvFROqPKMV9Q9YL9WFQR+ruARvXIB+pK3zkDnL2G/bM1eQWd/Fad9kzzpD9yPXSoXQpzWqLai1C9/lg==',key_name='tempest-TestMinimumBasicScenario-1808576556',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:43:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='270eb2fc5485447f9e09d83d48fdc14f',ramdisk_id='',reservation_id='r-tw2o6si9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fb6bd902-0ff7-4bbf-99b5-308600485455',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1675831883',owner_user_name='tempest-TestMinimumBasicScenario-1675831883-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:46:29Z,user_data=None,user_id='40cef2061d7a4ad9a98409cbaa0f6351',uuid=c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3", "address": "fa:16:3e:f4:cf:dd", "network": {"id": "8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1654230640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "270eb2fc5485447f9e09d83d48fdc14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe1ab7b-d3", "ovs_interfaceid": "0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:46:32 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Converting VIF {"id": "0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3", "address": "fa:16:3e:f4:cf:dd", "network": {"id": "8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1654230640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "270eb2fc5485447f9e09d83d48fdc14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe1ab7b-d3", "ovs_interfaceid": "0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:46:32 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:cf:dd,bridge_name='br-int',has_traffic_filtering=True,id=0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3,network=Network(8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fe1ab7b-d3') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:46:32 user nova-compute[74840]: DEBUG os_vif [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:cf:dd,bridge_name='br-int',has_traffic_filtering=True,id=0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3,network=Network(8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fe1ab7b-d3') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:46:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:46:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:46:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:46:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:46:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7a2c15ac-53cb-5a0c-af12-d030b5fe4c35', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:46:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:46:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:46:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:46:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0fe1ab7b-d3, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:46:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0fe1ab7b-d3, col_values=(('qos', UUID('ec506f01-c130-4ffe-8352-615fb2e5f2bd')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:46:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0fe1ab7b-d3, col_values=(('external_ids', {'iface-id': '0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:cf:dd', 'vm-uuid': 'c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:46:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:46:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:46:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:46:32 user nova-compute[74840]: INFO os_vif [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:cf:dd,bridge_name='br-int',has_traffic_filtering=True,id=0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3,network=Network(8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fe1ab7b-d3')
Nov 08 12:46:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:46:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:46:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:46:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:46:33 user nova-compute[74840]: DEBUG nova.compute.manager [req-5118c7f7-8e8f-4a74-9547-1a39bf37e89a req-6bc5d1c8-e71e-409f-ace5-6a905f716cce service nova] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Received event network-vif-plugged-0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:46:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-5118c7f7-8e8f-4a74-9547-1a39bf37e89a req-6bc5d1c8-e71e-409f-ace5-6a905f716cce service nova] Acquiring lock "c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:46:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-5118c7f7-8e8f-4a74-9547-1a39bf37e89a req-6bc5d1c8-e71e-409f-ace5-6a905f716cce service nova] Lock "c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:46:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-5118c7f7-8e8f-4a74-9547-1a39bf37e89a req-6bc5d1c8-e71e-409f-ace5-6a905f716cce service nova] Lock "c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:46:33 user nova-compute[74840]: DEBUG nova.compute.manager [req-5118c7f7-8e8f-4a74-9547-1a39bf37e89a req-6bc5d1c8-e71e-409f-ace5-6a905f716cce service nova] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] No waiting events found dispatching network-vif-plugged-0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:46:33 user nova-compute[74840]: WARNING nova.compute.manager [req-5118c7f7-8e8f-4a74-9547-1a39bf37e89a req-6bc5d1c8-e71e-409f-ace5-6a905f716cce service nova] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Received unexpected event network-vif-plugged-0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3 for instance with vm_state active and task_state reboot_started_hard.
Nov 08 12:46:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:46:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:46:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:46:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:46:35 user nova-compute[74840]: DEBUG nova.compute.manager [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:46:35 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Instance rebooted successfully.
Nov 08 12:46:35 user nova-compute[74840]: DEBUG nova.compute.manager [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:46:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0bd8967d-3fdc-48c2-b14e-c6ab10af3add tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.601s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:46:35 user nova-compute[74840]: DEBUG nova.compute.manager [req-07636f2e-1101-4ffc-a044-5fa7ce2891de req-23844e1b-7755-4963-a758-014f1d55239a service nova] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Received event network-vif-plugged-0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:46:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-07636f2e-1101-4ffc-a044-5fa7ce2891de req-23844e1b-7755-4963-a758-014f1d55239a service nova] Acquiring lock "c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:46:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-07636f2e-1101-4ffc-a044-5fa7ce2891de req-23844e1b-7755-4963-a758-014f1d55239a service nova] Lock "c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:46:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-07636f2e-1101-4ffc-a044-5fa7ce2891de req-23844e1b-7755-4963-a758-014f1d55239a service nova] Lock "c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:46:35 user nova-compute[74840]: DEBUG nova.compute.manager [req-07636f2e-1101-4ffc-a044-5fa7ce2891de req-23844e1b-7755-4963-a758-014f1d55239a service nova] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] No waiting events found dispatching network-vif-plugged-0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:46:35 user nova-compute[74840]: WARNING nova.compute.manager [req-07636f2e-1101-4ffc-a044-5fa7ce2891de req-23844e1b-7755-4963-a758-014f1d55239a service nova] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Received unexpected event network-vif-plugged-0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3 for instance with vm_state active and task_state None.
Nov 08 12:46:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:46:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:46:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:46:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:46:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:46:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 12:46:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:46:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:46:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:46:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:46:49 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-ddfc5294-55c1-4678-bd18-d7fb08a8705a tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f6bccde5-832b-476f-95c0-10b16af6b126 is timed out.
Nov 08 12:46:49 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-ddfc5294-55c1-4678-bd18-d7fb08a8705a tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Successfully detached device vdb from instance f6bccde5-832b-476f-95c0-10b16af6b126 from the live domain config.
Nov 08 12:46:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddfc5294-55c1-4678-bd18-d7fb08a8705a tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 12:46:49 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfc5294-55c1-4678-bd18-d7fb08a8705a tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qfCsNcVm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:46:49 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-ddfc5294-55c1-4678-bd18-d7fb08a8705a tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:46:49 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-ddfc5294-55c1-4678-bd18-d7fb08a8705a tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:46:49 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-ddfc5294-55c1-4678-bd18-d7fb08a8705a tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:46:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:46:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:46:49 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ecbabd-5113-4660-9ac0-044d6a82834e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:46:49 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfc5294-55c1-4678-bd18-d7fb08a8705a tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 12:46:49 user nova-compute[74840]: No targets found.
Nov 08 12:46:49 user nova-compute[74840]: iSNS:
Nov 08 12:46:49 user nova-compute[74840]: No targets found.
Nov 08 12:46:49 user nova-compute[74840]: STATIC:
Nov 08 12:46:49 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c
Nov 08 12:46:49 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:46:49 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:46:49 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729
Nov 08 12:46:49 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:46:49 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:46:49 user nova-compute[74840]: FIRMWARE:
Nov 08 12:46:49 user nova-compute[74840]: No targets found.
Nov 08 12:46:49 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:46:49 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfc5294-55c1-4678-bd18-d7fb08a8705a tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 12:46:49 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 12:46:49 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 12:46:49 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfc5294-55c1-4678-bd18-d7fb08a8705a tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 12:46:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:46:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:46:49 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f982f39-0b85-4d19-bdb9-0374c0eb8f50]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:46:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:46:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:46:49 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f6c60d-8fee-415c-a461-d1d4cd73bbec]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:46:49 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfc5294-55c1-4678-bd18-d7fb08a8705a tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c (non-flash)
Nov 08 12:46:49 user nova-compute[74840]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 (non-flash)
Nov 08 12:46:49 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:46:49 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfc5294-55c1-4678-bd18-d7fb08a8705a tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c (non-flash)
Nov 08 12:46:49 user nova-compute[74840]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 (non-flash)
Nov 08 12:46:49 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:46:49 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfc5294-55c1-4678-bd18-d7fb08a8705a tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7ec0ea200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c'): ({'sdb'}, set())}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 12:46:49 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-ddfc5294-55c1-4678-bd18-d7fb08a8705a tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Removing single pathed devices sdb {{(pid=74840) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 12:46:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:46:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:46:49 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f4148c-ba06-4d3a-b56e-67d15c2c87d9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:46:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:46:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:46:49 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[145136d4-3d8b-45a8-b957-41603e2eec47]: (4, ('ok\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:46:49 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-ddfc5294-55c1-4678-bd18-d7fb08a8705a tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Flushing IO for device /dev/sdb {{(pid=74840) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 12:46:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:46:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:46:49 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b075a1-b9f9-4054-bb1c-367d0d53d864]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:46:49 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-ddfc5294-55c1-4678-bd18-d7fb08a8705a tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74840) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 12:46:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:46:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:46:49 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8c691a-dc05-4cb0-8b25-47aa52a3350a]: (4, ('1', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:46:49 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-ddfc5294-55c1-4678-bd18-d7fb08a8705a tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 12:46:49 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-ddfc5294-55c1-4678-bd18-d7fb08a8705a tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] SCSI volumes sdb have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 12:46:49 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfc5294-55c1-4678-bd18-d7fb08a8705a tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c')] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 12:46:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:46:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:46:49 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c677812-a8cd-4bec-965f-d858de6e0c01]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:46:49 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfc5294-55c1-4678-bd18-d7fb08a8705a tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:46:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c -p 172.16.0.220:3260 --logout {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:46:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:46:49 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab877814-31d3-4e2a-9bd1-9e1b7dd994e4]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:46:49 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfc5294-55c1-4678-bd18-d7fb08a8705a tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c, portal: 172.16.0.220,3260]
Nov 08 12:46:49 user nova-compute[74840]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c, portal: 172.16.0.220,3260] successful.
Nov 08 12:46:49 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:46:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c -p 172.16.0.220:3260 --op delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:46:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3894819a-ade4-48be-aa72-8fe08f2ed68c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:46:49 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd247cde-66dc-47ca-90f0-4fae4bec74ae]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:46:49 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfc5294-55c1-4678-bd18-d7fb08a8705a tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:46:49 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-ddfc5294-55c1-4678-bd18-d7fb08a8705a tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:46:49 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfc5294-55c1-4678-bd18-d7fb08a8705a tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] <== disconnect_volume: return (290ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:46:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddfc5294-55c1-4678-bd18-d7fb08a8705a tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 12:46:50 user nova-compute[74840]: DEBUG nova.objects.instance [None req-ddfc5294-55c1-4678-bd18-d7fb08a8705a tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Lazy-loading 'flavor' on Instance uuid f6bccde5-832b-476f-95c0-10b16af6b126 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:46:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ddfc5294-55c1-4678-bd18-d7fb08a8705a tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Lock "f6bccde5-832b-476f-95c0-10b16af6b126" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.804s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:46:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:46:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:46:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:46:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:47:02 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:47:02 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:47:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:47:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:47:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:47:16 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:47:16 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:47:16 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:47:16 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:47:16 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:47:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:47:17 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:47:17 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:47:17 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Rebuilding the list of instances to heal {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 12:47:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "refresh_cache-f6bccde5-832b-476f-95c0-10b16af6b126" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:47:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquired lock "refresh_cache-f6bccde5-832b-476f-95c0-10b16af6b126" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:47:17 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Forcefully refreshing network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 12:47:17 user nova-compute[74840]: DEBUG nova.objects.instance [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lazy-loading 'info_cache' on Instance uuid f6bccde5-832b-476f-95c0-10b16af6b126 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:47:18 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Updating instance_info_cache with network_info: [{"id": "850d3852-db4b-4634-b37d-ad1e18f04a6b", "address": "fa:16:3e:41:0b:a1", "network": {"id": "a52573e9-cee6-4a6d-944d-56fe99e1c3a9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1100599758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3fd3c6c8e1c46c99adee8fdcc73bddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap850d3852-db", "ovs_interfaceid": "850d3852-db4b-4634-b37d-ad1e18f04a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:47:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Releasing lock "refresh_cache-f6bccde5-832b-476f-95c0-10b16af6b126" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:47:18 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Updated the network info_cache for instance {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 12:47:18 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:47:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bff0852a-cf1b-4cc9-a69a-85146fcb6983 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Acquiring lock "f6bccde5-832b-476f-95c0-10b16af6b126" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:47:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bff0852a-cf1b-4cc9-a69a-85146fcb6983 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Lock "f6bccde5-832b-476f-95c0-10b16af6b126" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:47:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bff0852a-cf1b-4cc9-a69a-85146fcb6983 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Acquiring lock "f6bccde5-832b-476f-95c0-10b16af6b126-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:47:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bff0852a-cf1b-4cc9-a69a-85146fcb6983 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Lock "f6bccde5-832b-476f-95c0-10b16af6b126-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:47:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bff0852a-cf1b-4cc9-a69a-85146fcb6983 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Lock "f6bccde5-832b-476f-95c0-10b16af6b126-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:47:19 user nova-compute[74840]: INFO nova.compute.manager [None req-bff0852a-cf1b-4cc9-a69a-85146fcb6983 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Terminating instance
Nov 08 12:47:19 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bff0852a-cf1b-4cc9-a69a-85146fcb6983 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Start destroying the instance on the hypervisor. {{(pid=74840) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 12:47:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:47:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:47:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:47:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:47:19 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:47:19 user nova-compute[74840]: DEBUG nova.compute.manager [req-8275d06b-00ce-4e23-b32e-d307d89c69ad req-c158afda-3d92-43b0-a477-50b5a3b49bde service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Received event network-vif-unplugged-850d3852-db4b-4634-b37d-ad1e18f04a6b {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:47:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8275d06b-00ce-4e23-b32e-d307d89c69ad req-c158afda-3d92-43b0-a477-50b5a3b49bde service nova] Acquiring lock "f6bccde5-832b-476f-95c0-10b16af6b126-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:47:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8275d06b-00ce-4e23-b32e-d307d89c69ad req-c158afda-3d92-43b0-a477-50b5a3b49bde service nova] Lock "f6bccde5-832b-476f-95c0-10b16af6b126-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:47:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8275d06b-00ce-4e23-b32e-d307d89c69ad req-c158afda-3d92-43b0-a477-50b5a3b49bde service nova] Lock "f6bccde5-832b-476f-95c0-10b16af6b126-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:47:19 user nova-compute[74840]: DEBUG nova.compute.manager [req-8275d06b-00ce-4e23-b32e-d307d89c69ad req-c158afda-3d92-43b0-a477-50b5a3b49bde service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] No waiting events found dispatching network-vif-unplugged-850d3852-db4b-4634-b37d-ad1e18f04a6b {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:47:19 user nova-compute[74840]: DEBUG nova.compute.manager [req-8275d06b-00ce-4e23-b32e-d307d89c69ad req-c158afda-3d92-43b0-a477-50b5a3b49bde service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Received event network-vif-unplugged-850d3852-db4b-4634-b37d-ad1e18f04a6b for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:47:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:47:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:47:20 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Instance destroyed successfully.
Nov 08 12:47:20 user nova-compute[74840]: DEBUG nova.objects.instance [None req-bff0852a-cf1b-4cc9-a69a-85146fcb6983 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Lazy-loading 'resources' on Instance uuid f6bccde5-832b-476f-95c0-10b16af6b126 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:47:20 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-bff0852a-cf1b-4cc9-a69a-85146fcb6983 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:39:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1299138905',display_name='tempest-ServerStableDeviceRescueTest-server-1299138905',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1299138905',id=45,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqa/+iNxPeIQYD3fLVa0jz66LjeWDnwNuOQk1VW3EmJ7Go0FB1KgI7HiVq2xPRo/3cUnAUmUNTqS4etPW+TkhZHwcnmFn5gt2tpGmOQDIvxOymmXIi5GxQ6a3v7+Mu/mg==',key_name='tempest-keypair-1162134661',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:44:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d3fd3c6c8e1c46c99adee8fdcc73bddd',ramdisk_id='',reservation_id='r-it2qamc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-950232424',owner_user_name='tempest-ServerStableDeviceRescueTest-950232424-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:46:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='95152d14cd714fa494e353afb9ffccec',uuid=f6bccde5-832b-476f-95c0-10b16af6b126,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "850d3852-db4b-4634-b37d-ad1e18f04a6b", "address": "fa:16:3e:41:0b:a1", "network": {"id": "a52573e9-cee6-4a6d-944d-56fe99e1c3a9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1100599758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3fd3c6c8e1c46c99adee8fdcc73bddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap850d3852-db", "ovs_interfaceid": "850d3852-db4b-4634-b37d-ad1e18f04a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:47:20 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-bff0852a-cf1b-4cc9-a69a-85146fcb6983 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Converting VIF {"id": "850d3852-db4b-4634-b37d-ad1e18f04a6b", "address": "fa:16:3e:41:0b:a1", "network": {"id": "a52573e9-cee6-4a6d-944d-56fe99e1c3a9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1100599758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3fd3c6c8e1c46c99adee8fdcc73bddd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap850d3852-db", "ovs_interfaceid": "850d3852-db4b-4634-b37d-ad1e18f04a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:47:20 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-bff0852a-cf1b-4cc9-a69a-85146fcb6983 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:0b:a1,bridge_name='br-int',has_traffic_filtering=True,id=850d3852-db4b-4634-b37d-ad1e18f04a6b,network=Network(a52573e9-cee6-4a6d-944d-56fe99e1c3a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap850d3852-db') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:47:20 user nova-compute[74840]: DEBUG os_vif [None req-bff0852a-cf1b-4cc9-a69a-85146fcb6983 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:0b:a1,bridge_name='br-int',has_traffic_filtering=True,id=850d3852-db4b-4634-b37d-ad1e18f04a6b,network=Network(a52573e9-cee6-4a6d-944d-56fe99e1c3a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap850d3852-db') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:47:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:47:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap850d3852-db, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:47:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:47:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:47:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:47:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9a17c82c-7cd0-4f5d-89fe-20d52f944fff) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:47:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:47:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:47:20 user nova-compute[74840]: INFO os_vif [None req-bff0852a-cf1b-4cc9-a69a-85146fcb6983 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:0b:a1,bridge_name='br-int',has_traffic_filtering=True,id=850d3852-db4b-4634-b37d-ad1e18f04a6b,network=Network(a52573e9-cee6-4a6d-944d-56fe99e1c3a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap850d3852-db')
Nov 08 12:47:20 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-bff0852a-cf1b-4cc9-a69a-85146fcb6983 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Deleting instance files /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126_del
Nov 08 12:47:20 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-bff0852a-cf1b-4cc9-a69a-85146fcb6983 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Deletion of /opt/stack/data/nova/instances/f6bccde5-832b-476f-95c0-10b16af6b126_del complete
Nov 08 12:47:20 user nova-compute[74840]: INFO nova.compute.manager [None req-bff0852a-cf1b-4cc9-a69a-85146fcb6983 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 08 12:47:20 user nova-compute[74840]: DEBUG oslo.service.loopingcall [None req-bff0852a-cf1b-4cc9-a69a-85146fcb6983 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74840) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 12:47:20 user nova-compute[74840]: DEBUG nova.compute.manager [-] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Deallocating network for instance {{(pid=74840) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 12:47:20 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] deallocate_for_instance() {{(pid=74840) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 12:47:21 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:47:21 user nova-compute[74840]: INFO nova.compute.manager [-] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Took 0.86 seconds to deallocate network for instance.
Nov 08 12:47:21 user nova-compute[74840]: DEBUG nova.compute.manager [req-f7841593-dcc3-48ae-a9d2-013d2dc6673b req-6d2fc916-b7ac-40a9-9ee9-7443eff12d31 service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Received event network-vif-deleted-850d3852-db4b-4634-b37d-ad1e18f04a6b {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:47:21 user nova-compute[74840]: INFO nova.compute.manager [req-f7841593-dcc3-48ae-a9d2-013d2dc6673b req-6d2fc916-b7ac-40a9-9ee9-7443eff12d31 service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Neutron deleted interface 850d3852-db4b-4634-b37d-ad1e18f04a6b; detaching it from the instance and deleting it from the info cache
Nov 08 12:47:21 user nova-compute[74840]: DEBUG nova.network.neutron [req-f7841593-dcc3-48ae-a9d2-013d2dc6673b req-6d2fc916-b7ac-40a9-9ee9-7443eff12d31 service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:47:21 user nova-compute[74840]: DEBUG nova.compute.manager [req-f7841593-dcc3-48ae-a9d2-013d2dc6673b req-6d2fc916-b7ac-40a9-9ee9-7443eff12d31 service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Detach interface failed, port_id=850d3852-db4b-4634-b37d-ad1e18f04a6b, reason: Instance f6bccde5-832b-476f-95c0-10b16af6b126 could not be found. {{(pid=74840) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 12:47:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bff0852a-cf1b-4cc9-a69a-85146fcb6983 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:47:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bff0852a-cf1b-4cc9-a69a-85146fcb6983 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:47:21 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bff0852a-cf1b-4cc9-a69a-85146fcb6983 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:47:21 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bff0852a-cf1b-4cc9-a69a-85146fcb6983 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:47:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bff0852a-cf1b-4cc9-a69a-85146fcb6983 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.151s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:47:21 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-bff0852a-cf1b-4cc9-a69a-85146fcb6983 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Deleted allocations for instance f6bccde5-832b-476f-95c0-10b16af6b126
Nov 08 12:47:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bff0852a-cf1b-4cc9-a69a-85146fcb6983 tempest-ServerStableDeviceRescueTest-950232424 tempest-ServerStableDeviceRescueTest-950232424-project-member] Lock "f6bccde5-832b-476f-95c0-10b16af6b126" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.068s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:47:21 user nova-compute[74840]: DEBUG nova.compute.manager [req-98839343-9ea1-4174-a92d-ea48e8ac3d13 req-352b3092-3838-4d31-8981-56f7c49826fc service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Received event network-vif-plugged-850d3852-db4b-4634-b37d-ad1e18f04a6b {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:47:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-98839343-9ea1-4174-a92d-ea48e8ac3d13 req-352b3092-3838-4d31-8981-56f7c49826fc service nova] Acquiring lock "f6bccde5-832b-476f-95c0-10b16af6b126-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:47:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-98839343-9ea1-4174-a92d-ea48e8ac3d13 req-352b3092-3838-4d31-8981-56f7c49826fc service nova] Lock "f6bccde5-832b-476f-95c0-10b16af6b126-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:47:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-98839343-9ea1-4174-a92d-ea48e8ac3d13 req-352b3092-3838-4d31-8981-56f7c49826fc service nova] Lock "f6bccde5-832b-476f-95c0-10b16af6b126-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:47:21 user nova-compute[74840]: DEBUG nova.compute.manager [req-98839343-9ea1-4174-a92d-ea48e8ac3d13 req-352b3092-3838-4d31-8981-56f7c49826fc service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] No waiting events found dispatching network-vif-plugged-850d3852-db4b-4634-b37d-ad1e18f04a6b {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:47:21 user nova-compute[74840]: WARNING nova.compute.manager [req-98839343-9ea1-4174-a92d-ea48e8ac3d13 req-352b3092-3838-4d31-8981-56f7c49826fc service nova] [instance: f6bccde5-832b-476f-95c0-10b16af6b126] Received unexpected event network-vif-plugged-850d3852-db4b-4634-b37d-ad1e18f04a6b for instance with vm_state deleted and task_state None.
Nov 08 12:47:22 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:47:23 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:47:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:47:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:47:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:47:23 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:47:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Acquiring lock "d141acfc-f098-41db-a925-90288dfba292" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:47:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Lock "d141acfc-f098-41db-a925-90288dfba292" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:47:23 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:47:23 user nova-compute[74840]: DEBUG nova.compute.manager [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: d141acfc-f098-41db-a925-90288dfba292] Starting instance... {{(pid=74840) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 12:47:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:47:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:47:23 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:47:23 user nova-compute[74840]: INFO nova.compute.claims [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: d141acfc-f098-41db-a925-90288dfba292] Claim successful on node user
Nov 08 12:47:23 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:47:23 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:47:24 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:47:24 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:47:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:47:24 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:47:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9294d85f-20ec-4a6c-9a52-379187cb2aa1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:47:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.287s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:47:24 user nova-compute[74840]: DEBUG nova.compute.manager [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: d141acfc-f098-41db-a925-90288dfba292] Start building networks asynchronously for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 12:47:24 user nova-compute[74840]: DEBUG nova.compute.manager [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: d141acfc-f098-41db-a925-90288dfba292] Allocating IP information in the background. {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 12:47:24 user nova-compute[74840]: DEBUG nova.network.neutron [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: d141acfc-f098-41db-a925-90288dfba292] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 12:47:24 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: d141acfc-f098-41db-a925-90288dfba292] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 12:47:24 user nova-compute[74840]: DEBUG nova.compute.manager [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: d141acfc-f098-41db-a925-90288dfba292] Start building block device mappings for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 12:47:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9294d85f-20ec-4a6c-9a52-379187cb2aa1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:47:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9294d85f-20ec-4a6c-9a52-379187cb2aa1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:47:24 user nova-compute[74840]: DEBUG nova.policy [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '52ea0bf6286c45f987154493a281b260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e48fbc441e79426f859e00e5c19a1167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 12:47:24 user nova-compute[74840]: DEBUG nova.compute.manager [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: d141acfc-f098-41db-a925-90288dfba292] Start spawning the instance on the hypervisor. {{(pid=74840) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 12:47:24 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: d141acfc-f098-41db-a925-90288dfba292] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:47:24 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: d141acfc-f098-41db-a925-90288dfba292] Creating image(s)
Nov 08 12:47:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Acquiring lock "/opt/stack/data/nova/instances/d141acfc-f098-41db-a925-90288dfba292/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:47:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Lock "/opt/stack/data/nova/instances/d141acfc-f098-41db-a925-90288dfba292/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:47:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Lock "/opt/stack/data/nova/instances/d141acfc-f098-41db-a925-90288dfba292/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:47:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:47:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9294d85f-20ec-4a6c-9a52-379187cb2aa1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:47:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.413s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:47:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Acquiring lock "5d26578eba85497f494c575690c4248f381a0fe6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:47:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:47:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:47:24 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:47:24 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:47:24 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=8699MB free_disk=24.816795349121094GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:47:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:47:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:47:25 user nova-compute[74840]: DEBUG nova.network.neutron [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: d141acfc-f098-41db-a925-90288dfba292] Successfully created port: 4e3dffbe-0646-40d3-9206-07eb0c427755 {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:47:25 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:47:25 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 9294d85f-20ec-4a6c-9a52-379187cb2aa1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:47:25 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance d141acfc-f098-41db-a925-90288dfba292 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:47:25 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:47:25 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:47:25 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.189s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:47:25 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/d141acfc-f098-41db-a925-90288dfba292/disk 1073741824 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:47:25 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/d141acfc-f098-41db-a925-90288dfba292/disk 1073741824" returned: 0 in 0.050s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:47:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:47:25 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:47:25 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:47:25 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:47:25 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:47:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.320s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:47:25 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:47:25 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.167s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:47:25 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d141acfc-f098-41db-a925-90288dfba292/disk. size=1073741824 {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 12:47:25 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d141acfc-f098-41db-a925-90288dfba292/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:47:25 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d141acfc-f098-41db-a925-90288dfba292/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:47:25 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Cannot resize image /opt/stack/data/nova/instances/d141acfc-f098-41db-a925-90288dfba292/disk to a smaller size. {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 12:47:25 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: d141acfc-f098-41db-a925-90288dfba292] Created local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 12:47:25 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: d141acfc-f098-41db-a925-90288dfba292] Ensure instance console log exists: /opt/stack/data/nova/instances/d141acfc-f098-41db-a925-90288dfba292/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:47:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:47:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:47:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:47:25 user nova-compute[74840]: DEBUG nova.network.neutron [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: d141acfc-f098-41db-a925-90288dfba292] Successfully updated port: 4e3dffbe-0646-40d3-9206-07eb0c427755 {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:47:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Acquiring lock "refresh_cache-d141acfc-f098-41db-a925-90288dfba292" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:47:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Acquired lock "refresh_cache-d141acfc-f098-41db-a925-90288dfba292" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:47:25 user nova-compute[74840]: DEBUG nova.network.neutron [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: d141acfc-f098-41db-a925-90288dfba292] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:47:25 user nova-compute[74840]: DEBUG nova.compute.manager [req-4e561da1-8dc8-49e1-84f5-3fdb1418948f req-17079c4b-7812-4e75-8b04-d186f9953a15 service nova] [instance: d141acfc-f098-41db-a925-90288dfba292] Received event network-changed-4e3dffbe-0646-40d3-9206-07eb0c427755 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:47:25 user nova-compute[74840]: DEBUG nova.compute.manager [req-4e561da1-8dc8-49e1-84f5-3fdb1418948f req-17079c4b-7812-4e75-8b04-d186f9953a15 service nova] [instance: d141acfc-f098-41db-a925-90288dfba292] Refreshing instance network info cache due to event network-changed-4e3dffbe-0646-40d3-9206-07eb0c427755. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:47:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4e561da1-8dc8-49e1-84f5-3fdb1418948f req-17079c4b-7812-4e75-8b04-d186f9953a15 service nova] Acquiring lock "refresh_cache-d141acfc-f098-41db-a925-90288dfba292" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:47:25 user nova-compute[74840]: DEBUG nova.network.neutron [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: d141acfc-f098-41db-a925-90288dfba292] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:47:26 user nova-compute[74840]: DEBUG nova.network.neutron [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: d141acfc-f098-41db-a925-90288dfba292] Updating instance_info_cache with network_info: [{"id": "4e3dffbe-0646-40d3-9206-07eb0c427755", "address": "fa:16:3e:4e:2e:3f", "network": {"id": "88ccbadb-f25d-463d-a2c3-01dcd402b165", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1492603656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e48fbc441e79426f859e00e5c19a1167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3dffbe-06", "ovs_interfaceid": "4e3dffbe-0646-40d3-9206-07eb0c427755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:47:26 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Releasing lock "refresh_cache-d141acfc-f098-41db-a925-90288dfba292" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:47:26 user nova-compute[74840]: DEBUG nova.compute.manager [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: d141acfc-f098-41db-a925-90288dfba292] Instance network_info: |[{"id": "4e3dffbe-0646-40d3-9206-07eb0c427755", "address": "fa:16:3e:4e:2e:3f", "network": {"id": "88ccbadb-f25d-463d-a2c3-01dcd402b165", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1492603656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e48fbc441e79426f859e00e5c19a1167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3dffbe-06", "ovs_interfaceid": "4e3dffbe-0646-40d3-9206-07eb0c427755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 12:47:26 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4e561da1-8dc8-49e1-84f5-3fdb1418948f req-17079c4b-7812-4e75-8b04-d186f9953a15 service nova] Acquired lock "refresh_cache-d141acfc-f098-41db-a925-90288dfba292" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:47:26 user nova-compute[74840]: DEBUG nova.network.neutron [req-4e561da1-8dc8-49e1-84f5-3fdb1418948f req-17079c4b-7812-4e75-8b04-d186f9953a15 service nova] [instance: d141acfc-f098-41db-a925-90288dfba292] Refreshing network info cache for port 4e3dffbe-0646-40d3-9206-07eb0c427755 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:47:26 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: d141acfc-f098-41db-a925-90288dfba292] Start _get_guest_xml network_info=[{"id": "4e3dffbe-0646-40d3-9206-07eb0c427755", "address": "fa:16:3e:4e:2e:3f", "network": {"id": "88ccbadb-f25d-463d-a2c3-01dcd402b165", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1492603656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e48fbc441e79426f859e00e5c19a1167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3dffbe-06", "ovs_interfaceid": "4e3dffbe-0646-40d3-9206-07eb0c427755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'image_id': '4fa17706-d304-4117-a420-dab994c703dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:47:26 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:47:26 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:47:26 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:47:26 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:47:26 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:47:26 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:47:26 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:47:26 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:47:26 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:47:26 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:47:26 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:47:26 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:47:26 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:47:26 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:47:26 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:47:26 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:47:26 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:47:26 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:47:26 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:47:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2084158875',display_name='tempest-ServersNegativeTestJSON-server-2084158875',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2084158875',id=48,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e48fbc441e79426f859e00e5c19a1167',ramdisk_id='',reservation_id='r-ok01kzy1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-199749076',owner_user_name='tempest-ServersNegativeTestJSON-199749076-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:47:24Z,user_data=None,user_id='52ea0bf6286c45f987154493a281b260',uuid=d141acfc-f098-41db-a925-90288dfba292,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e3dffbe-0646-40d3-9206-07eb0c427755", "address": "fa:16:3e:4e:2e:3f", "network": {"id": "88ccbadb-f25d-463d-a2c3-01dcd402b165", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1492603656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e48fbc441e79426f859e00e5c19a1167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3dffbe-06", "ovs_interfaceid": "4e3dffbe-0646-40d3-9206-07eb0c427755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:47:26 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Converting VIF {"id": "4e3dffbe-0646-40d3-9206-07eb0c427755", "address": "fa:16:3e:4e:2e:3f", "network": {"id": "88ccbadb-f25d-463d-a2c3-01dcd402b165", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1492603656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e48fbc441e79426f859e00e5c19a1167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3dffbe-06", "ovs_interfaceid": "4e3dffbe-0646-40d3-9206-07eb0c427755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:47:26 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:2e:3f,bridge_name='br-int',has_traffic_filtering=True,id=4e3dffbe-0646-40d3-9206-07eb0c427755,network=Network(88ccbadb-f25d-463d-a2c3-01dcd402b165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e3dffbe-06') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:47:26 user nova-compute[74840]: DEBUG nova.objects.instance [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Lazy-loading 'pci_devices' on Instance uuid d141acfc-f098-41db-a925-90288dfba292 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:47:26 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: d141acfc-f098-41db-a925-90288dfba292] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:47:26 user nova-compute[74840]:   <uuid>d141acfc-f098-41db-a925-90288dfba292</uuid>
Nov 08 12:47:26 user nova-compute[74840]:   <name>instance-00000030</name>
Nov 08 12:47:26 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:47:26 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:47:26 user nova-compute[74840]:   <metadata>
Nov 08 12:47:26 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:47:26 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:47:26 user nova-compute[74840]:       <nova:name>tempest-ServersNegativeTestJSON-server-2084158875</nova:name>
Nov 08 12:47:26 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:47:26</nova:creationTime>
Nov 08 12:47:26 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:47:26 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:47:26 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:47:26 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:47:26 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:47:26 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:47:26 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:47:26 user nova-compute[74840]:       <nova:owner>
Nov 08 12:47:26 user nova-compute[74840]:         <nova:user uuid="52ea0bf6286c45f987154493a281b260">tempest-ServersNegativeTestJSON-199749076-project-member</nova:user>
Nov 08 12:47:26 user nova-compute[74840]:         <nova:project uuid="e48fbc441e79426f859e00e5c19a1167">tempest-ServersNegativeTestJSON-199749076</nova:project>
Nov 08 12:47:26 user nova-compute[74840]:       </nova:owner>
Nov 08 12:47:26 user nova-compute[74840]:       <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:47:26 user nova-compute[74840]:       <nova:ports>
Nov 08 12:47:26 user nova-compute[74840]:         <nova:port uuid="4e3dffbe-0646-40d3-9206-07eb0c427755">
Nov 08 12:47:26 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 12:47:26 user nova-compute[74840]:         </nova:port>
Nov 08 12:47:26 user nova-compute[74840]:       </nova:ports>
Nov 08 12:47:26 user nova-compute[74840]:     </nova:instance>
Nov 08 12:47:26 user nova-compute[74840]:   </metadata>
Nov 08 12:47:26 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:47:26 user nova-compute[74840]:     <system>
Nov 08 12:47:26 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:47:26 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:47:26 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:47:26 user nova-compute[74840]:       <entry name="serial">d141acfc-f098-41db-a925-90288dfba292</entry>
Nov 08 12:47:26 user nova-compute[74840]:       <entry name="uuid">d141acfc-f098-41db-a925-90288dfba292</entry>
Nov 08 12:47:26 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:47:26 user nova-compute[74840]:     </system>
Nov 08 12:47:26 user nova-compute[74840]:   </sysinfo>
Nov 08 12:47:26 user nova-compute[74840]:   <os>
Nov 08 12:47:26 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:47:26 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:47:26 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:47:26 user nova-compute[74840]:   </os>
Nov 08 12:47:26 user nova-compute[74840]:   <features>
Nov 08 12:47:26 user nova-compute[74840]:     <acpi/>
Nov 08 12:47:26 user nova-compute[74840]:     <apic/>
Nov 08 12:47:26 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:47:26 user nova-compute[74840]:   </features>
Nov 08 12:47:26 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:47:26 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:47:26 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:47:26 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:47:26 user nova-compute[74840]:   </clock>
Nov 08 12:47:26 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:47:26 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:47:26 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:47:26 user nova-compute[74840]:   </cpu>
Nov 08 12:47:26 user nova-compute[74840]:   <devices>
Nov 08 12:47:26 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:47:26 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:47:26 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/d141acfc-f098-41db-a925-90288dfba292/disk"/>
Nov 08 12:47:26 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:47:26 user nova-compute[74840]:     </disk>
Nov 08 12:47:26 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:47:26 user nova-compute[74840]:       <mac address="fa:16:3e:4e:2e:3f"/>
Nov 08 12:47:26 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:47:26 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:47:26 user nova-compute[74840]:       <target dev="tap4e3dffbe-06"/>
Nov 08 12:47:26 user nova-compute[74840]:     </interface>
Nov 08 12:47:26 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:47:26 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/d141acfc-f098-41db-a925-90288dfba292/console.log" append="off"/>
Nov 08 12:47:26 user nova-compute[74840]:     </serial>
Nov 08 12:47:26 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:47:26 user nova-compute[74840]:     <video>
Nov 08 12:47:26 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:47:26 user nova-compute[74840]:     </video>
Nov 08 12:47:26 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:47:26 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:47:26 user nova-compute[74840]:     </rng>
Nov 08 12:47:26 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:47:26 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:47:26 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:47:26 user nova-compute[74840]:     </memballoon>
Nov 08 12:47:26 user nova-compute[74840]:   </devices>
Nov 08 12:47:26 user nova-compute[74840]: </domain>
Nov 08 12:47:26 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:47:26 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:47:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2084158875',display_name='tempest-ServersNegativeTestJSON-server-2084158875',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2084158875',id=48,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e48fbc441e79426f859e00e5c19a1167',ramdisk_id='',reservation_id='r-ok01kzy1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-199749076',owner_user_name='tempest-ServersNegativeTestJSON-199749076-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:47:24Z,user_data=None,user_id='52ea0bf6286c45f987154493a281b260',uuid=d141acfc-f098-41db-a925-90288dfba292,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e3dffbe-0646-40d3-9206-07eb0c427755", "address": "fa:16:3e:4e:2e:3f", "network": {"id": "88ccbadb-f25d-463d-a2c3-01dcd402b165", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1492603656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e48fbc441e79426f859e00e5c19a1167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3dffbe-06", "ovs_interfaceid": "4e3dffbe-0646-40d3-9206-07eb0c427755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:47:26 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Converting VIF {"id": "4e3dffbe-0646-40d3-9206-07eb0c427755", "address": "fa:16:3e:4e:2e:3f", "network": {"id": "88ccbadb-f25d-463d-a2c3-01dcd402b165", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1492603656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e48fbc441e79426f859e00e5c19a1167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3dffbe-06", "ovs_interfaceid": "4e3dffbe-0646-40d3-9206-07eb0c427755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:47:26 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:2e:3f,bridge_name='br-int',has_traffic_filtering=True,id=4e3dffbe-0646-40d3-9206-07eb0c427755,network=Network(88ccbadb-f25d-463d-a2c3-01dcd402b165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e3dffbe-06') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:47:26 user nova-compute[74840]: DEBUG os_vif [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:2e:3f,bridge_name='br-int',has_traffic_filtering=True,id=4e3dffbe-0646-40d3-9206-07eb0c427755,network=Network(88ccbadb-f25d-463d-a2c3-01dcd402b165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e3dffbe-06') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:47:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:47:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:47:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:47:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:47:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '744d9d01-eb88-514f-9a02-a904e46f0b25', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:47:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:47:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:47:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:47:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e3dffbe-06, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:47:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4e3dffbe-06, col_values=(('qos', UUID('d6585f5a-029a-46f8-ae16-0da3ecc03b98')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:47:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4e3dffbe-06, col_values=(('external_ids', {'iface-id': '4e3dffbe-0646-40d3-9206-07eb0c427755', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:2e:3f', 'vm-uuid': 'd141acfc-f098-41db-a925-90288dfba292'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:47:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:47:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:47:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:47:26 user nova-compute[74840]: INFO os_vif [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:2e:3f,bridge_name='br-int',has_traffic_filtering=True,id=4e3dffbe-0646-40d3-9206-07eb0c427755,network=Network(88ccbadb-f25d-463d-a2c3-01dcd402b165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e3dffbe-06')
Nov 08 12:47:26 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:47:26 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] No VIF found with MAC fa:16:3e:4e:2e:3f, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:47:26 user nova-compute[74840]: DEBUG nova.network.neutron [req-4e561da1-8dc8-49e1-84f5-3fdb1418948f req-17079c4b-7812-4e75-8b04-d186f9953a15 service nova] [instance: d141acfc-f098-41db-a925-90288dfba292] Updated VIF entry in instance network info cache for port 4e3dffbe-0646-40d3-9206-07eb0c427755. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:47:26 user nova-compute[74840]: DEBUG nova.network.neutron [req-4e561da1-8dc8-49e1-84f5-3fdb1418948f req-17079c4b-7812-4e75-8b04-d186f9953a15 service nova] [instance: d141acfc-f098-41db-a925-90288dfba292] Updating instance_info_cache with network_info: [{"id": "4e3dffbe-0646-40d3-9206-07eb0c427755", "address": "fa:16:3e:4e:2e:3f", "network": {"id": "88ccbadb-f25d-463d-a2c3-01dcd402b165", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1492603656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e48fbc441e79426f859e00e5c19a1167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3dffbe-06", "ovs_interfaceid": "4e3dffbe-0646-40d3-9206-07eb0c427755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:47:26 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-4e561da1-8dc8-49e1-84f5-3fdb1418948f req-17079c4b-7812-4e75-8b04-d186f9953a15 service nova] Releasing lock "refresh_cache-d141acfc-f098-41db-a925-90288dfba292" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:47:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:47:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:47:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:47:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:47:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:47:27 user nova-compute[74840]: DEBUG nova.compute.manager [req-68bb7e82-dee4-4d8c-8ada-611bd77a269b req-dbf2a2bc-252c-4391-8a9f-f5b6d6f707aa service nova] [instance: d141acfc-f098-41db-a925-90288dfba292] Received event network-vif-plugged-4e3dffbe-0646-40d3-9206-07eb0c427755 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:47:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-68bb7e82-dee4-4d8c-8ada-611bd77a269b req-dbf2a2bc-252c-4391-8a9f-f5b6d6f707aa service nova] Acquiring lock "d141acfc-f098-41db-a925-90288dfba292-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:47:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-68bb7e82-dee4-4d8c-8ada-611bd77a269b req-dbf2a2bc-252c-4391-8a9f-f5b6d6f707aa service nova] Lock "d141acfc-f098-41db-a925-90288dfba292-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:47:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-68bb7e82-dee4-4d8c-8ada-611bd77a269b req-dbf2a2bc-252c-4391-8a9f-f5b6d6f707aa service nova] Lock "d141acfc-f098-41db-a925-90288dfba292-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:47:27 user nova-compute[74840]: DEBUG nova.compute.manager [req-68bb7e82-dee4-4d8c-8ada-611bd77a269b req-dbf2a2bc-252c-4391-8a9f-f5b6d6f707aa service nova] [instance: d141acfc-f098-41db-a925-90288dfba292] No waiting events found dispatching network-vif-plugged-4e3dffbe-0646-40d3-9206-07eb0c427755 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:47:27 user nova-compute[74840]: WARNING nova.compute.manager [req-68bb7e82-dee4-4d8c-8ada-611bd77a269b req-dbf2a2bc-252c-4391-8a9f-f5b6d6f707aa service nova] [instance: d141acfc-f098-41db-a925-90288dfba292] Received unexpected event network-vif-plugged-4e3dffbe-0646-40d3-9206-07eb0c427755 for instance with vm_state building and task_state spawning.
Nov 08 12:47:29 user nova-compute[74840]: DEBUG nova.compute.manager [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: d141acfc-f098-41db-a925-90288dfba292] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:47:29 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: d141acfc-f098-41db-a925-90288dfba292] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:47:29 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: d141acfc-f098-41db-a925-90288dfba292] Instance spawned successfully.
Nov 08 12:47:29 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: d141acfc-f098-41db-a925-90288dfba292] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:47:29 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: d141acfc-f098-41db-a925-90288dfba292] Found default for hw_cdrom_bus of ide {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:47:29 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: d141acfc-f098-41db-a925-90288dfba292] Found default for hw_disk_bus of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:47:29 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: d141acfc-f098-41db-a925-90288dfba292] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:47:29 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: d141acfc-f098-41db-a925-90288dfba292] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:47:29 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: d141acfc-f098-41db-a925-90288dfba292] Found default for hw_video_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:47:29 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: d141acfc-f098-41db-a925-90288dfba292] Found default for hw_vif_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:47:29 user nova-compute[74840]: INFO nova.compute.manager [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: d141acfc-f098-41db-a925-90288dfba292] Took 5.18 seconds to spawn the instance on the hypervisor.
Nov 08 12:47:29 user nova-compute[74840]: DEBUG nova.compute.manager [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: d141acfc-f098-41db-a925-90288dfba292] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:47:29 user nova-compute[74840]: INFO nova.compute.manager [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: d141acfc-f098-41db-a925-90288dfba292] Took 5.83 seconds to build instance.
Nov 08 12:47:29 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1e8e4f06-b3d8-4ce1-ba82-468c54537822 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Lock "d141acfc-f098-41db-a925-90288dfba292" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.956s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:47:29 user nova-compute[74840]: DEBUG nova.compute.manager [req-8d250cf5-c5b6-4064-afa2-96b60b8d0859 req-82ea04a1-b09f-410b-b918-cf0f1e9e7273 service nova] [instance: d141acfc-f098-41db-a925-90288dfba292] Received event network-vif-plugged-4e3dffbe-0646-40d3-9206-07eb0c427755 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:47:29 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8d250cf5-c5b6-4064-afa2-96b60b8d0859 req-82ea04a1-b09f-410b-b918-cf0f1e9e7273 service nova] Acquiring lock "d141acfc-f098-41db-a925-90288dfba292-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:47:29 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8d250cf5-c5b6-4064-afa2-96b60b8d0859 req-82ea04a1-b09f-410b-b918-cf0f1e9e7273 service nova] Lock "d141acfc-f098-41db-a925-90288dfba292-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:47:29 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8d250cf5-c5b6-4064-afa2-96b60b8d0859 req-82ea04a1-b09f-410b-b918-cf0f1e9e7273 service nova] Lock "d141acfc-f098-41db-a925-90288dfba292-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:47:29 user nova-compute[74840]: DEBUG nova.compute.manager [req-8d250cf5-c5b6-4064-afa2-96b60b8d0859 req-82ea04a1-b09f-410b-b918-cf0f1e9e7273 service nova] [instance: d141acfc-f098-41db-a925-90288dfba292] No waiting events found dispatching network-vif-plugged-4e3dffbe-0646-40d3-9206-07eb0c427755 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:47:29 user nova-compute[74840]: WARNING nova.compute.manager [req-8d250cf5-c5b6-4064-afa2-96b60b8d0859 req-82ea04a1-b09f-410b-b918-cf0f1e9e7273 service nova] [instance: d141acfc-f098-41db-a925-90288dfba292] Received unexpected event network-vif-plugged-4e3dffbe-0646-40d3-9206-07eb0c427755 for instance with vm_state active and task_state None.
Nov 08 12:47:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:47:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:47:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:47:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:47:41 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:47:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:47:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:47:51 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:47:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:47:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:47:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:48:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:48:02 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:48:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:48:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:48:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:48:15 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:48:15 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:48:15 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:48:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:48:17 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:48:18 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:48:18 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:48:19 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:48:19 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:48:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "refresh_cache-c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:48:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquired lock "refresh_cache-c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:48:19 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Forcefully refreshing network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 12:48:19 user nova-compute[74840]: DEBUG nova.compute.manager [req-37821a5a-3a4a-4809-a1a4-4466ef795211 req-368a58e8-d545-4456-9630-5af5e5545dd8 service nova] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Received event network-changed-0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:48:19 user nova-compute[74840]: DEBUG nova.compute.manager [req-37821a5a-3a4a-4809-a1a4-4466ef795211 req-368a58e8-d545-4456-9630-5af5e5545dd8 service nova] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Refreshing instance network info cache due to event network-changed-0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:48:19 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-37821a5a-3a4a-4809-a1a4-4466ef795211 req-368a58e8-d545-4456-9630-5af5e5545dd8 service nova] Acquiring lock "refresh_cache-c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:48:20 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Updating instance_info_cache with network_info: [{"id": "0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3", "address": "fa:16:3e:f4:cf:dd", "network": {"id": "8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1654230640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "270eb2fc5485447f9e09d83d48fdc14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe1ab7b-d3", "ovs_interfaceid": "0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:48:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Releasing lock "refresh_cache-c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:48:20 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Updated the network info_cache for instance {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 12:48:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-37821a5a-3a4a-4809-a1a4-4466ef795211 req-368a58e8-d545-4456-9630-5af5e5545dd8 service nova] Acquired lock "refresh_cache-c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:48:20 user nova-compute[74840]: DEBUG nova.network.neutron [req-37821a5a-3a4a-4809-a1a4-4466ef795211 req-368a58e8-d545-4456-9630-5af5e5545dd8 service nova] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Refreshing network info cache for port 0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:48:20 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:48:21 user nova-compute[74840]: DEBUG nova.compute.manager [req-a12068cc-a0ba-466c-ba7c-eff09d202657 req-71be1d68-b131-4b18-868b-0405257516ea service nova] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Received event network-changed-0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:48:21 user nova-compute[74840]: DEBUG nova.compute.manager [req-a12068cc-a0ba-466c-ba7c-eff09d202657 req-71be1d68-b131-4b18-868b-0405257516ea service nova] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Refreshing instance network info cache due to event network-changed-0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:48:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a12068cc-a0ba-466c-ba7c-eff09d202657 req-71be1d68-b131-4b18-868b-0405257516ea service nova] Acquiring lock "refresh_cache-c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:48:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:48:21 user nova-compute[74840]: DEBUG nova.network.neutron [req-37821a5a-3a4a-4809-a1a4-4466ef795211 req-368a58e8-d545-4456-9630-5af5e5545dd8 service nova] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Updated VIF entry in instance network info cache for port 0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:48:21 user nova-compute[74840]: DEBUG nova.network.neutron [req-37821a5a-3a4a-4809-a1a4-4466ef795211 req-368a58e8-d545-4456-9630-5af5e5545dd8 service nova] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Updating instance_info_cache with network_info: [{"id": "0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3", "address": "fa:16:3e:f4:cf:dd", "network": {"id": "8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1654230640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "270eb2fc5485447f9e09d83d48fdc14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe1ab7b-d3", "ovs_interfaceid": "0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:48:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-37821a5a-3a4a-4809-a1a4-4466ef795211 req-368a58e8-d545-4456-9630-5af5e5545dd8 service nova] Releasing lock "refresh_cache-c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:48:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a12068cc-a0ba-466c-ba7c-eff09d202657 req-71be1d68-b131-4b18-868b-0405257516ea service nova] Acquired lock "refresh_cache-c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:48:21 user nova-compute[74840]: DEBUG nova.network.neutron [req-a12068cc-a0ba-466c-ba7c-eff09d202657 req-71be1d68-b131-4b18-868b-0405257516ea service nova] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Refreshing network info cache for port 0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:48:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e16f8e0c-9788-4dee-a984-2c3f81a87815 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Acquiring lock "c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:48:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e16f8e0c-9788-4dee-a984-2c3f81a87815 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:48:21 user nova-compute[74840]: INFO nova.compute.manager [None req-e16f8e0c-9788-4dee-a984-2c3f81a87815 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Detaching volume bc3597a9-a73b-484b-9c74-80c716a4d729
Nov 08 12:48:21 user nova-compute[74840]: INFO nova.virt.block_device [None req-e16f8e0c-9788-4dee-a984-2c3f81a87815 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Attempting to driver detach volume bc3597a9-a73b-484b-9c74-80c716a4d729 from mountpoint /dev/vdb
Nov 08 12:48:21 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-e16f8e0c-9788-4dee-a984-2c3f81a87815 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Attempting to detach device vdb from instance c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf from the persistent domain config. {{(pid=74840) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 12:48:21 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-e16f8e0c-9788-4dee-a984-2c3f81a87815 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 12:48:21 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:48:21 user nova-compute[74840]:   <source dev="/dev/sdc"/>
Nov 08 12:48:21 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:48:21 user nova-compute[74840]:   <serial>bc3597a9-a73b-484b-9c74-80c716a4d729</serial>
Nov 08 12:48:21 user nova-compute[74840]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 12:48:21 user nova-compute[74840]: </disk>
Nov 08 12:48:21 user nova-compute[74840]:  {{(pid=74840) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 12:48:21 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-e16f8e0c-9788-4dee-a984-2c3f81a87815 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Successfully detached device vdb from instance c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf from the persistent domain config.
Nov 08 12:48:21 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-e16f8e0c-9788-4dee-a984-2c3f81a87815 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf from the live domain config. {{(pid=74840) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 12:48:21 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-e16f8e0c-9788-4dee-a984-2c3f81a87815 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 12:48:21 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:48:21 user nova-compute[74840]:   <source dev="/dev/sdc"/>
Nov 08 12:48:21 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:48:21 user nova-compute[74840]:   <serial>bc3597a9-a73b-484b-9c74-80c716a4d729</serial>
Nov 08 12:48:21 user nova-compute[74840]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 12:48:21 user nova-compute[74840]: </disk>
Nov 08 12:48:21 user nova-compute[74840]:  {{(pid=74840) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 12:48:21 user nova-compute[74840]: DEBUG nova.network.neutron [req-a12068cc-a0ba-466c-ba7c-eff09d202657 req-71be1d68-b131-4b18-868b-0405257516ea service nova] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Updated VIF entry in instance network info cache for port 0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:48:21 user nova-compute[74840]: DEBUG nova.network.neutron [req-a12068cc-a0ba-466c-ba7c-eff09d202657 req-71be1d68-b131-4b18-868b-0405257516ea service nova] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Updating instance_info_cache with network_info: [{"id": "0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3", "address": "fa:16:3e:f4:cf:dd", "network": {"id": "8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1654230640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "270eb2fc5485447f9e09d83d48fdc14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe1ab7b-d3", "ovs_interfaceid": "0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:48:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a12068cc-a0ba-466c-ba7c-eff09d202657 req-71be1d68-b131-4b18-868b-0405257516ea service nova] Releasing lock "refresh_cache-c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:48:21 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-e16f8e0c-9788-4dee-a984-2c3f81a87815 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf {{(pid=74840) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 12:48:22 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:48:23 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:48:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:48:24 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:48:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:48:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.006s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:48:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:48:24 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:48:24 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d141acfc-f098-41db-a925-90288dfba292/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:48:25 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d141acfc-f098-41db-a925-90288dfba292/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:48:25 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d141acfc-f098-41db-a925-90288dfba292/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:48:25 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d141acfc-f098-41db-a925-90288dfba292/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:48:25 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:48:25 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:48:25 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:48:25 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:48:25 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9294d85f-20ec-4a6c-9a52-379187cb2aa1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:48:25 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9294d85f-20ec-4a6c-9a52-379187cb2aa1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:48:25 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9294d85f-20ec-4a6c-9a52-379187cb2aa1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:48:26 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9294d85f-20ec-4a6c-9a52-379187cb2aa1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:48:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:48:26 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:48:26 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:48:26 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=8694MB free_disk=24.786964416503906GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:48:26 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:48:26 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:48:26 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:48:26 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 9294d85f-20ec-4a6c-9a52-379187cb2aa1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:48:26 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance d141acfc-f098-41db-a925-90288dfba292 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:48:26 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:48:26 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:48:26 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:48:26 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:48:26 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:48:26 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.312s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:48:29 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:48:30 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:48:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:48:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:48:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Acquiring lock "301cc74c-0322-47c3-be22-a638592a755a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:48:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "301cc74c-0322-47c3-be22-a638592a755a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:48:33 user nova-compute[74840]: DEBUG nova.compute.manager [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Starting instance... {{(pid=74840) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 12:48:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:48:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:48:33 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:48:33 user nova-compute[74840]: INFO nova.compute.claims [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Claim successful on node user
Nov 08 12:48:33 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:48:33 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:48:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.256s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:48:33 user nova-compute[74840]: DEBUG nova.compute.manager [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Start building networks asynchronously for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 12:48:34 user nova-compute[74840]: DEBUG nova.compute.manager [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Allocating IP information in the background. {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 12:48:34 user nova-compute[74840]: DEBUG nova.network.neutron [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 12:48:34 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 12:48:34 user nova-compute[74840]: DEBUG nova.compute.manager [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Start building block device mappings for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 12:48:34 user nova-compute[74840]: DEBUG nova.policy [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9667df3a519d47809b332f8457cd1154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7e49db466d4c0a83700e2e917c78be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 12:48:34 user nova-compute[74840]: DEBUG nova.compute.manager [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Start spawning the instance on the hypervisor. {{(pid=74840) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 12:48:34 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:48:34 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Creating image(s)
Nov 08 12:48:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Acquiring lock "/opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:48:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "/opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:48:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "/opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:48:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:48:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.178s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:48:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Acquiring lock "5d26578eba85497f494c575690c4248f381a0fe6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:48:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:48:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:48:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.169s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:48:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk 1073741824 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:48:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk 1073741824" returned: 0 in 0.067s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:48:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:48:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:48:34 user nova-compute[74840]: DEBUG nova.network.neutron [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Successfully created port: f001cf21-b5b2-4a55-bcc4-5451e3a73170 {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:48:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.185s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:48:34 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Checking if we can resize image /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk. size=1073741824 {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 12:48:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:48:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:48:34 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Cannot resize image /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk to a smaller size. {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 12:48:34 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Created local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 12:48:34 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Ensure instance console log exists: /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:48:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:48:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:48:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG nova.network.neutron [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Successfully updated port: f001cf21-b5b2-4a55-bcc4-5451e3a73170 {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Acquiring lock "refresh_cache-301cc74c-0322-47c3-be22-a638592a755a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Acquired lock "refresh_cache-301cc74c-0322-47c3-be22-a638592a755a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG nova.network.neutron [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG nova.network.neutron [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG nova.compute.manager [req-2b70cbd8-7f0b-4f94-bd7c-9936ab03e1ae req-22d3bc21-db65-47cd-8a35-212a9da03a4f service nova] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Received event network-changed-f001cf21-b5b2-4a55-bcc4-5451e3a73170 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG nova.compute.manager [req-2b70cbd8-7f0b-4f94-bd7c-9936ab03e1ae req-22d3bc21-db65-47cd-8a35-212a9da03a4f service nova] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Refreshing instance network info cache due to event network-changed-f001cf21-b5b2-4a55-bcc4-5451e3a73170. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2b70cbd8-7f0b-4f94-bd7c-9936ab03e1ae req-22d3bc21-db65-47cd-8a35-212a9da03a4f service nova] Acquiring lock "refresh_cache-301cc74c-0322-47c3-be22-a638592a755a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG nova.network.neutron [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Updating instance_info_cache with network_info: [{"id": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "address": "fa:16:3e:f3:fc:27", "network": {"id": "515bf382-a9c9-4096-9de0-23fc0c912a71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1378790516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7e49db466d4c0a83700e2e917c78be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf001cf21-b5", "ovs_interfaceid": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Releasing lock "refresh_cache-301cc74c-0322-47c3-be22-a638592a755a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG nova.compute.manager [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Instance network_info: |[{"id": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "address": "fa:16:3e:f3:fc:27", "network": {"id": "515bf382-a9c9-4096-9de0-23fc0c912a71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1378790516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7e49db466d4c0a83700e2e917c78be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf001cf21-b5", "ovs_interfaceid": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2b70cbd8-7f0b-4f94-bd7c-9936ab03e1ae req-22d3bc21-db65-47cd-8a35-212a9da03a4f service nova] Acquired lock "refresh_cache-301cc74c-0322-47c3-be22-a638592a755a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG nova.network.neutron [req-2b70cbd8-7f0b-4f94-bd7c-9936ab03e1ae req-22d3bc21-db65-47cd-8a35-212a9da03a4f service nova] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Refreshing network info cache for port f001cf21-b5b2-4a55-bcc4-5451e3a73170 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Start _get_guest_xml network_info=[{"id": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "address": "fa:16:3e:f3:fc:27", "network": {"id": "515bf382-a9c9-4096-9de0-23fc0c912a71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1378790516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7e49db466d4c0a83700e2e917c78be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf001cf21-b5", "ovs_interfaceid": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'image_id': '4fa17706-d304-4117-a420-dab994c703dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:48:35 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:48:35 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:48:35 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:48:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1268219938',display_name='tempest-AttachVolumeTestJSON-server-1268219938',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1268219938',id=49,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1Q3P8MX65K+ewG2SwkHJsjLBfhR/vPyPX9ltkFerXJUdJghXZzKfH0GZA2WFBtwb7dErHNHWFrK86n2OEQBsGNeWGod8BzroVKFZNXS962Jzp5znHBxWuSa1al8Vb4Ew==',key_name='tempest-keypair-654921536',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e7e49db466d4c0a83700e2e917c78be',ramdisk_id='',reservation_id='r-cr0fa74z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-116807071',owner_user_name='tempest-AttachVolumeTestJSON-116807071-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:48:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9667df3a519d47809b332f8457cd1154',uuid=301cc74c-0322-47c3-be22-a638592a755a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "address": "fa:16:3e:f3:fc:27", "network": {"id": "515bf382-a9c9-4096-9de0-23fc0c912a71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1378790516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7e49db466d4c0a83700e2e917c78be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf001cf21-b5", "ovs_interfaceid": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Converting VIF {"id": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "address": "fa:16:3e:f3:fc:27", "network": {"id": "515bf382-a9c9-4096-9de0-23fc0c912a71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1378790516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7e49db466d4c0a83700e2e917c78be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf001cf21-b5", "ovs_interfaceid": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:fc:27,bridge_name='br-int',has_traffic_filtering=True,id=f001cf21-b5b2-4a55-bcc4-5451e3a73170,network=Network(515bf382-a9c9-4096-9de0-23fc0c912a71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf001cf21-b5') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG nova.objects.instance [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lazy-loading 'pci_devices' on Instance uuid 301cc74c-0322-47c3-be22-a638592a755a {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:48:35 user nova-compute[74840]:   <uuid>301cc74c-0322-47c3-be22-a638592a755a</uuid>
Nov 08 12:48:35 user nova-compute[74840]:   <name>instance-00000031</name>
Nov 08 12:48:35 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:48:35 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:48:35 user nova-compute[74840]:   <metadata>
Nov 08 12:48:35 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:48:35 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:48:35 user nova-compute[74840]:       <nova:name>tempest-AttachVolumeTestJSON-server-1268219938</nova:name>
Nov 08 12:48:35 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:48:35</nova:creationTime>
Nov 08 12:48:35 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:48:35 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:48:35 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:48:35 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:48:35 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:48:35 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:48:35 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:48:35 user nova-compute[74840]:       <nova:owner>
Nov 08 12:48:35 user nova-compute[74840]:         <nova:user uuid="9667df3a519d47809b332f8457cd1154">tempest-AttachVolumeTestJSON-116807071-project-member</nova:user>
Nov 08 12:48:35 user nova-compute[74840]:         <nova:project uuid="6e7e49db466d4c0a83700e2e917c78be">tempest-AttachVolumeTestJSON-116807071</nova:project>
Nov 08 12:48:35 user nova-compute[74840]:       </nova:owner>
Nov 08 12:48:35 user nova-compute[74840]:       <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:48:35 user nova-compute[74840]:       <nova:ports>
Nov 08 12:48:35 user nova-compute[74840]:         <nova:port uuid="f001cf21-b5b2-4a55-bcc4-5451e3a73170">
Nov 08 12:48:35 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 12:48:35 user nova-compute[74840]:         </nova:port>
Nov 08 12:48:35 user nova-compute[74840]:       </nova:ports>
Nov 08 12:48:35 user nova-compute[74840]:     </nova:instance>
Nov 08 12:48:35 user nova-compute[74840]:   </metadata>
Nov 08 12:48:35 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:48:35 user nova-compute[74840]:     <system>
Nov 08 12:48:35 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:48:35 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:48:35 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:48:35 user nova-compute[74840]:       <entry name="serial">301cc74c-0322-47c3-be22-a638592a755a</entry>
Nov 08 12:48:35 user nova-compute[74840]:       <entry name="uuid">301cc74c-0322-47c3-be22-a638592a755a</entry>
Nov 08 12:48:35 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:48:35 user nova-compute[74840]:     </system>
Nov 08 12:48:35 user nova-compute[74840]:   </sysinfo>
Nov 08 12:48:35 user nova-compute[74840]:   <os>
Nov 08 12:48:35 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:48:35 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:48:35 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:48:35 user nova-compute[74840]:   </os>
Nov 08 12:48:35 user nova-compute[74840]:   <features>
Nov 08 12:48:35 user nova-compute[74840]:     <acpi/>
Nov 08 12:48:35 user nova-compute[74840]:     <apic/>
Nov 08 12:48:35 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:48:35 user nova-compute[74840]:   </features>
Nov 08 12:48:35 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:48:35 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:48:35 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:48:35 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:48:35 user nova-compute[74840]:   </clock>
Nov 08 12:48:35 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:48:35 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:48:35 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:48:35 user nova-compute[74840]:   </cpu>
Nov 08 12:48:35 user nova-compute[74840]:   <devices>
Nov 08 12:48:35 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:48:35 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:48:35 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk"/>
Nov 08 12:48:35 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:48:35 user nova-compute[74840]:     </disk>
Nov 08 12:48:35 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:48:35 user nova-compute[74840]:       <mac address="fa:16:3e:f3:fc:27"/>
Nov 08 12:48:35 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:48:35 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:48:35 user nova-compute[74840]:       <target dev="tapf001cf21-b5"/>
Nov 08 12:48:35 user nova-compute[74840]:     </interface>
Nov 08 12:48:35 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:48:35 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/console.log" append="off"/>
Nov 08 12:48:35 user nova-compute[74840]:     </serial>
Nov 08 12:48:35 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:48:35 user nova-compute[74840]:     <video>
Nov 08 12:48:35 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:48:35 user nova-compute[74840]:     </video>
Nov 08 12:48:35 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:48:35 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:48:35 user nova-compute[74840]:     </rng>
Nov 08 12:48:35 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:48:35 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:48:35 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:48:35 user nova-compute[74840]:     </memballoon>
Nov 08 12:48:35 user nova-compute[74840]:   </devices>
Nov 08 12:48:35 user nova-compute[74840]: </domain>
Nov 08 12:48:35 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:48:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1268219938',display_name='tempest-AttachVolumeTestJSON-server-1268219938',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1268219938',id=49,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1Q3P8MX65K+ewG2SwkHJsjLBfhR/vPyPX9ltkFerXJUdJghXZzKfH0GZA2WFBtwb7dErHNHWFrK86n2OEQBsGNeWGod8BzroVKFZNXS962Jzp5znHBxWuSa1al8Vb4Ew==',key_name='tempest-keypair-654921536',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e7e49db466d4c0a83700e2e917c78be',ramdisk_id='',reservation_id='r-cr0fa74z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-116807071',owner_user_name='tempest-AttachVolumeTestJSON-116807071-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:48:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9667df3a519d47809b332f8457cd1154',uuid=301cc74c-0322-47c3-be22-a638592a755a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "address": "fa:16:3e:f3:fc:27", "network": {"id": "515bf382-a9c9-4096-9de0-23fc0c912a71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1378790516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7e49db466d4c0a83700e2e917c78be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf001cf21-b5", "ovs_interfaceid": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Converting VIF {"id": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "address": "fa:16:3e:f3:fc:27", "network": {"id": "515bf382-a9c9-4096-9de0-23fc0c912a71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1378790516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7e49db466d4c0a83700e2e917c78be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf001cf21-b5", "ovs_interfaceid": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:fc:27,bridge_name='br-int',has_traffic_filtering=True,id=f001cf21-b5b2-4a55-bcc4-5451e3a73170,network=Network(515bf382-a9c9-4096-9de0-23fc0c912a71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf001cf21-b5') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG os_vif [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:fc:27,bridge_name='br-int',has_traffic_filtering=True,id=f001cf21-b5b2-4a55-bcc4-5451e3a73170,network=Network(515bf382-a9c9-4096-9de0-23fc0c912a71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf001cf21-b5') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '82dddff3-df46-5d3f-8b05-7466983996a5', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf001cf21-b5, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf001cf21-b5, col_values=(('qos', UUID('49416552-f568-41be-8848-72db9aa7df6b')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf001cf21-b5, col_values=(('external_ids', {'iface-id': 'f001cf21-b5b2-4a55-bcc4-5451e3a73170', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:fc:27', 'vm-uuid': '301cc74c-0322-47c3-be22-a638592a755a'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:48:35 user nova-compute[74840]: INFO os_vif [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:fc:27,bridge_name='br-int',has_traffic_filtering=True,id=f001cf21-b5b2-4a55-bcc4-5451e3a73170,network=Network(515bf382-a9c9-4096-9de0-23fc0c912a71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf001cf21-b5')
Nov 08 12:48:35 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:48:35 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] No VIF found with MAC fa:16:3e:f3:fc:27, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:48:36 user nova-compute[74840]: DEBUG nova.network.neutron [req-2b70cbd8-7f0b-4f94-bd7c-9936ab03e1ae req-22d3bc21-db65-47cd-8a35-212a9da03a4f service nova] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Updated VIF entry in instance network info cache for port f001cf21-b5b2-4a55-bcc4-5451e3a73170. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:48:36 user nova-compute[74840]: DEBUG nova.network.neutron [req-2b70cbd8-7f0b-4f94-bd7c-9936ab03e1ae req-22d3bc21-db65-47cd-8a35-212a9da03a4f service nova] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Updating instance_info_cache with network_info: [{"id": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "address": "fa:16:3e:f3:fc:27", "network": {"id": "515bf382-a9c9-4096-9de0-23fc0c912a71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1378790516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7e49db466d4c0a83700e2e917c78be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf001cf21-b5", "ovs_interfaceid": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:48:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2b70cbd8-7f0b-4f94-bd7c-9936ab03e1ae req-22d3bc21-db65-47cd-8a35-212a9da03a4f service nova] Releasing lock "refresh_cache-301cc74c-0322-47c3-be22-a638592a755a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:48:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:48:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:48:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:48:37 user nova-compute[74840]: DEBUG nova.compute.manager [req-44059ca0-74ee-4bd4-85f4-ce2ac4f761dc req-16e485ff-94c5-4fbc-82c6-e1939f0d05d3 service nova] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Received event network-vif-plugged-f001cf21-b5b2-4a55-bcc4-5451e3a73170 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:48:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-44059ca0-74ee-4bd4-85f4-ce2ac4f761dc req-16e485ff-94c5-4fbc-82c6-e1939f0d05d3 service nova] Acquiring lock "301cc74c-0322-47c3-be22-a638592a755a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:48:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-44059ca0-74ee-4bd4-85f4-ce2ac4f761dc req-16e485ff-94c5-4fbc-82c6-e1939f0d05d3 service nova] Lock "301cc74c-0322-47c3-be22-a638592a755a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:48:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-44059ca0-74ee-4bd4-85f4-ce2ac4f761dc req-16e485ff-94c5-4fbc-82c6-e1939f0d05d3 service nova] Lock "301cc74c-0322-47c3-be22-a638592a755a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:48:37 user nova-compute[74840]: DEBUG nova.compute.manager [req-44059ca0-74ee-4bd4-85f4-ce2ac4f761dc req-16e485ff-94c5-4fbc-82c6-e1939f0d05d3 service nova] [instance: 301cc74c-0322-47c3-be22-a638592a755a] No waiting events found dispatching network-vif-plugged-f001cf21-b5b2-4a55-bcc4-5451e3a73170 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:48:37 user nova-compute[74840]: WARNING nova.compute.manager [req-44059ca0-74ee-4bd4-85f4-ce2ac4f761dc req-16e485ff-94c5-4fbc-82c6-e1939f0d05d3 service nova] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Received unexpected event network-vif-plugged-f001cf21-b5b2-4a55-bcc4-5451e3a73170 for instance with vm_state building and task_state spawning.
Nov 08 12:48:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:48:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:48:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:48:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:48:39 user nova-compute[74840]: DEBUG nova.compute.manager [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:48:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:48:39 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Instance spawned successfully.
Nov 08 12:48:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:48:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Found default for hw_cdrom_bus of ide {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:48:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Found default for hw_disk_bus of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:48:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:48:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:48:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Found default for hw_video_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:48:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Found default for hw_vif_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:48:39 user nova-compute[74840]: INFO nova.compute.manager [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Took 5.14 seconds to spawn the instance on the hypervisor.
Nov 08 12:48:39 user nova-compute[74840]: DEBUG nova.compute.manager [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:48:39 user nova-compute[74840]: DEBUG nova.compute.manager [req-b65e3b56-73ff-436e-baee-4607ef7ab557 req-0bafa733-693d-422c-a1ae-c9c989800bbb service nova] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Received event network-vif-plugged-f001cf21-b5b2-4a55-bcc4-5451e3a73170 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:48:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-b65e3b56-73ff-436e-baee-4607ef7ab557 req-0bafa733-693d-422c-a1ae-c9c989800bbb service nova] Acquiring lock "301cc74c-0322-47c3-be22-a638592a755a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:48:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-b65e3b56-73ff-436e-baee-4607ef7ab557 req-0bafa733-693d-422c-a1ae-c9c989800bbb service nova] Lock "301cc74c-0322-47c3-be22-a638592a755a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:48:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-b65e3b56-73ff-436e-baee-4607ef7ab557 req-0bafa733-693d-422c-a1ae-c9c989800bbb service nova] Lock "301cc74c-0322-47c3-be22-a638592a755a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:48:39 user nova-compute[74840]: DEBUG nova.compute.manager [req-b65e3b56-73ff-436e-baee-4607ef7ab557 req-0bafa733-693d-422c-a1ae-c9c989800bbb service nova] [instance: 301cc74c-0322-47c3-be22-a638592a755a] No waiting events found dispatching network-vif-plugged-f001cf21-b5b2-4a55-bcc4-5451e3a73170 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:48:39 user nova-compute[74840]: WARNING nova.compute.manager [req-b65e3b56-73ff-436e-baee-4607ef7ab557 req-0bafa733-693d-422c-a1ae-c9c989800bbb service nova] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Received unexpected event network-vif-plugged-f001cf21-b5b2-4a55-bcc4-5451e3a73170 for instance with vm_state building and task_state spawning.
Nov 08 12:48:39 user nova-compute[74840]: INFO nova.compute.manager [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Took 5.73 seconds to build instance.
Nov 08 12:48:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-6074953f-f081-4db3-a35f-eaf485990feb tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "301cc74c-0322-47c3-be22-a638592a755a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.819s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:48:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:48:41 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-e16f8e0c-9788-4dee-a984-2c3f81a87815 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf is timed out.
Nov 08 12:48:41 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-e16f8e0c-9788-4dee-a984-2c3f81a87815 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Successfully detached device vdb from instance c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf from the live domain config.
Nov 08 12:48:41 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e16f8e0c-9788-4dee-a984-2c3f81a87815 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 12:48:41 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16f8e0c-9788-4dee-a984-2c3f81a87815 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EImsVpbk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:48:41 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-e16f8e0c-9788-4dee-a984-2c3f81a87815 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:48:41 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-e16f8e0c-9788-4dee-a984-2c3f81a87815 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:48:41 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-e16f8e0c-9788-4dee-a984-2c3f81a87815 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:48:41 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:48:41 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:48:41 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f4f540-16c6-4d3d-9af2-0903a1c62dc3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:48:41 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16f8e0c-9788-4dee-a984-2c3f81a87815 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 12:48:41 user nova-compute[74840]: No targets found.
Nov 08 12:48:41 user nova-compute[74840]: iSNS:
Nov 08 12:48:41 user nova-compute[74840]: No targets found.
Nov 08 12:48:41 user nova-compute[74840]: STATIC:
Nov 08 12:48:41 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729
Nov 08 12:48:41 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:48:41 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:48:41 user nova-compute[74840]: FIRMWARE:
Nov 08 12:48:41 user nova-compute[74840]: No targets found.
Nov 08 12:48:41 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:48:41 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16f8e0c-9788-4dee-a984-2c3f81a87815 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 12:48:41 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 12:48:41 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 12:48:41 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16f8e0c-9788-4dee-a984-2c3f81a87815 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 12:48:41 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:48:42 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:48:42 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e336dd90-ae97-486e-b309-9e18ad6d4923]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:48:42 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:48:42 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:48:42 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8637b5-79be-42b4-bb28-5c72b9e39030]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:48:42 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16f8e0c-9788-4dee-a984-2c3f81a87815 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 (non-flash)
Nov 08 12:48:42 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:48:42 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16f8e0c-9788-4dee-a984-2c3f81a87815 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 (non-flash)
Nov 08 12:48:42 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:48:42 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16f8e0c-9788-4dee-a984-2c3f81a87815 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7f431b370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729'): ({'sdc'}, set())}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 12:48:42 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-e16f8e0c-9788-4dee-a984-2c3f81a87815 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Removing single pathed devices sdc {{(pid=74840) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 12:48:42 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:48:42 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:48:42 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f28965-eba7-45bf-8ae4-2975ea8dc823]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:48:42 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:48:42 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:48:42 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ca561b-ab74-4046-96c4-cffb7121ab94]: (4, ('ok\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:48:42 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-e16f8e0c-9788-4dee-a984-2c3f81a87815 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Flushing IO for device /dev/sdc {{(pid=74840) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 12:48:42 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:48:42 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:48:42 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f5560b-38b4-4f2f-937b-b302c5d89da4]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:48:42 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-e16f8e0c-9788-4dee-a984-2c3f81a87815 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74840) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 12:48:42 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:48:42 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:48:42 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[cabcbf10-3767-4364-9409-7015748ecdd5]: (4, ('1', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:48:42 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-e16f8e0c-9788-4dee-a984-2c3f81a87815 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 12:48:42 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-e16f8e0c-9788-4dee-a984-2c3f81a87815 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] SCSI volumes sdc have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 12:48:42 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16f8e0c-9788-4dee-a984-2c3f81a87815 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729')] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 12:48:42 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:48:42 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:48:42 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5346cb-a31d-4185-a859-e397571100f5]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:48:42 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16f8e0c-9788-4dee-a984-2c3f81a87815 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:48:42 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 -p 172.16.0.220:3260 --logout {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:48:42 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:48:42 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eba0920-2561-46e2-902f-7c8c3b8f3262]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:48:42 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16f8e0c-9788-4dee-a984-2c3f81a87815 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729, portal: 172.16.0.220,3260]
Nov 08 12:48:42 user nova-compute[74840]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729, portal: 172.16.0.220,3260] successful.
Nov 08 12:48:42 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:48:42 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 -p 172.16.0.220:3260 --op delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:48:42 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3597a9-a73b-484b-9c74-80c716a4d729 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:48:42 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b1a4a7-6c42-48bf-8276-5848a6b32101]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:48:42 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16f8e0c-9788-4dee-a984-2c3f81a87815 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:48:42 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-e16f8e0c-9788-4dee-a984-2c3f81a87815 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:48:42 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16f8e0c-9788-4dee-a984-2c3f81a87815 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] <== disconnect_volume: return (279ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:48:42 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e16f8e0c-9788-4dee-a984-2c3f81a87815 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 12:48:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:48:43 user nova-compute[74840]: DEBUG nova.objects.instance [None req-e16f8e0c-9788-4dee-a984-2c3f81a87815 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lazy-loading 'flavor' on Instance uuid c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:48:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e16f8e0c-9788-4dee-a984-2c3f81a87815 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.007s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:48:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:48:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:48:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:48:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:48:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:49:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:49:02 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:49:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:49:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:49:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:49:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-9611b546-c486-4fbd-8064-526bb9a69de1 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Acquiring lock "d141acfc-f098-41db-a925-90288dfba292" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:49:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-9611b546-c486-4fbd-8064-526bb9a69de1 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Lock "d141acfc-f098-41db-a925-90288dfba292" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:49:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-9611b546-c486-4fbd-8064-526bb9a69de1 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Acquiring lock "d141acfc-f098-41db-a925-90288dfba292-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:49:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-9611b546-c486-4fbd-8064-526bb9a69de1 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Lock "d141acfc-f098-41db-a925-90288dfba292-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:49:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-9611b546-c486-4fbd-8064-526bb9a69de1 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Lock "d141acfc-f098-41db-a925-90288dfba292-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:49:14 user nova-compute[74840]: INFO nova.compute.manager [None req-9611b546-c486-4fbd-8064-526bb9a69de1 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: d141acfc-f098-41db-a925-90288dfba292] Terminating instance
Nov 08 12:49:14 user nova-compute[74840]: DEBUG nova.compute.manager [None req-9611b546-c486-4fbd-8064-526bb9a69de1 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: d141acfc-f098-41db-a925-90288dfba292] Start destroying the instance on the hypervisor. {{(pid=74840) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 12:49:14 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:49:14 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:49:14 user nova-compute[74840]: DEBUG nova.compute.manager [req-7df4b2db-06e0-4325-9241-2c462bb832be req-62e18f7f-644d-4600-9737-805b8bb94241 service nova] [instance: d141acfc-f098-41db-a925-90288dfba292] Received event network-vif-unplugged-4e3dffbe-0646-40d3-9206-07eb0c427755 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:49:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-7df4b2db-06e0-4325-9241-2c462bb832be req-62e18f7f-644d-4600-9737-805b8bb94241 service nova] Acquiring lock "d141acfc-f098-41db-a925-90288dfba292-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:49:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-7df4b2db-06e0-4325-9241-2c462bb832be req-62e18f7f-644d-4600-9737-805b8bb94241 service nova] Lock "d141acfc-f098-41db-a925-90288dfba292-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:49:14 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-7df4b2db-06e0-4325-9241-2c462bb832be req-62e18f7f-644d-4600-9737-805b8bb94241 service nova] Lock "d141acfc-f098-41db-a925-90288dfba292-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:49:14 user nova-compute[74840]: DEBUG nova.compute.manager [req-7df4b2db-06e0-4325-9241-2c462bb832be req-62e18f7f-644d-4600-9737-805b8bb94241 service nova] [instance: d141acfc-f098-41db-a925-90288dfba292] No waiting events found dispatching network-vif-unplugged-4e3dffbe-0646-40d3-9206-07eb0c427755 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:49:14 user nova-compute[74840]: DEBUG nova.compute.manager [req-7df4b2db-06e0-4325-9241-2c462bb832be req-62e18f7f-644d-4600-9737-805b8bb94241 service nova] [instance: d141acfc-f098-41db-a925-90288dfba292] Received event network-vif-unplugged-4e3dffbe-0646-40d3-9206-07eb0c427755 for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:49:14 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:49:14 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:49:14 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:49:14 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:49:14 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: d141acfc-f098-41db-a925-90288dfba292] Instance destroyed successfully.
Nov 08 12:49:14 user nova-compute[74840]: DEBUG nova.objects.instance [None req-9611b546-c486-4fbd-8064-526bb9a69de1 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Lazy-loading 'resources' on Instance uuid d141acfc-f098-41db-a925-90288dfba292 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:49:14 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-9611b546-c486-4fbd-8064-526bb9a69de1 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:47:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2084158875',display_name='tempest-ServersNegativeTestJSON-server-2084158875',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2084158875',id=48,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:47:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e48fbc441e79426f859e00e5c19a1167',ramdisk_id='',reservation_id='r-ok01kzy1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-199749076',owner_user_name='tempest-ServersNegativeTestJSON-199749076-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:47:30Z,user_data=None,user_id='52ea0bf6286c45f987154493a281b260',uuid=d141acfc-f098-41db-a925-90288dfba292,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e3dffbe-0646-40d3-9206-07eb0c427755", "address": "fa:16:3e:4e:2e:3f", "network": {"id": "88ccbadb-f25d-463d-a2c3-01dcd402b165", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1492603656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e48fbc441e79426f859e00e5c19a1167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3dffbe-06", "ovs_interfaceid": "4e3dffbe-0646-40d3-9206-07eb0c427755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:49:14 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-9611b546-c486-4fbd-8064-526bb9a69de1 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Converting VIF {"id": "4e3dffbe-0646-40d3-9206-07eb0c427755", "address": "fa:16:3e:4e:2e:3f", "network": {"id": "88ccbadb-f25d-463d-a2c3-01dcd402b165", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1492603656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e48fbc441e79426f859e00e5c19a1167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3dffbe-06", "ovs_interfaceid": "4e3dffbe-0646-40d3-9206-07eb0c427755", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:49:14 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-9611b546-c486-4fbd-8064-526bb9a69de1 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:2e:3f,bridge_name='br-int',has_traffic_filtering=True,id=4e3dffbe-0646-40d3-9206-07eb0c427755,network=Network(88ccbadb-f25d-463d-a2c3-01dcd402b165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e3dffbe-06') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:49:14 user nova-compute[74840]: DEBUG os_vif [None req-9611b546-c486-4fbd-8064-526bb9a69de1 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:2e:3f,bridge_name='br-int',has_traffic_filtering=True,id=4e3dffbe-0646-40d3-9206-07eb0c427755,network=Network(88ccbadb-f25d-463d-a2c3-01dcd402b165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e3dffbe-06') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:49:14 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:49:14 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e3dffbe-06, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:49:14 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:49:14 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:49:14 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:49:14 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d6585f5a-029a-46f8-ae16-0da3ecc03b98) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:49:14 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:49:14 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:49:14 user nova-compute[74840]: INFO os_vif [None req-9611b546-c486-4fbd-8064-526bb9a69de1 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:2e:3f,bridge_name='br-int',has_traffic_filtering=True,id=4e3dffbe-0646-40d3-9206-07eb0c427755,network=Network(88ccbadb-f25d-463d-a2c3-01dcd402b165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e3dffbe-06')
Nov 08 12:49:14 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-9611b546-c486-4fbd-8064-526bb9a69de1 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: d141acfc-f098-41db-a925-90288dfba292] Deleting instance files /opt/stack/data/nova/instances/d141acfc-f098-41db-a925-90288dfba292_del
Nov 08 12:49:14 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-9611b546-c486-4fbd-8064-526bb9a69de1 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: d141acfc-f098-41db-a925-90288dfba292] Deletion of /opt/stack/data/nova/instances/d141acfc-f098-41db-a925-90288dfba292_del complete
Nov 08 12:49:14 user nova-compute[74840]: INFO nova.compute.manager [None req-9611b546-c486-4fbd-8064-526bb9a69de1 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: d141acfc-f098-41db-a925-90288dfba292] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 08 12:49:14 user nova-compute[74840]: DEBUG oslo.service.loopingcall [None req-9611b546-c486-4fbd-8064-526bb9a69de1 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74840) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 12:49:14 user nova-compute[74840]: DEBUG nova.compute.manager [-] [instance: d141acfc-f098-41db-a925-90288dfba292] Deallocating network for instance {{(pid=74840) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 12:49:14 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: d141acfc-f098-41db-a925-90288dfba292] deallocate_for_instance() {{(pid=74840) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 12:49:15 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: d141acfc-f098-41db-a925-90288dfba292] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:49:15 user nova-compute[74840]: INFO nova.compute.manager [-] [instance: d141acfc-f098-41db-a925-90288dfba292] Took 0.63 seconds to deallocate network for instance.
Nov 08 12:49:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-9611b546-c486-4fbd-8064-526bb9a69de1 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:49:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-9611b546-c486-4fbd-8064-526bb9a69de1 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:49:15 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-9611b546-c486-4fbd-8064-526bb9a69de1 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:49:15 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-9611b546-c486-4fbd-8064-526bb9a69de1 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:49:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-9611b546-c486-4fbd-8064-526bb9a69de1 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.171s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:49:15 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-9611b546-c486-4fbd-8064-526bb9a69de1 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Deleted allocations for instance d141acfc-f098-41db-a925-90288dfba292
Nov 08 12:49:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-9611b546-c486-4fbd-8064-526bb9a69de1 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Lock "d141acfc-f098-41db-a925-90288dfba292" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.890s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:49:16 user nova-compute[74840]: DEBUG nova.compute.manager [req-c43aaa27-dad8-45dc-b6c5-2f0b1c7de507 req-e89cbe75-d687-46e3-be03-b0ab6a740a47 service nova] [instance: d141acfc-f098-41db-a925-90288dfba292] Received event network-vif-plugged-4e3dffbe-0646-40d3-9206-07eb0c427755 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:49:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-c43aaa27-dad8-45dc-b6c5-2f0b1c7de507 req-e89cbe75-d687-46e3-be03-b0ab6a740a47 service nova] Acquiring lock "d141acfc-f098-41db-a925-90288dfba292-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:49:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-c43aaa27-dad8-45dc-b6c5-2f0b1c7de507 req-e89cbe75-d687-46e3-be03-b0ab6a740a47 service nova] Lock "d141acfc-f098-41db-a925-90288dfba292-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:49:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-c43aaa27-dad8-45dc-b6c5-2f0b1c7de507 req-e89cbe75-d687-46e3-be03-b0ab6a740a47 service nova] Lock "d141acfc-f098-41db-a925-90288dfba292-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:49:16 user nova-compute[74840]: DEBUG nova.compute.manager [req-c43aaa27-dad8-45dc-b6c5-2f0b1c7de507 req-e89cbe75-d687-46e3-be03-b0ab6a740a47 service nova] [instance: d141acfc-f098-41db-a925-90288dfba292] No waiting events found dispatching network-vif-plugged-4e3dffbe-0646-40d3-9206-07eb0c427755 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:49:16 user nova-compute[74840]: WARNING nova.compute.manager [req-c43aaa27-dad8-45dc-b6c5-2f0b1c7de507 req-e89cbe75-d687-46e3-be03-b0ab6a740a47 service nova] [instance: d141acfc-f098-41db-a925-90288dfba292] Received unexpected event network-vif-plugged-4e3dffbe-0646-40d3-9206-07eb0c427755 for instance with vm_state deleted and task_state None.
Nov 08 12:49:16 user nova-compute[74840]: DEBUG nova.compute.manager [req-c43aaa27-dad8-45dc-b6c5-2f0b1c7de507 req-e89cbe75-d687-46e3-be03-b0ab6a740a47 service nova] [instance: d141acfc-f098-41db-a925-90288dfba292] Received event network-vif-deleted-4e3dffbe-0646-40d3-9206-07eb0c427755 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:49:18 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:49:18 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:49:18 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:49:19 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:49:19 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:49:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:49:20 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:49:21 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:49:21 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:49:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "refresh_cache-9294d85f-20ec-4a6c-9a52-379187cb2aa1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:49:21 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquired lock "refresh_cache-9294d85f-20ec-4a6c-9a52-379187cb2aa1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:49:21 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Forcefully refreshing network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 12:49:22 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Updating instance_info_cache with network_info: [{"id": "4fed7aed-812e-40c4-a02b-25874b4dca07", "address": "fa:16:3e:88:d5:f1", "network": {"id": "88ccbadb-f25d-463d-a2c3-01dcd402b165", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1492603656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e48fbc441e79426f859e00e5c19a1167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fed7aed-81", "ovs_interfaceid": "4fed7aed-812e-40c4-a02b-25874b4dca07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:49:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Releasing lock "refresh_cache-9294d85f-20ec-4a6c-9a52-379187cb2aa1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:49:22 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Updated the network info_cache for instance {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 12:49:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ec3902f1-22f7-4574-ae71-bd0a691619c9 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Acquiring lock "c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:49:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ec3902f1-22f7-4574-ae71-bd0a691619c9 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:49:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ec3902f1-22f7-4574-ae71-bd0a691619c9 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Acquiring lock "c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:49:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ec3902f1-22f7-4574-ae71-bd0a691619c9 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:49:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ec3902f1-22f7-4574-ae71-bd0a691619c9 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:49:22 user nova-compute[74840]: INFO nova.compute.manager [None req-ec3902f1-22f7-4574-ae71-bd0a691619c9 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Terminating instance
Nov 08 12:49:22 user nova-compute[74840]: DEBUG nova.compute.manager [None req-ec3902f1-22f7-4574-ae71-bd0a691619c9 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Start destroying the instance on the hypervisor. {{(pid=74840) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 12:49:22 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:49:22 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:49:22 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:49:22 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:49:22 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:49:22 user nova-compute[74840]: DEBUG nova.compute.manager [req-d0d488d2-daa9-41bf-a276-5d77913ca227 req-cabd311f-b303-4f5f-a935-2cfe168b6ec2 service nova] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Received event network-vif-unplugged-0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:49:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-d0d488d2-daa9-41bf-a276-5d77913ca227 req-cabd311f-b303-4f5f-a935-2cfe168b6ec2 service nova] Acquiring lock "c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:49:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-d0d488d2-daa9-41bf-a276-5d77913ca227 req-cabd311f-b303-4f5f-a935-2cfe168b6ec2 service nova] Lock "c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:49:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-d0d488d2-daa9-41bf-a276-5d77913ca227 req-cabd311f-b303-4f5f-a935-2cfe168b6ec2 service nova] Lock "c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:49:22 user nova-compute[74840]: DEBUG nova.compute.manager [req-d0d488d2-daa9-41bf-a276-5d77913ca227 req-cabd311f-b303-4f5f-a935-2cfe168b6ec2 service nova] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] No waiting events found dispatching network-vif-unplugged-0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:49:22 user nova-compute[74840]: DEBUG nova.compute.manager [req-d0d488d2-daa9-41bf-a276-5d77913ca227 req-cabd311f-b303-4f5f-a935-2cfe168b6ec2 service nova] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Received event network-vif-unplugged-0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3 for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:49:23 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Instance destroyed successfully.
Nov 08 12:49:23 user nova-compute[74840]: DEBUG nova.objects.instance [None req-ec3902f1-22f7-4574-ae71-bd0a691619c9 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lazy-loading 'resources' on Instance uuid c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:49:23 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-ec3902f1-22f7-4574-ae71-bd0a691619c9 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:43:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1016291031',display_name='tempest-TestMinimumBasicScenario-server-1016291031',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1016291031',id=46,image_ref='fb6bd902-0ff7-4bbf-99b5-308600485455',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP28XUPPJPJMSa6nvlhEkvvxfAeIxKGkf0ffCl4HMfj1up76qF0QvFROqPKMV9Q9YL9WFQR+ruARvXIB+pK3zkDnL2G/bM1eQWd/Fad9kzzpD9yPXSoXQpzWqLai1C9/lg==',key_name='tempest-TestMinimumBasicScenario-1808576556',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:43:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='270eb2fc5485447f9e09d83d48fdc14f',ramdisk_id='',reservation_id='r-tw2o6si9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fb6bd902-0ff7-4bbf-99b5-308600485455',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1675831883',owner_user_name='tempest-TestMinimumBasicScenario-1675831883-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:46:36Z,user_data=None,user_id='40cef2061d7a4ad9a98409cbaa0f6351',uuid=c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3", "address": "fa:16:3e:f4:cf:dd", "network": {"id": "8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1654230640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "270eb2fc5485447f9e09d83d48fdc14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe1ab7b-d3", "ovs_interfaceid": "0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:49:23 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-ec3902f1-22f7-4574-ae71-bd0a691619c9 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Converting VIF {"id": "0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3", "address": "fa:16:3e:f4:cf:dd", "network": {"id": "8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1654230640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "270eb2fc5485447f9e09d83d48fdc14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fe1ab7b-d3", "ovs_interfaceid": "0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:49:23 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-ec3902f1-22f7-4574-ae71-bd0a691619c9 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:cf:dd,bridge_name='br-int',has_traffic_filtering=True,id=0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3,network=Network(8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fe1ab7b-d3') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:49:23 user nova-compute[74840]: DEBUG os_vif [None req-ec3902f1-22f7-4574-ae71-bd0a691619c9 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:cf:dd,bridge_name='br-int',has_traffic_filtering=True,id=0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3,network=Network(8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fe1ab7b-d3') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:49:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:49:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0fe1ab7b-d3, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:49:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:49:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:49:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:49:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ec506f01-c130-4ffe-8352-615fb2e5f2bd) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:49:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:49:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:49:23 user nova-compute[74840]: INFO os_vif [None req-ec3902f1-22f7-4574-ae71-bd0a691619c9 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:cf:dd,bridge_name='br-int',has_traffic_filtering=True,id=0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3,network=Network(8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fe1ab7b-d3')
Nov 08 12:49:23 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-ec3902f1-22f7-4574-ae71-bd0a691619c9 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Deleting instance files /opt/stack/data/nova/instances/c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf_del
Nov 08 12:49:23 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-ec3902f1-22f7-4574-ae71-bd0a691619c9 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Deletion of /opt/stack/data/nova/instances/c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf_del complete
Nov 08 12:49:23 user nova-compute[74840]: INFO nova.compute.manager [None req-ec3902f1-22f7-4574-ae71-bd0a691619c9 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Took 0.83 seconds to destroy the instance on the hypervisor.
Nov 08 12:49:23 user nova-compute[74840]: DEBUG oslo.service.loopingcall [None req-ec3902f1-22f7-4574-ae71-bd0a691619c9 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74840) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 12:49:23 user nova-compute[74840]: DEBUG nova.compute.manager [-] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Deallocating network for instance {{(pid=74840) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 12:49:23 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] deallocate_for_instance() {{(pid=74840) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 12:49:23 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:49:23 user nova-compute[74840]: INFO nova.compute.manager [-] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Took 0.41 seconds to deallocate network for instance.
Nov 08 12:49:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ec3902f1-22f7-4574-ae71-bd0a691619c9 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:49:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ec3902f1-22f7-4574-ae71-bd0a691619c9 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:49:23 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-ec3902f1-22f7-4574-ae71-bd0a691619c9 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:49:23 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-ec3902f1-22f7-4574-ae71-bd0a691619c9 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:49:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ec3902f1-22f7-4574-ae71-bd0a691619c9 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.148s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:49:24 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-ec3902f1-22f7-4574-ae71-bd0a691619c9 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Deleted allocations for instance c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf
Nov 08 12:49:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ec3902f1-22f7-4574-ae71-bd0a691619c9 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.571s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:49:24 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:49:24 user nova-compute[74840]: DEBUG nova.compute.manager [req-1c2dbedf-d178-4e19-bf58-3939a5a9d0e9 req-566df0e9-57c0-4a74-ad8e-859f689a4c9a service nova] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Received event network-vif-plugged-0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:49:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-1c2dbedf-d178-4e19-bf58-3939a5a9d0e9 req-566df0e9-57c0-4a74-ad8e-859f689a4c9a service nova] Acquiring lock "c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:49:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-1c2dbedf-d178-4e19-bf58-3939a5a9d0e9 req-566df0e9-57c0-4a74-ad8e-859f689a4c9a service nova] Lock "c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:49:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-1c2dbedf-d178-4e19-bf58-3939a5a9d0e9 req-566df0e9-57c0-4a74-ad8e-859f689a4c9a service nova] Lock "c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:49:24 user nova-compute[74840]: DEBUG nova.compute.manager [req-1c2dbedf-d178-4e19-bf58-3939a5a9d0e9 req-566df0e9-57c0-4a74-ad8e-859f689a4c9a service nova] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] No waiting events found dispatching network-vif-plugged-0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:49:24 user nova-compute[74840]: WARNING nova.compute.manager [req-1c2dbedf-d178-4e19-bf58-3939a5a9d0e9 req-566df0e9-57c0-4a74-ad8e-859f689a4c9a service nova] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Received unexpected event network-vif-plugged-0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3 for instance with vm_state deleted and task_state None.
Nov 08 12:49:24 user nova-compute[74840]: DEBUG nova.compute.manager [req-1c2dbedf-d178-4e19-bf58-3939a5a9d0e9 req-566df0e9-57c0-4a74-ad8e-859f689a4c9a service nova] [instance: c93a2ee4-0f4b-4ad4-bdfd-83770d3049bf] Received event network-vif-deleted-0fe1ab7b-d357-4786-b8d7-e2cf877d4ed3 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:49:26 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:49:26 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:49:26 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:49:26 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:49:26 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:49:26 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9294d85f-20ec-4a6c-9a52-379187cb2aa1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:49:26 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9294d85f-20ec-4a6c-9a52-379187cb2aa1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:49:26 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9294d85f-20ec-4a6c-9a52-379187cb2aa1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:49:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9294d85f-20ec-4a6c-9a52-379187cb2aa1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:49:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:49:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:49:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:49:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:49:27 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:49:27 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:49:27 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=8720MB free_disk=24.812549591064453GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:49:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:49:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:49:27 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 9294d85f-20ec-4a6c-9a52-379187cb2aa1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:49:27 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 301cc74c-0322-47c3-be22-a638592a755a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:49:27 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:49:27 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:49:28 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:49:28 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:49:28 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:49:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.214s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:49:28 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:49:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:49:38 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:49:41 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:49:43 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:49:48 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:49:53 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:49:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:50:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:50:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:50:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:50:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Acquiring lock "b25860e0-0030-4e80-8be2-f7a418a80b92" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:50:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "b25860e0-0030-4e80-8be2-f7a418a80b92" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:50:16 user nova-compute[74840]: DEBUG nova.compute.manager [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Starting instance... {{(pid=74840) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 12:50:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:50:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:50:16 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:50:16 user nova-compute[74840]: INFO nova.compute.claims [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Claim successful on node user
Nov 08 12:50:16 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:50:16 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:50:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.311s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:50:16 user nova-compute[74840]: DEBUG nova.compute.manager [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Start building networks asynchronously for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 12:50:16 user nova-compute[74840]: DEBUG nova.compute.manager [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Allocating IP information in the background. {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 12:50:16 user nova-compute[74840]: DEBUG nova.network.neutron [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 12:50:16 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 12:50:16 user nova-compute[74840]: DEBUG nova.compute.manager [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Start building block device mappings for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 12:50:16 user nova-compute[74840]: DEBUG nova.policy [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '40cef2061d7a4ad9a98409cbaa0f6351', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '270eb2fc5485447f9e09d83d48fdc14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 12:50:16 user nova-compute[74840]: DEBUG nova.compute.manager [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Start spawning the instance on the hypervisor. {{(pid=74840) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 12:50:16 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:50:16 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Creating image(s)
Nov 08 12:50:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Acquiring lock "/opt/stack/data/nova/instances/b25860e0-0030-4e80-8be2-f7a418a80b92/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:50:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "/opt/stack/data/nova/instances/b25860e0-0030-4e80-8be2-f7a418a80b92/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:50:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "/opt/stack/data/nova/instances/b25860e0-0030-4e80-8be2-f7a418a80b92/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:50:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Acquiring lock "da455c00b31c1f47c4d74ff63eaddf534b1c371f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:50:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "da455c00b31c1f47c4d74ff63eaddf534b1c371f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:50:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da455c00b31c1f47c4d74ff63eaddf534b1c371f.part --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:50:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da455c00b31c1f47c4d74ff63eaddf534b1c371f.part --force-share --output=json" returned: 0 in 0.167s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:50:17 user nova-compute[74840]: DEBUG nova.virt.images [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] cb426414-da98-450c-a7de-4d030fd07b7d was qcow2, converting to raw {{(pid=74840) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 12:50:17 user nova-compute[74840]: DEBUG nova.privsep.utils [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74840) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 12:50:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/da455c00b31c1f47c4d74ff63eaddf534b1c371f.part /opt/stack/data/nova/instances/_base/da455c00b31c1f47c4d74ff63eaddf534b1c371f.converted {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:50:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:50:17 user nova-compute[74840]: DEBUG nova.network.neutron [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Successfully created port: 46124c00-b635-4543-886c-914cfb23594c {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:50:17 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:50:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/da455c00b31c1f47c4d74ff63eaddf534b1c371f.part /opt/stack/data/nova/instances/_base/da455c00b31c1f47c4d74ff63eaddf534b1c371f.converted" returned: 0 in 0.253s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:50:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da455c00b31c1f47c4d74ff63eaddf534b1c371f.converted --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:50:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da455c00b31c1f47c4d74ff63eaddf534b1c371f.converted --force-share --output=json" returned: 0 in 0.173s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:50:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "da455c00b31c1f47c4d74ff63eaddf534b1c371f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.028s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:50:17 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da455c00b31c1f47c4d74ff63eaddf534b1c371f --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da455c00b31c1f47c4d74ff63eaddf534b1c371f --force-share --output=json" returned: 0 in 0.168s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Acquiring lock "da455c00b31c1f47c4d74ff63eaddf534b1c371f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "da455c00b31c1f47c4d74ff63eaddf534b1c371f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da455c00b31c1f47c4d74ff63eaddf534b1c371f --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da455c00b31c1f47c4d74ff63eaddf534b1c371f --force-share --output=json" returned: 0 in 0.194s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da455c00b31c1f47c4d74ff63eaddf534b1c371f,backing_fmt=raw /opt/stack/data/nova/instances/b25860e0-0030-4e80-8be2-f7a418a80b92/disk 1073741824 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da455c00b31c1f47c4d74ff63eaddf534b1c371f,backing_fmt=raw /opt/stack/data/nova/instances/b25860e0-0030-4e80-8be2-f7a418a80b92/disk 1073741824" returned: 0 in 0.053s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "da455c00b31c1f47c4d74ff63eaddf534b1c371f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da455c00b31c1f47c4d74ff63eaddf534b1c371f --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG nova.network.neutron [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Successfully updated port: 46124c00-b635-4543-886c-914cfb23594c {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG nova.compute.manager [req-0efad53a-e235-43ad-b1e0-7801ba93d872 req-54d9ed15-796a-43ef-a74b-80b892a4f036 service nova] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Received event network-changed-46124c00-b635-4543-886c-914cfb23594c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG nova.compute.manager [req-0efad53a-e235-43ad-b1e0-7801ba93d872 req-54d9ed15-796a-43ef-a74b-80b892a4f036 service nova] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Refreshing instance network info cache due to event network-changed-46124c00-b635-4543-886c-914cfb23594c. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0efad53a-e235-43ad-b1e0-7801ba93d872 req-54d9ed15-796a-43ef-a74b-80b892a4f036 service nova] Acquiring lock "refresh_cache-b25860e0-0030-4e80-8be2-f7a418a80b92" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0efad53a-e235-43ad-b1e0-7801ba93d872 req-54d9ed15-796a-43ef-a74b-80b892a4f036 service nova] Acquired lock "refresh_cache-b25860e0-0030-4e80-8be2-f7a418a80b92" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG nova.network.neutron [req-0efad53a-e235-43ad-b1e0-7801ba93d872 req-54d9ed15-796a-43ef-a74b-80b892a4f036 service nova] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Refreshing network info cache for port 46124c00-b635-4543-886c-914cfb23594c {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Acquiring lock "refresh_cache-b25860e0-0030-4e80-8be2-f7a418a80b92" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG nova.network.neutron [req-0efad53a-e235-43ad-b1e0-7801ba93d872 req-54d9ed15-796a-43ef-a74b-80b892a4f036 service nova] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da455c00b31c1f47c4d74ff63eaddf534b1c371f --force-share --output=json" returned: 0 in 0.176s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b25860e0-0030-4e80-8be2-f7a418a80b92/disk. size=1073741824 {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b25860e0-0030-4e80-8be2-f7a418a80b92/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG nova.network.neutron [req-0efad53a-e235-43ad-b1e0-7801ba93d872 req-54d9ed15-796a-43ef-a74b-80b892a4f036 service nova] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-0efad53a-e235-43ad-b1e0-7801ba93d872 req-54d9ed15-796a-43ef-a74b-80b892a4f036 service nova] Releasing lock "refresh_cache-b25860e0-0030-4e80-8be2-f7a418a80b92" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Acquired lock "refresh_cache-b25860e0-0030-4e80-8be2-f7a418a80b92" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG nova.network.neutron [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b25860e0-0030-4e80-8be2-f7a418a80b92/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Cannot resize image /opt/stack/data/nova/instances/b25860e0-0030-4e80-8be2-f7a418a80b92/disk to a smaller size. {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Created local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Ensure instance console log exists: /opt/stack/data/nova/instances/b25860e0-0030-4e80-8be2-f7a418a80b92/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG nova.network.neutron [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG nova.network.neutron [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Updating instance_info_cache with network_info: [{"id": "46124c00-b635-4543-886c-914cfb23594c", "address": "fa:16:3e:31:21:d4", "network": {"id": "8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1654230640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "270eb2fc5485447f9e09d83d48fdc14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46124c00-b6", "ovs_interfaceid": "46124c00-b635-4543-886c-914cfb23594c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Releasing lock "refresh_cache-b25860e0-0030-4e80-8be2-f7a418a80b92" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG nova.compute.manager [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Instance network_info: |[{"id": "46124c00-b635-4543-886c-914cfb23594c", "address": "fa:16:3e:31:21:d4", "network": {"id": "8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1654230640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "270eb2fc5485447f9e09d83d48fdc14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46124c00-b6", "ovs_interfaceid": "46124c00-b635-4543-886c-914cfb23594c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Start _get_guest_xml network_info=[{"id": "46124c00-b635-4543-886c-914cfb23594c", "address": "fa:16:3e:31:21:d4", "network": {"id": "8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1654230640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "270eb2fc5485447f9e09d83d48fdc14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46124c00-b6", "ovs_interfaceid": "46124c00-b635-4543-886c-914cfb23594c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:50:14Z,direct_url=<?>,disk_format='qcow2',id=cb426414-da98-450c-a7de-4d030fd07b7d,min_disk=0,min_ram=0,name='tempest-scenario-img--1503864347',owner='270eb2fc5485447f9e09d83d48fdc14f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:50:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'image_id': 'cb426414-da98-450c-a7de-4d030fd07b7d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:50:18 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:50:18 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:50:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:50:14Z,direct_url=<?>,disk_format='qcow2',id=cb426414-da98-450c-a7de-4d030fd07b7d,min_disk=0,min_ram=0,name='tempest-scenario-img--1503864347',owner='270eb2fc5485447f9e09d83d48fdc14f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:50:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:50:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-458461980',display_name='tempest-TestMinimumBasicScenario-server-458461980',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-458461980',id=50,image_ref='cb426414-da98-450c-a7de-4d030fd07b7d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgR/DdBe0/Em7Dkik9NFZ7N7KmeJNaA8h0QzN5WD7bCSbi6bJ1FMqtzP6EXFwGqJVtwsMpYrlpdQSkXUwZ68XDCQjSL0QgFH4Fy3ZRZ+k4kKsh12+FzwirDe50bD5aiIA==',key_name='tempest-TestMinimumBasicScenario-1548049828',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='270eb2fc5485447f9e09d83d48fdc14f',ramdisk_id='',reservation_id='r-ei7wy3cd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cb426414-da98-450c-a7de-4d030fd07b7d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1675831883',owner_user_name='tempest-TestMinimumBasicScenario-1675831883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:50:17Z,user_data=None,user_id='40cef2061d7a4ad9a98409cbaa0f6351',uuid=b25860e0-0030-4e80-8be2-f7a418a80b92,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46124c00-b635-4543-886c-914cfb23594c", "address": "fa:16:3e:31:21:d4", "network": {"id": "8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1654230640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "270eb2fc5485447f9e09d83d48fdc14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46124c00-b6", "ovs_interfaceid": "46124c00-b635-4543-886c-914cfb23594c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Converting VIF {"id": "46124c00-b635-4543-886c-914cfb23594c", "address": "fa:16:3e:31:21:d4", "network": {"id": "8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1654230640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "270eb2fc5485447f9e09d83d48fdc14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46124c00-b6", "ovs_interfaceid": "46124c00-b635-4543-886c-914cfb23594c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:21:d4,bridge_name='br-int',has_traffic_filtering=True,id=46124c00-b635-4543-886c-914cfb23594c,network=Network(8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46124c00-b6') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:50:18 user nova-compute[74840]: DEBUG nova.objects.instance [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lazy-loading 'pci_devices' on Instance uuid b25860e0-0030-4e80-8be2-f7a418a80b92 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:50:19 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:50:19 user nova-compute[74840]:   <uuid>b25860e0-0030-4e80-8be2-f7a418a80b92</uuid>
Nov 08 12:50:19 user nova-compute[74840]:   <name>instance-00000032</name>
Nov 08 12:50:19 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:50:19 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:50:19 user nova-compute[74840]:   <metadata>
Nov 08 12:50:19 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:50:19 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:50:19 user nova-compute[74840]:       <nova:name>tempest-TestMinimumBasicScenario-server-458461980</nova:name>
Nov 08 12:50:19 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:50:18</nova:creationTime>
Nov 08 12:50:19 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:50:19 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:50:19 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:50:19 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:50:19 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:50:19 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:50:19 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:50:19 user nova-compute[74840]:       <nova:owner>
Nov 08 12:50:19 user nova-compute[74840]:         <nova:user uuid="40cef2061d7a4ad9a98409cbaa0f6351">tempest-TestMinimumBasicScenario-1675831883-project-member</nova:user>
Nov 08 12:50:19 user nova-compute[74840]:         <nova:project uuid="270eb2fc5485447f9e09d83d48fdc14f">tempest-TestMinimumBasicScenario-1675831883</nova:project>
Nov 08 12:50:19 user nova-compute[74840]:       </nova:owner>
Nov 08 12:50:19 user nova-compute[74840]:       <nova:root type="image" uuid="cb426414-da98-450c-a7de-4d030fd07b7d"/>
Nov 08 12:50:19 user nova-compute[74840]:       <nova:ports>
Nov 08 12:50:19 user nova-compute[74840]:         <nova:port uuid="46124c00-b635-4543-886c-914cfb23594c">
Nov 08 12:50:19 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 12:50:19 user nova-compute[74840]:         </nova:port>
Nov 08 12:50:19 user nova-compute[74840]:       </nova:ports>
Nov 08 12:50:19 user nova-compute[74840]:     </nova:instance>
Nov 08 12:50:19 user nova-compute[74840]:   </metadata>
Nov 08 12:50:19 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:50:19 user nova-compute[74840]:     <system>
Nov 08 12:50:19 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:50:19 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:50:19 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:50:19 user nova-compute[74840]:       <entry name="serial">b25860e0-0030-4e80-8be2-f7a418a80b92</entry>
Nov 08 12:50:19 user nova-compute[74840]:       <entry name="uuid">b25860e0-0030-4e80-8be2-f7a418a80b92</entry>
Nov 08 12:50:19 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:50:19 user nova-compute[74840]:     </system>
Nov 08 12:50:19 user nova-compute[74840]:   </sysinfo>
Nov 08 12:50:19 user nova-compute[74840]:   <os>
Nov 08 12:50:19 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:50:19 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:50:19 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:50:19 user nova-compute[74840]:   </os>
Nov 08 12:50:19 user nova-compute[74840]:   <features>
Nov 08 12:50:19 user nova-compute[74840]:     <acpi/>
Nov 08 12:50:19 user nova-compute[74840]:     <apic/>
Nov 08 12:50:19 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:50:19 user nova-compute[74840]:   </features>
Nov 08 12:50:19 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:50:19 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:50:19 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:50:19 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:50:19 user nova-compute[74840]:   </clock>
Nov 08 12:50:19 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:50:19 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:50:19 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:50:19 user nova-compute[74840]:   </cpu>
Nov 08 12:50:19 user nova-compute[74840]:   <devices>
Nov 08 12:50:19 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:50:19 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:50:19 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/b25860e0-0030-4e80-8be2-f7a418a80b92/disk"/>
Nov 08 12:50:19 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:50:19 user nova-compute[74840]:     </disk>
Nov 08 12:50:19 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:50:19 user nova-compute[74840]:       <mac address="fa:16:3e:31:21:d4"/>
Nov 08 12:50:19 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:50:19 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:50:19 user nova-compute[74840]:       <target dev="tap46124c00-b6"/>
Nov 08 12:50:19 user nova-compute[74840]:     </interface>
Nov 08 12:50:19 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:50:19 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/b25860e0-0030-4e80-8be2-f7a418a80b92/console.log" append="off"/>
Nov 08 12:50:19 user nova-compute[74840]:     </serial>
Nov 08 12:50:19 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:50:19 user nova-compute[74840]:     <video>
Nov 08 12:50:19 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:50:19 user nova-compute[74840]:     </video>
Nov 08 12:50:19 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:50:19 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:50:19 user nova-compute[74840]:     </rng>
Nov 08 12:50:19 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:50:19 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:50:19 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:50:19 user nova-compute[74840]:     </memballoon>
Nov 08 12:50:19 user nova-compute[74840]:   </devices>
Nov 08 12:50:19 user nova-compute[74840]: </domain>
Nov 08 12:50:19 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:50:19 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:50:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-458461980',display_name='tempest-TestMinimumBasicScenario-server-458461980',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-458461980',id=50,image_ref='cb426414-da98-450c-a7de-4d030fd07b7d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgR/DdBe0/Em7Dkik9NFZ7N7KmeJNaA8h0QzN5WD7bCSbi6bJ1FMqtzP6EXFwGqJVtwsMpYrlpdQSkXUwZ68XDCQjSL0QgFH4Fy3ZRZ+k4kKsh12+FzwirDe50bD5aiIA==',key_name='tempest-TestMinimumBasicScenario-1548049828',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='270eb2fc5485447f9e09d83d48fdc14f',ramdisk_id='',reservation_id='r-ei7wy3cd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cb426414-da98-450c-a7de-4d030fd07b7d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1675831883',owner_user_name='tempest-TestMinimumBasicScenario-1675831883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:50:17Z,user_data=None,user_id='40cef2061d7a4ad9a98409cbaa0f6351',uuid=b25860e0-0030-4e80-8be2-f7a418a80b92,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46124c00-b635-4543-886c-914cfb23594c", "address": "fa:16:3e:31:21:d4", "network": {"id": "8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1654230640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "270eb2fc5485447f9e09d83d48fdc14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46124c00-b6", "ovs_interfaceid": "46124c00-b635-4543-886c-914cfb23594c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:50:19 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Converting VIF {"id": "46124c00-b635-4543-886c-914cfb23594c", "address": "fa:16:3e:31:21:d4", "network": {"id": "8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1654230640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "270eb2fc5485447f9e09d83d48fdc14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46124c00-b6", "ovs_interfaceid": "46124c00-b635-4543-886c-914cfb23594c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:50:19 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:21:d4,bridge_name='br-int',has_traffic_filtering=True,id=46124c00-b635-4543-886c-914cfb23594c,network=Network(8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46124c00-b6') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:50:19 user nova-compute[74840]: DEBUG os_vif [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:21:d4,bridge_name='br-int',has_traffic_filtering=True,id=46124c00-b635-4543-886c-914cfb23594c,network=Network(8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46124c00-b6') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:50:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:50:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:50:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:50:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:50:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '74ba2694-a259-53e8-a367-ced94c7511ea', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:50:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:50:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:50:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:50:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap46124c00-b6, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:50:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap46124c00-b6, col_values=(('qos', UUID('6846a8be-4638-4db6-b1ca-ce19fdd1f2e1')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:50:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap46124c00-b6, col_values=(('external_ids', {'iface-id': '46124c00-b635-4543-886c-914cfb23594c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:21:d4', 'vm-uuid': 'b25860e0-0030-4e80-8be2-f7a418a80b92'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:50:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:50:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:50:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:50:19 user nova-compute[74840]: INFO os_vif [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:21:d4,bridge_name='br-int',has_traffic_filtering=True,id=46124c00-b635-4543-886c-914cfb23594c,network=Network(8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46124c00-b6')
Nov 08 12:50:19 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:50:19 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] No VIF found with MAC fa:16:3e:31:21:d4, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:50:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:50:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:50:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:50:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:50:20 user nova-compute[74840]: DEBUG nova.compute.manager [req-7ff2757f-b06d-42b8-8358-68bb399b1d2d req-dd812191-eaf2-46c6-b4c9-bfdf38048eda service nova] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Received event network-vif-plugged-46124c00-b635-4543-886c-914cfb23594c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:50:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-7ff2757f-b06d-42b8-8358-68bb399b1d2d req-dd812191-eaf2-46c6-b4c9-bfdf38048eda service nova] Acquiring lock "b25860e0-0030-4e80-8be2-f7a418a80b92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:50:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-7ff2757f-b06d-42b8-8358-68bb399b1d2d req-dd812191-eaf2-46c6-b4c9-bfdf38048eda service nova] Lock "b25860e0-0030-4e80-8be2-f7a418a80b92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.008s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:50:20 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-7ff2757f-b06d-42b8-8358-68bb399b1d2d req-dd812191-eaf2-46c6-b4c9-bfdf38048eda service nova] Lock "b25860e0-0030-4e80-8be2-f7a418a80b92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.011s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:50:20 user nova-compute[74840]: DEBUG nova.compute.manager [req-7ff2757f-b06d-42b8-8358-68bb399b1d2d req-dd812191-eaf2-46c6-b4c9-bfdf38048eda service nova] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] No waiting events found dispatching network-vif-plugged-46124c00-b635-4543-886c-914cfb23594c {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:50:20 user nova-compute[74840]: WARNING nova.compute.manager [req-7ff2757f-b06d-42b8-8358-68bb399b1d2d req-dd812191-eaf2-46c6-b4c9-bfdf38048eda service nova] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Received unexpected event network-vif-plugged-46124c00-b635-4543-886c-914cfb23594c for instance with vm_state building and task_state spawning.
Nov 08 12:50:20 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:50:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:50:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:50:21 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:50:21 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:50:22 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:50:22 user nova-compute[74840]: DEBUG nova.compute.manager [req-8ae458c2-f082-429b-af3e-ea1b2f4050c1 req-b9c7fe6a-4b38-4068-a566-c5b3646225f4 service nova] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Received event network-vif-plugged-46124c00-b635-4543-886c-914cfb23594c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:50:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8ae458c2-f082-429b-af3e-ea1b2f4050c1 req-b9c7fe6a-4b38-4068-a566-c5b3646225f4 service nova] Acquiring lock "b25860e0-0030-4e80-8be2-f7a418a80b92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:50:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8ae458c2-f082-429b-af3e-ea1b2f4050c1 req-b9c7fe6a-4b38-4068-a566-c5b3646225f4 service nova] Lock "b25860e0-0030-4e80-8be2-f7a418a80b92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:50:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8ae458c2-f082-429b-af3e-ea1b2f4050c1 req-b9c7fe6a-4b38-4068-a566-c5b3646225f4 service nova] Lock "b25860e0-0030-4e80-8be2-f7a418a80b92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:50:22 user nova-compute[74840]: DEBUG nova.compute.manager [req-8ae458c2-f082-429b-af3e-ea1b2f4050c1 req-b9c7fe6a-4b38-4068-a566-c5b3646225f4 service nova] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] No waiting events found dispatching network-vif-plugged-46124c00-b635-4543-886c-914cfb23594c {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:50:22 user nova-compute[74840]: WARNING nova.compute.manager [req-8ae458c2-f082-429b-af3e-ea1b2f4050c1 req-b9c7fe6a-4b38-4068-a566-c5b3646225f4 service nova] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Received unexpected event network-vif-plugged-46124c00-b635-4543-886c-914cfb23594c for instance with vm_state building and task_state spawning.
Nov 08 12:50:22 user nova-compute[74840]: DEBUG nova.compute.manager [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:50:22 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:50:22 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Instance spawned successfully.
Nov 08 12:50:22 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:50:22 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Found default for hw_cdrom_bus of ide {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:50:22 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Found default for hw_disk_bus of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:50:22 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:50:22 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:50:22 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Found default for hw_video_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:50:22 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Found default for hw_vif_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:50:22 user nova-compute[74840]: INFO nova.compute.manager [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Took 5.87 seconds to spawn the instance on the hypervisor.
Nov 08 12:50:22 user nova-compute[74840]: DEBUG nova.compute.manager [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:50:22 user nova-compute[74840]: INFO nova.compute.manager [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Took 6.50 seconds to build instance.
Nov 08 12:50:22 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-479e17ce-530c-4fb7-91f5-585fb4aee155 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "b25860e0-0030-4e80-8be2-f7a418a80b92" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.613s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:50:23 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:50:23 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:50:23 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Rebuilding the list of instances to heal {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 12:50:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "refresh_cache-9294d85f-20ec-4a6c-9a52-379187cb2aa1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:50:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquired lock "refresh_cache-9294d85f-20ec-4a6c-9a52-379187cb2aa1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:50:23 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Forcefully refreshing network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 12:50:23 user nova-compute[74840]: DEBUG nova.objects.instance [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lazy-loading 'info_cache' on Instance uuid 9294d85f-20ec-4a6c-9a52-379187cb2aa1 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:50:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:50:24 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Updating instance_info_cache with network_info: [{"id": "4fed7aed-812e-40c4-a02b-25874b4dca07", "address": "fa:16:3e:88:d5:f1", "network": {"id": "88ccbadb-f25d-463d-a2c3-01dcd402b165", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1492603656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e48fbc441e79426f859e00e5c19a1167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fed7aed-81", "ovs_interfaceid": "4fed7aed-812e-40c4-a02b-25874b4dca07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:50:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Releasing lock "refresh_cache-9294d85f-20ec-4a6c-9a52-379187cb2aa1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:50:24 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Updated the network info_cache for instance {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 12:50:24 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:50:24 user nova-compute[74840]: DEBUG nova.compute.manager [req-33804acb-e580-4646-9772-68cdb8879804 req-ed2412bb-3391-417c-9154-6f304a360880 service nova] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Received event network-changed-f001cf21-b5b2-4a55-bcc4-5451e3a73170 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:50:24 user nova-compute[74840]: DEBUG nova.compute.manager [req-33804acb-e580-4646-9772-68cdb8879804 req-ed2412bb-3391-417c-9154-6f304a360880 service nova] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Refreshing instance network info cache due to event network-changed-f001cf21-b5b2-4a55-bcc4-5451e3a73170. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:50:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-33804acb-e580-4646-9772-68cdb8879804 req-ed2412bb-3391-417c-9154-6f304a360880 service nova] Acquiring lock "refresh_cache-301cc74c-0322-47c3-be22-a638592a755a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:50:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-33804acb-e580-4646-9772-68cdb8879804 req-ed2412bb-3391-417c-9154-6f304a360880 service nova] Acquired lock "refresh_cache-301cc74c-0322-47c3-be22-a638592a755a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:50:24 user nova-compute[74840]: DEBUG nova.network.neutron [req-33804acb-e580-4646-9772-68cdb8879804 req-ed2412bb-3391-417c-9154-6f304a360880 service nova] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Refreshing network info cache for port f001cf21-b5b2-4a55-bcc4-5451e3a73170 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:50:25 user nova-compute[74840]: DEBUG nova.network.neutron [req-33804acb-e580-4646-9772-68cdb8879804 req-ed2412bb-3391-417c-9154-6f304a360880 service nova] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Updated VIF entry in instance network info cache for port f001cf21-b5b2-4a55-bcc4-5451e3a73170. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:50:25 user nova-compute[74840]: DEBUG nova.network.neutron [req-33804acb-e580-4646-9772-68cdb8879804 req-ed2412bb-3391-417c-9154-6f304a360880 service nova] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Updating instance_info_cache with network_info: [{"id": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "address": "fa:16:3e:f3:fc:27", "network": {"id": "515bf382-a9c9-4096-9de0-23fc0c912a71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1378790516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7e49db466d4c0a83700e2e917c78be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf001cf21-b5", "ovs_interfaceid": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:50:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-33804acb-e580-4646-9772-68cdb8879804 req-ed2412bb-3391-417c-9154-6f304a360880 service nova] Releasing lock "refresh_cache-301cc74c-0322-47c3-be22-a638592a755a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:50:26 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:50:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:50:28 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:50:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:50:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:50:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:50:28 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:50:28 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b25860e0-0030-4e80-8be2-f7a418a80b92/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:50:28 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b25860e0-0030-4e80-8be2-f7a418a80b92/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:50:28 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b25860e0-0030-4e80-8be2-f7a418a80b92/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:50:29 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:50:29 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b25860e0-0030-4e80-8be2-f7a418a80b92/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:50:29 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9294d85f-20ec-4a6c-9a52-379187cb2aa1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:50:29 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9294d85f-20ec-4a6c-9a52-379187cb2aa1/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:50:29 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9294d85f-20ec-4a6c-9a52-379187cb2aa1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:50:29 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9294d85f-20ec-4a6c-9a52-379187cb2aa1/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:50:29 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:50:29 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:50:29 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:50:29 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:50:30 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:50:30 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:50:30 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=8591MB free_disk=24.789703369140625GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:50:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:50:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:50:30 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 9294d85f-20ec-4a6c-9a52-379187cb2aa1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:50:30 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 301cc74c-0322-47c3-be22-a638592a755a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:50:30 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance b25860e0-0030-4e80-8be2-f7a418a80b92 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:50:30 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:50:30 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:50:30 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:50:30 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:50:30 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:50:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.302s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:50:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Acquiring lock "301cc74c-0322-47c3-be22-a638592a755a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:50:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "301cc74c-0322-47c3-be22-a638592a755a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:50:31 user nova-compute[74840]: DEBUG nova.objects.instance [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lazy-loading 'flavor' on Instance uuid 301cc74c-0322-47c3-be22-a638592a755a {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:50:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "301cc74c-0322-47c3-be22-a638592a755a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:50:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Acquiring lock "301cc74c-0322-47c3-be22-a638592a755a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:50:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "301cc74c-0322-47c3-be22-a638592a755a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:50:31 user nova-compute[74840]: INFO nova.compute.manager [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Attaching volume 7bed5cad-1adf-41f9-bf68-19db96af4d2e to /dev/vdb
Nov 08 12:50:31 user nova-compute[74840]: DEBUG os_brick.utils [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:50:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:50:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:50:31 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[12112a9e-1c67-48ea-b0ce-2ea5dbf27ab2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c8228a11e03c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:50:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:50:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:50:31 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[db36f752-f215-4830-af3d-5b6c2d56152a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:50:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:50:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:50:31 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ac38ae-df12-4fba-8110-a25494bee47a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:50:31 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f8eea0-6432-48c2-853d-aa861c4a8b62]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:50:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Running cmd (subprocess): nvme version {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:50:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] 'nvme version' failed. Not Retrying. {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:50:31 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] nvme not present on system {{(pid=74840) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 12:50:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:50:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:50:31 user nova-compute[74840]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 12:50:31 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[907c104a-09ba-4814-855f-800f7a9eb133]: (4, '') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:50:31 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74840) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 12:50:31 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 12:50:31 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] LIGHTOS: no hostnqn found. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 12:50:31 user nova-compute[74840]: DEBUG os_brick.utils [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c8228a11e03c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:50:31 user nova-compute[74840]: DEBUG nova.virt.block_device [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Updating existing volume attachment record: 80038bfa-7813-4e07-92f8-64a8b99df64d {{(pid=74840) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 12:50:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:50:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:50:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:50:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:50:41 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:50:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:50:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:50:44 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:50:44 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74840) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 12:50:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:50:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:50:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Calling os-brick to attach iSCSI Volume {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YPHzqaOd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:50:53 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:50:53 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:50:53 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:50:53 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:50:53 user nova-compute[74840]: INFO os_brick.initiator.connectors.iscsi [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 12:50:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e -p 172.16.0.220:3260 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee12fe8d-1ce7-4f2f-940e-80509f5ba65d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 12:50:53 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e -p 172.16.0.220:3260 --interface default --op new {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8174000-c080-4832-88ae-320ac336f31b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e] added\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e] added
Nov 08 12:50:53 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd35dad9-c825-4e6e-bb53-a1c7aabb587c]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae8d6c6-911c-40ed-88e5-962c313e5e49]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YPHzqaOd {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YPHzqaOd" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc097c2e-91c5-4d93-a813-0a80201f38fc]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YPHzqaOd'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c548e05-d611-4d23-8a2b-ccb3ed770aad]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1bfd75a-b746-41b3-807e-8cec09631970]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 12:50:53 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 12:50:53 user nova-compute[74840]:  {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:50:53 user nova-compute[74840]: WARNING os_brick.initiator.connectors.iscsi [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 12:50:53 user nova-compute[74840]: 
Nov 08 12:50:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e -p 172.16.0.220:3260 --login {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de4ca6b-8ab8-4338-96f9-cea589172026]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e, portal: 172.16.0.220,3260]
Nov 08 12:50:53 user nova-compute[74840]: Login to [iface: default, target: iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e, portal: 172.16.0.220,3260] successful.
Nov 08 12:50:53 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1958d63-2c1a-4b4b-92dd-dbfbe06c509d]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[358da0ca-d9fd-4b7b-865e-e6e85eef0ea0]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e (non-flash)
Nov 08 12:50:53 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e (non-flash)
Nov 08 12:50:53 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Connected to 172.16.0.220:3260 {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=74840) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74840) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a8761a-78db-4ef6-86a6-a5167ac62864]: (4, ('- - 0', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:50:53 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YPHzqaOd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 12:50:54 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:50:54 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:50:54 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23537626138623231', 'path': '/dev/sdb'} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:50:54 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537626138623231', 'path': '/dev/sdb'} {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 12:50:54 user nova-compute[74840]: DEBUG nova.objects.instance [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lazy-loading 'flavor' on Instance uuid 301cc74c-0322-47c3-be22-a638592a755a {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:50:54 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 12:50:54 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:50:54 user nova-compute[74840]:   <source dev="/dev/sdb"/>
Nov 08 12:50:54 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:50:54 user nova-compute[74840]:   <serial>7bed5cad-1adf-41f9-bf68-19db96af4d2e</serial>
Nov 08 12:50:54 user nova-compute[74840]: </disk>
Nov 08 12:50:54 user nova-compute[74840]:  {{(pid=74840) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 12:50:54 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:50:54 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:50:54 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] No VIF found with MAC fa:16:3e:f3:fc:27, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:50:55 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b7a238c8-2128-4f78-914f-46c06249e086 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "301cc74c-0322-47c3-be22-a638592a755a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.671s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:50:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b380a710-9f49-4ed5-b3af-ea5392ff0bdc tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Acquiring lock "301cc74c-0322-47c3-be22-a638592a755a" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:50:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b380a710-9f49-4ed5-b3af-ea5392ff0bdc tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "301cc74c-0322-47c3-be22-a638592a755a" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:50:56 user nova-compute[74840]: DEBUG nova.compute.manager [None req-b380a710-9f49-4ed5-b3af-ea5392ff0bdc tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:50:56 user nova-compute[74840]: DEBUG nova.compute.manager [None req-b380a710-9f49-4ed5-b3af-ea5392ff0bdc tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74840) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 08 12:50:56 user nova-compute[74840]: DEBUG nova.objects.instance [None req-b380a710-9f49-4ed5-b3af-ea5392ff0bdc tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lazy-loading 'flavor' on Instance uuid 301cc74c-0322-47c3-be22-a638592a755a {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:50:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:50:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:50:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:50:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:50:56 user nova-compute[74840]: DEBUG nova.compute.manager [req-1c8b8080-ec74-43a0-9d8a-4976cb05253f req-52143249-da32-4b43-b81d-5ba221c8d8b3 service nova] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Received event network-vif-unplugged-f001cf21-b5b2-4a55-bcc4-5451e3a73170 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:50:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-1c8b8080-ec74-43a0-9d8a-4976cb05253f req-52143249-da32-4b43-b81d-5ba221c8d8b3 service nova] Acquiring lock "301cc74c-0322-47c3-be22-a638592a755a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:50:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-1c8b8080-ec74-43a0-9d8a-4976cb05253f req-52143249-da32-4b43-b81d-5ba221c8d8b3 service nova] Lock "301cc74c-0322-47c3-be22-a638592a755a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:50:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-1c8b8080-ec74-43a0-9d8a-4976cb05253f req-52143249-da32-4b43-b81d-5ba221c8d8b3 service nova] Lock "301cc74c-0322-47c3-be22-a638592a755a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:50:56 user nova-compute[74840]: DEBUG nova.compute.manager [req-1c8b8080-ec74-43a0-9d8a-4976cb05253f req-52143249-da32-4b43-b81d-5ba221c8d8b3 service nova] [instance: 301cc74c-0322-47c3-be22-a638592a755a] No waiting events found dispatching network-vif-unplugged-f001cf21-b5b2-4a55-bcc4-5451e3a73170 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:50:56 user nova-compute[74840]: WARNING nova.compute.manager [req-1c8b8080-ec74-43a0-9d8a-4976cb05253f req-52143249-da32-4b43-b81d-5ba221c8d8b3 service nova] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Received unexpected event network-vif-unplugged-f001cf21-b5b2-4a55-bcc4-5451e3a73170 for instance with vm_state active and task_state powering-off.
Nov 08 12:50:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:50:56 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Instance destroyed successfully.
Nov 08 12:50:56 user nova-compute[74840]: DEBUG nova.compute.manager [None req-b380a710-9f49-4ed5-b3af-ea5392ff0bdc tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:50:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b380a710-9f49-4ed5-b3af-ea5392ff0bdc tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "301cc74c-0322-47c3-be22-a638592a755a" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.872s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:50:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:50:58 user nova-compute[74840]: DEBUG nova.compute.manager [req-426f014b-bcc7-4631-814b-92e189be62b7 req-42809ec9-a532-411e-8707-16905d0aef66 service nova] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Received event network-vif-plugged-f001cf21-b5b2-4a55-bcc4-5451e3a73170 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:50:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-426f014b-bcc7-4631-814b-92e189be62b7 req-42809ec9-a532-411e-8707-16905d0aef66 service nova] Acquiring lock "301cc74c-0322-47c3-be22-a638592a755a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:50:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-426f014b-bcc7-4631-814b-92e189be62b7 req-42809ec9-a532-411e-8707-16905d0aef66 service nova] Lock "301cc74c-0322-47c3-be22-a638592a755a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:50:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-426f014b-bcc7-4631-814b-92e189be62b7 req-42809ec9-a532-411e-8707-16905d0aef66 service nova] Lock "301cc74c-0322-47c3-be22-a638592a755a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:50:58 user nova-compute[74840]: DEBUG nova.compute.manager [req-426f014b-bcc7-4631-814b-92e189be62b7 req-42809ec9-a532-411e-8707-16905d0aef66 service nova] [instance: 301cc74c-0322-47c3-be22-a638592a755a] No waiting events found dispatching network-vif-plugged-f001cf21-b5b2-4a55-bcc4-5451e3a73170 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:50:58 user nova-compute[74840]: WARNING nova.compute.manager [req-426f014b-bcc7-4631-814b-92e189be62b7 req-42809ec9-a532-411e-8707-16905d0aef66 service nova] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Received unexpected event network-vif-plugged-f001cf21-b5b2-4a55-bcc4-5451e3a73170 for instance with vm_state stopped and task_state None.
Nov 08 12:50:59 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:51:00 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:51:00 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Cleaning up deleted instances {{(pid=74840) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 12:51:00 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] There are 0 instances to clean {{(pid=74840) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 12:51:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:51:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:51:14 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:51:18 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:51:18 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:51:18 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:51:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:51:20 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:51:21 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:51:23 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:51:23 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:51:23 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:51:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "refresh_cache-301cc74c-0322-47c3-be22-a638592a755a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:51:23 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquired lock "refresh_cache-301cc74c-0322-47c3-be22-a638592a755a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:51:23 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Forcefully refreshing network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 12:51:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:51:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:51:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 12:51:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:51:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:51:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:51:24 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Updating instance_info_cache with network_info: [{"id": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "address": "fa:16:3e:f3:fc:27", "network": {"id": "515bf382-a9c9-4096-9de0-23fc0c912a71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1378790516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7e49db466d4c0a83700e2e917c78be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf001cf21-b5", "ovs_interfaceid": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:51:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Releasing lock "refresh_cache-301cc74c-0322-47c3-be22-a638592a755a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:51:24 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Updated the network info_cache for instance {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 12:51:24 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:51:28 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:51:29 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:51:30 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:51:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:51:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:51:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:51:30 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:51:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b25860e0-0030-4e80-8be2-f7a418a80b92/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:51:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b25860e0-0030-4e80-8be2-f7a418a80b92/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:51:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b25860e0-0030-4e80-8be2-f7a418a80b92/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:51:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b25860e0-0030-4e80-8be2-f7a418a80b92/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:51:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9294d85f-20ec-4a6c-9a52-379187cb2aa1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:51:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9294d85f-20ec-4a6c-9a52-379187cb2aa1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:51:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9294d85f-20ec-4a6c-9a52-379187cb2aa1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:51:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9294d85f-20ec-4a6c-9a52-379187cb2aa1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:51:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:51:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:51:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:51:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:51:31 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:51:32 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:51:32 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:51:32 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=8745MB free_disk=24.760704040527344GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:51:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:51:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:51:32 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 9294d85f-20ec-4a6c-9a52-379187cb2aa1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:51:32 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 301cc74c-0322-47c3-be22-a638592a755a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:51:32 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance b25860e0-0030-4e80-8be2-f7a418a80b92 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:51:32 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:51:32 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:51:32 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Refreshing inventories for resource provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 12:51:32 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Updating ProviderTree inventory for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 12:51:32 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Updating inventory in ProviderTree for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 12:51:32 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Refreshing aggregate associations for resource provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e, aggregates: None {{(pid=74840) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 12:51:32 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Refreshing trait associations for resource provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=74840) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 12:51:32 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:51:32 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:51:32 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:51:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.591s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:51:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:51:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:51:41 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:51:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:51:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:51:54 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:51:59 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:52:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:52:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:52:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 12:52:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:52:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:52:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:52:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:52:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Acquiring lock "b25860e0-0030-4e80-8be2-f7a418a80b92" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:52:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "b25860e0-0030-4e80-8be2-f7a418a80b92" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:52:12 user nova-compute[74840]: DEBUG nova.objects.instance [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lazy-loading 'flavor' on Instance uuid b25860e0-0030-4e80-8be2-f7a418a80b92 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:52:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "b25860e0-0030-4e80-8be2-f7a418a80b92" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:52:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Acquiring lock "b25860e0-0030-4e80-8be2-f7a418a80b92" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:52:12 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "b25860e0-0030-4e80-8be2-f7a418a80b92" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:52:12 user nova-compute[74840]: INFO nova.compute.manager [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Attaching volume e4022491-8a00-429f-aaa4-fae57b81eea2 to /dev/vdb
Nov 08 12:52:13 user nova-compute[74840]: DEBUG os_brick.utils [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:52:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:52:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:52:13 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1da4660-e70e-4fd8-9eaa-0ac58205c0a6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c8228a11e03c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:52:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:52:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:52:13 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66ff825-f6a4-4755-8a28-2846cdc050a1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:52:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:52:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:52:13 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1261e9-d5ea-4d2e-9bd4-2cebb9b73cdf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:52:13 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5bb016-077f-401a-910e-9030f6cf475a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:52:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Running cmd (subprocess): nvme version {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:52:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] 'nvme version' failed. Not Retrying. {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:52:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] nvme not present on system {{(pid=74840) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 12:52:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:52:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 12:52:13 user nova-compute[74840]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 12:52:13 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4330388-4218-4147-9922-70afe3ded793]: (4, '') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:52:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74840) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 12:52:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 12:52:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] LIGHTOS: no hostnqn found. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 12:52:13 user nova-compute[74840]: DEBUG os_brick.utils [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c8228a11e03c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:52:13 user nova-compute[74840]: DEBUG nova.virt.block_device [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Updating existing volume attachment record: afc79547-7679-423b-adda-50b33c90607b {{(pid=74840) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 12:52:14 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:52:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:52:19 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:52:19 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:52:20 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:52:21 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:52:22 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:52:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:52:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:52:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 12:52:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:52:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:52:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:52:24 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:52:24 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:52:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "refresh_cache-b25860e0-0030-4e80-8be2-f7a418a80b92" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:52:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquired lock "refresh_cache-b25860e0-0030-4e80-8be2-f7a418a80b92" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:52:24 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Forcefully refreshing network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 12:52:25 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Updating instance_info_cache with network_info: [{"id": "46124c00-b635-4543-886c-914cfb23594c", "address": "fa:16:3e:31:21:d4", "network": {"id": "8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1654230640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "270eb2fc5485447f9e09d83d48fdc14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46124c00-b6", "ovs_interfaceid": "46124c00-b635-4543-886c-914cfb23594c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:52:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Releasing lock "refresh_cache-b25860e0-0030-4e80-8be2-f7a418a80b92" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:52:25 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Updated the network info_cache for instance {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 12:52:26 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:52:26 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:52:28 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:52:29 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:52:30 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:52:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:52:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:52:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:52:30 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:52:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b25860e0-0030-4e80-8be2-f7a418a80b92/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:52:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b25860e0-0030-4e80-8be2-f7a418a80b92/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:52:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b25860e0-0030-4e80-8be2-f7a418a80b92/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:52:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b25860e0-0030-4e80-8be2-f7a418a80b92/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:52:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9294d85f-20ec-4a6c-9a52-379187cb2aa1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:52:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9294d85f-20ec-4a6c-9a52-379187cb2aa1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:52:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9294d85f-20ec-4a6c-9a52-379187cb2aa1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:52:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9294d85f-20ec-4a6c-9a52-379187cb2aa1/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:52:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:52:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:52:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:52:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:52:31 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:52:32 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:52:32 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:52:32 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=8765MB free_disk=24.752029418945312GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:52:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:52:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:52:32 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 9294d85f-20ec-4a6c-9a52-379187cb2aa1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:52:32 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 301cc74c-0322-47c3-be22-a638592a755a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:52:32 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance b25860e0-0030-4e80-8be2-f7a418a80b92 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:52:32 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:52:32 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:52:32 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:52:32 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:52:32 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:52:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.220s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:52:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:52:34 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Calling os-brick to attach iSCSI Volume {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 12:52:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UiMQhwVa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:52:34 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:52:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:52:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:52:34 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:52:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:52:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:52:34 user nova-compute[74840]: INFO os_brick.initiator.connectors.iscsi [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 12:52:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2 -p 172.16.0.220:3260 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:52:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:52:34 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[499d1a08-2b35-4626-86c3-d29b6aa47ead]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:52:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 12:52:34 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:52:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:52:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:52:34 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[237fd856-0330-46f5-bdc9-3d660371bc40]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2] added\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:52:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2] added
Nov 08 12:52:34 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:52:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:52:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:52:35 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[15447c8a-dac7-4f02-80ae-1b80f52c74fc]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:52:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:52:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:52:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:52:35 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c30d350-6292-4c8e-bad5-79812ae12e28]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:52:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:52:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UiMQhwVa {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:52:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UiMQhwVa" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:52:35 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c09aec-ab78-4a97-8400-971c249c3710]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:52:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UiMQhwVa'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:52:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:52:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:52:35 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[861adfe7-99c7-4502-9c52-befcb7b28665]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:52:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:52:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:52:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:52:35 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7329a456-f859-42b0-932b-45be32d057f6]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:52:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e (non-flash)
Nov 08 12:52:35 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:52:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e (non-flash)
Nov 08 12:52:35 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:52:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2 -p 172.16.0.220:3260 --login {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:52:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:52:35 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a16f5eb-9967-4f92-95fb-b1cc78e94ea8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:52:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2, portal: 172.16.0.220,3260]
Nov 08 12:52:35 user nova-compute[74840]: Login to [iface: default, target: iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2, portal: 172.16.0.220,3260] successful.
Nov 08 12:52:35 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:52:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:52:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:52:35 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a365e2bc-4e22-4b5f-bb30-a88a49b1148e]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:52:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:52:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:52:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:52:35 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c64b8dc-2b3e-4c63-9ffb-e0ee967a3b45]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:52:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e (non-flash)
Nov 08 12:52:35 user nova-compute[74840]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2 (non-flash)
Nov 08 12:52:35 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:52:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e (non-flash)
Nov 08 12:52:35 user nova-compute[74840]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2 (non-flash)
Nov 08 12:52:35 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:52:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:52:35 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Connected to 172.16.0.220:3260 {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 12:52:35 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=74840) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 12:52:35 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74840) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 12:52:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:52:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:52:35 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[be82fafc-9d06-49ab-8545-7916321aae0a]: (4, ('- - 0', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:52:35 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: None {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:52:36 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:52:36 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UiMQhwVa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 12:52:36 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:52:36 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '26236666436306631', 'path': '/dev/sdc'} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:52:36 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236666436306631', 'path': '/dev/sdc'} {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 12:52:36 user nova-compute[74840]: DEBUG nova.objects.instance [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lazy-loading 'flavor' on Instance uuid b25860e0-0030-4e80-8be2-f7a418a80b92 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:52:36 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 12:52:36 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:52:36 user nova-compute[74840]:   <source dev="/dev/sdc"/>
Nov 08 12:52:36 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:52:36 user nova-compute[74840]:   <serial>e4022491-8a00-429f-aaa4-fae57b81eea2</serial>
Nov 08 12:52:36 user nova-compute[74840]: </disk>
Nov 08 12:52:36 user nova-compute[74840]:  {{(pid=74840) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 12:52:36 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:52:36 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:52:36 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] No VIF found with MAC fa:16:3e:31:21:d4, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:52:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-7525f001-34cd-4dbb-8369-eb330f24c7cd tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "b25860e0-0030-4e80-8be2-f7a418a80b92" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.895s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:52:38 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:52:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:52:39 user nova-compute[74840]: DEBUG nova.compute.manager [req-945c24b6-d494-4ea9-bfa2-5bd158f9b17a req-4841b7d9-6073-4722-9eb0-c4d80e594f27 service nova] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Received event network-changed-46124c00-b635-4543-886c-914cfb23594c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:52:39 user nova-compute[74840]: DEBUG nova.compute.manager [req-945c24b6-d494-4ea9-bfa2-5bd158f9b17a req-4841b7d9-6073-4722-9eb0-c4d80e594f27 service nova] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Refreshing instance network info cache due to event network-changed-46124c00-b635-4543-886c-914cfb23594c. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:52:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-945c24b6-d494-4ea9-bfa2-5bd158f9b17a req-4841b7d9-6073-4722-9eb0-c4d80e594f27 service nova] Acquiring lock "refresh_cache-b25860e0-0030-4e80-8be2-f7a418a80b92" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:52:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-945c24b6-d494-4ea9-bfa2-5bd158f9b17a req-4841b7d9-6073-4722-9eb0-c4d80e594f27 service nova] Acquired lock "refresh_cache-b25860e0-0030-4e80-8be2-f7a418a80b92" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:52:39 user nova-compute[74840]: DEBUG nova.network.neutron [req-945c24b6-d494-4ea9-bfa2-5bd158f9b17a req-4841b7d9-6073-4722-9eb0-c4d80e594f27 service nova] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Refreshing network info cache for port 46124c00-b635-4543-886c-914cfb23594c {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:52:39 user nova-compute[74840]: DEBUG nova.network.neutron [req-945c24b6-d494-4ea9-bfa2-5bd158f9b17a req-4841b7d9-6073-4722-9eb0-c4d80e594f27 service nova] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Updated VIF entry in instance network info cache for port 46124c00-b635-4543-886c-914cfb23594c. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:52:39 user nova-compute[74840]: DEBUG nova.network.neutron [req-945c24b6-d494-4ea9-bfa2-5bd158f9b17a req-4841b7d9-6073-4722-9eb0-c4d80e594f27 service nova] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Updating instance_info_cache with network_info: [{"id": "46124c00-b635-4543-886c-914cfb23594c", "address": "fa:16:3e:31:21:d4", "network": {"id": "8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1654230640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "270eb2fc5485447f9e09d83d48fdc14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46124c00-b6", "ovs_interfaceid": "46124c00-b635-4543-886c-914cfb23594c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:52:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-945c24b6-d494-4ea9-bfa2-5bd158f9b17a req-4841b7d9-6073-4722-9eb0-c4d80e594f27 service nova] Releasing lock "refresh_cache-b25860e0-0030-4e80-8be2-f7a418a80b92" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:52:41 user nova-compute[74840]: DEBUG nova.compute.manager [req-949451e8-7e5d-4092-afe8-d853fe62dfa3 req-b5f72bfe-91ce-49be-be52-6ca7e11c3647 service nova] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Received event network-changed-46124c00-b635-4543-886c-914cfb23594c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:52:41 user nova-compute[74840]: DEBUG nova.compute.manager [req-949451e8-7e5d-4092-afe8-d853fe62dfa3 req-b5f72bfe-91ce-49be-be52-6ca7e11c3647 service nova] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Refreshing instance network info cache due to event network-changed-46124c00-b635-4543-886c-914cfb23594c. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:52:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-949451e8-7e5d-4092-afe8-d853fe62dfa3 req-b5f72bfe-91ce-49be-be52-6ca7e11c3647 service nova] Acquiring lock "refresh_cache-b25860e0-0030-4e80-8be2-f7a418a80b92" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:52:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-949451e8-7e5d-4092-afe8-d853fe62dfa3 req-b5f72bfe-91ce-49be-be52-6ca7e11c3647 service nova] Acquired lock "refresh_cache-b25860e0-0030-4e80-8be2-f7a418a80b92" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:52:41 user nova-compute[74840]: DEBUG nova.network.neutron [req-949451e8-7e5d-4092-afe8-d853fe62dfa3 req-b5f72bfe-91ce-49be-be52-6ca7e11c3647 service nova] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Refreshing network info cache for port 46124c00-b635-4543-886c-914cfb23594c {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:52:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-803845f0-08f6-4fdf-85f0-4fee6a64081e tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Acquiring lock "b25860e0-0030-4e80-8be2-f7a418a80b92" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:52:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-803845f0-08f6-4fdf-85f0-4fee6a64081e tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "b25860e0-0030-4e80-8be2-f7a418a80b92" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:52:41 user nova-compute[74840]: INFO nova.compute.manager [None req-803845f0-08f6-4fdf-85f0-4fee6a64081e tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Rebooting instance
Nov 08 12:52:41 user nova-compute[74840]: DEBUG nova.network.neutron [req-949451e8-7e5d-4092-afe8-d853fe62dfa3 req-b5f72bfe-91ce-49be-be52-6ca7e11c3647 service nova] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Updated VIF entry in instance network info cache for port 46124c00-b635-4543-886c-914cfb23594c. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:52:41 user nova-compute[74840]: DEBUG nova.network.neutron [req-949451e8-7e5d-4092-afe8-d853fe62dfa3 req-b5f72bfe-91ce-49be-be52-6ca7e11c3647 service nova] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Updating instance_info_cache with network_info: [{"id": "46124c00-b635-4543-886c-914cfb23594c", "address": "fa:16:3e:31:21:d4", "network": {"id": "8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1654230640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "270eb2fc5485447f9e09d83d48fdc14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46124c00-b6", "ovs_interfaceid": "46124c00-b635-4543-886c-914cfb23594c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:52:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-949451e8-7e5d-4092-afe8-d853fe62dfa3 req-b5f72bfe-91ce-49be-be52-6ca7e11c3647 service nova] Releasing lock "refresh_cache-b25860e0-0030-4e80-8be2-f7a418a80b92" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:52:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-803845f0-08f6-4fdf-85f0-4fee6a64081e tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Acquiring lock "refresh_cache-b25860e0-0030-4e80-8be2-f7a418a80b92" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:52:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-803845f0-08f6-4fdf-85f0-4fee6a64081e tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Acquired lock "refresh_cache-b25860e0-0030-4e80-8be2-f7a418a80b92" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:52:41 user nova-compute[74840]: DEBUG nova.network.neutron [None req-803845f0-08f6-4fdf-85f0-4fee6a64081e tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:52:42 user nova-compute[74840]: DEBUG nova.network.neutron [None req-803845f0-08f6-4fdf-85f0-4fee6a64081e tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Updating instance_info_cache with network_info: [{"id": "46124c00-b635-4543-886c-914cfb23594c", "address": "fa:16:3e:31:21:d4", "network": {"id": "8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1654230640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "270eb2fc5485447f9e09d83d48fdc14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46124c00-b6", "ovs_interfaceid": "46124c00-b635-4543-886c-914cfb23594c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:52:42 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-803845f0-08f6-4fdf-85f0-4fee6a64081e tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Releasing lock "refresh_cache-b25860e0-0030-4e80-8be2-f7a418a80b92" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:52:42 user nova-compute[74840]: DEBUG nova.compute.manager [None req-803845f0-08f6-4fdf-85f0-4fee6a64081e tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:52:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:52:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:52:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:52:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:52:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:52:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:52:44 user nova-compute[74840]: DEBUG nova.compute.manager [req-64fb8c54-bea7-4ef0-b775-51c34e548368 req-26ad8a12-4466-4269-9f3d-1e5175ec1fcf service nova] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Received event network-vif-unplugged-46124c00-b635-4543-886c-914cfb23594c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:52:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-64fb8c54-bea7-4ef0-b775-51c34e548368 req-26ad8a12-4466-4269-9f3d-1e5175ec1fcf service nova] Acquiring lock "b25860e0-0030-4e80-8be2-f7a418a80b92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:52:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-64fb8c54-bea7-4ef0-b775-51c34e548368 req-26ad8a12-4466-4269-9f3d-1e5175ec1fcf service nova] Lock "b25860e0-0030-4e80-8be2-f7a418a80b92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:52:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-64fb8c54-bea7-4ef0-b775-51c34e548368 req-26ad8a12-4466-4269-9f3d-1e5175ec1fcf service nova] Lock "b25860e0-0030-4e80-8be2-f7a418a80b92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:52:44 user nova-compute[74840]: DEBUG nova.compute.manager [req-64fb8c54-bea7-4ef0-b775-51c34e548368 req-26ad8a12-4466-4269-9f3d-1e5175ec1fcf service nova] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] No waiting events found dispatching network-vif-unplugged-46124c00-b635-4543-886c-914cfb23594c {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:52:44 user nova-compute[74840]: WARNING nova.compute.manager [req-64fb8c54-bea7-4ef0-b775-51c34e548368 req-26ad8a12-4466-4269-9f3d-1e5175ec1fcf service nova] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Received unexpected event network-vif-unplugged-46124c00-b635-4543-886c-914cfb23594c for instance with vm_state active and task_state reboot_started.
Nov 08 12:52:45 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-803845f0-08f6-4fdf-85f0-4fee6a64081e tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Instance shutdown successfully.
Nov 08 12:52:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:52:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:52:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:52:46 user nova-compute[74840]: DEBUG nova.compute.manager [req-84bd2691-7ef6-4c60-97eb-462964420408 req-1a0fd1f3-cc5d-4899-9d18-fdf186b11743 service nova] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Received event network-vif-plugged-46124c00-b635-4543-886c-914cfb23594c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:52:46 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-84bd2691-7ef6-4c60-97eb-462964420408 req-1a0fd1f3-cc5d-4899-9d18-fdf186b11743 service nova] Acquiring lock "b25860e0-0030-4e80-8be2-f7a418a80b92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:52:46 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-84bd2691-7ef6-4c60-97eb-462964420408 req-1a0fd1f3-cc5d-4899-9d18-fdf186b11743 service nova] Lock "b25860e0-0030-4e80-8be2-f7a418a80b92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:52:46 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-84bd2691-7ef6-4c60-97eb-462964420408 req-1a0fd1f3-cc5d-4899-9d18-fdf186b11743 service nova] Lock "b25860e0-0030-4e80-8be2-f7a418a80b92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:52:46 user nova-compute[74840]: DEBUG nova.compute.manager [req-84bd2691-7ef6-4c60-97eb-462964420408 req-1a0fd1f3-cc5d-4899-9d18-fdf186b11743 service nova] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] No waiting events found dispatching network-vif-plugged-46124c00-b635-4543-886c-914cfb23594c {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:52:46 user nova-compute[74840]: WARNING nova.compute.manager [req-84bd2691-7ef6-4c60-97eb-462964420408 req-1a0fd1f3-cc5d-4899-9d18-fdf186b11743 service nova] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Received unexpected event network-vif-plugged-46124c00-b635-4543-886c-914cfb23594c for instance with vm_state active and task_state reboot_started.
Nov 08 12:52:47 user nova-compute[74840]: DEBUG nova.objects.instance [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lazy-loading 'flavor' on Instance uuid 301cc74c-0322-47c3-be22-a638592a755a {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Acquiring lock "refresh_cache-301cc74c-0322-47c3-be22-a638592a755a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Acquired lock "refresh_cache-301cc74c-0322-47c3-be22-a638592a755a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG nova.network.neutron [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG nova.objects.instance [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lazy-loading 'info_cache' on Instance uuid 301cc74c-0322-47c3-be22-a638592a755a {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG nova.objects.base [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Object Instance<301cc74c-0322-47c3-be22-a638592a755a> lazy-loaded attributes: flavor,info_cache {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG nova.network.neutron [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Updating instance_info_cache with network_info: [{"id": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "address": "fa:16:3e:f3:fc:27", "network": {"id": "515bf382-a9c9-4096-9de0-23fc0c912a71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1378790516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7e49db466d4c0a83700e2e917c78be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf001cf21-b5", "ovs_interfaceid": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Releasing lock "refresh_cache-301cc74c-0322-47c3-be22-a638592a755a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:52:47 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Instance destroyed successfully.
Nov 08 12:52:47 user nova-compute[74840]: DEBUG nova.objects.instance [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lazy-loading 'resources' on Instance uuid 301cc74c-0322-47c3-be22-a638592a755a {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG nova.objects.base [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Object Instance<301cc74c-0322-47c3-be22-a638592a755a> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:48:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1268219938',display_name='tempest-AttachVolumeTestJSON-server-1268219938',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1268219938',id=49,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1Q3P8MX65K+ewG2SwkHJsjLBfhR/vPyPX9ltkFerXJUdJghXZzKfH0GZA2WFBtwb7dErHNHWFrK86n2OEQBsGNeWGod8BzroVKFZNXS962Jzp5znHBxWuSa1al8Vb4Ew==',key_name='tempest-keypair-654921536',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:48:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6e7e49db466d4c0a83700e2e917c78be',ramdisk_id='',reservation_id='r-cr0fa74z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-116807071',owner_user_name='tempest-AttachVolumeTestJSON-116807071-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:50:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9667df3a519d47809b332f8457cd1154',uuid=301cc74c-0322-47c3-be22-a638592a755a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "address": "fa:16:3e:f3:fc:27", "network": {"id": "515bf382-a9c9-4096-9de0-23fc0c912a71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1378790516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7e49db466d4c0a83700e2e917c78be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf001cf21-b5", "ovs_interfaceid": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Converting VIF {"id": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "address": "fa:16:3e:f3:fc:27", "network": {"id": "515bf382-a9c9-4096-9de0-23fc0c912a71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1378790516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7e49db466d4c0a83700e2e917c78be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf001cf21-b5", "ovs_interfaceid": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:fc:27,bridge_name='br-int',has_traffic_filtering=True,id=f001cf21-b5b2-4a55-bcc4-5451e3a73170,network=Network(515bf382-a9c9-4096-9de0-23fc0c912a71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf001cf21-b5') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG os_vif [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:fc:27,bridge_name='br-int',has_traffic_filtering=True,id=f001cf21-b5b2-4a55-bcc4-5451e3a73170,network=Network(515bf382-a9c9-4096-9de0-23fc0c912a71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf001cf21-b5') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf001cf21-b5, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=49416552-f568-41be-8848-72db9aa7df6b) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:52:47 user nova-compute[74840]: INFO os_vif [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:fc:27,bridge_name='br-int',has_traffic_filtering=True,id=f001cf21-b5b2-4a55-bcc4-5451e3a73170,network=Network(515bf382-a9c9-4096-9de0-23fc0c912a71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf001cf21-b5')
Nov 08 12:52:47 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YPHzqaOd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:52:47 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:52:47 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b762b8d0-a6fb-4904-9e35-6eb245d1f5bd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 12:52:47 user nova-compute[74840]: No targets found.
Nov 08 12:52:47 user nova-compute[74840]: iSNS:
Nov 08 12:52:47 user nova-compute[74840]: No targets found.
Nov 08 12:52:47 user nova-compute[74840]: STATIC:
Nov 08 12:52:47 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e
Nov 08 12:52:47 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:52:47 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:52:47 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2
Nov 08 12:52:47 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:52:47 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:52:47 user nova-compute[74840]: FIRMWARE:
Nov 08 12:52:47 user nova-compute[74840]: No targets found.
Nov 08 12:52:47 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 12:52:47 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 12:52:47 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[312c9cd7-cb6c-4045-960b-2c4166904e05]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[4566a553-37ee-4611-828e-0897a41ee2d6]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e (non-flash)
Nov 08 12:52:47 user nova-compute[74840]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2 (non-flash)
Nov 08 12:52:47 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e (non-flash)
Nov 08 12:52:47 user nova-compute[74840]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2 (non-flash)
Nov 08 12:52:47 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7f421c430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e'): ({'sdb'}, set())}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Removing single pathed devices sdb {{(pid=74840) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c979f4-b307-48e5-8ecd-3b8f05c5701f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1d519d-659e-49a0-8d65-a0dcad05ec28]: (4, ('ok\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Flushing IO for device /dev/sdb {{(pid=74840) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a1da0f-3d3f-4df1-b881-a534f00c12b9]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74840) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[11baea5a-f3d7-4c86-830d-f158e4046ece]: (4, ('1', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] SCSI volumes sdb have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e')] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e25846a-9b98-4014-809a-306a374d0d39]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e -p 172.16.0.220:3260 --logout {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a25b16-d022-43fe-b09d-da9f538a48b1]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e, portal: 172.16.0.220,3260]
Nov 08 12:52:47 user nova-compute[74840]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e, portal: 172.16.0.220,3260] successful.
Nov 08 12:52:47 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e -p 172.16.0.220:3260 --op delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[30bab3e7-e135-4562-8300-5c5862bf714c]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] <== disconnect_volume: return (287ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Start _get_guest_xml network_info=[{"id": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "address": "fa:16:3e:f3:fc:27", "network": {"id": "515bf382-a9c9-4096-9de0-23fc0c912a71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1378790516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7e49db466d4c0a83700e2e917c78be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf001cf21-b5", "ovs_interfaceid": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'image_id': '4fa17706-d304-4117-a420-dab994c703dc'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '80038bfa-7813-4e07-92f8-64a8b99df64d', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YPHzqaOd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '301cc74c-0322-47c3-be22-a638592a755a', 'attached_at': '', 'detached_at': '', 'volume_id': '7bed5cad-1adf-41f9-bf68-19db96af4d2e', 'serial': '7bed5cad-1adf-41f9-bf68-19db96af4d2e'}, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG nova.objects.instance [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lazy-loading 'numa_topology' on Instance uuid 301cc74c-0322-47c3-be22-a638592a755a {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG nova.objects.base [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Object Instance<301cc74c-0322-47c3-be22-a638592a755a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:52:47 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:52:47 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:52:47 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG nova.objects.instance [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lazy-loading 'vcpu_model' on Instance uuid 301cc74c-0322-47c3-be22-a638592a755a {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:52:47 user nova-compute[74840]: DEBUG nova.objects.base [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Object Instance<301cc74c-0322-47c3-be22-a638592a755a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Calling os-brick to attach iSCSI Volume {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YPHzqaOd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:52:48 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:52:48 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:52:48 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:52:48 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:52:48 user nova-compute[74840]: INFO os_brick.initiator.connectors.iscsi [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 12:52:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e -p 172.16.0.220:3260 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e5cf43-583d-411e-9cf5-4c43bab2f85c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 12:52:48 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e -p 172.16.0.220:3260 --interface default --op new {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e60ba0-e6cf-4b4b-8eb2-f2e61a1e6777]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e] added\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e] added
Nov 08 12:52:48 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5026127-f870-49bb-b911-9afb6f1235a0]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5d9175-e2fa-47b4-b263-23d83bc8436c]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YPHzqaOd {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YPHzqaOd" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db08b16-3869-44d9-aee4-8f7331d0431d]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YPHzqaOd'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce9628a-ffc6-4159-8db9-0a11970be529]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8d21d4-c54a-41f7-b6f7-021eff0ef784]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2 (non-flash)
Nov 08 12:52:48 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2 (non-flash)
Nov 08 12:52:48 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e -p 172.16.0.220:3260 --login {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[26cd4b45-5af5-48eb-afba-7a978c440470]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e, portal: 172.16.0.220,3260]
Nov 08 12:52:48 user nova-compute[74840]: Login to [iface: default, target: iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e, portal: 172.16.0.220,3260] successful.
Nov 08 12:52:48 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d191ea7b-e5b9-46e2-85d1-23f13dd661da]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b593ddfe-6ee3-436a-804f-b84a60991f1a]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2 (non-flash)
Nov 08 12:52:48 user nova-compute[74840]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e (non-flash)
Nov 08 12:52:48 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2 (non-flash)
Nov 08 12:52:48 user nova-compute[74840]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e (non-flash)
Nov 08 12:52:48 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Connected to 172.16.0.220:3260 {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=74840) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74840) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[19255e2f-7308-4834-a75b-cd9d57dac327]: (4, ('- - 0', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: None {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG nova.compute.manager [req-7f62131f-8cf2-4d8c-a43f-e66bd92faf21 req-69938799-b6ba-42f1-8042-8968b859e16b service nova] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Received event network-vif-plugged-46124c00-b635-4543-886c-914cfb23594c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-7f62131f-8cf2-4d8c-a43f-e66bd92faf21 req-69938799-b6ba-42f1-8042-8968b859e16b service nova] Acquiring lock "b25860e0-0030-4e80-8be2-f7a418a80b92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-7f62131f-8cf2-4d8c-a43f-e66bd92faf21 req-69938799-b6ba-42f1-8042-8968b859e16b service nova] Lock "b25860e0-0030-4e80-8be2-f7a418a80b92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-7f62131f-8cf2-4d8c-a43f-e66bd92faf21 req-69938799-b6ba-42f1-8042-8968b859e16b service nova] Lock "b25860e0-0030-4e80-8be2-f7a418a80b92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG nova.compute.manager [req-7f62131f-8cf2-4d8c-a43f-e66bd92faf21 req-69938799-b6ba-42f1-8042-8968b859e16b service nova] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] No waiting events found dispatching network-vif-plugged-46124c00-b635-4543-886c-914cfb23594c {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:52:48 user nova-compute[74840]: WARNING nova.compute.manager [req-7f62131f-8cf2-4d8c-a43f-e66bd92faf21 req-69938799-b6ba-42f1-8042-8968b859e16b service nova] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Received unexpected event network-vif-plugged-46124c00-b635-4543-886c-914cfb23594c for instance with vm_state active and task_state reboot_started.
Nov 08 12:52:48 user nova-compute[74840]: DEBUG nova.compute.manager [req-7f62131f-8cf2-4d8c-a43f-e66bd92faf21 req-69938799-b6ba-42f1-8042-8968b859e16b service nova] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Received event network-vif-plugged-46124c00-b635-4543-886c-914cfb23594c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-7f62131f-8cf2-4d8c-a43f-e66bd92faf21 req-69938799-b6ba-42f1-8042-8968b859e16b service nova] Acquiring lock "b25860e0-0030-4e80-8be2-f7a418a80b92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-7f62131f-8cf2-4d8c-a43f-e66bd92faf21 req-69938799-b6ba-42f1-8042-8968b859e16b service nova] Lock "b25860e0-0030-4e80-8be2-f7a418a80b92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-7f62131f-8cf2-4d8c-a43f-e66bd92faf21 req-69938799-b6ba-42f1-8042-8968b859e16b service nova] Lock "b25860e0-0030-4e80-8be2-f7a418a80b92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:52:48 user nova-compute[74840]: DEBUG nova.compute.manager [req-7f62131f-8cf2-4d8c-a43f-e66bd92faf21 req-69938799-b6ba-42f1-8042-8968b859e16b service nova] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] No waiting events found dispatching network-vif-plugged-46124c00-b635-4543-886c-914cfb23594c {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:52:48 user nova-compute[74840]: WARNING nova.compute.manager [req-7f62131f-8cf2-4d8c-a43f-e66bd92faf21 req-69938799-b6ba-42f1-8042-8968b859e16b service nova] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Received unexpected event network-vif-plugged-46124c00-b635-4543-886c-914cfb23594c for instance with vm_state active and task_state reboot_started.
Nov 08 12:52:48 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Instance running successfully.
Nov 08 12:52:48 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-803845f0-08f6-4fdf-85f0-4fee6a64081e tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Instance soft rebooted successfully.
Nov 08 12:52:48 user nova-compute[74840]: DEBUG nova.compute.manager [None req-803845f0-08f6-4fdf-85f0-4fee6a64081e tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:52:49 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-803845f0-08f6-4fdf-85f0-4fee6a64081e tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "b25860e0-0030-4e80-8be2-f7a418a80b92" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.216s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:52:49 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 12:52:49 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YPHzqaOd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 12:52:49 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:52:49 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23537626138623231', 'path': '/dev/sdb'} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:52:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537626138623231', 'path': '/dev/sdb'} {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 12:52:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:48:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1268219938',display_name='tempest-AttachVolumeTestJSON-server-1268219938',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1268219938',id=49,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1Q3P8MX65K+ewG2SwkHJsjLBfhR/vPyPX9ltkFerXJUdJghXZzKfH0GZA2WFBtwb7dErHNHWFrK86n2OEQBsGNeWGod8BzroVKFZNXS962Jzp5znHBxWuSa1al8Vb4Ew==',key_name='tempest-keypair-654921536',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:48:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6e7e49db466d4c0a83700e2e917c78be',ramdisk_id='',reservation_id='r-cr0fa74z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-116807071',owner_user_name='tempest-AttachVolumeTestJSON-116807071-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:50:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9667df3a519d47809b332f8457cd1154',uuid=301cc74c-0322-47c3-be22-a638592a755a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "address": "fa:16:3e:f3:fc:27", "network": {"id": "515bf382-a9c9-4096-9de0-23fc0c912a71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1378790516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7e49db466d4c0a83700e2e917c78be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf001cf21-b5", "ovs_interfaceid": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:52:49 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Converting VIF {"id": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "address": "fa:16:3e:f3:fc:27", "network": {"id": "515bf382-a9c9-4096-9de0-23fc0c912a71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1378790516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7e49db466d4c0a83700e2e917c78be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf001cf21-b5", "ovs_interfaceid": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:52:49 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:fc:27,bridge_name='br-int',has_traffic_filtering=True,id=f001cf21-b5b2-4a55-bcc4-5451e3a73170,network=Network(515bf382-a9c9-4096-9de0-23fc0c912a71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf001cf21-b5') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:52:49 user nova-compute[74840]: DEBUG nova.objects.instance [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lazy-loading 'pci_devices' on Instance uuid 301cc74c-0322-47c3-be22-a638592a755a {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:52:49 user nova-compute[74840]: DEBUG nova.objects.base [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Object Instance<301cc74c-0322-47c3-be22-a638592a755a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:52:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:52:49 user nova-compute[74840]:   <uuid>301cc74c-0322-47c3-be22-a638592a755a</uuid>
Nov 08 12:52:49 user nova-compute[74840]:   <name>instance-00000031</name>
Nov 08 12:52:49 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:52:49 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:52:49 user nova-compute[74840]:   <metadata>
Nov 08 12:52:49 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:52:49 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:52:49 user nova-compute[74840]:       <nova:name>tempest-AttachVolumeTestJSON-server-1268219938</nova:name>
Nov 08 12:52:49 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:52:47</nova:creationTime>
Nov 08 12:52:49 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:52:49 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:52:49 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:52:49 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:52:49 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:52:49 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:52:49 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:52:49 user nova-compute[74840]:       <nova:owner>
Nov 08 12:52:49 user nova-compute[74840]:         <nova:user uuid="9667df3a519d47809b332f8457cd1154">tempest-AttachVolumeTestJSON-116807071-project-member</nova:user>
Nov 08 12:52:49 user nova-compute[74840]:         <nova:project uuid="6e7e49db466d4c0a83700e2e917c78be">tempest-AttachVolumeTestJSON-116807071</nova:project>
Nov 08 12:52:49 user nova-compute[74840]:       </nova:owner>
Nov 08 12:52:49 user nova-compute[74840]:       <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:52:49 user nova-compute[74840]:       <nova:ports>
Nov 08 12:52:49 user nova-compute[74840]:         <nova:port uuid="f001cf21-b5b2-4a55-bcc4-5451e3a73170">
Nov 08 12:52:49 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 12:52:49 user nova-compute[74840]:         </nova:port>
Nov 08 12:52:49 user nova-compute[74840]:       </nova:ports>
Nov 08 12:52:49 user nova-compute[74840]:     </nova:instance>
Nov 08 12:52:49 user nova-compute[74840]:   </metadata>
Nov 08 12:52:49 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:52:49 user nova-compute[74840]:     <system>
Nov 08 12:52:49 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:52:49 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:52:49 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:52:49 user nova-compute[74840]:       <entry name="serial">301cc74c-0322-47c3-be22-a638592a755a</entry>
Nov 08 12:52:49 user nova-compute[74840]:       <entry name="uuid">301cc74c-0322-47c3-be22-a638592a755a</entry>
Nov 08 12:52:49 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:52:49 user nova-compute[74840]:     </system>
Nov 08 12:52:49 user nova-compute[74840]:   </sysinfo>
Nov 08 12:52:49 user nova-compute[74840]:   <os>
Nov 08 12:52:49 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:52:49 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:52:49 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:52:49 user nova-compute[74840]:   </os>
Nov 08 12:52:49 user nova-compute[74840]:   <features>
Nov 08 12:52:49 user nova-compute[74840]:     <acpi/>
Nov 08 12:52:49 user nova-compute[74840]:     <apic/>
Nov 08 12:52:49 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:52:49 user nova-compute[74840]:   </features>
Nov 08 12:52:49 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:52:49 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:52:49 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:52:49 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:52:49 user nova-compute[74840]:   </clock>
Nov 08 12:52:49 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:52:49 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:52:49 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:52:49 user nova-compute[74840]:   </cpu>
Nov 08 12:52:49 user nova-compute[74840]:   <devices>
Nov 08 12:52:49 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:52:49 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:52:49 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk"/>
Nov 08 12:52:49 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:52:49 user nova-compute[74840]:     </disk>
Nov 08 12:52:49 user nova-compute[74840]:     <disk type="block" device="disk">
Nov 08 12:52:49 user nova-compute[74840]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:52:49 user nova-compute[74840]:       <source dev="/dev/sdb"/>
Nov 08 12:52:49 user nova-compute[74840]:       <target dev="vdb" bus="virtio"/>
Nov 08 12:52:49 user nova-compute[74840]:       <serial>7bed5cad-1adf-41f9-bf68-19db96af4d2e</serial>
Nov 08 12:52:49 user nova-compute[74840]:     </disk>
Nov 08 12:52:49 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:52:49 user nova-compute[74840]:       <mac address="fa:16:3e:f3:fc:27"/>
Nov 08 12:52:49 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:52:49 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:52:49 user nova-compute[74840]:       <target dev="tapf001cf21-b5"/>
Nov 08 12:52:49 user nova-compute[74840]:     </interface>
Nov 08 12:52:49 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:52:49 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/console.log" append="off"/>
Nov 08 12:52:49 user nova-compute[74840]:     </serial>
Nov 08 12:52:49 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:52:49 user nova-compute[74840]:     <video>
Nov 08 12:52:49 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:52:49 user nova-compute[74840]:     </video>
Nov 08 12:52:49 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:52:49 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:52:49 user nova-compute[74840]:     </rng>
Nov 08 12:52:49 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:52:49 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:52:49 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:52:49 user nova-compute[74840]:     </memballoon>
Nov 08 12:52:49 user nova-compute[74840]:   </devices>
Nov 08 12:52:49 user nova-compute[74840]: </domain>
Nov 08 12:52:49 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:52:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:52:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:52:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:52:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:52:49 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:52:49 user nova-compute[74840]: DEBUG nova.objects.instance [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lazy-loading 'trusted_certs' on Instance uuid 301cc74c-0322-47c3-be22-a638592a755a {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:52:49 user nova-compute[74840]: DEBUG nova.objects.base [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Object Instance<301cc74c-0322-47c3-be22-a638592a755a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:52:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:52:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.178s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:52:49 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Checking if we can resize image /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk. size=1073741824 {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 12:52:49 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:52:50 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:52:50 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Cannot resize image /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk to a smaller size. {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 12:52:50 user nova-compute[74840]: DEBUG nova.objects.instance [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lazy-loading 'migration_context' on Instance uuid 301cc74c-0322-47c3-be22-a638592a755a {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:52:50 user nova-compute[74840]: DEBUG nova.objects.base [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Object Instance<301cc74c-0322-47c3-be22-a638592a755a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:52:50 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:48:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1268219938',display_name='tempest-AttachVolumeTestJSON-server-1268219938',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1268219938',id=49,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1Q3P8MX65K+ewG2SwkHJsjLBfhR/vPyPX9ltkFerXJUdJghXZzKfH0GZA2WFBtwb7dErHNHWFrK86n2OEQBsGNeWGod8BzroVKFZNXS962Jzp5znHBxWuSa1al8Vb4Ew==',key_name='tempest-keypair-654921536',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:48:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='6e7e49db466d4c0a83700e2e917c78be',ramdisk_id='',reservation_id='r-cr0fa74z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-116807071',owner_user_name='tempest-AttachVolumeTestJSON-116807071-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:50:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9667df3a519d47809b332f8457cd1154',uuid=301cc74c-0322-47c3-be22-a638592a755a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "address": "fa:16:3e:f3:fc:27", "network": {"id": "515bf382-a9c9-4096-9de0-23fc0c912a71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1378790516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7e49db466d4c0a83700e2e917c78be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf001cf21-b5", "ovs_interfaceid": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:52:50 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Converting VIF {"id": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "address": "fa:16:3e:f3:fc:27", "network": {"id": "515bf382-a9c9-4096-9de0-23fc0c912a71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1378790516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7e49db466d4c0a83700e2e917c78be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf001cf21-b5", "ovs_interfaceid": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:52:50 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:fc:27,bridge_name='br-int',has_traffic_filtering=True,id=f001cf21-b5b2-4a55-bcc4-5451e3a73170,network=Network(515bf382-a9c9-4096-9de0-23fc0c912a71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf001cf21-b5') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:52:50 user nova-compute[74840]: DEBUG os_vif [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:fc:27,bridge_name='br-int',has_traffic_filtering=True,id=f001cf21-b5b2-4a55-bcc4-5451e3a73170,network=Network(515bf382-a9c9-4096-9de0-23fc0c912a71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf001cf21-b5') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:52:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:52:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:52:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:52:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:52:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '82dddff3-df46-5d3f-8b05-7466983996a5', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:52:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:52:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:52:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:52:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf001cf21-b5, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:52:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf001cf21-b5, col_values=(('qos', UUID('39647b50-57c6-4b4b-92e2-9065d72df40d')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:52:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf001cf21-b5, col_values=(('external_ids', {'iface-id': 'f001cf21-b5b2-4a55-bcc4-5451e3a73170', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:fc:27', 'vm-uuid': '301cc74c-0322-47c3-be22-a638592a755a'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:52:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:52:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:52:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:52:50 user nova-compute[74840]: INFO os_vif [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:fc:27,bridge_name='br-int',has_traffic_filtering=True,id=f001cf21-b5b2-4a55-bcc4-5451e3a73170,network=Network(515bf382-a9c9-4096-9de0-23fc0c912a71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf001cf21-b5')
Nov 08 12:52:51 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:52:51 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:52:51 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:52:51 user nova-compute[74840]: DEBUG nova.compute.manager [req-292c0342-89a0-4715-8e0e-4bcfe06e6cf8 req-09cf0e9f-39cb-4c91-a944-ff2defb07a88 service nova] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Received event network-vif-plugged-f001cf21-b5b2-4a55-bcc4-5451e3a73170 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:52:51 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-292c0342-89a0-4715-8e0e-4bcfe06e6cf8 req-09cf0e9f-39cb-4c91-a944-ff2defb07a88 service nova] Acquiring lock "301cc74c-0322-47c3-be22-a638592a755a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:52:51 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-292c0342-89a0-4715-8e0e-4bcfe06e6cf8 req-09cf0e9f-39cb-4c91-a944-ff2defb07a88 service nova] Lock "301cc74c-0322-47c3-be22-a638592a755a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:52:51 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-292c0342-89a0-4715-8e0e-4bcfe06e6cf8 req-09cf0e9f-39cb-4c91-a944-ff2defb07a88 service nova] Lock "301cc74c-0322-47c3-be22-a638592a755a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:52:51 user nova-compute[74840]: DEBUG nova.compute.manager [req-292c0342-89a0-4715-8e0e-4bcfe06e6cf8 req-09cf0e9f-39cb-4c91-a944-ff2defb07a88 service nova] [instance: 301cc74c-0322-47c3-be22-a638592a755a] No waiting events found dispatching network-vif-plugged-f001cf21-b5b2-4a55-bcc4-5451e3a73170 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:52:51 user nova-compute[74840]: WARNING nova.compute.manager [req-292c0342-89a0-4715-8e0e-4bcfe06e6cf8 req-09cf0e9f-39cb-4c91-a944-ff2defb07a88 service nova] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Received unexpected event network-vif-plugged-f001cf21-b5b2-4a55-bcc4-5451e3a73170 for instance with vm_state stopped and task_state powering-on.
Nov 08 12:52:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:52:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:52:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:52:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:52:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:52:53 user nova-compute[74840]: DEBUG nova.compute.manager [req-920dc14d-9b4f-4809-bcd7-56bd41a51748 req-67098d0e-8082-4cd0-8339-1e0d37f7062b service nova] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Received event network-vif-plugged-f001cf21-b5b2-4a55-bcc4-5451e3a73170 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:52:53 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-920dc14d-9b4f-4809-bcd7-56bd41a51748 req-67098d0e-8082-4cd0-8339-1e0d37f7062b service nova] Acquiring lock "301cc74c-0322-47c3-be22-a638592a755a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:52:53 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-920dc14d-9b4f-4809-bcd7-56bd41a51748 req-67098d0e-8082-4cd0-8339-1e0d37f7062b service nova] Lock "301cc74c-0322-47c3-be22-a638592a755a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:52:53 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-920dc14d-9b4f-4809-bcd7-56bd41a51748 req-67098d0e-8082-4cd0-8339-1e0d37f7062b service nova] Lock "301cc74c-0322-47c3-be22-a638592a755a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:52:53 user nova-compute[74840]: DEBUG nova.compute.manager [req-920dc14d-9b4f-4809-bcd7-56bd41a51748 req-67098d0e-8082-4cd0-8339-1e0d37f7062b service nova] [instance: 301cc74c-0322-47c3-be22-a638592a755a] No waiting events found dispatching network-vif-plugged-f001cf21-b5b2-4a55-bcc4-5451e3a73170 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:52:53 user nova-compute[74840]: WARNING nova.compute.manager [req-920dc14d-9b4f-4809-bcd7-56bd41a51748 req-67098d0e-8082-4cd0-8339-1e0d37f7062b service nova] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Received unexpected event network-vif-plugged-f001cf21-b5b2-4a55-bcc4-5451e3a73170 for instance with vm_state stopped and task_state powering-on.
Nov 08 12:52:54 user nova-compute[74840]: DEBUG nova.compute.manager [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:52:54 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Instance rebooted successfully.
Nov 08 12:52:54 user nova-compute[74840]: DEBUG nova.compute.manager [None req-2260a567-b50a-4497-a7dd-018eed9f0b40 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:52:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:52:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:53:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:53:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:53:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:53:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:53:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:53:15 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:53:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:53:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:53:22 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:53:22 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:53:22 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:53:22 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:53:22 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:53:23 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:53:24 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:53:24 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:53:24 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Rebuilding the list of instances to heal {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 12:53:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "refresh_cache-9294d85f-20ec-4a6c-9a52-379187cb2aa1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:53:24 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquired lock "refresh_cache-9294d85f-20ec-4a6c-9a52-379187cb2aa1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:53:24 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Forcefully refreshing network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 12:53:24 user nova-compute[74840]: DEBUG nova.objects.instance [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lazy-loading 'info_cache' on Instance uuid 9294d85f-20ec-4a6c-9a52-379187cb2aa1 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:53:25 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Updating instance_info_cache with network_info: [{"id": "4fed7aed-812e-40c4-a02b-25874b4dca07", "address": "fa:16:3e:88:d5:f1", "network": {"id": "88ccbadb-f25d-463d-a2c3-01dcd402b165", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1492603656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e48fbc441e79426f859e00e5c19a1167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fed7aed-81", "ovs_interfaceid": "4fed7aed-812e-40c4-a02b-25874b4dca07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:53:25 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:53:25 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Releasing lock "refresh_cache-9294d85f-20ec-4a6c-9a52-379187cb2aa1" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:53:25 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Updated the network info_cache for instance {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 12:53:26 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:53:27 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:53:28 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:53:30 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:53:30 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:53:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:53:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:53:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:53:30 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:53:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b25860e0-0030-4e80-8be2-f7a418a80b92/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:53:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b25860e0-0030-4e80-8be2-f7a418a80b92/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:53:30 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b25860e0-0030-4e80-8be2-f7a418a80b92/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:53:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b25860e0-0030-4e80-8be2-f7a418a80b92/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:53:31 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:53:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9294d85f-20ec-4a6c-9a52-379187cb2aa1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:53:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9294d85f-20ec-4a6c-9a52-379187cb2aa1/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:53:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9294d85f-20ec-4a6c-9a52-379187cb2aa1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:53:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9294d85f-20ec-4a6c-9a52-379187cb2aa1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:53:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:53:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:53:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:53:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:53:31 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:53:32 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:53:32 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:53:32 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=8557MB free_disk=24.749141693115234GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:53:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:53:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:53:32 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 9294d85f-20ec-4a6c-9a52-379187cb2aa1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:53:32 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 301cc74c-0322-47c3-be22-a638592a755a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:53:32 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance b25860e0-0030-4e80-8be2-f7a418a80b92 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:53:32 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:53:32 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:53:32 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:53:32 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:53:32 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:53:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.271s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:53:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:53:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:53:41 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:53:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:53:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:53:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:53:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 12:53:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:53:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:53:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:53:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:53:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:53:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 12:53:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:53:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:53:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:54:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:54:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:54:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:54:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 12:54:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:54:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:54:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:54:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:54:15 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:54:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:54:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:54:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 12:54:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:54:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:54:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:54:20 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:54:22 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:54:22 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:54:23 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:54:24 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:54:25 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:54:25 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:54:25 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 12:54:25 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:54:25 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:54:25 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:54:26 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:54:26 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:54:26 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "refresh_cache-301cc74c-0322-47c3-be22-a638592a755a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:54:26 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquired lock "refresh_cache-301cc74c-0322-47c3-be22-a638592a755a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:54:26 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Forcefully refreshing network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 12:54:27 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Updating instance_info_cache with network_info: [{"id": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "address": "fa:16:3e:f3:fc:27", "network": {"id": "515bf382-a9c9-4096-9de0-23fc0c912a71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1378790516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7e49db466d4c0a83700e2e917c78be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf001cf21-b5", "ovs_interfaceid": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:54:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Releasing lock "refresh_cache-301cc74c-0322-47c3-be22-a638592a755a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:54:27 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Updated the network info_cache for instance {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 12:54:27 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:54:27 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:54:30 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:54:30 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:54:30 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 12:54:30 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:54:30 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:54:30 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:54:30 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:54:31 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:54:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:54:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:54:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:54:31 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:54:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b25860e0-0030-4e80-8be2-f7a418a80b92/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:54:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b25860e0-0030-4e80-8be2-f7a418a80b92/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:54:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b25860e0-0030-4e80-8be2-f7a418a80b92/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:54:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b25860e0-0030-4e80-8be2-f7a418a80b92/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:54:32 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:54:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9294d85f-20ec-4a6c-9a52-379187cb2aa1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:54:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9294d85f-20ec-4a6c-9a52-379187cb2aa1/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:54:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9294d85f-20ec-4a6c-9a52-379187cb2aa1/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:54:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:54:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9294d85f-20ec-4a6c-9a52-379187cb2aa1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:54:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:54:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:54:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:54:33 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:54:33 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 12:54:33 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:54:33 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:54:33 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=8682MB free_disk=24.748374938964844GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:54:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:54:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:54:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:54:33 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 9294d85f-20ec-4a6c-9a52-379187cb2aa1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:54:33 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 301cc74c-0322-47c3-be22-a638592a755a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:54:33 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance b25860e0-0030-4e80-8be2-f7a418a80b92 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:54:33 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:54:33 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:54:33 user nova-compute[74840]: DEBUG nova.compute.manager [req-c73b1d6c-5be3-4bfc-a9f8-9517d3a2fcda req-ce3905a0-1d0f-401d-8c25-b3bfc0cde71d service nova] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Received event network-changed-46124c00-b635-4543-886c-914cfb23594c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:54:33 user nova-compute[74840]: DEBUG nova.compute.manager [req-c73b1d6c-5be3-4bfc-a9f8-9517d3a2fcda req-ce3905a0-1d0f-401d-8c25-b3bfc0cde71d service nova] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Refreshing instance network info cache due to event network-changed-46124c00-b635-4543-886c-914cfb23594c. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:54:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-c73b1d6c-5be3-4bfc-a9f8-9517d3a2fcda req-ce3905a0-1d0f-401d-8c25-b3bfc0cde71d service nova] Acquiring lock "refresh_cache-b25860e0-0030-4e80-8be2-f7a418a80b92" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:54:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-c73b1d6c-5be3-4bfc-a9f8-9517d3a2fcda req-ce3905a0-1d0f-401d-8c25-b3bfc0cde71d service nova] Acquired lock "refresh_cache-b25860e0-0030-4e80-8be2-f7a418a80b92" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:54:33 user nova-compute[74840]: DEBUG nova.network.neutron [req-c73b1d6c-5be3-4bfc-a9f8-9517d3a2fcda req-ce3905a0-1d0f-401d-8c25-b3bfc0cde71d service nova] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Refreshing network info cache for port 46124c00-b635-4543-886c-914cfb23594c {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:54:33 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:54:33 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:54:33 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:54:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.283s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:54:34 user nova-compute[74840]: DEBUG nova.network.neutron [req-c73b1d6c-5be3-4bfc-a9f8-9517d3a2fcda req-ce3905a0-1d0f-401d-8c25-b3bfc0cde71d service nova] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Updated VIF entry in instance network info cache for port 46124c00-b635-4543-886c-914cfb23594c. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:54:34 user nova-compute[74840]: DEBUG nova.network.neutron [req-c73b1d6c-5be3-4bfc-a9f8-9517d3a2fcda req-ce3905a0-1d0f-401d-8c25-b3bfc0cde71d service nova] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Updating instance_info_cache with network_info: [{"id": "46124c00-b635-4543-886c-914cfb23594c", "address": "fa:16:3e:31:21:d4", "network": {"id": "8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1654230640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "270eb2fc5485447f9e09d83d48fdc14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46124c00-b6", "ovs_interfaceid": "46124c00-b635-4543-886c-914cfb23594c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:54:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-c73b1d6c-5be3-4bfc-a9f8-9517d3a2fcda req-ce3905a0-1d0f-401d-8c25-b3bfc0cde71d service nova] Releasing lock "refresh_cache-b25860e0-0030-4e80-8be2-f7a418a80b92" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:54:34 user nova-compute[74840]: DEBUG nova.compute.manager [req-e3e1e7f4-a7ac-4cb4-8e5d-d8b0f83bed89 req-a2283318-6b46-4bfb-b47d-14b2ac9be295 service nova] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Received event network-changed-46124c00-b635-4543-886c-914cfb23594c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:54:34 user nova-compute[74840]: DEBUG nova.compute.manager [req-e3e1e7f4-a7ac-4cb4-8e5d-d8b0f83bed89 req-a2283318-6b46-4bfb-b47d-14b2ac9be295 service nova] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Refreshing instance network info cache due to event network-changed-46124c00-b635-4543-886c-914cfb23594c. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:54:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e3e1e7f4-a7ac-4cb4-8e5d-d8b0f83bed89 req-a2283318-6b46-4bfb-b47d-14b2ac9be295 service nova] Acquiring lock "refresh_cache-b25860e0-0030-4e80-8be2-f7a418a80b92" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:54:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e3e1e7f4-a7ac-4cb4-8e5d-d8b0f83bed89 req-a2283318-6b46-4bfb-b47d-14b2ac9be295 service nova] Acquired lock "refresh_cache-b25860e0-0030-4e80-8be2-f7a418a80b92" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:54:34 user nova-compute[74840]: DEBUG nova.network.neutron [req-e3e1e7f4-a7ac-4cb4-8e5d-d8b0f83bed89 req-a2283318-6b46-4bfb-b47d-14b2ac9be295 service nova] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Refreshing network info cache for port 46124c00-b635-4543-886c-914cfb23594c {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:54:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1522b649-27fd-4f7c-8507-1f3f580432de tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Acquiring lock "b25860e0-0030-4e80-8be2-f7a418a80b92" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:54:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1522b649-27fd-4f7c-8507-1f3f580432de tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "b25860e0-0030-4e80-8be2-f7a418a80b92" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:54:34 user nova-compute[74840]: INFO nova.compute.manager [None req-1522b649-27fd-4f7c-8507-1f3f580432de tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Detaching volume e4022491-8a00-429f-aaa4-fae57b81eea2
Nov 08 12:54:35 user nova-compute[74840]: INFO nova.virt.block_device [None req-1522b649-27fd-4f7c-8507-1f3f580432de tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Attempting to driver detach volume e4022491-8a00-429f-aaa4-fae57b81eea2 from mountpoint /dev/vdb
Nov 08 12:54:35 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1522b649-27fd-4f7c-8507-1f3f580432de tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Attempting to detach device vdb from instance b25860e0-0030-4e80-8be2-f7a418a80b92 from the persistent domain config. {{(pid=74840) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 12:54:35 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-1522b649-27fd-4f7c-8507-1f3f580432de tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 12:54:35 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:54:35 user nova-compute[74840]:   <source dev="/dev/sdc"/>
Nov 08 12:54:35 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:54:35 user nova-compute[74840]:   <serial>e4022491-8a00-429f-aaa4-fae57b81eea2</serial>
Nov 08 12:54:35 user nova-compute[74840]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 12:54:35 user nova-compute[74840]: </disk>
Nov 08 12:54:35 user nova-compute[74840]:  {{(pid=74840) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 12:54:35 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-1522b649-27fd-4f7c-8507-1f3f580432de tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Successfully detached device vdb from instance b25860e0-0030-4e80-8be2-f7a418a80b92 from the persistent domain config.
Nov 08 12:54:35 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1522b649-27fd-4f7c-8507-1f3f580432de tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b25860e0-0030-4e80-8be2-f7a418a80b92 from the live domain config. {{(pid=74840) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 12:54:35 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-1522b649-27fd-4f7c-8507-1f3f580432de tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 12:54:35 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:54:35 user nova-compute[74840]:   <source dev="/dev/sdc"/>
Nov 08 12:54:35 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:54:35 user nova-compute[74840]:   <serial>e4022491-8a00-429f-aaa4-fae57b81eea2</serial>
Nov 08 12:54:35 user nova-compute[74840]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 12:54:35 user nova-compute[74840]: </disk>
Nov 08 12:54:35 user nova-compute[74840]:  {{(pid=74840) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 12:54:35 user nova-compute[74840]: DEBUG nova.network.neutron [req-e3e1e7f4-a7ac-4cb4-8e5d-d8b0f83bed89 req-a2283318-6b46-4bfb-b47d-14b2ac9be295 service nova] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Updated VIF entry in instance network info cache for port 46124c00-b635-4543-886c-914cfb23594c. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:54:35 user nova-compute[74840]: DEBUG nova.network.neutron [req-e3e1e7f4-a7ac-4cb4-8e5d-d8b0f83bed89 req-a2283318-6b46-4bfb-b47d-14b2ac9be295 service nova] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Updating instance_info_cache with network_info: [{"id": "46124c00-b635-4543-886c-914cfb23594c", "address": "fa:16:3e:31:21:d4", "network": {"id": "8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1654230640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "270eb2fc5485447f9e09d83d48fdc14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46124c00-b6", "ovs_interfaceid": "46124c00-b635-4543-886c-914cfb23594c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:54:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e3e1e7f4-a7ac-4cb4-8e5d-d8b0f83bed89 req-a2283318-6b46-4bfb-b47d-14b2ac9be295 service nova] Releasing lock "refresh_cache-b25860e0-0030-4e80-8be2-f7a418a80b92" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:54:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:54:35 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-1522b649-27fd-4f7c-8507-1f3f580432de tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b25860e0-0030-4e80-8be2-f7a418a80b92 {{(pid=74840) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 12:54:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:54:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-52bd02af-8ee2-4986-a329-551fbbcb6498 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Acquiring lock "301cc74c-0322-47c3-be22-a638592a755a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:54:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-52bd02af-8ee2-4986-a329-551fbbcb6498 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "301cc74c-0322-47c3-be22-a638592a755a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:54:38 user nova-compute[74840]: INFO nova.compute.manager [None req-52bd02af-8ee2-4986-a329-551fbbcb6498 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Detaching volume 7bed5cad-1adf-41f9-bf68-19db96af4d2e
Nov 08 12:54:38 user nova-compute[74840]: INFO nova.virt.block_device [None req-52bd02af-8ee2-4986-a329-551fbbcb6498 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Attempting to driver detach volume 7bed5cad-1adf-41f9-bf68-19db96af4d2e from mountpoint /dev/vdb
Nov 08 12:54:38 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-52bd02af-8ee2-4986-a329-551fbbcb6498 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Attempting to detach device vdb from instance 301cc74c-0322-47c3-be22-a638592a755a from the persistent domain config. {{(pid=74840) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 12:54:38 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-52bd02af-8ee2-4986-a329-551fbbcb6498 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 12:54:38 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:54:38 user nova-compute[74840]:   <source dev="/dev/sdb"/>
Nov 08 12:54:38 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:54:38 user nova-compute[74840]:   <serial>7bed5cad-1adf-41f9-bf68-19db96af4d2e</serial>
Nov 08 12:54:38 user nova-compute[74840]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 12:54:38 user nova-compute[74840]: </disk>
Nov 08 12:54:38 user nova-compute[74840]:  {{(pid=74840) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 12:54:38 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-52bd02af-8ee2-4986-a329-551fbbcb6498 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Successfully detached device vdb from instance 301cc74c-0322-47c3-be22-a638592a755a from the persistent domain config.
Nov 08 12:54:38 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-52bd02af-8ee2-4986-a329-551fbbcb6498 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 301cc74c-0322-47c3-be22-a638592a755a from the live domain config. {{(pid=74840) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 12:54:38 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-52bd02af-8ee2-4986-a329-551fbbcb6498 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 12:54:38 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 12:54:38 user nova-compute[74840]:   <source dev="/dev/sdb"/>
Nov 08 12:54:38 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 12:54:38 user nova-compute[74840]:   <serial>7bed5cad-1adf-41f9-bf68-19db96af4d2e</serial>
Nov 08 12:54:38 user nova-compute[74840]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 12:54:38 user nova-compute[74840]: </disk>
Nov 08 12:54:38 user nova-compute[74840]:  {{(pid=74840) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 12:54:38 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-52bd02af-8ee2-4986-a329-551fbbcb6498 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 301cc74c-0322-47c3-be22-a638592a755a {{(pid=74840) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 12:54:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-106f7e89-25c0-4395-815b-bfbaef285245 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Acquiring lock "9294d85f-20ec-4a6c-9a52-379187cb2aa1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:54:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-106f7e89-25c0-4395-815b-bfbaef285245 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Lock "9294d85f-20ec-4a6c-9a52-379187cb2aa1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:54:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-106f7e89-25c0-4395-815b-bfbaef285245 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Acquiring lock "9294d85f-20ec-4a6c-9a52-379187cb2aa1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:54:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-106f7e89-25c0-4395-815b-bfbaef285245 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Lock "9294d85f-20ec-4a6c-9a52-379187cb2aa1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:54:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-106f7e89-25c0-4395-815b-bfbaef285245 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Lock "9294d85f-20ec-4a6c-9a52-379187cb2aa1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:54:39 user nova-compute[74840]: INFO nova.compute.manager [None req-106f7e89-25c0-4395-815b-bfbaef285245 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Terminating instance
Nov 08 12:54:39 user nova-compute[74840]: DEBUG nova.compute.manager [None req-106f7e89-25c0-4395-815b-bfbaef285245 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Start destroying the instance on the hypervisor. {{(pid=74840) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 12:54:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:54:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:54:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:54:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:54:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:54:40 user nova-compute[74840]: DEBUG nova.compute.manager [req-80ea1b8f-bb04-4909-8eee-fb359ef158c9 req-9dca39d9-7db2-41cb-9a75-6684aaf45a6f service nova] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Received event network-vif-unplugged-4fed7aed-812e-40c4-a02b-25874b4dca07 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:54:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-80ea1b8f-bb04-4909-8eee-fb359ef158c9 req-9dca39d9-7db2-41cb-9a75-6684aaf45a6f service nova] Acquiring lock "9294d85f-20ec-4a6c-9a52-379187cb2aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:54:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-80ea1b8f-bb04-4909-8eee-fb359ef158c9 req-9dca39d9-7db2-41cb-9a75-6684aaf45a6f service nova] Lock "9294d85f-20ec-4a6c-9a52-379187cb2aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:54:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-80ea1b8f-bb04-4909-8eee-fb359ef158c9 req-9dca39d9-7db2-41cb-9a75-6684aaf45a6f service nova] Lock "9294d85f-20ec-4a6c-9a52-379187cb2aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:54:40 user nova-compute[74840]: DEBUG nova.compute.manager [req-80ea1b8f-bb04-4909-8eee-fb359ef158c9 req-9dca39d9-7db2-41cb-9a75-6684aaf45a6f service nova] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] No waiting events found dispatching network-vif-unplugged-4fed7aed-812e-40c4-a02b-25874b4dca07 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:54:40 user nova-compute[74840]: DEBUG nova.compute.manager [req-80ea1b8f-bb04-4909-8eee-fb359ef158c9 req-9dca39d9-7db2-41cb-9a75-6684aaf45a6f service nova] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Received event network-vif-unplugged-4fed7aed-812e-40c4-a02b-25874b4dca07 for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:54:40 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Instance destroyed successfully.
Nov 08 12:54:40 user nova-compute[74840]: DEBUG nova.objects.instance [None req-106f7e89-25c0-4395-815b-bfbaef285245 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Lazy-loading 'resources' on Instance uuid 9294d85f-20ec-4a6c-9a52-379187cb2aa1 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:54:40 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-106f7e89-25c0-4395-815b-bfbaef285245 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:45:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1986475937',display_name='tempest-ServersNegativeTestJSON-server-1986475937',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1986475937',id=47,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:45:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e48fbc441e79426f859e00e5c19a1167',ramdisk_id='',reservation_id='r-sa8x2z47',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-199749076',owner_user_name='tempest-ServersNegativeTestJSON-199749076-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:45:39Z,user_data=None,user_id='52ea0bf6286c45f987154493a281b260',uuid=9294d85f-20ec-4a6c-9a52-379187cb2aa1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4fed7aed-812e-40c4-a02b-25874b4dca07", "address": "fa:16:3e:88:d5:f1", "network": {"id": "88ccbadb-f25d-463d-a2c3-01dcd402b165", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1492603656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e48fbc441e79426f859e00e5c19a1167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fed7aed-81", "ovs_interfaceid": "4fed7aed-812e-40c4-a02b-25874b4dca07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:54:40 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-106f7e89-25c0-4395-815b-bfbaef285245 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Converting VIF {"id": "4fed7aed-812e-40c4-a02b-25874b4dca07", "address": "fa:16:3e:88:d5:f1", "network": {"id": "88ccbadb-f25d-463d-a2c3-01dcd402b165", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1492603656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e48fbc441e79426f859e00e5c19a1167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fed7aed-81", "ovs_interfaceid": "4fed7aed-812e-40c4-a02b-25874b4dca07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:54:40 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-106f7e89-25c0-4395-815b-bfbaef285245 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:d5:f1,bridge_name='br-int',has_traffic_filtering=True,id=4fed7aed-812e-40c4-a02b-25874b4dca07,network=Network(88ccbadb-f25d-463d-a2c3-01dcd402b165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fed7aed-81') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:54:40 user nova-compute[74840]: DEBUG os_vif [None req-106f7e89-25c0-4395-815b-bfbaef285245 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:d5:f1,bridge_name='br-int',has_traffic_filtering=True,id=4fed7aed-812e-40c4-a02b-25874b4dca07,network=Network(88ccbadb-f25d-463d-a2c3-01dcd402b165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fed7aed-81') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:54:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:54:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4fed7aed-81, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:54:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:54:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:54:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:54:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=69d99011-9573-45e8-8539-f68891f113c7) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:54:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:54:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:54:40 user nova-compute[74840]: INFO os_vif [None req-106f7e89-25c0-4395-815b-bfbaef285245 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:d5:f1,bridge_name='br-int',has_traffic_filtering=True,id=4fed7aed-812e-40c4-a02b-25874b4dca07,network=Network(88ccbadb-f25d-463d-a2c3-01dcd402b165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fed7aed-81')
Nov 08 12:54:40 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-106f7e89-25c0-4395-815b-bfbaef285245 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Deleting instance files /opt/stack/data/nova/instances/9294d85f-20ec-4a6c-9a52-379187cb2aa1_del
Nov 08 12:54:40 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-106f7e89-25c0-4395-815b-bfbaef285245 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Deletion of /opt/stack/data/nova/instances/9294d85f-20ec-4a6c-9a52-379187cb2aa1_del complete
Nov 08 12:54:40 user nova-compute[74840]: INFO nova.compute.manager [None req-106f7e89-25c0-4395-815b-bfbaef285245 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 08 12:54:40 user nova-compute[74840]: DEBUG oslo.service.loopingcall [None req-106f7e89-25c0-4395-815b-bfbaef285245 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74840) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 12:54:40 user nova-compute[74840]: DEBUG nova.compute.manager [-] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Deallocating network for instance {{(pid=74840) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 12:54:40 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] deallocate_for_instance() {{(pid=74840) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 12:54:41 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:54:41 user nova-compute[74840]: DEBUG nova.compute.manager [req-3bca2631-e8d9-4baa-b0c1-92d0cf8aae53 req-0a478dcb-2a70-40e1-822a-b826fed2382b service nova] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Received event network-vif-deleted-4fed7aed-812e-40c4-a02b-25874b4dca07 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:54:41 user nova-compute[74840]: INFO nova.compute.manager [req-3bca2631-e8d9-4baa-b0c1-92d0cf8aae53 req-0a478dcb-2a70-40e1-822a-b826fed2382b service nova] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Neutron deleted interface 4fed7aed-812e-40c4-a02b-25874b4dca07; detaching it from the instance and deleting it from the info cache
Nov 08 12:54:41 user nova-compute[74840]: DEBUG nova.network.neutron [req-3bca2631-e8d9-4baa-b0c1-92d0cf8aae53 req-0a478dcb-2a70-40e1-822a-b826fed2382b service nova] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:54:41 user nova-compute[74840]: INFO nova.compute.manager [-] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Took 0.79 seconds to deallocate network for instance.
Nov 08 12:54:41 user nova-compute[74840]: DEBUG nova.compute.manager [req-3bca2631-e8d9-4baa-b0c1-92d0cf8aae53 req-0a478dcb-2a70-40e1-822a-b826fed2382b service nova] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Detach interface failed, port_id=4fed7aed-812e-40c4-a02b-25874b4dca07, reason: Instance 9294d85f-20ec-4a6c-9a52-379187cb2aa1 could not be found. {{(pid=74840) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 12:54:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-106f7e89-25c0-4395-815b-bfbaef285245 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:54:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-106f7e89-25c0-4395-815b-bfbaef285245 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:54:41 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-106f7e89-25c0-4395-815b-bfbaef285245 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:54:41 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-106f7e89-25c0-4395-815b-bfbaef285245 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:54:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-106f7e89-25c0-4395-815b-bfbaef285245 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.260s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:54:41 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-106f7e89-25c0-4395-815b-bfbaef285245 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Deleted allocations for instance 9294d85f-20ec-4a6c-9a52-379187cb2aa1
Nov 08 12:54:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-106f7e89-25c0-4395-815b-bfbaef285245 tempest-ServersNegativeTestJSON-199749076 tempest-ServersNegativeTestJSON-199749076-project-member] Lock "9294d85f-20ec-4a6c-9a52-379187cb2aa1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.067s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:54:42 user nova-compute[74840]: DEBUG nova.compute.manager [req-e66691e4-15e0-42fd-a840-7276393159d8 req-83f84ff2-d527-4bca-adab-f9b3309ae32a service nova] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Received event network-vif-plugged-4fed7aed-812e-40c4-a02b-25874b4dca07 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:54:42 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e66691e4-15e0-42fd-a840-7276393159d8 req-83f84ff2-d527-4bca-adab-f9b3309ae32a service nova] Acquiring lock "9294d85f-20ec-4a6c-9a52-379187cb2aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:54:42 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e66691e4-15e0-42fd-a840-7276393159d8 req-83f84ff2-d527-4bca-adab-f9b3309ae32a service nova] Lock "9294d85f-20ec-4a6c-9a52-379187cb2aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:54:42 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-e66691e4-15e0-42fd-a840-7276393159d8 req-83f84ff2-d527-4bca-adab-f9b3309ae32a service nova] Lock "9294d85f-20ec-4a6c-9a52-379187cb2aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:54:42 user nova-compute[74840]: DEBUG nova.compute.manager [req-e66691e4-15e0-42fd-a840-7276393159d8 req-83f84ff2-d527-4bca-adab-f9b3309ae32a service nova] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] No waiting events found dispatching network-vif-plugged-4fed7aed-812e-40c4-a02b-25874b4dca07 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:54:42 user nova-compute[74840]: WARNING nova.compute.manager [req-e66691e4-15e0-42fd-a840-7276393159d8 req-83f84ff2-d527-4bca-adab-f9b3309ae32a service nova] [instance: 9294d85f-20ec-4a6c-9a52-379187cb2aa1] Received unexpected event network-vif-plugged-4fed7aed-812e-40c4-a02b-25874b4dca07 for instance with vm_state deleted and task_state None.
Nov 08 12:54:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:54:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:54:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:54:55 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-1522b649-27fd-4f7c-8507-1f3f580432de tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b25860e0-0030-4e80-8be2-f7a418a80b92 is timed out.
Nov 08 12:54:55 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-1522b649-27fd-4f7c-8507-1f3f580432de tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Successfully detached device vdb from instance b25860e0-0030-4e80-8be2-f7a418a80b92 from the live domain config.
Nov 08 12:54:55 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1522b649-27fd-4f7c-8507-1f3f580432de tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 12:54:55 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1522b649-27fd-4f7c-8507-1f3f580432de tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UiMQhwVa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:54:55 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-1522b649-27fd-4f7c-8507-1f3f580432de tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:54:55 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-1522b649-27fd-4f7c-8507-1f3f580432de tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:54:55 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-1522b649-27fd-4f7c-8507-1f3f580432de tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:54:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:54:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:54:55 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc26f4c-c197-482e-8ed7-00899c4e4eaa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:54:55 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1522b649-27fd-4f7c-8507-1f3f580432de tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 12:54:55 user nova-compute[74840]: No targets found.
Nov 08 12:54:55 user nova-compute[74840]: iSNS:
Nov 08 12:54:55 user nova-compute[74840]: No targets found.
Nov 08 12:54:55 user nova-compute[74840]: STATIC:
Nov 08 12:54:55 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e
Nov 08 12:54:55 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:54:55 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:54:55 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2
Nov 08 12:54:55 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:54:55 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:54:55 user nova-compute[74840]: FIRMWARE:
Nov 08 12:54:55 user nova-compute[74840]: No targets found.
Nov 08 12:54:55 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:54:55 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1522b649-27fd-4f7c-8507-1f3f580432de tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 12:54:55 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 12:54:55 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 12:54:55 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1522b649-27fd-4f7c-8507-1f3f580432de tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 12:54:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:54:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:54:55 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8f42af-fce1-4b09-a3e4-d01c6484ee3e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:54:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:54:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:54:55 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[33026128-57f9-46f2-bfc9-a2dd746c7e79]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:54:55 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1522b649-27fd-4f7c-8507-1f3f580432de tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2 (non-flash)
Nov 08 12:54:55 user nova-compute[74840]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e (non-flash)
Nov 08 12:54:55 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:54:55 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1522b649-27fd-4f7c-8507-1f3f580432de tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2 (non-flash)
Nov 08 12:54:55 user nova-compute[74840]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e (non-flash)
Nov 08 12:54:55 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:54:55 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1522b649-27fd-4f7c-8507-1f3f580432de tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7f4267be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2'): ({'sdc'}, set())}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 12:54:55 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-1522b649-27fd-4f7c-8507-1f3f580432de tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Removing single pathed devices sdc {{(pid=74840) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 12:54:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:54:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:54:55 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6929f3-1042-4109-943d-2839d5588dbf]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:54:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:54:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:54:55 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5effc6-7b81-468c-b5df-c9b38a7dd35f]: (4, ('ok\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:54:55 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-1522b649-27fd-4f7c-8507-1f3f580432de tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Flushing IO for device /dev/sdc {{(pid=74840) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 12:54:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:54:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:54:55 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7926d53b-0f31-4ccd-a937-fb594e812bde]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:54:55 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-1522b649-27fd-4f7c-8507-1f3f580432de tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74840) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 12:54:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:54:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:54:55 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba940e47-992b-4151-bd10-8d1827c9b0c7]: (4, ('1', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:54:55 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-1522b649-27fd-4f7c-8507-1f3f580432de tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 12:54:55 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-1522b649-27fd-4f7c-8507-1f3f580432de tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] SCSI volumes sdc have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 12:54:55 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1522b649-27fd-4f7c-8507-1f3f580432de tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2')] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 12:54:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:54:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:54:55 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[08821c59-9294-438a-bb80-29ff15707ef7]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:54:55 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1522b649-27fd-4f7c-8507-1f3f580432de tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:54:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:54:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2 -p 172.16.0.220:3260 --logout {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:54:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:54:55 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4683ea-468f-4536-b0b6-f8a1f094ceb5]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:54:55 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1522b649-27fd-4f7c-8507-1f3f580432de tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2, portal: 172.16.0.220,3260]
Nov 08 12:54:55 user nova-compute[74840]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2, portal: 172.16.0.220,3260] successful.
Nov 08 12:54:55 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:54:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2 -p 172.16.0.220:3260 --op delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:54:55 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4022491-8a00-429f-aaa4-fae57b81eea2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:54:55 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f563dce6-cf46-4b55-810f-75a6a71ff9e5]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:54:55 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1522b649-27fd-4f7c-8507-1f3f580432de tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:54:55 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-1522b649-27fd-4f7c-8507-1f3f580432de tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:54:55 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-1522b649-27fd-4f7c-8507-1f3f580432de tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] <== disconnect_volume: return (299ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:54:55 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1522b649-27fd-4f7c-8507-1f3f580432de tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 12:54:56 user nova-compute[74840]: DEBUG nova.objects.instance [None req-1522b649-27fd-4f7c-8507-1f3f580432de tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lazy-loading 'flavor' on Instance uuid b25860e0-0030-4e80-8be2-f7a418a80b92 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:54:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1522b649-27fd-4f7c-8507-1f3f580432de tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "b25860e0-0030-4e80-8be2-f7a418a80b92" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.885s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:54:58 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-52bd02af-8ee2-4986-a329-551fbbcb6498 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 301cc74c-0322-47c3-be22-a638592a755a is timed out.
Nov 08 12:54:58 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-52bd02af-8ee2-4986-a329-551fbbcb6498 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Successfully detached device vdb from instance 301cc74c-0322-47c3-be22-a638592a755a from the live domain config.
Nov 08 12:54:58 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52bd02af-8ee2-4986-a329-551fbbcb6498 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 12:54:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-52bd02af-8ee2-4986-a329-551fbbcb6498 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YPHzqaOd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 12:54:58 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-52bd02af-8ee2-4986-a329-551fbbcb6498 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 12:54:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-52bd02af-8ee2-4986-a329-551fbbcb6498 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 12:54:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-52bd02af-8ee2-4986-a329-551fbbcb6498 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 12:54:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:54:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:54:58 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5773404-a8f5-4274-873d-43170f6cb361]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:54:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-52bd02af-8ee2-4986-a329-551fbbcb6498 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 12:54:58 user nova-compute[74840]: No targets found.
Nov 08 12:54:58 user nova-compute[74840]: iSNS:
Nov 08 12:54:58 user nova-compute[74840]: No targets found.
Nov 08 12:54:58 user nova-compute[74840]: STATIC:
Nov 08 12:54:58 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e
Nov 08 12:54:58 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 12:54:58 user nova-compute[74840]:                 Iface Name: default
Nov 08 12:54:58 user nova-compute[74840]: FIRMWARE:
Nov 08 12:54:58 user nova-compute[74840]: No targets found.
Nov 08 12:54:58 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:54:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-52bd02af-8ee2-4986-a329-551fbbcb6498 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 12:54:58 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 12:54:58 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 12:54:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-52bd02af-8ee2-4986-a329-551fbbcb6498 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 12:54:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:54:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:54:58 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0ac5b1-8a31-434c-8706-c67aaf20da99]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:54:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:54:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:54:58 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a8ddfe-0d17-48a1-b6d2-c816bf3d889c]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:54:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-52bd02af-8ee2-4986-a329-551fbbcb6498 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e (non-flash)
Nov 08 12:54:58 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 12:54:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-52bd02af-8ee2-4986-a329-551fbbcb6498 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e (non-flash)
Nov 08 12:54:58 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 12:54:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-52bd02af-8ee2-4986-a329-551fbbcb6498 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7ec149870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e'): ({'sdb'}, set())}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 12:54:58 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-52bd02af-8ee2-4986-a329-551fbbcb6498 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Removing single pathed devices sdb {{(pid=74840) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 12:54:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:54:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:54:58 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[338ce3f0-1332-4d6e-bae3-47470ed34353]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:54:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:54:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:54:58 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5096296-319c-4d04-86e4-df134ba283b7]: (4, ('ok\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:54:58 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-52bd02af-8ee2-4986-a329-551fbbcb6498 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Flushing IO for device /dev/sdb {{(pid=74840) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 12:54:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:54:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:54:58 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fde0804-08b7-4235-8d27-9c8c226b48ca]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:54:58 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-52bd02af-8ee2-4986-a329-551fbbcb6498 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74840) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 12:54:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:54:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:54:58 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e57352f-4ff1-4506-9cc1-96dc6016eb85]: (4, ('1', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:54:58 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-52bd02af-8ee2-4986-a329-551fbbcb6498 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 12:54:58 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-52bd02af-8ee2-4986-a329-551fbbcb6498 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] SCSI volumes sdb have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 12:54:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-52bd02af-8ee2-4986-a329-551fbbcb6498 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e')] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 12:54:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:54:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:54:58 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9655f9-1fe9-4375-8574-68d1823a9a84]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:54:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-52bd02af-8ee2-4986-a329-551fbbcb6498 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:54:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e -p 172.16.0.220:3260 --logout {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:54:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:54:58 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[04402db6-c2a9-45ce-87dd-10617ea43aa9]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:54:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-52bd02af-8ee2-4986-a329-551fbbcb6498 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e, portal: 172.16.0.220,3260]
Nov 08 12:54:58 user nova-compute[74840]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e, portal: 172.16.0.220,3260] successful.
Nov 08 12:54:58 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:54:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e -p 172.16.0.220:3260 --op delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:54:58 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bed5cad-1adf-41f9-bf68-19db96af4d2e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:54:58 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae269f8-6cfd-4337-9bd3-750e0dc3ec77]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 12:54:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-52bd02af-8ee2-4986-a329-551fbbcb6498 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 12:54:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-52bd02af-8ee2-4986-a329-551fbbcb6498 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 12:54:58 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-52bd02af-8ee2-4986-a329-551fbbcb6498 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] <== disconnect_volume: return (294ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 12:54:58 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52bd02af-8ee2-4986-a329-551fbbcb6498 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 12:54:59 user nova-compute[74840]: DEBUG nova.objects.instance [None req-52bd02af-8ee2-4986-a329-551fbbcb6498 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lazy-loading 'flavor' on Instance uuid 301cc74c-0322-47c3-be22-a638592a755a {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:54:59 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-52bd02af-8ee2-4986-a329-551fbbcb6498 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "301cc74c-0322-47c3-be22-a638592a755a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.827s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:55:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4cfe0b64-8db2-4da6-bc70-b486fd280eee tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Acquiring lock "301cc74c-0322-47c3-be22-a638592a755a" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:55:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4cfe0b64-8db2-4da6-bc70-b486fd280eee tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "301cc74c-0322-47c3-be22-a638592a755a" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:55:00 user nova-compute[74840]: DEBUG nova.compute.manager [None req-4cfe0b64-8db2-4da6-bc70-b486fd280eee tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:55:00 user nova-compute[74840]: DEBUG nova.compute.manager [None req-4cfe0b64-8db2-4da6-bc70-b486fd280eee tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74840) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 08 12:55:00 user nova-compute[74840]: DEBUG nova.objects.instance [None req-4cfe0b64-8db2-4da6-bc70-b486fd280eee tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lazy-loading 'flavor' on Instance uuid 301cc74c-0322-47c3-be22-a638592a755a {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:55:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:55:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:55:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:55:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:55:00 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:55:00 user nova-compute[74840]: DEBUG nova.compute.manager [req-02ce70a3-704e-4167-9862-e73358ec452b req-543cb0f3-0551-47b4-aa1e-691d803fdaee service nova] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Received event network-vif-unplugged-f001cf21-b5b2-4a55-bcc4-5451e3a73170 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:55:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-02ce70a3-704e-4167-9862-e73358ec452b req-543cb0f3-0551-47b4-aa1e-691d803fdaee service nova] Acquiring lock "301cc74c-0322-47c3-be22-a638592a755a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:55:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-02ce70a3-704e-4167-9862-e73358ec452b req-543cb0f3-0551-47b4-aa1e-691d803fdaee service nova] Lock "301cc74c-0322-47c3-be22-a638592a755a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:55:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-02ce70a3-704e-4167-9862-e73358ec452b req-543cb0f3-0551-47b4-aa1e-691d803fdaee service nova] Lock "301cc74c-0322-47c3-be22-a638592a755a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:55:00 user nova-compute[74840]: DEBUG nova.compute.manager [req-02ce70a3-704e-4167-9862-e73358ec452b req-543cb0f3-0551-47b4-aa1e-691d803fdaee service nova] [instance: 301cc74c-0322-47c3-be22-a638592a755a] No waiting events found dispatching network-vif-unplugged-f001cf21-b5b2-4a55-bcc4-5451e3a73170 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:55:00 user nova-compute[74840]: WARNING nova.compute.manager [req-02ce70a3-704e-4167-9862-e73358ec452b req-543cb0f3-0551-47b4-aa1e-691d803fdaee service nova] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Received unexpected event network-vif-unplugged-f001cf21-b5b2-4a55-bcc4-5451e3a73170 for instance with vm_state active and task_state powering-off.
Nov 08 12:55:01 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Instance destroyed successfully.
Nov 08 12:55:01 user nova-compute[74840]: DEBUG nova.compute.manager [None req-4cfe0b64-8db2-4da6-bc70-b486fd280eee tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:55:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-4cfe0b64-8db2-4da6-bc70-b486fd280eee tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "301cc74c-0322-47c3-be22-a638592a755a" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.824s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:55:03 user nova-compute[74840]: DEBUG nova.compute.manager [req-09a31cb3-8a2f-45e8-aab1-bae5cc360bef req-6b626a30-c128-4be4-bef3-f2600370406d service nova] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Received event network-vif-plugged-f001cf21-b5b2-4a55-bcc4-5451e3a73170 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:55:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-09a31cb3-8a2f-45e8-aab1-bae5cc360bef req-6b626a30-c128-4be4-bef3-f2600370406d service nova] Acquiring lock "301cc74c-0322-47c3-be22-a638592a755a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:55:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-09a31cb3-8a2f-45e8-aab1-bae5cc360bef req-6b626a30-c128-4be4-bef3-f2600370406d service nova] Lock "301cc74c-0322-47c3-be22-a638592a755a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:55:03 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-09a31cb3-8a2f-45e8-aab1-bae5cc360bef req-6b626a30-c128-4be4-bef3-f2600370406d service nova] Lock "301cc74c-0322-47c3-be22-a638592a755a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:55:03 user nova-compute[74840]: DEBUG nova.compute.manager [req-09a31cb3-8a2f-45e8-aab1-bae5cc360bef req-6b626a30-c128-4be4-bef3-f2600370406d service nova] [instance: 301cc74c-0322-47c3-be22-a638592a755a] No waiting events found dispatching network-vif-plugged-f001cf21-b5b2-4a55-bcc4-5451e3a73170 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:55:03 user nova-compute[74840]: WARNING nova.compute.manager [req-09a31cb3-8a2f-45e8-aab1-bae5cc360bef req-6b626a30-c128-4be4-bef3-f2600370406d service nova] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Received unexpected event network-vif-plugged-f001cf21-b5b2-4a55-bcc4-5451e3a73170 for instance with vm_state stopped and task_state None.
Nov 08 12:55:05 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:55:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:55:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:55:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 12:55:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:55:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:55:10 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:55:15 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:55:20 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:55:22 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:55:23 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:55:23 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:55:24 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:55:25 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:55:25 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:55:25 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 12:55:25 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:55:25 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:55:25 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:55:26 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:55:27 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:55:27 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:55:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "refresh_cache-b25860e0-0030-4e80-8be2-f7a418a80b92" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:55:27 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquired lock "refresh_cache-b25860e0-0030-4e80-8be2-f7a418a80b92" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:55:27 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Forcefully refreshing network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 12:55:28 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Updating instance_info_cache with network_info: [{"id": "46124c00-b635-4543-886c-914cfb23594c", "address": "fa:16:3e:31:21:d4", "network": {"id": "8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1654230640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "270eb2fc5485447f9e09d83d48fdc14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46124c00-b6", "ovs_interfaceid": "46124c00-b635-4543-886c-914cfb23594c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:55:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Releasing lock "refresh_cache-b25860e0-0030-4e80-8be2-f7a418a80b92" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:55:28 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Updated the network info_cache for instance {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 12:55:28 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:55:29 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:55:30 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:55:31 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:55:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:55:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:55:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:55:31 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:55:31 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b25860e0-0030-4e80-8be2-f7a418a80b92/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:55:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b25860e0-0030-4e80-8be2-f7a418a80b92/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:55:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b25860e0-0030-4e80-8be2-f7a418a80b92/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:55:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b25860e0-0030-4e80-8be2-f7a418a80b92/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:55:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:55:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:55:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:55:32 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:55:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:55:32 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:55:32 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:55:32 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=8832MB free_disk=24.774890899658203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:55:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:55:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:55:33 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 301cc74c-0322-47c3-be22-a638592a755a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:55:33 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance b25860e0-0030-4e80-8be2-f7a418a80b92 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:55:33 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:55:33 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:55:33 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:55:33 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:55:33 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:55:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.232s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:55:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:55:34 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:55:35 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:55:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:55:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:55:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 12:55:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:55:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:55:40 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:55:43 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:55:45 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:55:46 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1edf5b93-0961-4a76-a9f2-370f751781c3 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Acquiring lock "b25860e0-0030-4e80-8be2-f7a418a80b92" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:55:46 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1edf5b93-0961-4a76-a9f2-370f751781c3 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "b25860e0-0030-4e80-8be2-f7a418a80b92" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:55:46 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1edf5b93-0961-4a76-a9f2-370f751781c3 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Acquiring lock "b25860e0-0030-4e80-8be2-f7a418a80b92-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:55:46 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1edf5b93-0961-4a76-a9f2-370f751781c3 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "b25860e0-0030-4e80-8be2-f7a418a80b92-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:55:46 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1edf5b93-0961-4a76-a9f2-370f751781c3 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "b25860e0-0030-4e80-8be2-f7a418a80b92-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:55:46 user nova-compute[74840]: INFO nova.compute.manager [None req-1edf5b93-0961-4a76-a9f2-370f751781c3 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Terminating instance
Nov 08 12:55:46 user nova-compute[74840]: DEBUG nova.compute.manager [None req-1edf5b93-0961-4a76-a9f2-370f751781c3 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Start destroying the instance on the hypervisor. {{(pid=74840) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 12:55:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:55:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:55:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:55:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:55:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:55:46 user nova-compute[74840]: DEBUG nova.compute.manager [req-44043276-d835-442d-bfc4-4339fefcba88 req-e72f84ea-d0cc-4a08-ab80-a97107b46d01 service nova] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Received event network-vif-unplugged-46124c00-b635-4543-886c-914cfb23594c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:55:46 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-44043276-d835-442d-bfc4-4339fefcba88 req-e72f84ea-d0cc-4a08-ab80-a97107b46d01 service nova] Acquiring lock "b25860e0-0030-4e80-8be2-f7a418a80b92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:55:46 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-44043276-d835-442d-bfc4-4339fefcba88 req-e72f84ea-d0cc-4a08-ab80-a97107b46d01 service nova] Lock "b25860e0-0030-4e80-8be2-f7a418a80b92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:55:46 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-44043276-d835-442d-bfc4-4339fefcba88 req-e72f84ea-d0cc-4a08-ab80-a97107b46d01 service nova] Lock "b25860e0-0030-4e80-8be2-f7a418a80b92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:55:46 user nova-compute[74840]: DEBUG nova.compute.manager [req-44043276-d835-442d-bfc4-4339fefcba88 req-e72f84ea-d0cc-4a08-ab80-a97107b46d01 service nova] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] No waiting events found dispatching network-vif-unplugged-46124c00-b635-4543-886c-914cfb23594c {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:55:46 user nova-compute[74840]: DEBUG nova.compute.manager [req-44043276-d835-442d-bfc4-4339fefcba88 req-e72f84ea-d0cc-4a08-ab80-a97107b46d01 service nova] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Received event network-vif-unplugged-46124c00-b635-4543-886c-914cfb23594c for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:55:47 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Instance destroyed successfully.
Nov 08 12:55:47 user nova-compute[74840]: DEBUG nova.objects.instance [None req-1edf5b93-0961-4a76-a9f2-370f751781c3 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lazy-loading 'resources' on Instance uuid b25860e0-0030-4e80-8be2-f7a418a80b92 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:55:47 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-1edf5b93-0961-4a76-a9f2-370f751781c3 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:50:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-458461980',display_name='tempest-TestMinimumBasicScenario-server-458461980',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-458461980',id=50,image_ref='cb426414-da98-450c-a7de-4d030fd07b7d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgR/DdBe0/Em7Dkik9NFZ7N7KmeJNaA8h0QzN5WD7bCSbi6bJ1FMqtzP6EXFwGqJVtwsMpYrlpdQSkXUwZ68XDCQjSL0QgFH4Fy3ZRZ+k4kKsh12+FzwirDe50bD5aiIA==',key_name='tempest-TestMinimumBasicScenario-1548049828',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:50:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='270eb2fc5485447f9e09d83d48fdc14f',ramdisk_id='',reservation_id='r-ei7wy3cd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='cb426414-da98-450c-a7de-4d030fd07b7d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1675831883',owner_user_name='tempest-TestMinimumBasicScenario-1675831883-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:52:49Z,user_data=None,user_id='40cef2061d7a4ad9a98409cbaa0f6351',uuid=b25860e0-0030-4e80-8be2-f7a418a80b92,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46124c00-b635-4543-886c-914cfb23594c", "address": "fa:16:3e:31:21:d4", "network": {"id": "8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1654230640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "270eb2fc5485447f9e09d83d48fdc14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46124c00-b6", "ovs_interfaceid": "46124c00-b635-4543-886c-914cfb23594c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:55:47 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-1edf5b93-0961-4a76-a9f2-370f751781c3 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Converting VIF {"id": "46124c00-b635-4543-886c-914cfb23594c", "address": "fa:16:3e:31:21:d4", "network": {"id": "8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1654230640-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "270eb2fc5485447f9e09d83d48fdc14f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46124c00-b6", "ovs_interfaceid": "46124c00-b635-4543-886c-914cfb23594c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:55:47 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-1edf5b93-0961-4a76-a9f2-370f751781c3 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:21:d4,bridge_name='br-int',has_traffic_filtering=True,id=46124c00-b635-4543-886c-914cfb23594c,network=Network(8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46124c00-b6') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:55:47 user nova-compute[74840]: DEBUG os_vif [None req-1edf5b93-0961-4a76-a9f2-370f751781c3 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:21:d4,bridge_name='br-int',has_traffic_filtering=True,id=46124c00-b635-4543-886c-914cfb23594c,network=Network(8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46124c00-b6') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:55:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:55:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap46124c00-b6, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:55:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:55:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:55:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:55:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:55:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6846a8be-4638-4db6-b1ca-ce19fdd1f2e1) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:55:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:55:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:55:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:55:47 user nova-compute[74840]: INFO os_vif [None req-1edf5b93-0961-4a76-a9f2-370f751781c3 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:21:d4,bridge_name='br-int',has_traffic_filtering=True,id=46124c00-b635-4543-886c-914cfb23594c,network=Network(8d40e76a-cfef-48b3-8fbd-94d2c5c33f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46124c00-b6')
Nov 08 12:55:47 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-1edf5b93-0961-4a76-a9f2-370f751781c3 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Deleting instance files /opt/stack/data/nova/instances/b25860e0-0030-4e80-8be2-f7a418a80b92_del
Nov 08 12:55:47 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-1edf5b93-0961-4a76-a9f2-370f751781c3 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Deletion of /opt/stack/data/nova/instances/b25860e0-0030-4e80-8be2-f7a418a80b92_del complete
Nov 08 12:55:47 user nova-compute[74840]: INFO nova.compute.manager [None req-1edf5b93-0961-4a76-a9f2-370f751781c3 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 08 12:55:47 user nova-compute[74840]: DEBUG oslo.service.loopingcall [None req-1edf5b93-0961-4a76-a9f2-370f751781c3 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74840) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 12:55:47 user nova-compute[74840]: DEBUG nova.compute.manager [-] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Deallocating network for instance {{(pid=74840) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 12:55:47 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] deallocate_for_instance() {{(pid=74840) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 12:55:47 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:55:47 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74840) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 12:55:47 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:55:47 user nova-compute[74840]: INFO nova.compute.manager [-] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Took 0.49 seconds to deallocate network for instance.
Nov 08 12:55:47 user nova-compute[74840]: DEBUG nova.compute.manager [req-c23f5e22-9e8d-49d0-b206-ddf1015df6f6 req-a16a63a5-4a33-40a5-a8e8-be3fa1f9b9f3 service nova] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Received event network-vif-deleted-46124c00-b635-4543-886c-914cfb23594c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:55:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1edf5b93-0961-4a76-a9f2-370f751781c3 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:55:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1edf5b93-0961-4a76-a9f2-370f751781c3 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:55:48 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-1edf5b93-0961-4a76-a9f2-370f751781c3 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:55:48 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-1edf5b93-0961-4a76-a9f2-370f751781c3 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:55:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1edf5b93-0961-4a76-a9f2-370f751781c3 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.136s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:55:48 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-1edf5b93-0961-4a76-a9f2-370f751781c3 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Deleted allocations for instance b25860e0-0030-4e80-8be2-f7a418a80b92
Nov 08 12:55:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-1edf5b93-0961-4a76-a9f2-370f751781c3 tempest-TestMinimumBasicScenario-1675831883 tempest-TestMinimumBasicScenario-1675831883-project-member] Lock "b25860e0-0030-4e80-8be2-f7a418a80b92" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.681s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:55:48 user nova-compute[74840]: DEBUG nova.compute.manager [req-8b217923-c532-45fe-81af-a9595b86f0b2 req-d0244e6e-a167-4bd9-acae-aaae91288a2d service nova] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Received event network-vif-plugged-46124c00-b635-4543-886c-914cfb23594c {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:55:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8b217923-c532-45fe-81af-a9595b86f0b2 req-d0244e6e-a167-4bd9-acae-aaae91288a2d service nova] Acquiring lock "b25860e0-0030-4e80-8be2-f7a418a80b92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:55:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8b217923-c532-45fe-81af-a9595b86f0b2 req-d0244e6e-a167-4bd9-acae-aaae91288a2d service nova] Lock "b25860e0-0030-4e80-8be2-f7a418a80b92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:55:48 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8b217923-c532-45fe-81af-a9595b86f0b2 req-d0244e6e-a167-4bd9-acae-aaae91288a2d service nova] Lock "b25860e0-0030-4e80-8be2-f7a418a80b92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:55:48 user nova-compute[74840]: DEBUG nova.compute.manager [req-8b217923-c532-45fe-81af-a9595b86f0b2 req-d0244e6e-a167-4bd9-acae-aaae91288a2d service nova] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] No waiting events found dispatching network-vif-plugged-46124c00-b635-4543-886c-914cfb23594c {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:55:48 user nova-compute[74840]: WARNING nova.compute.manager [req-8b217923-c532-45fe-81af-a9595b86f0b2 req-d0244e6e-a167-4bd9-acae-aaae91288a2d service nova] [instance: b25860e0-0030-4e80-8be2-f7a418a80b92] Received unexpected event network-vif-plugged-46124c00-b635-4543-886c-914cfb23594c for instance with vm_state deleted and task_state None.
Nov 08 12:55:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:55:55 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:55:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:55:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:55:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 12:55:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:55:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:55:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:55:59 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:55:59 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Triggering sync for uuid 301cc74c-0322-47c3-be22-a638592a755a {{(pid=74840) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 12:55:59 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "301cc74c-0322-47c3-be22-a638592a755a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:55:59 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "301cc74c-0322-47c3-be22-a638592a755a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:55:59 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "301cc74c-0322-47c3-be22-a638592a755a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.021s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:56:02 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:56:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:56:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:56:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 12:56:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:56:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:56:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:56:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:56:14 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:56:14 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Cleaning up deleted instances {{(pid=74840) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 12:56:14 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] There are 0 instances to clean {{(pid=74840) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 12:56:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:56:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:56:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 12:56:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:56:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:56:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:56:20 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:56:22 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:56:23 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:56:23 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:56:26 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:56:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:56:28 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:56:28 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:56:28 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:56:28 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Rebuilding the list of instances to heal {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 12:56:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "refresh_cache-301cc74c-0322-47c3-be22-a638592a755a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:56:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquired lock "refresh_cache-301cc74c-0322-47c3-be22-a638592a755a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:56:28 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Forcefully refreshing network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 12:56:28 user nova-compute[74840]: DEBUG nova.objects.instance [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lazy-loading 'info_cache' on Instance uuid 301cc74c-0322-47c3-be22-a638592a755a {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:56:29 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Updating instance_info_cache with network_info: [{"id": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "address": "fa:16:3e:f3:fc:27", "network": {"id": "515bf382-a9c9-4096-9de0-23fc0c912a71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1378790516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7e49db466d4c0a83700e2e917c78be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf001cf21-b5", "ovs_interfaceid": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:56:29 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Releasing lock "refresh_cache-301cc74c-0322-47c3-be22-a638592a755a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:56:29 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Updated the network info_cache for instance {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 12:56:29 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:56:29 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:56:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:56:33 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:56:33 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:56:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:56:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:56:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:56:33 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:56:33 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:56:33 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:56:33 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:56:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:56:34 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:56:34 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:56:34 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=9001MB free_disk=24.800804138183594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:56:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:56:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:56:34 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 301cc74c-0322-47c3-be22-a638592a755a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:56:34 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:56:34 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:56:34 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Refreshing inventories for resource provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 12:56:34 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Updating ProviderTree inventory for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 12:56:34 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Updating inventory in ProviderTree for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 12:56:34 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Refreshing aggregate associations for resource provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e, aggregates: None {{(pid=74840) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 12:56:34 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Refreshing trait associations for resource provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=74840) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 12:56:34 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:56:34 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:56:34 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:56:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.446s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:56:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:56:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:56:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 12:56:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:56:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:56:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:56:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:56:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:56:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:56:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:56:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:56:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:56:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 12:56:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:56:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:56:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:56:51 user nova-compute[74840]: DEBUG nova.objects.instance [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lazy-loading 'flavor' on Instance uuid 301cc74c-0322-47c3-be22-a638592a755a {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:56:51 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Acquiring lock "refresh_cache-301cc74c-0322-47c3-be22-a638592a755a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:56:51 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Acquired lock "refresh_cache-301cc74c-0322-47c3-be22-a638592a755a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:56:51 user nova-compute[74840]: DEBUG nova.network.neutron [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:56:51 user nova-compute[74840]: DEBUG nova.objects.instance [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lazy-loading 'info_cache' on Instance uuid 301cc74c-0322-47c3-be22-a638592a755a {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:56:51 user nova-compute[74840]: DEBUG nova.objects.base [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Object Instance<301cc74c-0322-47c3-be22-a638592a755a> lazy-loaded attributes: flavor,info_cache {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG nova.network.neutron [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Updating instance_info_cache with network_info: [{"id": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "address": "fa:16:3e:f3:fc:27", "network": {"id": "515bf382-a9c9-4096-9de0-23fc0c912a71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1378790516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7e49db466d4c0a83700e2e917c78be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf001cf21-b5", "ovs_interfaceid": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Releasing lock "refresh_cache-301cc74c-0322-47c3-be22-a638592a755a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:56:52 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Instance destroyed successfully.
Nov 08 12:56:52 user nova-compute[74840]: DEBUG nova.objects.instance [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lazy-loading 'resources' on Instance uuid 301cc74c-0322-47c3-be22-a638592a755a {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG nova.objects.base [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Object Instance<301cc74c-0322-47c3-be22-a638592a755a> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:48:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1268219938',display_name='tempest-AttachVolumeTestJSON-server-1268219938',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1268219938',id=49,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1Q3P8MX65K+ewG2SwkHJsjLBfhR/vPyPX9ltkFerXJUdJghXZzKfH0GZA2WFBtwb7dErHNHWFrK86n2OEQBsGNeWGod8BzroVKFZNXS962Jzp5znHBxWuSa1al8Vb4Ew==',key_name='tempest-keypair-654921536',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:48:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6e7e49db466d4c0a83700e2e917c78be',ramdisk_id='',reservation_id='r-cr0fa74z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-116807071',owner_user_name='tempest-AttachVolumeTestJSON-116807071-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:55:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9667df3a519d47809b332f8457cd1154',uuid=301cc74c-0322-47c3-be22-a638592a755a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "address": "fa:16:3e:f3:fc:27", "network": {"id": "515bf382-a9c9-4096-9de0-23fc0c912a71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1378790516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7e49db466d4c0a83700e2e917c78be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf001cf21-b5", "ovs_interfaceid": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Converting VIF {"id": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "address": "fa:16:3e:f3:fc:27", "network": {"id": "515bf382-a9c9-4096-9de0-23fc0c912a71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1378790516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7e49db466d4c0a83700e2e917c78be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf001cf21-b5", "ovs_interfaceid": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:fc:27,bridge_name='br-int',has_traffic_filtering=True,id=f001cf21-b5b2-4a55-bcc4-5451e3a73170,network=Network(515bf382-a9c9-4096-9de0-23fc0c912a71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf001cf21-b5') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG os_vif [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:fc:27,bridge_name='br-int',has_traffic_filtering=True,id=f001cf21-b5b2-4a55-bcc4-5451e3a73170,network=Network(515bf382-a9c9-4096-9de0-23fc0c912a71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf001cf21-b5') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf001cf21-b5, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=39647b50-57c6-4b4b-92e2-9065d72df40d) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:56:52 user nova-compute[74840]: INFO os_vif [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:fc:27,bridge_name='br-int',has_traffic_filtering=True,id=f001cf21-b5b2-4a55-bcc4-5451e3a73170,network=Network(515bf382-a9c9-4096-9de0-23fc0c912a71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf001cf21-b5')
Nov 08 12:56:52 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Start _get_guest_xml network_info=[{"id": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "address": "fa:16:3e:f3:fc:27", "network": {"id": "515bf382-a9c9-4096-9de0-23fc0c912a71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1378790516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7e49db466d4c0a83700e2e917c78be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf001cf21-b5", "ovs_interfaceid": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'image_id': '4fa17706-d304-4117-a420-dab994c703dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG nova.objects.instance [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lazy-loading 'numa_topology' on Instance uuid 301cc74c-0322-47c3-be22-a638592a755a {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG nova.objects.base [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Object Instance<301cc74c-0322-47c3-be22-a638592a755a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:56:52 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:56:52 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:56:52 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG nova.objects.instance [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lazy-loading 'vcpu_model' on Instance uuid 301cc74c-0322-47c3-be22-a638592a755a {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG nova.objects.base [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Object Instance<301cc74c-0322-47c3-be22-a638592a755a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:48:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1268219938',display_name='tempest-AttachVolumeTestJSON-server-1268219938',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1268219938',id=49,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1Q3P8MX65K+ewG2SwkHJsjLBfhR/vPyPX9ltkFerXJUdJghXZzKfH0GZA2WFBtwb7dErHNHWFrK86n2OEQBsGNeWGod8BzroVKFZNXS962Jzp5znHBxWuSa1al8Vb4Ew==',key_name='tempest-keypair-654921536',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:48:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6e7e49db466d4c0a83700e2e917c78be',ramdisk_id='',reservation_id='r-cr0fa74z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-116807071',owner_user_name='tempest-AttachVolumeTestJSON-116807071-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:55:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9667df3a519d47809b332f8457cd1154',uuid=301cc74c-0322-47c3-be22-a638592a755a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "address": "fa:16:3e:f3:fc:27", "network": {"id": "515bf382-a9c9-4096-9de0-23fc0c912a71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1378790516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7e49db466d4c0a83700e2e917c78be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf001cf21-b5", "ovs_interfaceid": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Converting VIF {"id": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "address": "fa:16:3e:f3:fc:27", "network": {"id": "515bf382-a9c9-4096-9de0-23fc0c912a71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1378790516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7e49db466d4c0a83700e2e917c78be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf001cf21-b5", "ovs_interfaceid": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:fc:27,bridge_name='br-int',has_traffic_filtering=True,id=f001cf21-b5b2-4a55-bcc4-5451e3a73170,network=Network(515bf382-a9c9-4096-9de0-23fc0c912a71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf001cf21-b5') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG nova.objects.instance [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lazy-loading 'pci_devices' on Instance uuid 301cc74c-0322-47c3-be22-a638592a755a {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG nova.objects.base [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Object Instance<301cc74c-0322-47c3-be22-a638592a755a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:56:52 user nova-compute[74840]:   <uuid>301cc74c-0322-47c3-be22-a638592a755a</uuid>
Nov 08 12:56:52 user nova-compute[74840]:   <name>instance-00000031</name>
Nov 08 12:56:52 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:56:52 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:56:52 user nova-compute[74840]:   <metadata>
Nov 08 12:56:52 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:56:52 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:56:52 user nova-compute[74840]:       <nova:name>tempest-AttachVolumeTestJSON-server-1268219938</nova:name>
Nov 08 12:56:52 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:56:52</nova:creationTime>
Nov 08 12:56:52 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:56:52 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:56:52 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:56:52 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:56:52 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:56:52 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:56:52 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:56:52 user nova-compute[74840]:       <nova:owner>
Nov 08 12:56:52 user nova-compute[74840]:         <nova:user uuid="9667df3a519d47809b332f8457cd1154">tempest-AttachVolumeTestJSON-116807071-project-member</nova:user>
Nov 08 12:56:52 user nova-compute[74840]:         <nova:project uuid="6e7e49db466d4c0a83700e2e917c78be">tempest-AttachVolumeTestJSON-116807071</nova:project>
Nov 08 12:56:52 user nova-compute[74840]:       </nova:owner>
Nov 08 12:56:52 user nova-compute[74840]:       <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:56:52 user nova-compute[74840]:       <nova:ports>
Nov 08 12:56:52 user nova-compute[74840]:         <nova:port uuid="f001cf21-b5b2-4a55-bcc4-5451e3a73170">
Nov 08 12:56:52 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 12:56:52 user nova-compute[74840]:         </nova:port>
Nov 08 12:56:52 user nova-compute[74840]:       </nova:ports>
Nov 08 12:56:52 user nova-compute[74840]:     </nova:instance>
Nov 08 12:56:52 user nova-compute[74840]:   </metadata>
Nov 08 12:56:52 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:56:52 user nova-compute[74840]:     <system>
Nov 08 12:56:52 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:56:52 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:56:52 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:56:52 user nova-compute[74840]:       <entry name="serial">301cc74c-0322-47c3-be22-a638592a755a</entry>
Nov 08 12:56:52 user nova-compute[74840]:       <entry name="uuid">301cc74c-0322-47c3-be22-a638592a755a</entry>
Nov 08 12:56:52 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:56:52 user nova-compute[74840]:     </system>
Nov 08 12:56:52 user nova-compute[74840]:   </sysinfo>
Nov 08 12:56:52 user nova-compute[74840]:   <os>
Nov 08 12:56:52 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:56:52 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:56:52 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:56:52 user nova-compute[74840]:   </os>
Nov 08 12:56:52 user nova-compute[74840]:   <features>
Nov 08 12:56:52 user nova-compute[74840]:     <acpi/>
Nov 08 12:56:52 user nova-compute[74840]:     <apic/>
Nov 08 12:56:52 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:56:52 user nova-compute[74840]:   </features>
Nov 08 12:56:52 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:56:52 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:56:52 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:56:52 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:56:52 user nova-compute[74840]:   </clock>
Nov 08 12:56:52 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:56:52 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:56:52 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:56:52 user nova-compute[74840]:   </cpu>
Nov 08 12:56:52 user nova-compute[74840]:   <devices>
Nov 08 12:56:52 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:56:52 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:56:52 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk"/>
Nov 08 12:56:52 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:56:52 user nova-compute[74840]:     </disk>
Nov 08 12:56:52 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:56:52 user nova-compute[74840]:       <mac address="fa:16:3e:f3:fc:27"/>
Nov 08 12:56:52 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:56:52 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:56:52 user nova-compute[74840]:       <target dev="tapf001cf21-b5"/>
Nov 08 12:56:52 user nova-compute[74840]:     </interface>
Nov 08 12:56:52 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:56:52 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/console.log" append="off"/>
Nov 08 12:56:52 user nova-compute[74840]:     </serial>
Nov 08 12:56:52 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:56:52 user nova-compute[74840]:     <video>
Nov 08 12:56:52 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:56:52 user nova-compute[74840]:     </video>
Nov 08 12:56:52 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:56:52 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:56:52 user nova-compute[74840]:     </rng>
Nov 08 12:56:52 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:56:52 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:56:52 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:56:52 user nova-compute[74840]:     </memballoon>
Nov 08 12:56:52 user nova-compute[74840]:   </devices>
Nov 08 12:56:52 user nova-compute[74840]: </domain>
Nov 08 12:56:52 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG nova.objects.instance [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lazy-loading 'trusted_certs' on Instance uuid 301cc74c-0322-47c3-be22-a638592a755a {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG nova.objects.base [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Object Instance<301cc74c-0322-47c3-be22-a638592a755a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.194s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Checking if we can resize image /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk. size=1073741824 {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Cannot resize image /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk to a smaller size. {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG nova.objects.instance [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lazy-loading 'migration_context' on Instance uuid 301cc74c-0322-47c3-be22-a638592a755a {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG nova.objects.base [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Object Instance<301cc74c-0322-47c3-be22-a638592a755a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74840) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:48:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1268219938',display_name='tempest-AttachVolumeTestJSON-server-1268219938',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1268219938',id=49,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1Q3P8MX65K+ewG2SwkHJsjLBfhR/vPyPX9ltkFerXJUdJghXZzKfH0GZA2WFBtwb7dErHNHWFrK86n2OEQBsGNeWGod8BzroVKFZNXS962Jzp5znHBxWuSa1al8Vb4Ew==',key_name='tempest-keypair-654921536',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:48:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='6e7e49db466d4c0a83700e2e917c78be',ramdisk_id='',reservation_id='r-cr0fa74z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-116807071',owner_user_name='tempest-AttachVolumeTestJSON-116807071-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:55:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9667df3a519d47809b332f8457cd1154',uuid=301cc74c-0322-47c3-be22-a638592a755a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "address": "fa:16:3e:f3:fc:27", "network": {"id": "515bf382-a9c9-4096-9de0-23fc0c912a71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1378790516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7e49db466d4c0a83700e2e917c78be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf001cf21-b5", "ovs_interfaceid": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Converting VIF {"id": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "address": "fa:16:3e:f3:fc:27", "network": {"id": "515bf382-a9c9-4096-9de0-23fc0c912a71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1378790516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7e49db466d4c0a83700e2e917c78be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf001cf21-b5", "ovs_interfaceid": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:fc:27,bridge_name='br-int',has_traffic_filtering=True,id=f001cf21-b5b2-4a55-bcc4-5451e3a73170,network=Network(515bf382-a9c9-4096-9de0-23fc0c912a71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf001cf21-b5') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:56:52 user nova-compute[74840]: DEBUG os_vif [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:fc:27,bridge_name='br-int',has_traffic_filtering=True,id=f001cf21-b5b2-4a55-bcc4-5451e3a73170,network=Network(515bf382-a9c9-4096-9de0-23fc0c912a71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf001cf21-b5') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:56:53 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:56:53 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:56:53 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:56:53 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:56:53 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '82dddff3-df46-5d3f-8b05-7466983996a5', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:56:53 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:56:53 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:56:53 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:56:53 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf001cf21-b5, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:56:53 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf001cf21-b5, col_values=(('qos', UUID('099f1f0e-2474-4842-8a24-aa1e55212a04')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:56:53 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf001cf21-b5, col_values=(('external_ids', {'iface-id': 'f001cf21-b5b2-4a55-bcc4-5451e3a73170', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:fc:27', 'vm-uuid': '301cc74c-0322-47c3-be22-a638592a755a'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:56:53 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:56:53 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:56:53 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:56:53 user nova-compute[74840]: INFO os_vif [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:fc:27,bridge_name='br-int',has_traffic_filtering=True,id=f001cf21-b5b2-4a55-bcc4-5451e3a73170,network=Network(515bf382-a9c9-4096-9de0-23fc0c912a71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf001cf21-b5')
Nov 08 12:56:54 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:56:54 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:56:54 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:56:54 user nova-compute[74840]: DEBUG nova.compute.manager [req-d7f6dd66-599f-4805-9fbb-007ac3aacdec req-63dc369b-3a61-4d49-85ba-0736c45c8a27 service nova] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Received event network-vif-plugged-f001cf21-b5b2-4a55-bcc4-5451e3a73170 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:56:54 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-d7f6dd66-599f-4805-9fbb-007ac3aacdec req-63dc369b-3a61-4d49-85ba-0736c45c8a27 service nova] Acquiring lock "301cc74c-0322-47c3-be22-a638592a755a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:56:54 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-d7f6dd66-599f-4805-9fbb-007ac3aacdec req-63dc369b-3a61-4d49-85ba-0736c45c8a27 service nova] Lock "301cc74c-0322-47c3-be22-a638592a755a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:56:54 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-d7f6dd66-599f-4805-9fbb-007ac3aacdec req-63dc369b-3a61-4d49-85ba-0736c45c8a27 service nova] Lock "301cc74c-0322-47c3-be22-a638592a755a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:56:54 user nova-compute[74840]: DEBUG nova.compute.manager [req-d7f6dd66-599f-4805-9fbb-007ac3aacdec req-63dc369b-3a61-4d49-85ba-0736c45c8a27 service nova] [instance: 301cc74c-0322-47c3-be22-a638592a755a] No waiting events found dispatching network-vif-plugged-f001cf21-b5b2-4a55-bcc4-5451e3a73170 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:56:54 user nova-compute[74840]: WARNING nova.compute.manager [req-d7f6dd66-599f-4805-9fbb-007ac3aacdec req-63dc369b-3a61-4d49-85ba-0736c45c8a27 service nova] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Received unexpected event network-vif-plugged-f001cf21-b5b2-4a55-bcc4-5451e3a73170 for instance with vm_state stopped and task_state powering-on.
Nov 08 12:56:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:56:55 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:56:56 user nova-compute[74840]: DEBUG nova.compute.manager [req-befbd62a-00d8-4b7f-9d59-800c006f77c5 req-e65c0229-64f7-4431-b114-c83960829dd4 service nova] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Received event network-vif-plugged-f001cf21-b5b2-4a55-bcc4-5451e3a73170 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:56:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-befbd62a-00d8-4b7f-9d59-800c006f77c5 req-e65c0229-64f7-4431-b114-c83960829dd4 service nova] Acquiring lock "301cc74c-0322-47c3-be22-a638592a755a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:56:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-befbd62a-00d8-4b7f-9d59-800c006f77c5 req-e65c0229-64f7-4431-b114-c83960829dd4 service nova] Lock "301cc74c-0322-47c3-be22-a638592a755a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:56:56 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-befbd62a-00d8-4b7f-9d59-800c006f77c5 req-e65c0229-64f7-4431-b114-c83960829dd4 service nova] Lock "301cc74c-0322-47c3-be22-a638592a755a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:56:56 user nova-compute[74840]: DEBUG nova.compute.manager [req-befbd62a-00d8-4b7f-9d59-800c006f77c5 req-e65c0229-64f7-4431-b114-c83960829dd4 service nova] [instance: 301cc74c-0322-47c3-be22-a638592a755a] No waiting events found dispatching network-vif-plugged-f001cf21-b5b2-4a55-bcc4-5451e3a73170 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:56:56 user nova-compute[74840]: WARNING nova.compute.manager [req-befbd62a-00d8-4b7f-9d59-800c006f77c5 req-e65c0229-64f7-4431-b114-c83960829dd4 service nova] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Received unexpected event network-vif-plugged-f001cf21-b5b2-4a55-bcc4-5451e3a73170 for instance with vm_state stopped and task_state powering-on.
Nov 08 12:56:56 user nova-compute[74840]: DEBUG nova.compute.manager [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:56:56 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Instance rebooted successfully.
Nov 08 12:56:56 user nova-compute[74840]: DEBUG nova.compute.manager [None req-ccc87f7b-e650-412c-ae2f-8baab0c86da9 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:56:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:56:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:57:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:57:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:57:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 12:57:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:57:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:57:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:57:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:57:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:57:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:57:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:57:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:57:21 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:57:22 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:57:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:57:24 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:57:24 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:57:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:57:27 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:57:28 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:57:28 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:57:28 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:57:28 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Rebuilding the list of instances to heal {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 12:57:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "refresh_cache-301cc74c-0322-47c3-be22-a638592a755a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:57:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquired lock "refresh_cache-301cc74c-0322-47c3-be22-a638592a755a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:57:28 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Forcefully refreshing network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 12:57:28 user nova-compute[74840]: DEBUG nova.objects.instance [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lazy-loading 'info_cache' on Instance uuid 301cc74c-0322-47c3-be22-a638592a755a {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:57:29 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Updating instance_info_cache with network_info: [{"id": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "address": "fa:16:3e:f3:fc:27", "network": {"id": "515bf382-a9c9-4096-9de0-23fc0c912a71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1378790516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7e49db466d4c0a83700e2e917c78be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf001cf21-b5", "ovs_interfaceid": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:57:29 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Releasing lock "refresh_cache-301cc74c-0322-47c3-be22-a638592a755a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:57:29 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Updated the network info_cache for instance {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 12:57:29 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:57:30 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:57:30 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:57:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:57:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:57:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 12:57:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:57:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:57:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:57:34 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:57:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:57:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:57:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:57:34 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:57:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:57:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:57:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:57:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:57:35 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:57:35 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:57:35 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=8958MB free_disk=24.838401794433594GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:57:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:57:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:57:35 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 301cc74c-0322-47c3-be22-a638592a755a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:57:35 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:57:35 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:57:35 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:57:35 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:57:35 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:57:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.209s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:57:36 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:57:38 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:57:43 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:57:44 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:57:48 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:57:53 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:57:53 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:57:53 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 12:57:53 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:57:53 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:57:53 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:57:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:57:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:57:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 12:57:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:57:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:57:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:58:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:58:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:58:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:58:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:58:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 12:58:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:58:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:58:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:58:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:58:20 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:58:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:58:26 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:58:26 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:58:27 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:58:28 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:58:28 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:58:28 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 12:58:28 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:58:28 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:58:28 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:58:29 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:58:29 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:58:29 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Rebuilding the list of instances to heal {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 12:58:29 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "refresh_cache-301cc74c-0322-47c3-be22-a638592a755a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:58:29 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquired lock "refresh_cache-301cc74c-0322-47c3-be22-a638592a755a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:58:29 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Forcefully refreshing network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 12:58:29 user nova-compute[74840]: DEBUG nova.objects.instance [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lazy-loading 'info_cache' on Instance uuid 301cc74c-0322-47c3-be22-a638592a755a {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:58:30 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Updating instance_info_cache with network_info: [{"id": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "address": "fa:16:3e:f3:fc:27", "network": {"id": "515bf382-a9c9-4096-9de0-23fc0c912a71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1378790516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7e49db466d4c0a83700e2e917c78be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf001cf21-b5", "ovs_interfaceid": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:58:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Releasing lock "refresh_cache-301cc74c-0322-47c3-be22-a638592a755a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:58:30 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Updated the network info_cache for instance {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 12:58:30 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:58:31 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:58:31 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:58:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:58:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:58:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 12:58:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:58:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 12:58:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:58:34 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:58:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:58:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:58:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:58:34 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:58:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:58:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:58:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:58:35 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:58:35 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:58:35 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:58:35 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=8972MB free_disk=24.837867736816406GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:58:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:58:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:58:35 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 301cc74c-0322-47c3-be22-a638592a755a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 12:58:35 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:58:35 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:58:35 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:58:35 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:58:35 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:58:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.202s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:58:37 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:58:38 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:58:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:58:43 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:58:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-7c802ced-115a-4bd3-922d-1496911186fa tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Acquiring lock "301cc74c-0322-47c3-be22-a638592a755a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:58:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-7c802ced-115a-4bd3-922d-1496911186fa tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "301cc74c-0322-47c3-be22-a638592a755a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:58:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-7c802ced-115a-4bd3-922d-1496911186fa tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Acquiring lock "301cc74c-0322-47c3-be22-a638592a755a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:58:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-7c802ced-115a-4bd3-922d-1496911186fa tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "301cc74c-0322-47c3-be22-a638592a755a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:58:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-7c802ced-115a-4bd3-922d-1496911186fa tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "301cc74c-0322-47c3-be22-a638592a755a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:58:43 user nova-compute[74840]: INFO nova.compute.manager [None req-7c802ced-115a-4bd3-922d-1496911186fa tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Terminating instance
Nov 08 12:58:43 user nova-compute[74840]: DEBUG nova.compute.manager [None req-7c802ced-115a-4bd3-922d-1496911186fa tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Start destroying the instance on the hypervisor. {{(pid=74840) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 12:58:43 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:58:43 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:58:43 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:58:43 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:58:43 user nova-compute[74840]: DEBUG nova.compute.manager [req-26eac072-d8a8-4aae-a7bf-b2e61720aaa5 req-d035e4e5-b565-45ad-8ecb-b605e94d6632 service nova] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Received event network-vif-unplugged-f001cf21-b5b2-4a55-bcc4-5451e3a73170 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:58:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-26eac072-d8a8-4aae-a7bf-b2e61720aaa5 req-d035e4e5-b565-45ad-8ecb-b605e94d6632 service nova] Acquiring lock "301cc74c-0322-47c3-be22-a638592a755a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:58:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-26eac072-d8a8-4aae-a7bf-b2e61720aaa5 req-d035e4e5-b565-45ad-8ecb-b605e94d6632 service nova] Lock "301cc74c-0322-47c3-be22-a638592a755a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:58:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-26eac072-d8a8-4aae-a7bf-b2e61720aaa5 req-d035e4e5-b565-45ad-8ecb-b605e94d6632 service nova] Lock "301cc74c-0322-47c3-be22-a638592a755a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:58:43 user nova-compute[74840]: DEBUG nova.compute.manager [req-26eac072-d8a8-4aae-a7bf-b2e61720aaa5 req-d035e4e5-b565-45ad-8ecb-b605e94d6632 service nova] [instance: 301cc74c-0322-47c3-be22-a638592a755a] No waiting events found dispatching network-vif-unplugged-f001cf21-b5b2-4a55-bcc4-5451e3a73170 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:58:43 user nova-compute[74840]: DEBUG nova.compute.manager [req-26eac072-d8a8-4aae-a7bf-b2e61720aaa5 req-d035e4e5-b565-45ad-8ecb-b605e94d6632 service nova] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Received event network-vif-unplugged-f001cf21-b5b2-4a55-bcc4-5451e3a73170 for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 12:58:43 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:58:43 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Instance destroyed successfully.
Nov 08 12:58:43 user nova-compute[74840]: DEBUG nova.objects.instance [None req-7c802ced-115a-4bd3-922d-1496911186fa tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lazy-loading 'resources' on Instance uuid 301cc74c-0322-47c3-be22-a638592a755a {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:58:43 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-7c802ced-115a-4bd3-922d-1496911186fa tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:48:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1268219938',display_name='tempest-AttachVolumeTestJSON-server-1268219938',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1268219938',id=49,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1Q3P8MX65K+ewG2SwkHJsjLBfhR/vPyPX9ltkFerXJUdJghXZzKfH0GZA2WFBtwb7dErHNHWFrK86n2OEQBsGNeWGod8BzroVKFZNXS962Jzp5znHBxWuSa1al8Vb4Ew==',key_name='tempest-keypair-654921536',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:48:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6e7e49db466d4c0a83700e2e917c78be',ramdisk_id='',reservation_id='r-cr0fa74z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-116807071',owner_user_name='tempest-AttachVolumeTestJSON-116807071-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:56:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9667df3a519d47809b332f8457cd1154',uuid=301cc74c-0322-47c3-be22-a638592a755a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "address": "fa:16:3e:f3:fc:27", "network": {"id": "515bf382-a9c9-4096-9de0-23fc0c912a71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1378790516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7e49db466d4c0a83700e2e917c78be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf001cf21-b5", "ovs_interfaceid": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 12:58:43 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-7c802ced-115a-4bd3-922d-1496911186fa tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Converting VIF {"id": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "address": "fa:16:3e:f3:fc:27", "network": {"id": "515bf382-a9c9-4096-9de0-23fc0c912a71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1378790516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7e49db466d4c0a83700e2e917c78be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf001cf21-b5", "ovs_interfaceid": "f001cf21-b5b2-4a55-bcc4-5451e3a73170", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:58:43 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-7c802ced-115a-4bd3-922d-1496911186fa tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:fc:27,bridge_name='br-int',has_traffic_filtering=True,id=f001cf21-b5b2-4a55-bcc4-5451e3a73170,network=Network(515bf382-a9c9-4096-9de0-23fc0c912a71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf001cf21-b5') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:58:43 user nova-compute[74840]: DEBUG os_vif [None req-7c802ced-115a-4bd3-922d-1496911186fa tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:fc:27,bridge_name='br-int',has_traffic_filtering=True,id=f001cf21-b5b2-4a55-bcc4-5451e3a73170,network=Network(515bf382-a9c9-4096-9de0-23fc0c912a71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf001cf21-b5') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 12:58:43 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:58:43 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf001cf21-b5, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:58:43 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:58:43 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:58:43 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:58:43 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=099f1f0e-2474-4842-8a24-aa1e55212a04) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:58:43 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:58:43 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:58:43 user nova-compute[74840]: INFO os_vif [None req-7c802ced-115a-4bd3-922d-1496911186fa tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:fc:27,bridge_name='br-int',has_traffic_filtering=True,id=f001cf21-b5b2-4a55-bcc4-5451e3a73170,network=Network(515bf382-a9c9-4096-9de0-23fc0c912a71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf001cf21-b5')
Nov 08 12:58:43 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-7c802ced-115a-4bd3-922d-1496911186fa tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Deleting instance files /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a_del
Nov 08 12:58:43 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-7c802ced-115a-4bd3-922d-1496911186fa tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Deletion of /opt/stack/data/nova/instances/301cc74c-0322-47c3-be22-a638592a755a_del complete
Nov 08 12:58:44 user nova-compute[74840]: INFO nova.compute.manager [None req-7c802ced-115a-4bd3-922d-1496911186fa tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 08 12:58:44 user nova-compute[74840]: DEBUG oslo.service.loopingcall [None req-7c802ced-115a-4bd3-922d-1496911186fa tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74840) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 12:58:44 user nova-compute[74840]: DEBUG nova.compute.manager [-] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Deallocating network for instance {{(pid=74840) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 12:58:44 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 301cc74c-0322-47c3-be22-a638592a755a] deallocate_for_instance() {{(pid=74840) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 12:58:44 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:58:44 user nova-compute[74840]: INFO nova.compute.manager [-] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Took 0.85 seconds to deallocate network for instance.
Nov 08 12:58:44 user nova-compute[74840]: DEBUG nova.compute.manager [req-e91f41ce-fc03-446f-8e80-667ee89f0c1d req-108d6e5d-a877-4d2c-a062-f8f42732b543 service nova] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Received event network-vif-deleted-f001cf21-b5b2-4a55-bcc4-5451e3a73170 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:58:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-7c802ced-115a-4bd3-922d-1496911186fa tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:58:44 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-7c802ced-115a-4bd3-922d-1496911186fa tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:58:45 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-7c802ced-115a-4bd3-922d-1496911186fa tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:58:45 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-7c802ced-115a-4bd3-922d-1496911186fa tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:58:45 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-7c802ced-115a-4bd3-922d-1496911186fa tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.103s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:58:45 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-7c802ced-115a-4bd3-922d-1496911186fa tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Deleted allocations for instance 301cc74c-0322-47c3-be22-a638592a755a
Nov 08 12:58:45 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-7c802ced-115a-4bd3-922d-1496911186fa tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "301cc74c-0322-47c3-be22-a638592a755a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.023s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:58:45 user nova-compute[74840]: DEBUG nova.compute.manager [req-58693dca-1bcd-453a-be4a-3ecc518ed9fd req-79b71cce-2894-4e9e-9a16-1c7ca91203b1 service nova] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Received event network-vif-plugged-f001cf21-b5b2-4a55-bcc4-5451e3a73170 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:58:45 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-58693dca-1bcd-453a-be4a-3ecc518ed9fd req-79b71cce-2894-4e9e-9a16-1c7ca91203b1 service nova] Acquiring lock "301cc74c-0322-47c3-be22-a638592a755a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:58:45 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-58693dca-1bcd-453a-be4a-3ecc518ed9fd req-79b71cce-2894-4e9e-9a16-1c7ca91203b1 service nova] Lock "301cc74c-0322-47c3-be22-a638592a755a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:58:45 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-58693dca-1bcd-453a-be4a-3ecc518ed9fd req-79b71cce-2894-4e9e-9a16-1c7ca91203b1 service nova] Lock "301cc74c-0322-47c3-be22-a638592a755a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:58:45 user nova-compute[74840]: DEBUG nova.compute.manager [req-58693dca-1bcd-453a-be4a-3ecc518ed9fd req-79b71cce-2894-4e9e-9a16-1c7ca91203b1 service nova] [instance: 301cc74c-0322-47c3-be22-a638592a755a] No waiting events found dispatching network-vif-plugged-f001cf21-b5b2-4a55-bcc4-5451e3a73170 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:58:45 user nova-compute[74840]: WARNING nova.compute.manager [req-58693dca-1bcd-453a-be4a-3ecc518ed9fd req-79b71cce-2894-4e9e-9a16-1c7ca91203b1 service nova] [instance: 301cc74c-0322-47c3-be22-a638592a755a] Received unexpected event network-vif-plugged-f001cf21-b5b2-4a55-bcc4-5451e3a73170 for instance with vm_state deleted and task_state None.
Nov 08 12:58:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:58:48 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:58:53 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:58:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:59:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:59:08 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:59:13 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:59:18 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:59:21 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:59:23 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:59:26 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:59:26 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 12:59:28 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:59:29 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:59:30 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:59:30 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 12:59:30 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Rebuilding the list of instances to heal {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 12:59:30 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Didn't find any instances for network info cache update. {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 12:59:31 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:59:31 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:59:32 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:59:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:59:33 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:59:36 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:59:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:59:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:59:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:59:36 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 12:59:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Acquiring lock "89e914ff-ea4d-4780-a2db-50570d93b830" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:59:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "89e914ff-ea4d-4780-a2db-50570d93b830" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:59:37 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:59:37 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:59:37 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=9091MB free_disk=24.864971160888672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 12:59:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:59:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:59:37 user nova-compute[74840]: DEBUG nova.compute.manager [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Starting instance... {{(pid=74840) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 12:59:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:59:37 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 89e914ff-ea4d-4780-a2db-50570d93b830 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 08 12:59:37 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 12:59:37 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 12:59:37 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:59:37 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:59:37 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 12:59:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.194s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:59:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.105s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:59:37 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 12:59:37 user nova-compute[74840]: INFO nova.compute.claims [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Claim successful on node user
Nov 08 12:59:37 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 12:59:37 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 12:59:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.172s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:59:37 user nova-compute[74840]: DEBUG nova.compute.manager [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Start building networks asynchronously for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 12:59:37 user nova-compute[74840]: DEBUG nova.compute.manager [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Allocating IP information in the background. {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 12:59:37 user nova-compute[74840]: DEBUG nova.network.neutron [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 12:59:37 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 12:59:37 user nova-compute[74840]: DEBUG nova.compute.manager [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Start building block device mappings for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 12:59:37 user nova-compute[74840]: DEBUG nova.compute.manager [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Start spawning the instance on the hypervisor. {{(pid=74840) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 12:59:37 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 12:59:37 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Creating image(s)
Nov 08 12:59:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Acquiring lock "/opt/stack/data/nova/instances/89e914ff-ea4d-4780-a2db-50570d93b830/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:59:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "/opt/stack/data/nova/instances/89e914ff-ea4d-4780-a2db-50570d93b830/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:59:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "/opt/stack/data/nova/instances/89e914ff-ea4d-4780-a2db-50570d93b830/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:59:37 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:59:37 user nova-compute[74840]: DEBUG nova.policy [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9667df3a519d47809b332f8457cd1154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e7e49db466d4c0a83700e2e917c78be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 12:59:37 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.180s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:59:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Acquiring lock "5d26578eba85497f494c575690c4248f381a0fe6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:59:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:59:37 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:59:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.169s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:59:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/89e914ff-ea4d-4780-a2db-50570d93b830/disk 1073741824 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:59:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/89e914ff-ea4d-4780-a2db-50570d93b830/disk 1073741824" returned: 0 in 0.046s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:59:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:59:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:59:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.185s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:59:38 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Checking if we can resize image /opt/stack/data/nova/instances/89e914ff-ea4d-4780-a2db-50570d93b830/disk. size=1073741824 {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 12:59:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e914ff-ea4d-4780-a2db-50570d93b830/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 12:59:38 user nova-compute[74840]: DEBUG nova.network.neutron [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Successfully created port: b3224b82-b3d3-4434-bfc2-e25a862234ae {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 12:59:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e914ff-ea4d-4780-a2db-50570d93b830/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 12:59:38 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Cannot resize image /opt/stack/data/nova/instances/89e914ff-ea4d-4780-a2db-50570d93b830/disk to a smaller size. {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 12:59:38 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Created local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 12:59:38 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Ensure instance console log exists: /opt/stack/data/nova/instances/89e914ff-ea4d-4780-a2db-50570d93b830/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 12:59:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:59:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:59:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:59:38 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:59:38 user nova-compute[74840]: DEBUG nova.network.neutron [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Successfully updated port: b3224b82-b3d3-4434-bfc2-e25a862234ae {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Acquiring lock "refresh_cache-89e914ff-ea4d-4780-a2db-50570d93b830" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Acquired lock "refresh_cache-89e914ff-ea4d-4780-a2db-50570d93b830" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG nova.network.neutron [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG nova.network.neutron [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG nova.compute.manager [req-457baa7f-2edd-4878-8d71-e5dd99c804a3 req-7116d660-8b05-47f4-8660-50320931f15a service nova] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Received event network-changed-b3224b82-b3d3-4434-bfc2-e25a862234ae {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG nova.compute.manager [req-457baa7f-2edd-4878-8d71-e5dd99c804a3 req-7116d660-8b05-47f4-8660-50320931f15a service nova] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Refreshing instance network info cache due to event network-changed-b3224b82-b3d3-4434-bfc2-e25a862234ae. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-457baa7f-2edd-4878-8d71-e5dd99c804a3 req-7116d660-8b05-47f4-8660-50320931f15a service nova] Acquiring lock "refresh_cache-89e914ff-ea4d-4780-a2db-50570d93b830" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG nova.network.neutron [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Updating instance_info_cache with network_info: [{"id": "b3224b82-b3d3-4434-bfc2-e25a862234ae", "address": "fa:16:3e:f0:c8:82", "network": {"id": "515bf382-a9c9-4096-9de0-23fc0c912a71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1378790516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7e49db466d4c0a83700e2e917c78be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3224b82-b3", "ovs_interfaceid": "b3224b82-b3d3-4434-bfc2-e25a862234ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Releasing lock "refresh_cache-89e914ff-ea4d-4780-a2db-50570d93b830" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG nova.compute.manager [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Instance network_info: |[{"id": "b3224b82-b3d3-4434-bfc2-e25a862234ae", "address": "fa:16:3e:f0:c8:82", "network": {"id": "515bf382-a9c9-4096-9de0-23fc0c912a71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1378790516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7e49db466d4c0a83700e2e917c78be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3224b82-b3", "ovs_interfaceid": "b3224b82-b3d3-4434-bfc2-e25a862234ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-457baa7f-2edd-4878-8d71-e5dd99c804a3 req-7116d660-8b05-47f4-8660-50320931f15a service nova] Acquired lock "refresh_cache-89e914ff-ea4d-4780-a2db-50570d93b830" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG nova.network.neutron [req-457baa7f-2edd-4878-8d71-e5dd99c804a3 req-7116d660-8b05-47f4-8660-50320931f15a service nova] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Refreshing network info cache for port b3224b82-b3d3-4434-bfc2-e25a862234ae {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Start _get_guest_xml network_info=[{"id": "b3224b82-b3d3-4434-bfc2-e25a862234ae", "address": "fa:16:3e:f0:c8:82", "network": {"id": "515bf382-a9c9-4096-9de0-23fc0c912a71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1378790516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7e49db466d4c0a83700e2e917c78be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3224b82-b3", "ovs_interfaceid": "b3224b82-b3d3-4434-bfc2-e25a862234ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'image_id': '4fa17706-d304-4117-a420-dab994c703dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 12:59:39 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:59:39 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 12:59:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:59:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-100535444',display_name='tempest-AttachVolumeTestJSON-server-100535444',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-100535444',id=51,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMT6QZbmT61xJw2qaMfwP4I1eqin67Le2SOxTH00eDL6YTkobNlIUMpBqO6ceVWPMBCqYKbcS9DzikbMpNH+3r12NTiBaRFhCY30zoDzExfaT9L2aP1M/MO5yXvKLUWi3A==',key_name='tempest-keypair-1202362640',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e7e49db466d4c0a83700e2e917c78be',ramdisk_id='',reservation_id='r-xcxjt4r0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-116807071',owner_user_name='tempest-AttachVolumeTestJSON-116807071-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:59:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9667df3a519d47809b332f8457cd1154',uuid=89e914ff-ea4d-4780-a2db-50570d93b830,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3224b82-b3d3-4434-bfc2-e25a862234ae", "address": "fa:16:3e:f0:c8:82", "network": {"id": "515bf382-a9c9-4096-9de0-23fc0c912a71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1378790516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7e49db466d4c0a83700e2e917c78be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3224b82-b3", "ovs_interfaceid": "b3224b82-b3d3-4434-bfc2-e25a862234ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Converting VIF {"id": "b3224b82-b3d3-4434-bfc2-e25a862234ae", "address": "fa:16:3e:f0:c8:82", "network": {"id": "515bf382-a9c9-4096-9de0-23fc0c912a71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1378790516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7e49db466d4c0a83700e2e917c78be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3224b82-b3", "ovs_interfaceid": "b3224b82-b3d3-4434-bfc2-e25a862234ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:c8:82,bridge_name='br-int',has_traffic_filtering=True,id=b3224b82-b3d3-4434-bfc2-e25a862234ae,network=Network(515bf382-a9c9-4096-9de0-23fc0c912a71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3224b82-b3') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG nova.objects.instance [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lazy-loading 'pci_devices' on Instance uuid 89e914ff-ea4d-4780-a2db-50570d93b830 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] End _get_guest_xml xml=<domain type="kvm">
Nov 08 12:59:39 user nova-compute[74840]:   <uuid>89e914ff-ea4d-4780-a2db-50570d93b830</uuid>
Nov 08 12:59:39 user nova-compute[74840]:   <name>instance-00000033</name>
Nov 08 12:59:39 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 12:59:39 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 12:59:39 user nova-compute[74840]:   <metadata>
Nov 08 12:59:39 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 12:59:39 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 12:59:39 user nova-compute[74840]:       <nova:name>tempest-AttachVolumeTestJSON-server-100535444</nova:name>
Nov 08 12:59:39 user nova-compute[74840]:       <nova:creationTime>2023-11-08 12:59:39</nova:creationTime>
Nov 08 12:59:39 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 12:59:39 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 12:59:39 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 12:59:39 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 12:59:39 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 12:59:39 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 12:59:39 user nova-compute[74840]:       </nova:flavor>
Nov 08 12:59:39 user nova-compute[74840]:       <nova:owner>
Nov 08 12:59:39 user nova-compute[74840]:         <nova:user uuid="9667df3a519d47809b332f8457cd1154">tempest-AttachVolumeTestJSON-116807071-project-member</nova:user>
Nov 08 12:59:39 user nova-compute[74840]:         <nova:project uuid="6e7e49db466d4c0a83700e2e917c78be">tempest-AttachVolumeTestJSON-116807071</nova:project>
Nov 08 12:59:39 user nova-compute[74840]:       </nova:owner>
Nov 08 12:59:39 user nova-compute[74840]:       <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 12:59:39 user nova-compute[74840]:       <nova:ports>
Nov 08 12:59:39 user nova-compute[74840]:         <nova:port uuid="b3224b82-b3d3-4434-bfc2-e25a862234ae">
Nov 08 12:59:39 user nova-compute[74840]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 12:59:39 user nova-compute[74840]:         </nova:port>
Nov 08 12:59:39 user nova-compute[74840]:       </nova:ports>
Nov 08 12:59:39 user nova-compute[74840]:     </nova:instance>
Nov 08 12:59:39 user nova-compute[74840]:   </metadata>
Nov 08 12:59:39 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 12:59:39 user nova-compute[74840]:     <system>
Nov 08 12:59:39 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 12:59:39 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 12:59:39 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 12:59:39 user nova-compute[74840]:       <entry name="serial">89e914ff-ea4d-4780-a2db-50570d93b830</entry>
Nov 08 12:59:39 user nova-compute[74840]:       <entry name="uuid">89e914ff-ea4d-4780-a2db-50570d93b830</entry>
Nov 08 12:59:39 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 12:59:39 user nova-compute[74840]:     </system>
Nov 08 12:59:39 user nova-compute[74840]:   </sysinfo>
Nov 08 12:59:39 user nova-compute[74840]:   <os>
Nov 08 12:59:39 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 12:59:39 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 12:59:39 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 12:59:39 user nova-compute[74840]:   </os>
Nov 08 12:59:39 user nova-compute[74840]:   <features>
Nov 08 12:59:39 user nova-compute[74840]:     <acpi/>
Nov 08 12:59:39 user nova-compute[74840]:     <apic/>
Nov 08 12:59:39 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 12:59:39 user nova-compute[74840]:   </features>
Nov 08 12:59:39 user nova-compute[74840]:   <clock offset="utc">
Nov 08 12:59:39 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 12:59:39 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 12:59:39 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 12:59:39 user nova-compute[74840]:   </clock>
Nov 08 12:59:39 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 12:59:39 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 12:59:39 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 12:59:39 user nova-compute[74840]:   </cpu>
Nov 08 12:59:39 user nova-compute[74840]:   <devices>
Nov 08 12:59:39 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 12:59:39 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 12:59:39 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/89e914ff-ea4d-4780-a2db-50570d93b830/disk"/>
Nov 08 12:59:39 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 12:59:39 user nova-compute[74840]:     </disk>
Nov 08 12:59:39 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 12:59:39 user nova-compute[74840]:       <mac address="fa:16:3e:f0:c8:82"/>
Nov 08 12:59:39 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:59:39 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 12:59:39 user nova-compute[74840]:       <target dev="tapb3224b82-b3"/>
Nov 08 12:59:39 user nova-compute[74840]:     </interface>
Nov 08 12:59:39 user nova-compute[74840]:     <serial type="pty">
Nov 08 12:59:39 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/89e914ff-ea4d-4780-a2db-50570d93b830/console.log" append="off"/>
Nov 08 12:59:39 user nova-compute[74840]:     </serial>
Nov 08 12:59:39 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 12:59:39 user nova-compute[74840]:     <video>
Nov 08 12:59:39 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 12:59:39 user nova-compute[74840]:     </video>
Nov 08 12:59:39 user nova-compute[74840]:     <rng model="virtio">
Nov 08 12:59:39 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 12:59:39 user nova-compute[74840]:     </rng>
Nov 08 12:59:39 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 12:59:39 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 12:59:39 user nova-compute[74840]:       <stats period="10"/>
Nov 08 12:59:39 user nova-compute[74840]:     </memballoon>
Nov 08 12:59:39 user nova-compute[74840]:   </devices>
Nov 08 12:59:39 user nova-compute[74840]: </domain>
Nov 08 12:59:39 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:59:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-100535444',display_name='tempest-AttachVolumeTestJSON-server-100535444',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-100535444',id=51,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMT6QZbmT61xJw2qaMfwP4I1eqin67Le2SOxTH00eDL6YTkobNlIUMpBqO6ceVWPMBCqYKbcS9DzikbMpNH+3r12NTiBaRFhCY30zoDzExfaT9L2aP1M/MO5yXvKLUWi3A==',key_name='tempest-keypair-1202362640',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e7e49db466d4c0a83700e2e917c78be',ramdisk_id='',reservation_id='r-xcxjt4r0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-116807071',owner_user_name='tempest-AttachVolumeTestJSON-116807071-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T12:59:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9667df3a519d47809b332f8457cd1154',uuid=89e914ff-ea4d-4780-a2db-50570d93b830,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3224b82-b3d3-4434-bfc2-e25a862234ae", "address": "fa:16:3e:f0:c8:82", "network": {"id": "515bf382-a9c9-4096-9de0-23fc0c912a71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1378790516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7e49db466d4c0a83700e2e917c78be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3224b82-b3", "ovs_interfaceid": "b3224b82-b3d3-4434-bfc2-e25a862234ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Converting VIF {"id": "b3224b82-b3d3-4434-bfc2-e25a862234ae", "address": "fa:16:3e:f0:c8:82", "network": {"id": "515bf382-a9c9-4096-9de0-23fc0c912a71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1378790516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7e49db466d4c0a83700e2e917c78be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3224b82-b3", "ovs_interfaceid": "b3224b82-b3d3-4434-bfc2-e25a862234ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:c8:82,bridge_name='br-int',has_traffic_filtering=True,id=b3224b82-b3d3-4434-bfc2-e25a862234ae,network=Network(515bf382-a9c9-4096-9de0-23fc0c912a71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3224b82-b3') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG os_vif [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:c8:82,bridge_name='br-int',has_traffic_filtering=True,id=b3224b82-b3d3-4434-bfc2-e25a862234ae,network=Network(515bf382-a9c9-4096-9de0-23fc0c912a71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3224b82-b3') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0a1e3403-dc28-5c5f-a77f-7ffa3f825003', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3224b82-b3, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb3224b82-b3, col_values=(('qos', UUID('9a262c7e-164d-462c-88d0-6cb93b370d7f')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb3224b82-b3, col_values=(('external_ids', {'iface-id': 'b3224b82-b3d3-4434-bfc2-e25a862234ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:c8:82', 'vm-uuid': '89e914ff-ea4d-4780-a2db-50570d93b830'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:59:39 user nova-compute[74840]: INFO os_vif [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:c8:82,bridge_name='br-int',has_traffic_filtering=True,id=b3224b82-b3d3-4434-bfc2-e25a862234ae,network=Network(515bf382-a9c9-4096-9de0-23fc0c912a71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3224b82-b3')
Nov 08 12:59:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 12:59:39 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] No VIF found with MAC fa:16:3e:f0:c8:82, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 12:59:40 user nova-compute[74840]: DEBUG nova.network.neutron [req-457baa7f-2edd-4878-8d71-e5dd99c804a3 req-7116d660-8b05-47f4-8660-50320931f15a service nova] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Updated VIF entry in instance network info cache for port b3224b82-b3d3-4434-bfc2-e25a862234ae. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 12:59:40 user nova-compute[74840]: DEBUG nova.network.neutron [req-457baa7f-2edd-4878-8d71-e5dd99c804a3 req-7116d660-8b05-47f4-8660-50320931f15a service nova] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Updating instance_info_cache with network_info: [{"id": "b3224b82-b3d3-4434-bfc2-e25a862234ae", "address": "fa:16:3e:f0:c8:82", "network": {"id": "515bf382-a9c9-4096-9de0-23fc0c912a71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1378790516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7e49db466d4c0a83700e2e917c78be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3224b82-b3", "ovs_interfaceid": "b3224b82-b3d3-4434-bfc2-e25a862234ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 12:59:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-457baa7f-2edd-4878-8d71-e5dd99c804a3 req-7116d660-8b05-47f4-8660-50320931f15a service nova] Releasing lock "refresh_cache-89e914ff-ea4d-4780-a2db-50570d93b830" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 12:59:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:59:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:59:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:59:41 user nova-compute[74840]: DEBUG nova.compute.manager [req-a1eb698a-a89d-4422-ba6c-cb02af1d6aff req-faed41df-f33a-4931-99b5-d975be15307b service nova] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Received event network-vif-plugged-b3224b82-b3d3-4434-bfc2-e25a862234ae {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:59:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a1eb698a-a89d-4422-ba6c-cb02af1d6aff req-faed41df-f33a-4931-99b5-d975be15307b service nova] Acquiring lock "89e914ff-ea4d-4780-a2db-50570d93b830-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:59:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a1eb698a-a89d-4422-ba6c-cb02af1d6aff req-faed41df-f33a-4931-99b5-d975be15307b service nova] Lock "89e914ff-ea4d-4780-a2db-50570d93b830-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:59:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a1eb698a-a89d-4422-ba6c-cb02af1d6aff req-faed41df-f33a-4931-99b5-d975be15307b service nova] Lock "89e914ff-ea4d-4780-a2db-50570d93b830-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:59:41 user nova-compute[74840]: DEBUG nova.compute.manager [req-a1eb698a-a89d-4422-ba6c-cb02af1d6aff req-faed41df-f33a-4931-99b5-d975be15307b service nova] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] No waiting events found dispatching network-vif-plugged-b3224b82-b3d3-4434-bfc2-e25a862234ae {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:59:41 user nova-compute[74840]: WARNING nova.compute.manager [req-a1eb698a-a89d-4422-ba6c-cb02af1d6aff req-faed41df-f33a-4931-99b5-d975be15307b service nova] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Received unexpected event network-vif-plugged-b3224b82-b3d3-4434-bfc2-e25a862234ae for instance with vm_state building and task_state spawning.
Nov 08 12:59:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:59:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:59:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:59:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:59:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:59:43 user nova-compute[74840]: DEBUG nova.compute.manager [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 12:59:43 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 12:59:43 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Instance spawned successfully.
Nov 08 12:59:43 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 12:59:43 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Found default for hw_cdrom_bus of ide {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:59:43 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Found default for hw_disk_bus of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:59:43 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:59:43 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:59:43 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Found default for hw_video_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:59:43 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Found default for hw_vif_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 12:59:43 user nova-compute[74840]: INFO nova.compute.manager [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Took 5.71 seconds to spawn the instance on the hypervisor.
Nov 08 12:59:43 user nova-compute[74840]: DEBUG nova.compute.manager [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 12:59:43 user nova-compute[74840]: DEBUG nova.compute.manager [req-8fea9190-fb2e-426a-ad16-8a621788c8fc req-78ca324c-e10d-4a13-b18e-89a6e6871916 service nova] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Received event network-vif-plugged-b3224b82-b3d3-4434-bfc2-e25a862234ae {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 12:59:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8fea9190-fb2e-426a-ad16-8a621788c8fc req-78ca324c-e10d-4a13-b18e-89a6e6871916 service nova] Acquiring lock "89e914ff-ea4d-4780-a2db-50570d93b830-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 12:59:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8fea9190-fb2e-426a-ad16-8a621788c8fc req-78ca324c-e10d-4a13-b18e-89a6e6871916 service nova] Lock "89e914ff-ea4d-4780-a2db-50570d93b830-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 12:59:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8fea9190-fb2e-426a-ad16-8a621788c8fc req-78ca324c-e10d-4a13-b18e-89a6e6871916 service nova] Lock "89e914ff-ea4d-4780-a2db-50570d93b830-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:59:43 user nova-compute[74840]: DEBUG nova.compute.manager [req-8fea9190-fb2e-426a-ad16-8a621788c8fc req-78ca324c-e10d-4a13-b18e-89a6e6871916 service nova] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] No waiting events found dispatching network-vif-plugged-b3224b82-b3d3-4434-bfc2-e25a862234ae {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 12:59:43 user nova-compute[74840]: WARNING nova.compute.manager [req-8fea9190-fb2e-426a-ad16-8a621788c8fc req-78ca324c-e10d-4a13-b18e-89a6e6871916 service nova] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Received unexpected event network-vif-plugged-b3224b82-b3d3-4434-bfc2-e25a862234ae for instance with vm_state building and task_state spawning.
Nov 08 12:59:43 user nova-compute[74840]: INFO nova.compute.manager [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Took 6.30 seconds to build instance.
Nov 08 12:59:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-e8842255-9b83-4ee8-a018-fa13b09e69a0 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "89e914ff-ea4d-4780-a2db-50570d93b830" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.407s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 12:59:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:59:46 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 12:59:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:59:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:59:54 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:59:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 12:59:59 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:00:02 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:00:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:00:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:00:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:00:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:00:14 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:00:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:00:23 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:00:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:00:28 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:00:28 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 13:00:29 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:00:29 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:00:31 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:00:31 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 13:00:31 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Rebuilding the list of instances to heal {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 13:00:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "refresh_cache-89e914ff-ea4d-4780-a2db-50570d93b830" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:00:31 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquired lock "refresh_cache-89e914ff-ea4d-4780-a2db-50570d93b830" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:00:31 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Forcefully refreshing network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 13:00:31 user nova-compute[74840]: DEBUG nova.objects.instance [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lazy-loading 'info_cache' on Instance uuid 89e914ff-ea4d-4780-a2db-50570d93b830 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:00:32 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Updating instance_info_cache with network_info: [{"id": "b3224b82-b3d3-4434-bfc2-e25a862234ae", "address": "fa:16:3e:f0:c8:82", "network": {"id": "515bf382-a9c9-4096-9de0-23fc0c912a71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1378790516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7e49db466d4c0a83700e2e917c78be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3224b82-b3", "ovs_interfaceid": "b3224b82-b3d3-4434-bfc2-e25a862234ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:00:32 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Releasing lock "refresh_cache-89e914ff-ea4d-4780-a2db-50570d93b830" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:00:32 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Updated the network info_cache for instance {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 13:00:32 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:00:33 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:00:34 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:00:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:00:36 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:00:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:00:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:00:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:00:36 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 13:00:36 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e914ff-ea4d-4780-a2db-50570d93b830/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:00:36 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e914ff-ea4d-4780-a2db-50570d93b830/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:00:36 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e914ff-ea4d-4780-a2db-50570d93b830/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:00:37 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e914ff-ea4d-4780-a2db-50570d93b830/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:00:37 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:00:37 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:00:37 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=8997MB free_disk=24.82770538330078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 13:00:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:00:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:00:37 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 89e914ff-ea4d-4780-a2db-50570d93b830 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:00:37 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 13:00:37 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 13:00:37 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:00:37 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:00:37 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 13:00:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:00:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:00:40 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:00:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:00:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:00:54 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:00:59 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:01:01 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:01:01 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74840) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 13:01:01 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:01:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:01:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:01:14 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:01:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:01:23 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:01:23 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Cleaning up deleted instances {{(pid=74840) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 13:01:23 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] There are 0 instances to clean {{(pid=74840) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 13:01:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:01:25 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:01:28 user nova-compute[74840]: DEBUG nova.compute.manager [req-dfea70da-6bcb-4975-bf47-fab5d3fb9539 req-b650216c-5e5d-4c6b-b864-efe36a2114b2 service nova] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Received event network-changed-b3224b82-b3d3-4434-bfc2-e25a862234ae {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:01:28 user nova-compute[74840]: DEBUG nova.compute.manager [req-dfea70da-6bcb-4975-bf47-fab5d3fb9539 req-b650216c-5e5d-4c6b-b864-efe36a2114b2 service nova] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Refreshing instance network info cache due to event network-changed-b3224b82-b3d3-4434-bfc2-e25a862234ae. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:01:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-dfea70da-6bcb-4975-bf47-fab5d3fb9539 req-b650216c-5e5d-4c6b-b864-efe36a2114b2 service nova] Acquiring lock "refresh_cache-89e914ff-ea4d-4780-a2db-50570d93b830" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:01:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-dfea70da-6bcb-4975-bf47-fab5d3fb9539 req-b650216c-5e5d-4c6b-b864-efe36a2114b2 service nova] Acquired lock "refresh_cache-89e914ff-ea4d-4780-a2db-50570d93b830" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:01:28 user nova-compute[74840]: DEBUG nova.network.neutron [req-dfea70da-6bcb-4975-bf47-fab5d3fb9539 req-b650216c-5e5d-4c6b-b864-efe36a2114b2 service nova] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Refreshing network info cache for port b3224b82-b3d3-4434-bfc2-e25a862234ae {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:01:28 user nova-compute[74840]: DEBUG nova.network.neutron [req-dfea70da-6bcb-4975-bf47-fab5d3fb9539 req-b650216c-5e5d-4c6b-b864-efe36a2114b2 service nova] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Updated VIF entry in instance network info cache for port b3224b82-b3d3-4434-bfc2-e25a862234ae. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:01:28 user nova-compute[74840]: DEBUG nova.network.neutron [req-dfea70da-6bcb-4975-bf47-fab5d3fb9539 req-b650216c-5e5d-4c6b-b864-efe36a2114b2 service nova] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Updating instance_info_cache with network_info: [{"id": "b3224b82-b3d3-4434-bfc2-e25a862234ae", "address": "fa:16:3e:f0:c8:82", "network": {"id": "515bf382-a9c9-4096-9de0-23fc0c912a71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1378790516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7e49db466d4c0a83700e2e917c78be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3224b82-b3", "ovs_interfaceid": "b3224b82-b3d3-4434-bfc2-e25a862234ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:01:28 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-dfea70da-6bcb-4975-bf47-fab5d3fb9539 req-b650216c-5e5d-4c6b-b864-efe36a2114b2 service nova] Releasing lock "refresh_cache-89e914ff-ea4d-4780-a2db-50570d93b830" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:01:28 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:01:28 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 13:01:29 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:01:29 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:01:29 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:01:29 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 13:01:29 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 13:01:29 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 13:01:29 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:01:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:01:33 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:01:33 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 13:01:33 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Rebuilding the list of instances to heal {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 13:01:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "refresh_cache-89e914ff-ea4d-4780-a2db-50570d93b830" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:01:33 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquired lock "refresh_cache-89e914ff-ea4d-4780-a2db-50570d93b830" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:01:33 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Forcefully refreshing network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 13:01:33 user nova-compute[74840]: DEBUG nova.objects.instance [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lazy-loading 'info_cache' on Instance uuid 89e914ff-ea4d-4780-a2db-50570d93b830 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:01:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Acquiring lock "89e914ff-ea4d-4780-a2db-50570d93b830" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:01:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "89e914ff-ea4d-4780-a2db-50570d93b830" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:01:34 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Updating instance_info_cache with network_info: [{"id": "b3224b82-b3d3-4434-bfc2-e25a862234ae", "address": "fa:16:3e:f0:c8:82", "network": {"id": "515bf382-a9c9-4096-9de0-23fc0c912a71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1378790516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7e49db466d4c0a83700e2e917c78be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3224b82-b3", "ovs_interfaceid": "b3224b82-b3d3-4434-bfc2-e25a862234ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:01:34 user nova-compute[74840]: DEBUG nova.objects.instance [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lazy-loading 'flavor' on Instance uuid 89e914ff-ea4d-4780-a2db-50570d93b830 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:01:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Releasing lock "refresh_cache-89e914ff-ea4d-4780-a2db-50570d93b830" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:01:34 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Updated the network info_cache for instance {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 13:01:34 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:01:34 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:01:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "89e914ff-ea4d-4780-a2db-50570d93b830" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:01:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Acquiring lock "89e914ff-ea4d-4780-a2db-50570d93b830" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:01:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "89e914ff-ea4d-4780-a2db-50570d93b830" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:01:34 user nova-compute[74840]: INFO nova.compute.manager [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Attaching volume da8145a8-5fd0-402a-bc89-39bfa8cd6c89 to /dev/vdb
Nov 08 13:01:34 user nova-compute[74840]: DEBUG os_brick.utils [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:01:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:01:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:01:34 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2889cca-7777-4922-86ff-ab483826ccc7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c8228a11e03c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:01:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:01:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:01:34 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ffd25a-f312-44c4-84b0-4b64fc945bf5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:01:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:01:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:01:34 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[496ece15-fc4f-40e5-be65-ad56822a42d1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:01:34 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd8b8fd-5697-4f18-92b8-55edc2323ccc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:01:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Running cmd (subprocess): nvme version {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:01:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] 'nvme version' failed. Not Retrying. {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:01:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] nvme not present on system {{(pid=74840) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 13:01:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:01:34 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:01:34 user nova-compute[74840]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 13:01:34 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38ea8d1-7cd2-4617-8a18-12bce3978fb2]: (4, '') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:01:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74840) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 13:01:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 13:01:34 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] LIGHTOS: no hostnqn found. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 13:01:34 user nova-compute[74840]: DEBUG os_brick.utils [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c8228a11e03c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:01:34 user nova-compute[74840]: DEBUG nova.virt.block_device [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Updating existing volume attachment record: 864b0b0c-6791-43f7-9f5d-d5198442ed9f {{(pid=74840) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 13:01:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:01:36 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:01:36 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:01:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:01:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:01:36 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:01:36 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 13:01:36 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e914ff-ea4d-4780-a2db-50570d93b830/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:01:37 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e914ff-ea4d-4780-a2db-50570d93b830/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:01:37 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e914ff-ea4d-4780-a2db-50570d93b830/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:01:37 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e914ff-ea4d-4780-a2db-50570d93b830/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:01:37 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:01:37 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:01:37 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=8986MB free_disk=24.826915740966797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 13:01:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:01:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:01:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:01:37 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 89e914ff-ea4d-4780-a2db-50570d93b830 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:01:37 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 13:01:37 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 13:01:37 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Refreshing inventories for resource provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 13:01:37 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Updating ProviderTree inventory for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 13:01:37 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Updating inventory in ProviderTree for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 13:01:37 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Refreshing aggregate associations for resource provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e, aggregates: None {{(pid=74840) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 13:01:37 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Refreshing trait associations for resource provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=74840) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 13:01:37 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:01:37 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:01:37 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 13:01:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.332s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:01:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:01:40 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:01:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:01:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:01:48 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:01:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:01:54 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Calling os-brick to attach iSCSI Volume {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XLScNvqO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:01:56 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:01:56 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:01:56 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:01:56 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:01:56 user nova-compute[74840]: INFO os_brick.initiator.connectors.iscsi [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 13:01:56 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89 -p 172.16.0.220:3260 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[248d2453-e818-4402-a4f8-35cbeedaed32]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 13:01:56 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89 -p 172.16.0.220:3260 --interface default --op new {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[8989f72c-0495-4ad5-bedd-46ea21ea14e2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89] added\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89] added
Nov 08 13:01:56 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e6c666-20a3-4d17-a9c3-200afa2185aa]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[720af886-faf2-495e-bd84-0717bde32d9f]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XLScNvqO {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XLScNvqO" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[c001ab5a-9edf-47c9-a125-648cd3c6be5b]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XLScNvqO'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e350cb-6f01-4469-b91f-093801f5c12b]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8df38d-c60f-401d-8f36-7518ef04ab66]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 13:01:56 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 13:01:56 user nova-compute[74840]:  {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:01:56 user nova-compute[74840]: WARNING os_brick.initiator.connectors.iscsi [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 13:01:56 user nova-compute[74840]: 
Nov 08 13:01:56 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89 -p 172.16.0.220:3260 --login {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e190db-5569-4122-a50c-d9acd918ab66]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89, portal: 172.16.0.220,3260]
Nov 08 13:01:56 user nova-compute[74840]: Login to [iface: default, target: iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89, portal: 172.16.0.220,3260] successful.
Nov 08 13:01:56 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7755b387-9ced-4869-a05f-9b0207a54afe]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e218984f-ae0b-4dfc-a5fc-4fb82720ac05]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89 (non-flash)
Nov 08 13:01:56 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89 (non-flash)
Nov 08 13:01:56 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Connected to 172.16.0.220:3260 {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=74840) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74840) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7352a954-c988-4d83-bf03-e7856fe2d557]: (4, ('- - 0', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 13:01:56 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XLScNvqO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 13:01:57 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:01:57 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23331353666313064', 'path': '/dev/sdb'} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:01:57 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23331353666313064', 'path': '/dev/sdb'} {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 13:01:57 user nova-compute[74840]: DEBUG nova.objects.instance [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lazy-loading 'flavor' on Instance uuid 89e914ff-ea4d-4780-a2db-50570d93b830 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:01:57 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 13:01:57 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 13:01:57 user nova-compute[74840]:   <source dev="/dev/sdb"/>
Nov 08 13:01:57 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 13:01:57 user nova-compute[74840]:   <serial>da8145a8-5fd0-402a-bc89-39bfa8cd6c89</serial>
Nov 08 13:01:57 user nova-compute[74840]: </disk>
Nov 08 13:01:57 user nova-compute[74840]:  {{(pid=74840) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 13:01:57 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:01:57 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:01:57 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] No VIF found with MAC fa:16:3e:f0:c8:82, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:01:58 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-b60787bb-61be-4e76-9335-baad202eb72c tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "89e914ff-ea4d-4780-a2db-50570d93b830" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.669s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:01:59 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:02:02 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:02:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:02:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Acquiring lock "89e914ff-ea4d-4780-a2db-50570d93b830" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:02:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "89e914ff-ea4d-4780-a2db-50570d93b830" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:02:05 user nova-compute[74840]: DEBUG nova.objects.instance [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lazy-loading 'flavor' on Instance uuid 89e914ff-ea4d-4780-a2db-50570d93b830 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:02:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "89e914ff-ea4d-4780-a2db-50570d93b830" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:02:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Acquiring lock "89e914ff-ea4d-4780-a2db-50570d93b830" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:02:05 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "89e914ff-ea4d-4780-a2db-50570d93b830" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:02:05 user nova-compute[74840]: INFO nova.compute.manager [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Attaching volume fe056813-48c9-4ac7-99d3-30855a8aef25 to /dev/vdc
Nov 08 13:02:05 user nova-compute[74840]: DEBUG os_brick.utils [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:02:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:02:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:02:05 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1eb8381-b760-4e2a-85b3-8af32c52e833]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c8228a11e03c\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:02:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:02:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:02:05 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[691a674b-c523-4dab-bb2f-2982e38b5de4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:02:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:02:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:02:05 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[46368714-3767-41b5-bc08-3a5edb013ea3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:02:05 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f55067-0dc5-4a87-9ef4-e70ddae9dc10]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:02:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Running cmd (subprocess): nvme version {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:02:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] 'nvme version' failed. Not Retrying. {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:02:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.nvmeof [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] nvme not present on system {{(pid=74840) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 13:02:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:02:05 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 13:02:05 user nova-compute[74840]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 13:02:05 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77902a9-c228-43a4-b568-0142e2489a26]: (4, '') {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:02:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74840) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 13:02:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 13:02:05 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.lightos [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] LIGHTOS: no hostnqn found. {{(pid=74840) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 13:02:05 user nova-compute[74840]: DEBUG os_brick.utils [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c8228a11e03c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:02:05 user nova-compute[74840]: DEBUG nova.virt.block_device [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Updating existing volume attachment record: e1f3be12-63e1-4ff7-aeb5-410d05d6db0c {{(pid=74840) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 13:02:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:02:14 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:02:19 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:02:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:02:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:02:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 13:02:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 13:02:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 13:02:24 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Calling os-brick to attach iSCSI Volume {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'miTLeXrJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:02:27 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:02:27 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:02:27 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:02:27 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:02:27 user nova-compute[74840]: INFO os_brick.initiator.connectors.iscsi [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 13:02:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25 -p 172.16.0.220:3260 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[39dca12d-3a8a-4792-b7bf-23967c8238a6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 13:02:27 user nova-compute[74840]:  {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25 -p 172.16.0.220:3260 --interface default --op new {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a877e6fa-f541-4bbd-8b58-421db32a639c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25] added\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25] added
Nov 08 13:02:27 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf8b752-03e9-4e73-ac21-a62adddf063e]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc44acb-1e55-4a68-977d-a349cb649204]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v miTLeXrJ {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v miTLeXrJ" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ecc1b22-e879-48b0-bc4d-3940b035c90d]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'miTLeXrJ'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d35969-e59a-4173-b073-f63b85c620c5]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e902bc5b-6712-4978-84fc-7befa68dbe4a]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89 (non-flash)
Nov 08 13:02:27 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89 (non-flash)
Nov 08 13:02:27 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25 -p 172.16.0.220:3260 --login {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57585a3-b431-41f9-aad7-9088ab5d667c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25, portal: 172.16.0.220,3260]
Nov 08 13:02:27 user nova-compute[74840]: Login to [iface: default, target: iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25, portal: 172.16.0.220,3260] successful.
Nov 08 13:02:27 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab94bfe-ed42-4594-987a-e40e38e09517]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f35925a-95e2-419b-9c67-0668aca23b05]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89 (non-flash)
Nov 08 13:02:27 user nova-compute[74840]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25 (non-flash)
Nov 08 13:02:27 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89 (non-flash)
Nov 08 13:02:27 user nova-compute[74840]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25 (non-flash)
Nov 08 13:02:27 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Connected to 172.16.0.220:3260 {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=74840) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74840) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8b981e-e7a5-482f-8fa7-fa3204e3d3a1]: (4, ('- - 0', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: None {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 13:02:27 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:02:28 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74840) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 13:02:28 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'miTLeXrJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74840) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 13:02:28 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:02:28 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '26465333139376130', 'path': '/dev/sdc'} {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:02:28 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465333139376130', 'path': '/dev/sdc'} {{(pid=74840) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 13:02:28 user nova-compute[74840]: DEBUG nova.objects.instance [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lazy-loading 'flavor' on Instance uuid 89e914ff-ea4d-4780-a2db-50570d93b830 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:02:28 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 13:02:28 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 13:02:28 user nova-compute[74840]:   <source dev="/dev/sdc"/>
Nov 08 13:02:28 user nova-compute[74840]:   <target dev="vdc" bus="virtio"/>
Nov 08 13:02:28 user nova-compute[74840]:   <serial>fe056813-48c9-4ac7-99d3-30855a8aef25</serial>
Nov 08 13:02:28 user nova-compute[74840]: </disk>
Nov 08 13:02:28 user nova-compute[74840]:  {{(pid=74840) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 13:02:28 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:02:28 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:02:28 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:02:28 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] No VIF found with MAC fa:16:3e:f0:c8:82, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:02:29 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-83ae5f90-deb2-4d75-8773-b27c8fba45d6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "89e914ff-ea4d-4780-a2db-50570d93b830" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.616s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:02:29 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:02:29 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 13:02:29 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:02:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0583e246-3266-427e-8f9d-2215f85260fe tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Acquiring lock "89e914ff-ea4d-4780-a2db-50570d93b830" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:02:30 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0583e246-3266-427e-8f9d-2215f85260fe tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "89e914ff-ea4d-4780-a2db-50570d93b830" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:02:30 user nova-compute[74840]: INFO nova.compute.manager [None req-0583e246-3266-427e-8f9d-2215f85260fe tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Detaching volume da8145a8-5fd0-402a-bc89-39bfa8cd6c89
Nov 08 13:02:30 user nova-compute[74840]: INFO nova.virt.block_device [None req-0583e246-3266-427e-8f9d-2215f85260fe tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Attempting to driver detach volume da8145a8-5fd0-402a-bc89-39bfa8cd6c89 from mountpoint /dev/vdb
Nov 08 13:02:30 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-0583e246-3266-427e-8f9d-2215f85260fe tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Attempting to detach device vdb from instance 89e914ff-ea4d-4780-a2db-50570d93b830 from the persistent domain config. {{(pid=74840) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 13:02:30 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-0583e246-3266-427e-8f9d-2215f85260fe tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 13:02:30 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 13:02:30 user nova-compute[74840]:   <source dev="/dev/sdb"/>
Nov 08 13:02:30 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 13:02:30 user nova-compute[74840]:   <serial>da8145a8-5fd0-402a-bc89-39bfa8cd6c89</serial>
Nov 08 13:02:30 user nova-compute[74840]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 13:02:30 user nova-compute[74840]: </disk>
Nov 08 13:02:30 user nova-compute[74840]:  {{(pid=74840) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 13:02:30 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-0583e246-3266-427e-8f9d-2215f85260fe tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Successfully detached device vdb from instance 89e914ff-ea4d-4780-a2db-50570d93b830 from the persistent domain config.
Nov 08 13:02:30 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-0583e246-3266-427e-8f9d-2215f85260fe tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 89e914ff-ea4d-4780-a2db-50570d93b830 from the live domain config. {{(pid=74840) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 13:02:30 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-0583e246-3266-427e-8f9d-2215f85260fe tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 13:02:30 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 13:02:30 user nova-compute[74840]:   <source dev="/dev/sdb"/>
Nov 08 13:02:30 user nova-compute[74840]:   <target dev="vdb" bus="virtio"/>
Nov 08 13:02:30 user nova-compute[74840]:   <serial>da8145a8-5fd0-402a-bc89-39bfa8cd6c89</serial>
Nov 08 13:02:30 user nova-compute[74840]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 13:02:30 user nova-compute[74840]: </disk>
Nov 08 13:02:30 user nova-compute[74840]:  {{(pid=74840) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 13:02:30 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:02:31 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-0583e246-3266-427e-8f9d-2215f85260fe tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 89e914ff-ea4d-4780-a2db-50570d93b830 {{(pid=74840) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 13:02:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:02:33 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:02:33 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:02:34 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:02:34 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 13:02:34 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Rebuilding the list of instances to heal {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 13:02:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "refresh_cache-89e914ff-ea4d-4780-a2db-50570d93b830" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:02:34 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquired lock "refresh_cache-89e914ff-ea4d-4780-a2db-50570d93b830" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:02:34 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Forcefully refreshing network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 13:02:34 user nova-compute[74840]: DEBUG nova.objects.instance [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lazy-loading 'info_cache' on Instance uuid 89e914ff-ea4d-4780-a2db-50570d93b830 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:02:34 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:02:35 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Updating instance_info_cache with network_info: [{"id": "b3224b82-b3d3-4434-bfc2-e25a862234ae", "address": "fa:16:3e:f0:c8:82", "network": {"id": "515bf382-a9c9-4096-9de0-23fc0c912a71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1378790516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7e49db466d4c0a83700e2e917c78be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3224b82-b3", "ovs_interfaceid": "b3224b82-b3d3-4434-bfc2-e25a862234ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:02:35 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Releasing lock "refresh_cache-89e914ff-ea4d-4780-a2db-50570d93b830" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:02:35 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Updated the network info_cache for instance {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 13:02:37 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:02:37 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:02:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:02:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:02:37 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:02:37 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 13:02:37 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e914ff-ea4d-4780-a2db-50570d93b830/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:02:37 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e914ff-ea4d-4780-a2db-50570d93b830/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:02:37 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e914ff-ea4d-4780-a2db-50570d93b830/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:02:38 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e914ff-ea4d-4780-a2db-50570d93b830/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:02:38 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=74840) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 13:02:38 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:02:38 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:02:38 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=8964MB free_disk=24.825660705566406GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 13:02:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:02:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:02:38 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 89e914ff-ea4d-4780-a2db-50570d93b830 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:02:38 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 13:02:38 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 13:02:38 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:02:38 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:02:38 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 13:02:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.191s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:02:39 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:02:41 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:02:44 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:02:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:02:51 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-0583e246-3266-427e-8f9d-2215f85260fe tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 89e914ff-ea4d-4780-a2db-50570d93b830 is timed out.
Nov 08 13:02:51 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-0583e246-3266-427e-8f9d-2215f85260fe tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Successfully detached device vdb from instance 89e914ff-ea4d-4780-a2db-50570d93b830 from the live domain config.
Nov 08 13:02:51 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0583e246-3266-427e-8f9d-2215f85260fe tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 13:02:51 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0583e246-3266-427e-8f9d-2215f85260fe tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XLScNvqO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:02:51 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-0583e246-3266-427e-8f9d-2215f85260fe tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:02:51 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-0583e246-3266-427e-8f9d-2215f85260fe tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:02:51 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-0583e246-3266-427e-8f9d-2215f85260fe tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:02:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:02:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:02:51 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[094ce039-45d3-49d7-8f0a-4a262abf47ca]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:02:51 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0583e246-3266-427e-8f9d-2215f85260fe tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 13:02:51 user nova-compute[74840]: No targets found.
Nov 08 13:02:51 user nova-compute[74840]: iSNS:
Nov 08 13:02:51 user nova-compute[74840]: No targets found.
Nov 08 13:02:51 user nova-compute[74840]: STATIC:
Nov 08 13:02:51 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89
Nov 08 13:02:51 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:02:51 user nova-compute[74840]:                 Iface Name: default
Nov 08 13:02:51 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25
Nov 08 13:02:51 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:02:51 user nova-compute[74840]:                 Iface Name: default
Nov 08 13:02:51 user nova-compute[74840]: FIRMWARE:
Nov 08 13:02:51 user nova-compute[74840]: No targets found.
Nov 08 13:02:51 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:02:51 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0583e246-3266-427e-8f9d-2215f85260fe tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 13:02:51 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 13:02:51 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 13:02:51 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0583e246-3266-427e-8f9d-2215f85260fe tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 13:02:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:02:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:02:51 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b80777-44f7-49c6-bfb2-5e6fc2928ede]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:02:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:02:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:02:51 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3666167-3060-4789-ba74-d1780ce40873]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:02:51 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0583e246-3266-427e-8f9d-2215f85260fe tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89 (non-flash)
Nov 08 13:02:51 user nova-compute[74840]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25 (non-flash)
Nov 08 13:02:51 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:02:51 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0583e246-3266-427e-8f9d-2215f85260fe tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89 (non-flash)
Nov 08 13:02:51 user nova-compute[74840]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25 (non-flash)
Nov 08 13:02:51 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:02:51 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0583e246-3266-427e-8f9d-2215f85260fe tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7d45125f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89'): ({'sdb'}, set())}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 13:02:51 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-0583e246-3266-427e-8f9d-2215f85260fe tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Removing single pathed devices sdb {{(pid=74840) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 13:02:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:02:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:02:51 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdef6ca4-28e4-44e5-8f9d-be00ed7679f9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:02:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:02:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:02:51 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e48d885-8a60-4f20-aee9-0545b025098e]: (4, ('ok\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:02:51 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-0583e246-3266-427e-8f9d-2215f85260fe tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Flushing IO for device /dev/sdb {{(pid=74840) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 13:02:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:02:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:02:51 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6eb473-6d00-4128-8773-73ea8c6083fb]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:02:51 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-0583e246-3266-427e-8f9d-2215f85260fe tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74840) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 13:02:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:02:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:02:51 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce2c8cc-b9bc-48cb-b3d1-aa5d850c4fc2]: (4, ('1', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:02:51 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-0583e246-3266-427e-8f9d-2215f85260fe tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 13:02:51 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-0583e246-3266-427e-8f9d-2215f85260fe tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] SCSI volumes sdb have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 13:02:51 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0583e246-3266-427e-8f9d-2215f85260fe tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89')] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 13:02:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:02:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:02:51 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2ed50e-b147-4f01-a9e6-ee9bc9a1939c]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:02:51 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0583e246-3266-427e-8f9d-2215f85260fe tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:02:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89 -p 172.16.0.220:3260 --logout {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:02:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:02:51 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd041dc3-3816-40e3-812e-ce3d70cd31ec]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:02:51 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0583e246-3266-427e-8f9d-2215f85260fe tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89, portal: 172.16.0.220,3260]
Nov 08 13:02:51 user nova-compute[74840]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89, portal: 172.16.0.220,3260] successful.
Nov 08 13:02:51 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:02:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89 -p 172.16.0.220:3260 --op delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:02:51 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da8145a8-5fd0-402a-bc89-39bfa8cd6c89 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:02:51 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f7a052-a1b5-4900-95d9-3428ffd16563]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:02:51 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0583e246-3266-427e-8f9d-2215f85260fe tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:02:51 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-0583e246-3266-427e-8f9d-2215f85260fe tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:02:51 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-0583e246-3266-427e-8f9d-2215f85260fe tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] <== disconnect_volume: return (314ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:02:51 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0583e246-3266-427e-8f9d-2215f85260fe tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 13:02:52 user nova-compute[74840]: DEBUG nova.objects.instance [None req-0583e246-3266-427e-8f9d-2215f85260fe tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lazy-loading 'flavor' on Instance uuid 89e914ff-ea4d-4780-a2db-50570d93b830 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:02:52 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-0583e246-3266-427e-8f9d-2215f85260fe tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "89e914ff-ea4d-4780-a2db-50570d93b830" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.811s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:02:53 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-3c4fd908-9239-481f-aa56-12400eae6be6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Acquiring lock "89e914ff-ea4d-4780-a2db-50570d93b830" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:02:53 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-3c4fd908-9239-481f-aa56-12400eae6be6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "89e914ff-ea4d-4780-a2db-50570d93b830" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:02:53 user nova-compute[74840]: INFO nova.compute.manager [None req-3c4fd908-9239-481f-aa56-12400eae6be6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Detaching volume fe056813-48c9-4ac7-99d3-30855a8aef25
Nov 08 13:02:53 user nova-compute[74840]: INFO nova.virt.block_device [None req-3c4fd908-9239-481f-aa56-12400eae6be6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Attempting to driver detach volume fe056813-48c9-4ac7-99d3-30855a8aef25 from mountpoint /dev/vdc
Nov 08 13:02:53 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-3c4fd908-9239-481f-aa56-12400eae6be6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Attempting to detach device vdc from instance 89e914ff-ea4d-4780-a2db-50570d93b830 from the persistent domain config. {{(pid=74840) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 13:02:53 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-3c4fd908-9239-481f-aa56-12400eae6be6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 13:02:53 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 13:02:53 user nova-compute[74840]:   <source dev="/dev/sdc"/>
Nov 08 13:02:53 user nova-compute[74840]:   <target dev="vdc" bus="virtio"/>
Nov 08 13:02:53 user nova-compute[74840]:   <serial>fe056813-48c9-4ac7-99d3-30855a8aef25</serial>
Nov 08 13:02:53 user nova-compute[74840]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 08 13:02:53 user nova-compute[74840]: </disk>
Nov 08 13:02:53 user nova-compute[74840]:  {{(pid=74840) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 13:02:53 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-3c4fd908-9239-481f-aa56-12400eae6be6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Successfully detached device vdc from instance 89e914ff-ea4d-4780-a2db-50570d93b830 from the persistent domain config.
Nov 08 13:02:53 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-3c4fd908-9239-481f-aa56-12400eae6be6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 89e914ff-ea4d-4780-a2db-50570d93b830 from the live domain config. {{(pid=74840) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 13:02:53 user nova-compute[74840]: DEBUG nova.virt.libvirt.guest [None req-3c4fd908-9239-481f-aa56-12400eae6be6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 13:02:53 user nova-compute[74840]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 13:02:53 user nova-compute[74840]:   <source dev="/dev/sdc"/>
Nov 08 13:02:53 user nova-compute[74840]:   <target dev="vdc" bus="virtio"/>
Nov 08 13:02:53 user nova-compute[74840]:   <serial>fe056813-48c9-4ac7-99d3-30855a8aef25</serial>
Nov 08 13:02:53 user nova-compute[74840]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 08 13:02:53 user nova-compute[74840]: </disk>
Nov 08 13:02:53 user nova-compute[74840]:  {{(pid=74840) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 13:02:53 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-3c4fd908-9239-481f-aa56-12400eae6be6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 89e914ff-ea4d-4780-a2db-50570d93b830 {{(pid=74840) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 13:02:54 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:02:54 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:02:54 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 13:02:54 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 13:02:54 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 13:02:54 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:02:59 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:02:59 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:02:59 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 13:02:59 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 13:02:59 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 13:02:59 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:03:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:03:09 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:03:13 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-3c4fd908-9239-481f-aa56-12400eae6be6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 89e914ff-ea4d-4780-a2db-50570d93b830 is timed out.
Nov 08 13:03:13 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-3c4fd908-9239-481f-aa56-12400eae6be6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Successfully detached device vdc from instance 89e914ff-ea4d-4780-a2db-50570d93b830 from the live domain config.
Nov 08 13:03:13 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c4fd908-9239-481f-aa56-12400eae6be6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] calling os-brick to detach iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 13:03:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4fd908-9239-481f-aa56-12400eae6be6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa7f42ee500>, {'target_iqn': 'iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'miTLeXrJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 13:03:13 user nova-compute[74840]: WARNING os_brick.initiator.connectors.base [None req-3c4fd908-9239-481f-aa56-12400eae6be6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 13:03:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-3c4fd908-9239-481f-aa56-12400eae6be6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 13:03:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-3c4fd908-9239-481f-aa56-12400eae6be6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 13:03:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:03:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:03:13 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d64211-9c3f-4009-afce-1eff28b5c53c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:03:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4fd908-9239-481f-aa56-12400eae6be6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 13:03:13 user nova-compute[74840]: No targets found.
Nov 08 13:03:13 user nova-compute[74840]: iSNS:
Nov 08 13:03:13 user nova-compute[74840]: No targets found.
Nov 08 13:03:13 user nova-compute[74840]: STATIC:
Nov 08 13:03:13 user nova-compute[74840]: Target: iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25
Nov 08 13:03:13 user nova-compute[74840]:         Portal: 172.16.0.220:3260,-1
Nov 08 13:03:13 user nova-compute[74840]:                 Iface Name: default
Nov 08 13:03:13 user nova-compute[74840]: FIRMWARE:
Nov 08 13:03:13 user nova-compute[74840]: No targets found.
Nov 08 13:03:13 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:03:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4fd908-9239-481f-aa56-12400eae6be6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 13:03:13 user nova-compute[74840]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 13:03:13 user nova-compute[74840]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74840) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 13:03:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4fd908-9239-481f-aa56-12400eae6be6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25', 0)] {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 13:03:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:03:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:03:13 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdeb883e-390f-4341-8cde-0a20a87a8a14]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:03:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:03:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:03:13 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[194f4e6a-1c0f-4d0a-9a65-a50973b935ae]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25 (non-flash)\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:03:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4fd908-9239-481f-aa56-12400eae6be6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25 (non-flash)
Nov 08 13:03:13 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 13:03:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4fd908-9239-481f-aa56-12400eae6be6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25 (non-flash)
Nov 08 13:03:13 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 13:03:13 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4fd908-9239-481f-aa56-12400eae6be6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa7f421f640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25'): ({'sdc'}, set())}) {{(pid=74840) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 13:03:13 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-3c4fd908-9239-481f-aa56-12400eae6be6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Removing single pathed devices sdc {{(pid=74840) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 13:03:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:03:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:03:13 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[39cf6c1a-3075-42e0-8bda-50bca8d426a1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:03:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:03:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:03:13 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2d2902-3da6-48be-86ae-49f00b22cb31]: (4, ('ok\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:03:13 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-3c4fd908-9239-481f-aa56-12400eae6be6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Flushing IO for device /dev/sdc {{(pid=74840) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 13:03:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:03:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:03:13 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ef13ef-df8f-4055-8738-44396344272e]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:03:13 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-3c4fd908-9239-481f-aa56-12400eae6be6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74840) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 13:03:13 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:03:14 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:03:14 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[948ce76d-7a07-4d57-8236-d700d9c814dd]: (4, ('1', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:03:14 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-3c4fd908-9239-481f-aa56-12400eae6be6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 13:03:14 user nova-compute[74840]: DEBUG os_brick.initiator.linuxscsi [None req-3c4fd908-9239-481f-aa56-12400eae6be6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] SCSI volumes sdc have been removed. {{(pid=74840) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 13:03:14 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4fd908-9239-481f-aa56-12400eae6be6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25')] {{(pid=74840) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 13:03:14 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:03:14 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:03:14 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c40aab-d3fa-4b85-a492-816843617d91]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:03:14 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4fd908-9239-481f-aa56-12400eae6be6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:03:14 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25 -p 172.16.0.220:3260 --logout {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:03:14 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:03:14 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[b970c841-8bf2-43c5-a559-94541481a966]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:03:14 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4fd908-9239-481f-aa56-12400eae6be6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25, portal: 172.16.0.220,3260]
Nov 08 13:03:14 user nova-compute[74840]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25, portal: 172.16.0.220,3260] successful.
Nov 08 13:03:14 user nova-compute[74840]:  stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:03:14 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25 -p 172.16.0.220:3260 --op delete {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:03:14 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe056813-48c9-4ac7-99d3-30855a8aef25 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85688) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:03:14 user nova-compute[74840]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6555cb-4685-462c-abda-a63d86873a64]: (4, ('', '')) {{(pid=85688) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 13:03:14 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4fd908-9239-481f-aa56-12400eae6be6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74840) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 13:03:14 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.base [None req-3c4fd908-9239-481f-aa56-12400eae6be6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 13:03:14 user nova-compute[74840]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4fd908-9239-481f-aa56-12400eae6be6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] <== disconnect_volume: return (296ms) None {{(pid=74840) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 13:03:14 user nova-compute[74840]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c4fd908-9239-481f-aa56-12400eae6be6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Disconnected iSCSI Volume {{(pid=74840) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 13:03:14 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:03:15 user nova-compute[74840]: DEBUG nova.objects.instance [None req-3c4fd908-9239-481f-aa56-12400eae6be6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lazy-loading 'flavor' on Instance uuid 89e914ff-ea4d-4780-a2db-50570d93b830 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:03:15 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-3c4fd908-9239-481f-aa56-12400eae6be6 tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "89e914ff-ea4d-4780-a2db-50570d93b830" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.850s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:03:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bdb5399a-db58-441c-a49c-16c1f8b00d8a tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Acquiring lock "89e914ff-ea4d-4780-a2db-50570d93b830" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:03:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bdb5399a-db58-441c-a49c-16c1f8b00d8a tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "89e914ff-ea4d-4780-a2db-50570d93b830" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:03:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bdb5399a-db58-441c-a49c-16c1f8b00d8a tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Acquiring lock "89e914ff-ea4d-4780-a2db-50570d93b830-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:03:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bdb5399a-db58-441c-a49c-16c1f8b00d8a tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "89e914ff-ea4d-4780-a2db-50570d93b830-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:03:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bdb5399a-db58-441c-a49c-16c1f8b00d8a tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "89e914ff-ea4d-4780-a2db-50570d93b830-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:03:16 user nova-compute[74840]: INFO nova.compute.manager [None req-bdb5399a-db58-441c-a49c-16c1f8b00d8a tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Terminating instance
Nov 08 13:03:16 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bdb5399a-db58-441c-a49c-16c1f8b00d8a tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Start destroying the instance on the hypervisor. {{(pid=74840) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 13:03:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:03:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:03:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:03:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:03:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:03:16 user nova-compute[74840]: DEBUG nova.compute.manager [req-be88e92e-b1ed-4b69-992b-98dd25204495 req-d9de891c-2c16-46a3-ad1e-d7155d2e737f service nova] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Received event network-vif-unplugged-b3224b82-b3d3-4434-bfc2-e25a862234ae {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:03:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-be88e92e-b1ed-4b69-992b-98dd25204495 req-d9de891c-2c16-46a3-ad1e-d7155d2e737f service nova] Acquiring lock "89e914ff-ea4d-4780-a2db-50570d93b830-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:03:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-be88e92e-b1ed-4b69-992b-98dd25204495 req-d9de891c-2c16-46a3-ad1e-d7155d2e737f service nova] Lock "89e914ff-ea4d-4780-a2db-50570d93b830-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:03:16 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-be88e92e-b1ed-4b69-992b-98dd25204495 req-d9de891c-2c16-46a3-ad1e-d7155d2e737f service nova] Lock "89e914ff-ea4d-4780-a2db-50570d93b830-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:03:16 user nova-compute[74840]: DEBUG nova.compute.manager [req-be88e92e-b1ed-4b69-992b-98dd25204495 req-d9de891c-2c16-46a3-ad1e-d7155d2e737f service nova] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] No waiting events found dispatching network-vif-unplugged-b3224b82-b3d3-4434-bfc2-e25a862234ae {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:03:16 user nova-compute[74840]: DEBUG nova.compute.manager [req-be88e92e-b1ed-4b69-992b-98dd25204495 req-d9de891c-2c16-46a3-ad1e-d7155d2e737f service nova] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Received event network-vif-unplugged-b3224b82-b3d3-4434-bfc2-e25a862234ae for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 13:03:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:03:16 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Instance destroyed successfully.
Nov 08 13:03:16 user nova-compute[74840]: DEBUG nova.objects.instance [None req-bdb5399a-db58-441c-a49c-16c1f8b00d8a tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lazy-loading 'resources' on Instance uuid 89e914ff-ea4d-4780-a2db-50570d93b830 {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:03:16 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-bdb5399a-db58-441c-a49c-16c1f8b00d8a tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T12:59:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-100535444',display_name='tempest-AttachVolumeTestJSON-server-100535444',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-100535444',id=51,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMT6QZbmT61xJw2qaMfwP4I1eqin67Le2SOxTH00eDL6YTkobNlIUMpBqO6ceVWPMBCqYKbcS9DzikbMpNH+3r12NTiBaRFhCY30zoDzExfaT9L2aP1M/MO5yXvKLUWi3A==',key_name='tempest-keypair-1202362640',keypairs=<?>,launch_index=0,launched_at=2023-11-08T12:59:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6e7e49db466d4c0a83700e2e917c78be',ramdisk_id='',reservation_id='r-xcxjt4r0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-116807071',owner_user_name='tempest-AttachVolumeTestJSON-116807071-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T12:59:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9667df3a519d47809b332f8457cd1154',uuid=89e914ff-ea4d-4780-a2db-50570d93b830,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3224b82-b3d3-4434-bfc2-e25a862234ae", "address": "fa:16:3e:f0:c8:82", "network": {"id": "515bf382-a9c9-4096-9de0-23fc0c912a71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1378790516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7e49db466d4c0a83700e2e917c78be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3224b82-b3", "ovs_interfaceid": "b3224b82-b3d3-4434-bfc2-e25a862234ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 13:03:16 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-bdb5399a-db58-441c-a49c-16c1f8b00d8a tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Converting VIF {"id": "b3224b82-b3d3-4434-bfc2-e25a862234ae", "address": "fa:16:3e:f0:c8:82", "network": {"id": "515bf382-a9c9-4096-9de0-23fc0c912a71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1378790516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e7e49db466d4c0a83700e2e917c78be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3224b82-b3", "ovs_interfaceid": "b3224b82-b3d3-4434-bfc2-e25a862234ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:03:16 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-bdb5399a-db58-441c-a49c-16c1f8b00d8a tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:c8:82,bridge_name='br-int',has_traffic_filtering=True,id=b3224b82-b3d3-4434-bfc2-e25a862234ae,network=Network(515bf382-a9c9-4096-9de0-23fc0c912a71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3224b82-b3') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:03:16 user nova-compute[74840]: DEBUG os_vif [None req-bdb5399a-db58-441c-a49c-16c1f8b00d8a tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:c8:82,bridge_name='br-int',has_traffic_filtering=True,id=b3224b82-b3d3-4434-bfc2-e25a862234ae,network=Network(515bf382-a9c9-4096-9de0-23fc0c912a71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3224b82-b3') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 13:03:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:03:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3224b82-b3, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:03:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:03:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:03:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:03:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9a262c7e-164d-462c-88d0-6cb93b370d7f) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:03:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:03:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:03:16 user nova-compute[74840]: INFO os_vif [None req-bdb5399a-db58-441c-a49c-16c1f8b00d8a tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:c8:82,bridge_name='br-int',has_traffic_filtering=True,id=b3224b82-b3d3-4434-bfc2-e25a862234ae,network=Network(515bf382-a9c9-4096-9de0-23fc0c912a71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3224b82-b3')
Nov 08 13:03:16 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-bdb5399a-db58-441c-a49c-16c1f8b00d8a tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Deleting instance files /opt/stack/data/nova/instances/89e914ff-ea4d-4780-a2db-50570d93b830_del
Nov 08 13:03:16 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-bdb5399a-db58-441c-a49c-16c1f8b00d8a tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Deletion of /opt/stack/data/nova/instances/89e914ff-ea4d-4780-a2db-50570d93b830_del complete
Nov 08 13:03:16 user nova-compute[74840]: INFO nova.compute.manager [None req-bdb5399a-db58-441c-a49c-16c1f8b00d8a tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Took 0.83 seconds to destroy the instance on the hypervisor.
Nov 08 13:03:16 user nova-compute[74840]: DEBUG oslo.service.loopingcall [None req-bdb5399a-db58-441c-a49c-16c1f8b00d8a tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74840) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 13:03:16 user nova-compute[74840]: DEBUG nova.compute.manager [-] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Deallocating network for instance {{(pid=74840) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 13:03:16 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] deallocate_for_instance() {{(pid=74840) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 13:03:17 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:03:17 user nova-compute[74840]: INFO nova.compute.manager [-] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Took 0.67 seconds to deallocate network for instance.
Nov 08 13:03:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bdb5399a-db58-441c-a49c-16c1f8b00d8a tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:03:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bdb5399a-db58-441c-a49c-16c1f8b00d8a tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:03:17 user nova-compute[74840]: DEBUG nova.compute.manager [req-a479e731-e195-4359-a76d-061eb3c8d813 req-0b460355-1edb-4f91-bd31-1371e4beeb69 service nova] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Received event network-vif-deleted-b3224b82-b3d3-4434-bfc2-e25a862234ae {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:03:17 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bdb5399a-db58-441c-a49c-16c1f8b00d8a tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:03:17 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bdb5399a-db58-441c-a49c-16c1f8b00d8a tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:03:17 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bdb5399a-db58-441c-a49c-16c1f8b00d8a tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.287s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:03:17 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-bdb5399a-db58-441c-a49c-16c1f8b00d8a tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Deleted allocations for instance 89e914ff-ea4d-4780-a2db-50570d93b830
Nov 08 13:03:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bdb5399a-db58-441c-a49c-16c1f8b00d8a tempest-AttachVolumeTestJSON-116807071 tempest-AttachVolumeTestJSON-116807071-project-member] Lock "89e914ff-ea4d-4780-a2db-50570d93b830" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.970s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:03:18 user nova-compute[74840]: DEBUG nova.compute.manager [req-2396eb37-cb93-4167-ac31-e73190f58716 req-8a082aeb-1585-4833-9442-f58cb54718d2 service nova] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Received event network-vif-plugged-b3224b82-b3d3-4434-bfc2-e25a862234ae {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:03:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2396eb37-cb93-4167-ac31-e73190f58716 req-8a082aeb-1585-4833-9442-f58cb54718d2 service nova] Acquiring lock "89e914ff-ea4d-4780-a2db-50570d93b830-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:03:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2396eb37-cb93-4167-ac31-e73190f58716 req-8a082aeb-1585-4833-9442-f58cb54718d2 service nova] Lock "89e914ff-ea4d-4780-a2db-50570d93b830-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:03:18 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-2396eb37-cb93-4167-ac31-e73190f58716 req-8a082aeb-1585-4833-9442-f58cb54718d2 service nova] Lock "89e914ff-ea4d-4780-a2db-50570d93b830-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:03:18 user nova-compute[74840]: DEBUG nova.compute.manager [req-2396eb37-cb93-4167-ac31-e73190f58716 req-8a082aeb-1585-4833-9442-f58cb54718d2 service nova] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] No waiting events found dispatching network-vif-plugged-b3224b82-b3d3-4434-bfc2-e25a862234ae {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:03:18 user nova-compute[74840]: WARNING nova.compute.manager [req-2396eb37-cb93-4167-ac31-e73190f58716 req-8a082aeb-1585-4833-9442-f58cb54718d2 service nova] [instance: 89e914ff-ea4d-4780-a2db-50570d93b830] Received unexpected event network-vif-plugged-b3224b82-b3d3-4434-bfc2-e25a862234ae for instance with vm_state deleted and task_state None.
Nov 08 13:03:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:03:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:03:27 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:03:31 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:03:31 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:03:31 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 13:03:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:03:34 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:03:34 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 13:03:34 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Rebuilding the list of instances to heal {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 13:03:34 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Didn't find any instances for network info cache update. {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 13:03:35 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:03:35 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:03:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:03:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:03:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 13:03:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 13:03:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 13:03:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:03:38 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:03:39 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:03:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:03:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:03:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:03:39 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 13:03:40 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:03:40 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:03:40 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=9113MB free_disk=24.852550506591797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 13:03:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:03:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:03:40 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 13:03:40 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 13:03:40 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:03:40 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:03:40 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 13:03:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.156s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:03:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:03:43 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:03:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:03:51 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:03:53 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:03:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:04:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:04:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:04:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:04:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:04:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:04:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:04:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 13:04:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 13:04:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 13:04:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:04:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:04:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:04:27 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:04:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:04:32 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:04:32 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 13:04:33 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:04:34 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:04:34 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 13:04:34 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Rebuilding the list of instances to heal {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 13:04:34 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Didn't find any instances for network info cache update. {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 13:04:35 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:04:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:04:37 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:04:39 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:04:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:04:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:04:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:04:39 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 13:04:40 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:04:40 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:04:40 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=9121MB free_disk=24.851428985595703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 13:04:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:04:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:04:40 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 13:04:40 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 13:04:40 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:04:40 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:04:40 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 13:04:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.145s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:04:41 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:04:41 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:04:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:04:43 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:04:43 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:04:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:04:51 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:04:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:05:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:05:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:05:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:05:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:05:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:05:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:05:29 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:05:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:05:34 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:05:34 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:05:34 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 13:05:35 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:05:36 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:05:36 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 13:05:36 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Rebuilding the list of instances to heal {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 13:05:36 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Didn't find any instances for network info cache update. {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 13:05:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:05:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:05:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 13:05:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 13:05:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 13:05:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:05:38 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:05:40 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:05:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:05:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:05:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:05:40 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 13:05:41 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:05:41 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:05:41 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=9128MB free_disk=24.849536895751953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 13:05:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:05:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:05:41 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 13:05:41 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 13:05:41 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:05:41 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:05:41 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 13:05:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.116s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:05:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:05:42 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:05:45 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:05:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:05:49 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:05:51 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:05:55 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:05:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:06:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Acquiring lock "974ac6dc-1327-41f8-95f9-889c901afc4a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:06:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Lock "974ac6dc-1327-41f8-95f9-889c901afc4a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:06:00 user nova-compute[74840]: DEBUG nova.compute.manager [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Starting instance... {{(pid=74840) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 13:06:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:06:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:06:00 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74840) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 13:06:00 user nova-compute[74840]: INFO nova.compute.claims [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Claim successful on node user
Nov 08 13:06:00 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:06:00 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:06:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.218s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:06:00 user nova-compute[74840]: DEBUG nova.compute.manager [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Start building networks asynchronously for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 13:06:00 user nova-compute[74840]: DEBUG nova.compute.manager [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Allocating IP information in the background. {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 13:06:00 user nova-compute[74840]: DEBUG nova.network.neutron [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] allocate_for_instance() {{(pid=74840) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 13:06:00 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 13:06:00 user nova-compute[74840]: DEBUG nova.compute.manager [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Start building block device mappings for instance. {{(pid=74840) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 13:06:00 user nova-compute[74840]: DEBUG nova.compute.manager [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Start spawning the instance on the hypervisor. {{(pid=74840) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 13:06:00 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Creating instance directory {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 13:06:00 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Creating image(s)
Nov 08 13:06:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Acquiring lock "/opt/stack/data/nova/instances/974ac6dc-1327-41f8-95f9-889c901afc4a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:06:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Lock "/opt/stack/data/nova/instances/974ac6dc-1327-41f8-95f9-889c901afc4a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:06:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Lock "/opt/stack/data/nova/instances/974ac6dc-1327-41f8-95f9-889c901afc4a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:06:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:06:00 user nova-compute[74840]: DEBUG nova.policy [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '777753afeafd4326bc372665ec463bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5439f860a944d5a17579188b337922', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74840) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 13:06:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.184s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:06:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Acquiring lock "5d26578eba85497f494c575690c4248f381a0fe6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:06:00 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:06:00 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:06:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.177s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:06:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/974ac6dc-1327-41f8-95f9-889c901afc4a/disk 1073741824 {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:06:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6,backing_fmt=raw /opt/stack/data/nova/instances/974ac6dc-1327-41f8-95f9-889c901afc4a/disk 1073741824" returned: 0 in 0.054s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:06:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Lock "5d26578eba85497f494c575690c4248f381a0fe6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:06:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:06:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d26578eba85497f494c575690c4248f381a0fe6 --force-share --output=json" returned: 0 in 0.188s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:06:01 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Checking if we can resize image /opt/stack/data/nova/instances/974ac6dc-1327-41f8-95f9-889c901afc4a/disk. size=1073741824 {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 13:06:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/974ac6dc-1327-41f8-95f9-889c901afc4a/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:06:01 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/974ac6dc-1327-41f8-95f9-889c901afc4a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:06:01 user nova-compute[74840]: DEBUG nova.virt.disk.api [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Cannot resize image /opt/stack/data/nova/instances/974ac6dc-1327-41f8-95f9-889c901afc4a/disk to a smaller size. {{(pid=74840) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 13:06:01 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Created local disks {{(pid=74840) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 13:06:01 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Ensure instance console log exists: /opt/stack/data/nova/instances/974ac6dc-1327-41f8-95f9-889c901afc4a/console.log {{(pid=74840) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 13:06:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:06:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:06:01 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:06:01 user nova-compute[74840]: DEBUG nova.network.neutron [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Successfully created port: fe0e9b63-103b-47b1-9488-b9f8094a2e80 {{(pid=74840) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 13:06:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG nova.network.neutron [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Successfully updated port: fe0e9b63-103b-47b1-9488-b9f8094a2e80 {{(pid=74840) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Acquiring lock "refresh_cache-974ac6dc-1327-41f8-95f9-889c901afc4a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Acquired lock "refresh_cache-974ac6dc-1327-41f8-95f9-889c901afc4a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG nova.network.neutron [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Building network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG nova.network.neutron [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Instance cache missing network info. {{(pid=74840) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG nova.compute.manager [req-8a9a9778-9b37-4e90-8d7f-7c24c47dfc62 req-560784fb-a7d0-498b-88e8-89f6bc5daf5f service nova] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Received event network-changed-fe0e9b63-103b-47b1-9488-b9f8094a2e80 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG nova.compute.manager [req-8a9a9778-9b37-4e90-8d7f-7c24c47dfc62 req-560784fb-a7d0-498b-88e8-89f6bc5daf5f service nova] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Refreshing instance network info cache due to event network-changed-fe0e9b63-103b-47b1-9488-b9f8094a2e80. {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8a9a9778-9b37-4e90-8d7f-7c24c47dfc62 req-560784fb-a7d0-498b-88e8-89f6bc5daf5f service nova] Acquiring lock "refresh_cache-974ac6dc-1327-41f8-95f9-889c901afc4a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG nova.network.neutron [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Updating instance_info_cache with network_info: [{"id": "fe0e9b63-103b-47b1-9488-b9f8094a2e80", "address": "fa:16:3e:88:35:88", "network": {"id": "522212c6-7960-46b2-b88f-fd73e50128dc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d1d606ef58794297a9d8ca517eb8db6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0e9b63-10", "ovs_interfaceid": "fe0e9b63-103b-47b1-9488-b9f8094a2e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Releasing lock "refresh_cache-974ac6dc-1327-41f8-95f9-889c901afc4a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG nova.compute.manager [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Instance network_info: |[{"id": "fe0e9b63-103b-47b1-9488-b9f8094a2e80", "address": "fa:16:3e:88:35:88", "network": {"id": "522212c6-7960-46b2-b88f-fd73e50128dc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d1d606ef58794297a9d8ca517eb8db6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0e9b63-10", "ovs_interfaceid": "fe0e9b63-103b-47b1-9488-b9f8094a2e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74840) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8a9a9778-9b37-4e90-8d7f-7c24c47dfc62 req-560784fb-a7d0-498b-88e8-89f6bc5daf5f service nova] Acquired lock "refresh_cache-974ac6dc-1327-41f8-95f9-889c901afc4a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG nova.network.neutron [req-8a9a9778-9b37-4e90-8d7f-7c24c47dfc62 req-560784fb-a7d0-498b-88e8-89f6bc5daf5f service nova] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Refreshing network info cache for port fe0e9b63-103b-47b1-9488-b9f8094a2e80 {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Start _get_guest_xml network_info=[{"id": "fe0e9b63-103b-47b1-9488-b9f8094a2e80", "address": "fa:16:3e:88:35:88", "network": {"id": "522212c6-7960-46b2-b88f-fd73e50128dc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d1d606ef58794297a9d8ca517eb8db6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0e9b63-10", "ovs_interfaceid": "fe0e9b63-103b-47b1-9488-b9f8094a2e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'encryption_format': None, 'encrypted': False, 'image_id': '4fa17706-d304-4117-a420-dab994c703dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 13:06:02 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:06:02 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:06:02 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] CPU controller missing on host. {{(pid=74840) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG nova.virt.libvirt.host [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] CPU controller found on host. {{(pid=74840) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74840) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T12:04:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T12:05:10Z,direct_url=<?>,disk_format='qcow2',id=4fa17706-d304-4117-a420-dab994c703dc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d1d606ef58794297a9d8ca517eb8db6d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T12:05:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Flavor limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Image limits 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Flavor pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Image pref 0:0:0 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Got 1 possible topologies {{(pid=74840) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG nova.virt.hardware [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74840) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:05:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-534984226',display_name='tempest-VolumesNegativeTest-instance-534984226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-534984226',id=52,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e5439f860a944d5a17579188b337922',ramdisk_id='',reservation_id='r-zeme36h9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1977633780',owner_user_name='tempest-VolumesNegativeTest-1977633780-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:06:01Z,user_data=None,user_id='777753afeafd4326bc372665ec463bc1',uuid=974ac6dc-1327-41f8-95f9-889c901afc4a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe0e9b63-103b-47b1-9488-b9f8094a2e80", "address": "fa:16:3e:88:35:88", "network": {"id": "522212c6-7960-46b2-b88f-fd73e50128dc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d1d606ef58794297a9d8ca517eb8db6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0e9b63-10", "ovs_interfaceid": "fe0e9b63-103b-47b1-9488-b9f8094a2e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74840) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Converting VIF {"id": "fe0e9b63-103b-47b1-9488-b9f8094a2e80", "address": "fa:16:3e:88:35:88", "network": {"id": "522212c6-7960-46b2-b88f-fd73e50128dc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d1d606ef58794297a9d8ca517eb8db6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0e9b63-10", "ovs_interfaceid": "fe0e9b63-103b-47b1-9488-b9f8094a2e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:35:88,bridge_name='br-int',has_traffic_filtering=True,id=fe0e9b63-103b-47b1-9488-b9f8094a2e80,network=Network(522212c6-7960-46b2-b88f-fd73e50128dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe0e9b63-10') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG nova.objects.instance [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Lazy-loading 'pci_devices' on Instance uuid 974ac6dc-1327-41f8-95f9-889c901afc4a {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] End _get_guest_xml xml=<domain type="kvm">
Nov 08 13:06:02 user nova-compute[74840]:   <uuid>974ac6dc-1327-41f8-95f9-889c901afc4a</uuid>
Nov 08 13:06:02 user nova-compute[74840]:   <name>instance-00000034</name>
Nov 08 13:06:02 user nova-compute[74840]:   <memory>524288</memory>
Nov 08 13:06:02 user nova-compute[74840]:   <vcpu>1</vcpu>
Nov 08 13:06:02 user nova-compute[74840]:   <metadata>
Nov 08 13:06:02 user nova-compute[74840]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 13:06:02 user nova-compute[74840]:       <nova:package version="0.0.0"/>
Nov 08 13:06:02 user nova-compute[74840]:       <nova:name>tempest-VolumesNegativeTest-instance-534984226</nova:name>
Nov 08 13:06:02 user nova-compute[74840]:       <nova:creationTime>2023-11-08 13:06:02</nova:creationTime>
Nov 08 13:06:02 user nova-compute[74840]:       <nova:flavor name="m1.tiny">
Nov 08 13:06:02 user nova-compute[74840]:         <nova:memory>512</nova:memory>
Nov 08 13:06:02 user nova-compute[74840]:         <nova:disk>1</nova:disk>
Nov 08 13:06:02 user nova-compute[74840]:         <nova:swap>0</nova:swap>
Nov 08 13:06:02 user nova-compute[74840]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 13:06:02 user nova-compute[74840]:         <nova:vcpus>1</nova:vcpus>
Nov 08 13:06:02 user nova-compute[74840]:       </nova:flavor>
Nov 08 13:06:02 user nova-compute[74840]:       <nova:owner>
Nov 08 13:06:02 user nova-compute[74840]:         <nova:user uuid="777753afeafd4326bc372665ec463bc1">tempest-VolumesNegativeTest-1977633780-project-member</nova:user>
Nov 08 13:06:02 user nova-compute[74840]:         <nova:project uuid="1e5439f860a944d5a17579188b337922">tempest-VolumesNegativeTest-1977633780</nova:project>
Nov 08 13:06:02 user nova-compute[74840]:       </nova:owner>
Nov 08 13:06:02 user nova-compute[74840]:       <nova:root type="image" uuid="4fa17706-d304-4117-a420-dab994c703dc"/>
Nov 08 13:06:02 user nova-compute[74840]:       <nova:ports>
Nov 08 13:06:02 user nova-compute[74840]:         <nova:port uuid="fe0e9b63-103b-47b1-9488-b9f8094a2e80">
Nov 08 13:06:02 user nova-compute[74840]:           <nova:ip type="fixed" address="192.168.233.254" ipVersion="4"/>
Nov 08 13:06:02 user nova-compute[74840]:         </nova:port>
Nov 08 13:06:02 user nova-compute[74840]:       </nova:ports>
Nov 08 13:06:02 user nova-compute[74840]:     </nova:instance>
Nov 08 13:06:02 user nova-compute[74840]:   </metadata>
Nov 08 13:06:02 user nova-compute[74840]:   <sysinfo type="smbios">
Nov 08 13:06:02 user nova-compute[74840]:     <system>
Nov 08 13:06:02 user nova-compute[74840]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 13:06:02 user nova-compute[74840]:       <entry name="product">OpenStack Nova</entry>
Nov 08 13:06:02 user nova-compute[74840]:       <entry name="version">0.0.0</entry>
Nov 08 13:06:02 user nova-compute[74840]:       <entry name="serial">974ac6dc-1327-41f8-95f9-889c901afc4a</entry>
Nov 08 13:06:02 user nova-compute[74840]:       <entry name="uuid">974ac6dc-1327-41f8-95f9-889c901afc4a</entry>
Nov 08 13:06:02 user nova-compute[74840]:       <entry name="family">Virtual Machine</entry>
Nov 08 13:06:02 user nova-compute[74840]:     </system>
Nov 08 13:06:02 user nova-compute[74840]:   </sysinfo>
Nov 08 13:06:02 user nova-compute[74840]:   <os>
Nov 08 13:06:02 user nova-compute[74840]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 13:06:02 user nova-compute[74840]:     <boot dev="hd"/>
Nov 08 13:06:02 user nova-compute[74840]:     <smbios mode="sysinfo"/>
Nov 08 13:06:02 user nova-compute[74840]:   </os>
Nov 08 13:06:02 user nova-compute[74840]:   <features>
Nov 08 13:06:02 user nova-compute[74840]:     <acpi/>
Nov 08 13:06:02 user nova-compute[74840]:     <apic/>
Nov 08 13:06:02 user nova-compute[74840]:     <vmcoreinfo/>
Nov 08 13:06:02 user nova-compute[74840]:   </features>
Nov 08 13:06:02 user nova-compute[74840]:   <clock offset="utc">
Nov 08 13:06:02 user nova-compute[74840]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 13:06:02 user nova-compute[74840]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 13:06:02 user nova-compute[74840]:     <timer name="hpet" present="no"/>
Nov 08 13:06:02 user nova-compute[74840]:   </clock>
Nov 08 13:06:02 user nova-compute[74840]:   <cpu mode="custom" match="exact">
Nov 08 13:06:02 user nova-compute[74840]:     <model>Nehalem</model>
Nov 08 13:06:02 user nova-compute[74840]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 13:06:02 user nova-compute[74840]:   </cpu>
Nov 08 13:06:02 user nova-compute[74840]:   <devices>
Nov 08 13:06:02 user nova-compute[74840]:     <disk type="file" device="disk">
Nov 08 13:06:02 user nova-compute[74840]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 13:06:02 user nova-compute[74840]:       <source file="/opt/stack/data/nova/instances/974ac6dc-1327-41f8-95f9-889c901afc4a/disk"/>
Nov 08 13:06:02 user nova-compute[74840]:       <target dev="vda" bus="virtio"/>
Nov 08 13:06:02 user nova-compute[74840]:     </disk>
Nov 08 13:06:02 user nova-compute[74840]:     <interface type="ethernet">
Nov 08 13:06:02 user nova-compute[74840]:       <mac address="fa:16:3e:88:35:88"/>
Nov 08 13:06:02 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 13:06:02 user nova-compute[74840]:       <mtu size="1442"/>
Nov 08 13:06:02 user nova-compute[74840]:       <target dev="tapfe0e9b63-10"/>
Nov 08 13:06:02 user nova-compute[74840]:     </interface>
Nov 08 13:06:02 user nova-compute[74840]:     <serial type="pty">
Nov 08 13:06:02 user nova-compute[74840]:       <log file="/opt/stack/data/nova/instances/974ac6dc-1327-41f8-95f9-889c901afc4a/console.log" append="off"/>
Nov 08 13:06:02 user nova-compute[74840]:     </serial>
Nov 08 13:06:02 user nova-compute[74840]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 13:06:02 user nova-compute[74840]:     <video>
Nov 08 13:06:02 user nova-compute[74840]:       <model type="virtio"/>
Nov 08 13:06:02 user nova-compute[74840]:     </video>
Nov 08 13:06:02 user nova-compute[74840]:     <rng model="virtio">
Nov 08 13:06:02 user nova-compute[74840]:       <backend model="random">/dev/urandom</backend>
Nov 08 13:06:02 user nova-compute[74840]:     </rng>
Nov 08 13:06:02 user nova-compute[74840]:     <controller type="usb" index="0" model="none"/>
Nov 08 13:06:02 user nova-compute[74840]:     <memballoon model="virtio">
Nov 08 13:06:02 user nova-compute[74840]:       <stats period="10"/>
Nov 08 13:06:02 user nova-compute[74840]:     </memballoon>
Nov 08 13:06:02 user nova-compute[74840]:   </devices>
Nov 08 13:06:02 user nova-compute[74840]: </domain>
Nov 08 13:06:02 user nova-compute[74840]:  {{(pid=74840) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:05:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-534984226',display_name='tempest-VolumesNegativeTest-instance-534984226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-534984226',id=52,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e5439f860a944d5a17579188b337922',ramdisk_id='',reservation_id='r-zeme36h9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1977633780',owner_user_name='tempest-VolumesNegativeTest-1977633780-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T13:06:01Z,user_data=None,user_id='777753afeafd4326bc372665ec463bc1',uuid=974ac6dc-1327-41f8-95f9-889c901afc4a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe0e9b63-103b-47b1-9488-b9f8094a2e80", "address": "fa:16:3e:88:35:88", "network": {"id": "522212c6-7960-46b2-b88f-fd73e50128dc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d1d606ef58794297a9d8ca517eb8db6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0e9b63-10", "ovs_interfaceid": "fe0e9b63-103b-47b1-9488-b9f8094a2e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Converting VIF {"id": "fe0e9b63-103b-47b1-9488-b9f8094a2e80", "address": "fa:16:3e:88:35:88", "network": {"id": "522212c6-7960-46b2-b88f-fd73e50128dc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d1d606ef58794297a9d8ca517eb8db6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0e9b63-10", "ovs_interfaceid": "fe0e9b63-103b-47b1-9488-b9f8094a2e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:35:88,bridge_name='br-int',has_traffic_filtering=True,id=fe0e9b63-103b-47b1-9488-b9f8094a2e80,network=Network(522212c6-7960-46b2-b88f-fd73e50128dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe0e9b63-10') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG os_vif [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:35:88,bridge_name='br-int',has_traffic_filtering=True,id=fe0e9b63-103b-47b1-9488-b9f8094a2e80,network=Network(522212c6-7960-46b2-b88f-fd73e50128dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe0e9b63-10') {{(pid=74840) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '30439426-4e71-5d54-bdd0-9dc17e7846cc', '_type': 'linux-noop'}}, row=False) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe0e9b63-10, may_exist=True, interface_attrs={}) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe0e9b63-10, col_values=(('qos', UUID('3d3e7fb0-a9d9-4565-8c9a-8c4ebf1c2868')),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe0e9b63-10, col_values=(('external_ids', {'iface-id': 'fe0e9b63-103b-47b1-9488-b9f8094a2e80', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:35:88', 'vm-uuid': '974ac6dc-1327-41f8-95f9-889c901afc4a'}),), if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:06:02 user nova-compute[74840]: INFO os_vif [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:35:88,bridge_name='br-int',has_traffic_filtering=True,id=fe0e9b63-103b-47b1-9488-b9f8094a2e80,network=Network(522212c6-7960-46b2-b88f-fd73e50128dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe0e9b63-10')
Nov 08 13:06:02 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] No BDM found with device name vda, not building metadata. {{(pid=74840) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] No VIF found with MAC fa:16:3e:88:35:88, not building metadata {{(pid=74840) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG nova.network.neutron [req-8a9a9778-9b37-4e90-8d7f-7c24c47dfc62 req-560784fb-a7d0-498b-88e8-89f6bc5daf5f service nova] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Updated VIF entry in instance network info cache for port fe0e9b63-103b-47b1-9488-b9f8094a2e80. {{(pid=74840) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG nova.network.neutron [req-8a9a9778-9b37-4e90-8d7f-7c24c47dfc62 req-560784fb-a7d0-498b-88e8-89f6bc5daf5f service nova] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Updating instance_info_cache with network_info: [{"id": "fe0e9b63-103b-47b1-9488-b9f8094a2e80", "address": "fa:16:3e:88:35:88", "network": {"id": "522212c6-7960-46b2-b88f-fd73e50128dc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d1d606ef58794297a9d8ca517eb8db6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0e9b63-10", "ovs_interfaceid": "fe0e9b63-103b-47b1-9488-b9f8094a2e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:06:02 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-8a9a9778-9b37-4e90-8d7f-7c24c47dfc62 req-560784fb-a7d0-498b-88e8-89f6bc5daf5f service nova] Releasing lock "refresh_cache-974ac6dc-1327-41f8-95f9-889c901afc4a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:06:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:06:03 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:06:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:06:03 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:06:04 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Triggering sync for uuid 974ac6dc-1327-41f8-95f9-889c901afc4a {{(pid=74840) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 13:06:04 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "974ac6dc-1327-41f8-95f9-889c901afc4a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:06:04 user nova-compute[74840]: DEBUG nova.compute.manager [req-ae919e5c-3dff-437e-8993-59ac6ee00829 req-0231d0e7-e5d3-4402-adb0-b0c40b9a509d service nova] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Received event network-vif-plugged-fe0e9b63-103b-47b1-9488-b9f8094a2e80 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:06:04 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-ae919e5c-3dff-437e-8993-59ac6ee00829 req-0231d0e7-e5d3-4402-adb0-b0c40b9a509d service nova] Acquiring lock "974ac6dc-1327-41f8-95f9-889c901afc4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:06:04 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-ae919e5c-3dff-437e-8993-59ac6ee00829 req-0231d0e7-e5d3-4402-adb0-b0c40b9a509d service nova] Lock "974ac6dc-1327-41f8-95f9-889c901afc4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:06:04 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-ae919e5c-3dff-437e-8993-59ac6ee00829 req-0231d0e7-e5d3-4402-adb0-b0c40b9a509d service nova] Lock "974ac6dc-1327-41f8-95f9-889c901afc4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:06:04 user nova-compute[74840]: DEBUG nova.compute.manager [req-ae919e5c-3dff-437e-8993-59ac6ee00829 req-0231d0e7-e5d3-4402-adb0-b0c40b9a509d service nova] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] No waiting events found dispatching network-vif-plugged-fe0e9b63-103b-47b1-9488-b9f8094a2e80 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:06:04 user nova-compute[74840]: WARNING nova.compute.manager [req-ae919e5c-3dff-437e-8993-59ac6ee00829 req-0231d0e7-e5d3-4402-adb0-b0c40b9a509d service nova] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Received unexpected event network-vif-plugged-fe0e9b63-103b-47b1-9488-b9f8094a2e80 for instance with vm_state building and task_state spawning.
Nov 08 13:06:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:06:04 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:06:05 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:06:06 user nova-compute[74840]: DEBUG nova.compute.manager [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Instance event wait completed in 0 seconds for  {{(pid=74840) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 13:06:06 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Guest created on hypervisor {{(pid=74840) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 13:06:06 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Instance spawned successfully.
Nov 08 13:06:06 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 13:06:06 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Found default for hw_cdrom_bus of ide {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:06:06 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Found default for hw_disk_bus of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:06:06 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Found default for hw_input_bus of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:06:06 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Found default for hw_pointer_model of None {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:06:06 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Found default for hw_video_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:06:06 user nova-compute[74840]: DEBUG nova.virt.libvirt.driver [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Found default for hw_vif_model of virtio {{(pid=74840) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 13:06:06 user nova-compute[74840]: INFO nova.compute.manager [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Took 5.49 seconds to spawn the instance on the hypervisor.
Nov 08 13:06:06 user nova-compute[74840]: DEBUG nova.compute.manager [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Checking state {{(pid=74840) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 13:06:06 user nova-compute[74840]: INFO nova.compute.manager [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Took 6.02 seconds to build instance.
Nov 08 13:06:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-f2f9e74c-fc08-4e62-8b66-c7b143ea80ff tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Lock "974ac6dc-1327-41f8-95f9-889c901afc4a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.117s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:06:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "974ac6dc-1327-41f8-95f9-889c901afc4a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.961s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:06:06 user nova-compute[74840]: INFO nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] During sync_power_state the instance has a pending task (spawning). Skip.
Nov 08 13:06:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "974ac6dc-1327-41f8-95f9-889c901afc4a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:06:06 user nova-compute[74840]: DEBUG nova.compute.manager [req-a59e19f0-7763-4aeb-ba68-3dcce5f56edd req-df555a60-ce21-4f37-8b03-27b529c0077c service nova] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Received event network-vif-plugged-fe0e9b63-103b-47b1-9488-b9f8094a2e80 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:06:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a59e19f0-7763-4aeb-ba68-3dcce5f56edd req-df555a60-ce21-4f37-8b03-27b529c0077c service nova] Acquiring lock "974ac6dc-1327-41f8-95f9-889c901afc4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:06:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a59e19f0-7763-4aeb-ba68-3dcce5f56edd req-df555a60-ce21-4f37-8b03-27b529c0077c service nova] Lock "974ac6dc-1327-41f8-95f9-889c901afc4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:06:06 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-a59e19f0-7763-4aeb-ba68-3dcce5f56edd req-df555a60-ce21-4f37-8b03-27b529c0077c service nova] Lock "974ac6dc-1327-41f8-95f9-889c901afc4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:06:06 user nova-compute[74840]: DEBUG nova.compute.manager [req-a59e19f0-7763-4aeb-ba68-3dcce5f56edd req-df555a60-ce21-4f37-8b03-27b529c0077c service nova] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] No waiting events found dispatching network-vif-plugged-fe0e9b63-103b-47b1-9488-b9f8094a2e80 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:06:06 user nova-compute[74840]: WARNING nova.compute.manager [req-a59e19f0-7763-4aeb-ba68-3dcce5f56edd req-df555a60-ce21-4f37-8b03-27b529c0077c service nova] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Received unexpected event network-vif-plugged-fe0e9b63-103b-47b1-9488-b9f8094a2e80 for instance with vm_state active and task_state None.
Nov 08 13:06:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:06:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:06:10 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:06:10 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74840) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 13:06:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:06:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:06:17 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:06:22 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:06:22 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:06:23 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:06:23 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Cleaning up deleted instances {{(pid=74840) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 13:06:23 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] There are 0 instances to clean {{(pid=74840) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 13:06:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:06:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:06:31 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:06:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:06:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:06:35 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:06:35 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:06:35 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 13:06:36 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:06:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:06:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:06:38 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:06:38 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 13:06:38 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Rebuilding the list of instances to heal {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 13:06:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "refresh_cache-974ac6dc-1327-41f8-95f9-889c901afc4a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:06:38 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquired lock "refresh_cache-974ac6dc-1327-41f8-95f9-889c901afc4a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:06:38 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Forcefully refreshing network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 13:06:38 user nova-compute[74840]: DEBUG nova.objects.instance [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lazy-loading 'info_cache' on Instance uuid 974ac6dc-1327-41f8-95f9-889c901afc4a {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:06:39 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Updating instance_info_cache with network_info: [{"id": "fe0e9b63-103b-47b1-9488-b9f8094a2e80", "address": "fa:16:3e:88:35:88", "network": {"id": "522212c6-7960-46b2-b88f-fd73e50128dc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d1d606ef58794297a9d8ca517eb8db6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0e9b63-10", "ovs_interfaceid": "fe0e9b63-103b-47b1-9488-b9f8094a2e80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:06:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Releasing lock "refresh_cache-974ac6dc-1327-41f8-95f9-889c901afc4a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:06:39 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Updated the network info_cache for instance {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 13:06:39 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:06:40 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:06:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:06:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:06:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:06:40 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 13:06:40 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/974ac6dc-1327-41f8-95f9-889c901afc4a/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:06:41 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/974ac6dc-1327-41f8-95f9-889c901afc4a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:06:41 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/974ac6dc-1327-41f8-95f9-889c901afc4a/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:06:41 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/974ac6dc-1327-41f8-95f9-889c901afc4a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:06:41 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:06:41 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:06:41 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=8934MB free_disk=24.804004669189453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 13:06:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:06:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:06:41 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 974ac6dc-1327-41f8-95f9-889c901afc4a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:06:41 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 13:06:41 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 13:06:41 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Refreshing inventories for resource provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 13:06:41 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Updating ProviderTree inventory for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 13:06:41 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Updating inventory in ProviderTree for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 13:06:41 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Refreshing aggregate associations for resource provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e, aggregates: None {{(pid=74840) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 13:06:41 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Refreshing trait associations for resource provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_MMX,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE {{(pid=74840) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 13:06:41 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:06:41 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:06:41 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 13:06:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.299s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:06:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:06:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:06:43 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:06:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:06:47 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:06:52 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:06:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:06:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:06:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 13:06:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 13:06:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 13:06:57 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:07:02 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:07:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:07:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:07:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 13:07:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 13:07:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 13:07:07 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:07:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:07:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:07:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 13:07:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 13:07:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 13:07:12 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:07:17 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:07:22 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:07:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:07:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:07:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 13:07:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 13:07:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 13:07:27 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:07:32 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:07:33 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:07:36 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:07:37 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:07:37 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:07:37 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:07:37 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 13:07:39 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:07:39 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 13:07:39 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Rebuilding the list of instances to heal {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 13:07:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "refresh_cache-974ac6dc-1327-41f8-95f9-889c901afc4a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 13:07:39 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquired lock "refresh_cache-974ac6dc-1327-41f8-95f9-889c901afc4a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 13:07:39 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Forcefully refreshing network info cache for instance {{(pid=74840) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 13:07:39 user nova-compute[74840]: DEBUG nova.objects.instance [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lazy-loading 'info_cache' on Instance uuid 974ac6dc-1327-41f8-95f9-889c901afc4a {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:07:40 user nova-compute[74840]: DEBUG nova.network.neutron [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Updating instance_info_cache with network_info: [{"id": "fe0e9b63-103b-47b1-9488-b9f8094a2e80", "address": "fa:16:3e:88:35:88", "network": {"id": "522212c6-7960-46b2-b88f-fd73e50128dc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d1d606ef58794297a9d8ca517eb8db6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0e9b63-10", "ovs_interfaceid": "fe0e9b63-103b-47b1-9488-b9f8094a2e80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:07:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Releasing lock "refresh_cache-974ac6dc-1327-41f8-95f9-889c901afc4a" {{(pid=74840) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 13:07:40 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Updated the network info_cache for instance {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 13:07:40 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:07:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:07:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:07:40 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:07:40 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 13:07:40 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/974ac6dc-1327-41f8-95f9-889c901afc4a/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:07:40 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/974ac6dc-1327-41f8-95f9-889c901afc4a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:07:40 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/974ac6dc-1327-41f8-95f9-889c901afc4a/disk --force-share --output=json {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 13:07:41 user nova-compute[74840]: DEBUG oslo_concurrency.processutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/974ac6dc-1327-41f8-95f9-889c901afc4a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74840) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 13:07:41 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:07:41 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:07:41 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=8959MB free_disk=24.803367614746094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 13:07:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:07:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:07:41 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Instance 974ac6dc-1327-41f8-95f9-889c901afc4a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74840) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 13:07:41 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 13:07:41 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 13:07:41 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:07:41 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:07:41 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 13:07:41 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.152s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:07:42 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:07:42 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:07:42 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:07:47 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:07:49 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:07:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-40f09944-0250-49af-b737-090ac338d1fd tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Acquiring lock "974ac6dc-1327-41f8-95f9-889c901afc4a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:07:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-40f09944-0250-49af-b737-090ac338d1fd tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Lock "974ac6dc-1327-41f8-95f9-889c901afc4a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:07:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-40f09944-0250-49af-b737-090ac338d1fd tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Acquiring lock "974ac6dc-1327-41f8-95f9-889c901afc4a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:07:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-40f09944-0250-49af-b737-090ac338d1fd tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Lock "974ac6dc-1327-41f8-95f9-889c901afc4a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:07:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-40f09944-0250-49af-b737-090ac338d1fd tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Lock "974ac6dc-1327-41f8-95f9-889c901afc4a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:07:50 user nova-compute[74840]: INFO nova.compute.manager [None req-40f09944-0250-49af-b737-090ac338d1fd tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Terminating instance
Nov 08 13:07:50 user nova-compute[74840]: DEBUG nova.compute.manager [None req-40f09944-0250-49af-b737-090ac338d1fd tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Start destroying the instance on the hypervisor. {{(pid=74840) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 13:07:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:07:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:07:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:07:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:07:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:07:50 user nova-compute[74840]: DEBUG nova.compute.manager [req-850ca25e-457e-49c4-a602-7274d50fd319 req-998ca4da-d783-4ba5-8745-fabaf7df5e00 service nova] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Received event network-vif-unplugged-fe0e9b63-103b-47b1-9488-b9f8094a2e80 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:07:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-850ca25e-457e-49c4-a602-7274d50fd319 req-998ca4da-d783-4ba5-8745-fabaf7df5e00 service nova] Acquiring lock "974ac6dc-1327-41f8-95f9-889c901afc4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:07:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-850ca25e-457e-49c4-a602-7274d50fd319 req-998ca4da-d783-4ba5-8745-fabaf7df5e00 service nova] Lock "974ac6dc-1327-41f8-95f9-889c901afc4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:07:50 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-850ca25e-457e-49c4-a602-7274d50fd319 req-998ca4da-d783-4ba5-8745-fabaf7df5e00 service nova] Lock "974ac6dc-1327-41f8-95f9-889c901afc4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:07:50 user nova-compute[74840]: DEBUG nova.compute.manager [req-850ca25e-457e-49c4-a602-7274d50fd319 req-998ca4da-d783-4ba5-8745-fabaf7df5e00 service nova] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] No waiting events found dispatching network-vif-unplugged-fe0e9b63-103b-47b1-9488-b9f8094a2e80 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:07:50 user nova-compute[74840]: DEBUG nova.compute.manager [req-850ca25e-457e-49c4-a602-7274d50fd319 req-998ca4da-d783-4ba5-8745-fabaf7df5e00 service nova] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Received event network-vif-unplugged-fe0e9b63-103b-47b1-9488-b9f8094a2e80 for instance with task_state deleting. {{(pid=74840) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 13:07:50 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:07:51 user nova-compute[74840]: INFO nova.virt.libvirt.driver [-] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Instance destroyed successfully.
Nov 08 13:07:51 user nova-compute[74840]: DEBUG nova.objects.instance [None req-40f09944-0250-49af-b737-090ac338d1fd tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Lazy-loading 'resources' on Instance uuid 974ac6dc-1327-41f8-95f9-889c901afc4a {{(pid=74840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 13:07:51 user nova-compute[74840]: DEBUG nova.virt.libvirt.vif [None req-40f09944-0250-49af-b737-090ac338d1fd tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T13:05:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-534984226',display_name='tempest-VolumesNegativeTest-instance-534984226',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-534984226',id=52,image_ref='4fa17706-d304-4117-a420-dab994c703dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T13:06:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e5439f860a944d5a17579188b337922',ramdisk_id='',reservation_id='r-zeme36h9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fa17706-d304-4117-a420-dab994c703dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1977633780',owner_user_name='tempest-VolumesNegativeTest-1977633780-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T13:06:06Z,user_data=None,user_id='777753afeafd4326bc372665ec463bc1',uuid=974ac6dc-1327-41f8-95f9-889c901afc4a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe0e9b63-103b-47b1-9488-b9f8094a2e80", "address": "fa:16:3e:88:35:88", "network": {"id": "522212c6-7960-46b2-b88f-fd73e50128dc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d1d606ef58794297a9d8ca517eb8db6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0e9b63-10", "ovs_interfaceid": "fe0e9b63-103b-47b1-9488-b9f8094a2e80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 13:07:51 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-40f09944-0250-49af-b737-090ac338d1fd tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Converting VIF {"id": "fe0e9b63-103b-47b1-9488-b9f8094a2e80", "address": "fa:16:3e:88:35:88", "network": {"id": "522212c6-7960-46b2-b88f-fd73e50128dc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d1d606ef58794297a9d8ca517eb8db6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe0e9b63-10", "ovs_interfaceid": "fe0e9b63-103b-47b1-9488-b9f8094a2e80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 13:07:51 user nova-compute[74840]: DEBUG nova.network.os_vif_util [None req-40f09944-0250-49af-b737-090ac338d1fd tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:35:88,bridge_name='br-int',has_traffic_filtering=True,id=fe0e9b63-103b-47b1-9488-b9f8094a2e80,network=Network(522212c6-7960-46b2-b88f-fd73e50128dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe0e9b63-10') {{(pid=74840) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 13:07:51 user nova-compute[74840]: DEBUG os_vif [None req-40f09944-0250-49af-b737-090ac338d1fd tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:35:88,bridge_name='br-int',has_traffic_filtering=True,id=fe0e9b63-103b-47b1-9488-b9f8094a2e80,network=Network(522212c6-7960-46b2-b88f-fd73e50128dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe0e9b63-10') {{(pid=74840) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 13:07:51 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:07:51 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe0e9b63-10, bridge=br-int, if_exists=True) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:07:51 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:07:51 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:07:51 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:07:51 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3d3e7fb0-a9d9-4565-8c9a-8c4ebf1c2868) {{(pid=74840) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 13:07:51 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:07:51 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:07:51 user nova-compute[74840]: INFO os_vif [None req-40f09944-0250-49af-b737-090ac338d1fd tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:35:88,bridge_name='br-int',has_traffic_filtering=True,id=fe0e9b63-103b-47b1-9488-b9f8094a2e80,network=Network(522212c6-7960-46b2-b88f-fd73e50128dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe0e9b63-10')
Nov 08 13:07:51 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-40f09944-0250-49af-b737-090ac338d1fd tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Deleting instance files /opt/stack/data/nova/instances/974ac6dc-1327-41f8-95f9-889c901afc4a_del
Nov 08 13:07:51 user nova-compute[74840]: INFO nova.virt.libvirt.driver [None req-40f09944-0250-49af-b737-090ac338d1fd tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Deletion of /opt/stack/data/nova/instances/974ac6dc-1327-41f8-95f9-889c901afc4a_del complete
Nov 08 13:07:51 user nova-compute[74840]: INFO nova.compute.manager [None req-40f09944-0250-49af-b737-090ac338d1fd tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 08 13:07:51 user nova-compute[74840]: DEBUG oslo.service.loopingcall [None req-40f09944-0250-49af-b737-090ac338d1fd tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74840) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 13:07:51 user nova-compute[74840]: DEBUG nova.compute.manager [-] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Deallocating network for instance {{(pid=74840) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 13:07:51 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] deallocate_for_instance() {{(pid=74840) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 13:07:51 user nova-compute[74840]: DEBUG nova.network.neutron [-] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Updating instance_info_cache with network_info: [] {{(pid=74840) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 13:07:51 user nova-compute[74840]: INFO nova.compute.manager [-] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Took 0.43 seconds to deallocate network for instance.
Nov 08 13:07:51 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-40f09944-0250-49af-b737-090ac338d1fd tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:07:51 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-40f09944-0250-49af-b737-090ac338d1fd tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:07:51 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-40f09944-0250-49af-b737-090ac338d1fd tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:07:51 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-40f09944-0250-49af-b737-090ac338d1fd tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:07:51 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-40f09944-0250-49af-b737-090ac338d1fd tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.105s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:07:51 user nova-compute[74840]: INFO nova.scheduler.client.report [None req-40f09944-0250-49af-b737-090ac338d1fd tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Deleted allocations for instance 974ac6dc-1327-41f8-95f9-889c901afc4a
Nov 08 13:07:52 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-40f09944-0250-49af-b737-090ac338d1fd tempest-VolumesNegativeTest-1977633780 tempest-VolumesNegativeTest-1977633780-project-member] Lock "974ac6dc-1327-41f8-95f9-889c901afc4a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.627s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:07:52 user nova-compute[74840]: DEBUG nova.compute.manager [req-f010ac7b-7f08-401c-820d-f84bf1e13dee req-4e66c83f-b34f-40d7-b464-3e9866e64e24 service nova] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Received event network-vif-plugged-fe0e9b63-103b-47b1-9488-b9f8094a2e80 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:07:52 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-f010ac7b-7f08-401c-820d-f84bf1e13dee req-4e66c83f-b34f-40d7-b464-3e9866e64e24 service nova] Acquiring lock "974ac6dc-1327-41f8-95f9-889c901afc4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:07:52 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-f010ac7b-7f08-401c-820d-f84bf1e13dee req-4e66c83f-b34f-40d7-b464-3e9866e64e24 service nova] Lock "974ac6dc-1327-41f8-95f9-889c901afc4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:07:52 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [req-f010ac7b-7f08-401c-820d-f84bf1e13dee req-4e66c83f-b34f-40d7-b464-3e9866e64e24 service nova] Lock "974ac6dc-1327-41f8-95f9-889c901afc4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:07:52 user nova-compute[74840]: DEBUG nova.compute.manager [req-f010ac7b-7f08-401c-820d-f84bf1e13dee req-4e66c83f-b34f-40d7-b464-3e9866e64e24 service nova] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] No waiting events found dispatching network-vif-plugged-fe0e9b63-103b-47b1-9488-b9f8094a2e80 {{(pid=74840) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 13:07:52 user nova-compute[74840]: WARNING nova.compute.manager [req-f010ac7b-7f08-401c-820d-f84bf1e13dee req-4e66c83f-b34f-40d7-b464-3e9866e64e24 service nova] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Received unexpected event network-vif-plugged-fe0e9b63-103b-47b1-9488-b9f8094a2e80 for instance with vm_state deleted and task_state None.
Nov 08 13:07:52 user nova-compute[74840]: DEBUG nova.compute.manager [req-f010ac7b-7f08-401c-820d-f84bf1e13dee req-4e66c83f-b34f-40d7-b464-3e9866e64e24 service nova] [instance: 974ac6dc-1327-41f8-95f9-889c901afc4a] Received event network-vif-deleted-fe0e9b63-103b-47b1-9488-b9f8094a2e80 {{(pid=74840) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 13:07:55 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:07:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:08:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:08:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:08:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 13:08:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 13:08:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 13:08:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:08:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:08:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:08:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:08:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:08:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:08:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:08:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 13:08:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 13:08:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 13:08:26 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:08:31 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:08:34 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:08:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:08:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:08:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 13:08:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 13:08:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 13:08:36 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:08:37 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:08:38 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:08:38 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:08:38 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74840) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 13:08:40 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:08:40 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Starting heal instance info cache {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 13:08:40 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Rebuilding the list of instances to heal {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 13:08:40 user nova-compute[74840]: DEBUG nova.compute.manager [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Didn't find any instances for network info cache update. {{(pid=74840) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 13:08:41 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:08:42 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:08:42 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:08:42 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:08:42 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:08:42 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:08:42 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Auditing locally available compute resources for user (node: user) {{(pid=74840) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 13:08:43 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:08:43 user nova-compute[74840]: WARNING nova.virt.libvirt.driver [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 13:08:43 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Hypervisor/Node resource view: name=user free_ram=9096MB free_disk=24.830535888671875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=74840) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 13:08:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 13:08:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 13:08:43 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 13:08:43 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74840) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 13:08:43 user nova-compute[74840]: DEBUG nova.compute.provider_tree [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed in ProviderTree for provider: 74d527b3-4704-47dd-ab76-ffd69ef9a25e {{(pid=74840) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 13:08:43 user nova-compute[74840]: DEBUG nova.scheduler.client.report [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Inventory has not changed for provider 74d527b3-4704-47dd-ab76-ffd69ef9a25e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74840) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 13:08:43 user nova-compute[74840]: DEBUG nova.compute.resource_tracker [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Compute_service record updated for user:user {{(pid=74840) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 13:08:43 user nova-compute[74840]: DEBUG oslo_concurrency.lockutils [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.218s {{(pid=74840) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 13:08:44 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:08:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:08:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:08:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 13:08:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 13:08:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 13:08:46 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:08:49 user nova-compute[74840]: DEBUG oslo_service.periodic_task [None req-bb00e232-ac24-4af6-a334-2401214739d8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74840) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 13:08:51 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:08:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:08:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:08:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74840) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 13:08:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 13:08:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74840) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 13:08:56 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:08:58 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:09:01 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:09:06 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:09:11 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 13:09:16 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 13:09:21 user nova-compute[74840]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74840) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}